Hook up a MediaWiki instance to BHL APIs for text & metadata editing

[KatjaSchulz]

We want to be able to pull text and associated metadata from BHL APIs into a MediaWiki instance for further processing.

More details are provided here: https://docs.google.com/document/d/1sc5PVMTEUzuN1KHfnXc_qXoQpHYIpJdCJvjZsq6lzYQ/edit?usp=sharing

[eliagbayani]

Will copy here parts of my daily standup to document progress.

---

Eli standup: Wednesday Nov 11
Greetings,
BHL-to-EoL data pipeline project.
Finished search and display interface for:

• BHL Book search (result includes lists and summary for: authors, items)
• BHL Item search (result includes lists and summary for: pages, parts)

Next in line:

• More searches:
  —— BHL Title ID search
  —— BHL Page ID search
• Select/assemble data to move to MediaWiki

---

[eliagbayani]

Finished search and display interface for:
BHL Book search
see screenshots: https://dl.dropboxusercontent.com/u/7597512/BHL_images/booksearch.zip
BHL Item search
see screenshots: https://dl.dropboxusercontent.com/u/7597512/BHL_images/itemsearch.zip

Finished today:
BHL Title search (result includes lists and summary for: authors, subjects, identifiers, variants, items, notes)
see screenshots: https://dl.dropboxusercontent.com/u/7597512/BHL_images/titlesearch.zip

Search results will be used to assemble data that will be moved into the MediaWiki instance.

[eliagbayani]

Hi Katja,
Status on BHL-to-EoL data pipeline.
I now have a working interface to search BHL using their API and also a way to just pick a title from a list of ALL titles from BHL.
I’m now half-way in assembling this data, that is selected-data by a user using this interface.
I will continue this on Monday and then will create a script that will move this user-selected data to a MediaWiki instance.
I should then be able to demo you this before the week ends next week.
I hope schedule is okay with you.
Thanks,
Eli

[KatjaSchulz]

Hi Eli,
That sounds great. Next week is Thanksgiving here, so I will be off eating turkey on Thursday. I'm also busy Wednesday night, but most other nights should work for me. Just ping me when you're ready.

Katja

[eliagbayani]

Hi Katja,
Today I started doing the script that will move the user-selected data from the interface to MediaWiki on-click of a button. I’ve also been doing some back and forth with the interface as I go along.
But I’m happy with the progress.

If you can, we can have our demo on Friday Nov 27, 10PM Eastern (your time).
That will be on Sat 11AM my time.
If you’re not available, we can also have it on Monday Nov 30, 10PM Eastern (your time).
Thanks,
Eli

[KatjaSchulz]

Hi Eli,

Yes, I can do Friday Nov 27, 10PM. Should we do skype or Google hangout?

Katja

On Tue, Nov 24, 2015 at 3:43 AM, eliagbayani [email protected]
wrote:

Hi Katja,
Today I started doing the script that will move the user-selected data
from the interface to MediaWiki on-click of a button. I’ve also been doing
some back and forth with the interface as I go along.
But I’m happy with the progress.

If you can, we have our demo on Friday Nov 27, 10PM Eastern (your time).
That will be on Sat 11AM my time.
If you’re not available, we can also have it on Monday Nov 30, 10PM
Eastern (your time).
Thanks,
Eli

—
Reply to this email directly or view it on GitHub
#148 (comment).

Katja Schulz
Program Coordinator
Encyclopedia of Life
http://eol.org
Office: 202.633.8730
Fax: 202.633.8742
[email protected]

Mailing address:
Smithsonian Institution
National Museum of Natural History
P.O. Box 37012
MRC 106
Washington, DC 20013-7012
USA

[eliagbayani]

Skype should work. Thanks Katja.

[eliagbayani]

Hi Katja,
Earlier this week I was doing a couple more MediaWiki configuration settings.

• Moving the default /images/ folder inside MediaWiki to outside MediaWiki’s main code.
• Implemented user capability to ’upload files’ in MediaWiki. Includes the needed permissions and settings of paths.
• And will create a sample Git repo for a MediaWiki instance.

Will start next week the creation of a connector script that will read MediaWiki pages and generate the EoL DWC-A file.
Thanks.

[KatjaSchulz]

Thanks Eli, I will get the DwC-A mappings to you early next week.

[eliagbayani]

Thanks Katja, that will be great.

[KatjaSchulz]

Hi Eli, the Darwin Core mappings are here: https://docs.google.com/spreadsheets/d/1AgwkccSRb-n47mTTp_lbSrF9t40Bog2pe_DCRVPjtSI/edit?usp=sharing

Let me know if you have any questions or concerns.

[eliagbayani]

Hi Katja, thanks.
I made good progress here but will continue work generating the EOL DWC-A next week.
I was told that the new SI server (for editors.eol.org) will be available soon and the EoEarth migration is imminent. I will spend sometime preparing EoEarth MediaWiki. And frankly since the LiteratureEditor is smaller in size, I will set that up first so you can play around with it. Basically that's the one I showed you in our Skype screen share.
Thanks.

[KatjaSchulz]

Thanks Eli, I will be on vacation from 14 Dec to 10 Jan, so there's no rush.

[eliagbayani]

Good to know. Enjoy your vacation Katja.

[eliagbayani]

Eli standup: Wednesday Jan 13

Greetings,
Today I continued work on: EoL Literature Editor Project.
Will need more time to finish this as many fields have its own detailed specification on how to get its values.
Will be moving back and forth between the three sections of this project: (BHL search interface, MediaWiki instance and the connector) to proceed.
Will be a challenge but doable. More in the next couple of days.

Finished today:

• Saved the current MediaWiki logged-in user when saving BHL API results as Wiki. This was then used as an agent in the DWC-A (with role:provider), as specified by the mapping document.

Regards,
Eli