GSOC2013_Progress_Hady Elsahar

integrating WikiData in DBpedia

proposal

full project proposal

Students

• Hady Elsahar

Mentors

• Sebastian Hellman
• Dimitris kontokostas

---

#Project Progress:

week 1 :

• public clone of Extraction framework
• preparing development environment
• compiling the Extraction framework
• Getting to know DBpedia main classes structures of the extraction framework

readings

• papers No. #1 #2 #4 in DBpedia publications
• http://wiki.dbpedia.org/Documentation

important discussions :

• Warmup task - URI Schema to use for wikiData - using or not the WikiData RDF format

---

week 2 [17-6-2013] :

• exploring the PubSubHubbub Protocol
• installing a local Hub and subscribing to some RSS Feed

Overview about the PubSubHubbub protocol

readings

• PubSubHubbub home page : https://code.google.com/p/pubsubhubbub/

important discussions :

• Reliability and Hadware Requirements of PubSubHubbub
• Rate of new changes in WikiData

---

week 3 [24-6-2013] :

• Create a RDF dump out of 1-2K WikiData entities
• work on the language links from API:
  1. process Wikidata info, generate master IL links file.
  2. produce language-specific same_as files from master IL links file,
• Create a few mappings in the mappings wiki (as owl:equivalentProperty). The most common ones in the dumps

important discussions :

• Different Language links Files

---

Weeks 4,5,6,7 Language Links Extraction [1-7-2013] -> [1-8-2013] :

• step 1: Creating Master LLinks file (replacing the old bash commands with scala code)
• Step 2: Creating specific LLinks extraction in folders (after some number of code iterations we agreed upon that we can depend on that links comes in blocks ) , Implemented Algorithm
• updating code to utilize some Extraction framework utilities instead of rewriting them
• Code Reviews 1 , 2 ,3
• More code reviews , some code conflicts

important links/Discussions :

• implicit conversions in Scala
• Master branch uses Scala 2.9 , Dump branch uses Scala 2.10
• Updating RichReader.foreach to support end of lines detection
• recent commits : https://github.com/hadyelsahar/extraction-framework/commits/lang-link-extract

---

--- off to Leipzig 2-8 > 6-8

---

week 8 [5-8-2013] - [11-8-2013] :

• Running wda-export-data.py script on lgd server

important discussions/Links :

• WikiData RDF export available