Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extremely low frequency tag issues between HDT and GSD - possible bug? #7

Open
AngledLuffa opened this issue Dec 22, 2020 · 1 comment

Comments

@AngledLuffa
Copy link

AngledLuffa commented Dec 22, 2020

There are a couple tags of extremely low frequency in HDT: VAIMP and VMPP. In general the words with those tags, such as "sein" tagged VAIMP, are tagged in other places with a more common tag, such as "sein" being tagged VAFIN most of the time. Are these unusual tags correct or is there an issue somewhere causing them to crop up?

There are also some "unknown" lemmas:

# sent_id = hdt-s134888
# text = Die SPD-Fraktion habe den Entwurf abgelehnt , weil damit eher das Gegenteil des Gewollten erreicht würde , sagte die Abgeordnete Waltraud Schmidt-Sibeth .
14      Gewollten       unknown NOUN    NN      Person=3        12      nmod    _       _

There is also PIDAT, which never occurs in GSD but occurs relatively frequently in HDT. Perhaps this is a tagging issue in GSD? It seems to occur on words where the UPOS takes on different values depending on context in HDT, but is always the same in GSD.

Lastly, PAV in GSD seems to be the same as PROAV in HDT. If there's any way to unify those, that would be great. Easy enough to do on the consumer side, though.

@akoehn
Copy link
Member

akoehn commented Dec 22, 2020 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants