Automatic testing with .conllu files

[ftyers]

Around a third of the sentences that I put into annotatrix don't display for some reason. It would be good to set up some kind of automatic testing with notatrix on all of the UD treebanks that pass validation. For example,
https://quest.ms.mff.cuni.cz/udvalidator/cgi-bin/unidep/validation-report.pl?UD_Chukchi-HSE
You can see that Chukchi passes validation, but some of the sentences don't parse with notatrix.

[kmurphy4]

I totally agree. I'll look into setting this up. There is a test suite for notatrix, but it doesn't have nearly enough data.

Do you know of similar "treebanks" for the other formats (cg3, sdparse, brackets, etc.)?

[ftyers]

Hmm, I don't, but those are much less error prone (and used) it seems than conllu.

[keggsmurph21]

Ok. I'll look into integrating more conllu tests tho!