ti: Added training data for the Tigrinya language. #615
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The Tigrinya language is based off of the Ge'ez script and is similar to Amharic (its spoken by over 10 million people). The dictionary is based off of the Nagaoka Tigrinya Corpus, cited below.
Tedla, Y. K., Yamamoto, K., & Marasinghe, A. (2016). Nagaoka Tigrinya Corpus: Design and development of part-of-speech tagged corpus. Nagaoka University of Technology, 1-4.
I've also included a smaller, less clean corpus that's generated from old newspapers and books. The words sometimes include punctuation and numbers.
Grammar: https://en.wikipedia.org/wiki/Tigrinya_grammar
Full list of punctuation: https://gist.github.com/babraham123/d1b597b9a5b293f332ff5613db0df3dc
Fonts: http://www.wazu.jp/gallery/Fonts_Ethiopic.html