morphemepiece
Morpheme Tokenization
Tokenize text into morphemes. The morphemepiece algorithm uses a lookup table to determine the morpheme breakdown of words, and falls back on a modified wordpiece tokenization algorithm for words not found in the lookup table.
- Version1.2.3
- R versionunknown
- LicenseApache License (≥ 2)
- Needs compilation?No
- Last release04/16/2022
Documentation
Team
Jonathan Bratt
Jon Harmon
Bedford Freeman & Worth Pub Grp LLC DBA Macmillan Learning
Show author detailsRolesCopyright holder
Insights
Last 30 days
Last 365 days
The following line graph shows the downloads per day. You can hover over the graph to see the exact number of downloads per day.
Data provided by CRAN
Binaries
Dependencies
- Imports10 packages
- Suggests8 packages