tokenizations造句
例句與造句
- All of MASC includes manually validated annotations for logical structure ( headings, sections, paragraphs, etc . ), sentence boundaries, three different tokenizations with associated part of speech tags, shallow parse ( noun and verb chunks ), named entities ( person, location, organization, date and time ), and Penn Treebank syntax.
- It's difficult to find tokenizations in a sentence. 用tokenizations造句挺難的