The string to be tokenized is specified through the 屬性指定要標(biāo)記化的字符串,而通過
Company would be tokenized as Company將標(biāo)記為
Should be specified as the string of hexadecimal digits representing the tokenized form of the public key 應(yīng)指定為十六進(jìn)制數(shù)字的字符串以表示標(biāo)記形式的公鑰。
In some specific cases , changes made to the word breakers have the potential to impact how some data is tokenized 在某些特定情況下,對斷字符所做的更改可能會影響對某些數(shù)據(jù)進(jìn)行標(biāo)記化的方式。
In a tokenized type , the parser will normalize all white space to a single space character and will eliminate leading and trailing white space altogether 在標(biāo)記化類型中,分析器將使所有空白標(biāo)準(zhǔn)化為單個空格字符,并將前導(dǎo)和尾隨空白一同刪除。