WhitespaceTokenizer
Class WhitespaceTokenizer
- Full name:
\LanguageDetection\Tokenizer\WhitespaceTokenizer
- This class implements:
\LanguageDetection\Tokenizer\TokenizerInterface
Methods
tokenize
Parameters:
Parameter | Type | Description |
---|---|---|
$str |
string |
Automatically generated on 2025-03-18