Package org.luwrain.nlp.ru

Class ReaderTokenizer

java.lang.Object

org.luwrain.nlp.ru.AbstractTokenizer

org.luwrain.nlp.ru.ReaderTokenizer

public final class ReaderTokenizer
extends AbstractTokenizer

Field Summary

Fields inherited from class org.luwrain.nlp.ru.AbstractTokenizer

output

Constructor Summary

Constructors

Constructor	Description
ReaderTokenizer(Reader reader)

Method Summary

Modifier and Type	Method	Description
void	backCh(char ch)
char	getCh()
boolean	hasCh()
static Token[]	tokenize(String text)

Methods inherited from class org.luwrain.nlp.ru.AbstractTokenizer

getOutput, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ReaderTokenizer

public ReaderTokenizer(Reader reader)

Method Details

getCh

public char getCh()

hasCh

public boolean hasCh()

Specified by:

hasCh in class AbstractTokenizer

backCh

public void backCh(char ch)

Specified by:

backCh in class AbstractTokenizer

tokenize

public static Token[] tokenize(String text)