edu.umass.cs.mallet.base.util
Interface Lexer
- All Superinterfaces:
- java.util.Iterator
- All Known Implementing Classes:
- CharSequenceLexer
- public interface Lexer
- extends java.util.Iterator
getStartOffset
public int getStartOffset()
getEndOffset
public int getEndOffset()
getTokenString
public java.lang.String getTokenString()
hasNext
public boolean hasNext()
- Specified by:
hasNext
in interface java.util.Iterator
next
public java.lang.Object next()
- Specified by:
next
in interface java.util.Iterator
remove
public void remove()
- Specified by:
remove
in interface java.util.Iterator