public class LineTokenizer extends ProjectComponent implements Tokenizer
description, location, project| Constructor and Description | 
|---|
| LineTokenizer() | 
| Modifier and Type | Method and Description | 
|---|---|
| java.lang.String | getPostToken()return the string between tokens, after the
 previous token. | 
| java.lang.String | getToken(java.io.Reader in)get the next line from the input | 
| void | setIncludeDelims(boolean includeDelims)attribute includedelims - whether to include
 the line ending with the line, or to return
 it in the posttoken
 default false | 
clone, getDescription, getLocation, getProject, log, log, setDescription, setLocation, setProjectpublic void setIncludeDelims(boolean includeDelims)
includeDelims - if true include /r and /n in the linepublic java.lang.String getToken(java.io.Reader in)
                          throws java.io.IOException
public java.lang.String getPostToken()
TokenizergetPostToken in interface Tokenizer