public class StringTokenizer extends ProjectComponent implements Tokenizer
description, location, project| Constructor and Description | 
|---|
| StringTokenizer() | 
| Modifier and Type | Method and Description | 
|---|---|
| java.lang.String | getPostToken()return the string between tokens, after the
 previous token. | 
| java.lang.String | getToken(java.io.Reader in)find and return the next token | 
| void | setDelims(java.lang.String delims)attribute delims - the delimiter characters | 
| void | setDelimsAreTokens(boolean delimsAreTokens)attribute delimsaretokens - treat delimiters as
 separate tokens. | 
| void | setIncludeDelims(boolean includeDelims)attribute includedelims - treat delimiters as part
 of the token. | 
| void | setSuppressDelims(boolean suppressDelims)attribute suppressdelims - suppress delimiters. | 
clone, getDescription, getLocation, getProject, log, log, setDescription, setLocation, setProjectpublic void setDelims(java.lang.String delims)
delims - a string containing the delimiter characterspublic void setDelimsAreTokens(boolean delimsAreTokens)
delimsAreTokens - true if delimiters are to be separatepublic void setSuppressDelims(boolean suppressDelims)
suppressDelims - if true do not report delimiterspublic void setIncludeDelims(boolean includeDelims)
includeDelims - if true add delimiters to the tokenpublic java.lang.String getToken(java.io.Reader in)
                          throws java.io.IOException
public java.lang.String getPostToken()
TokenizergetPostToken in interface Tokenizer