Home       Trees       Indices       Help   
nltk 2.0.1rc1
Package nltk :: Package tokenize :: Module api
[hide private]
[frames] | no frames]

Module api

source code

Tokenizer Interface

Classes [hide private]
TokenizerI
A processing interface for tokenizing a string, or dividing it into a list of substrings.
StringTokenizer
A tokenizer that divides a string into substrings by splitting on the specified string (defined in subclasses).
   Home       Trees       Indices       Help   
nltk 2.0.1rc1
Generated by Epydoc 3.0.1 on Mon Apr 11 14:39:42 2011 http://epydoc.sourceforge.net