Package nltk_lite :: Package tokenize
[hide private]
[frames] | no frames]

Source Code for Package nltk_lite.tokenize

 1  # Natural Language Toolkit: Tokenizers 
 2  # 
 3  # Copyright (C) 2001-2007 University of Pennsylvania 
 4  # Author: Edward Loper <edloper@gradient.cis.upenn.edu> 
 5  #         Steven Bird <sb@csse.unimelb.edu.au> (minor additions) 
 6  # URL: <http://nltk.sf.net> 
 7  # For license information, see LICENSE.TXT 
 8   
 9  """ 
10  Functions for tokenizing text. 
11  """ 
12   
13  from simple import * 
14  from regexp import * 
15  from sexpr import * 
16