Home       Trees       Indices       Help   
nltk 2.0.1rc1
Package nltk :: Package corpus :: Package reader :: Module conll :: Class ConllCorpusReader
[hide private]
[frames] | no frames]

type ConllCorpusReader

source code

      object --+    
               |    
api.CorpusReader --+
                   |
                  ConllCorpusReader
Known Subclasses:

A corpus reader for CoNLL-style files. These files consist of a series of sentences, separated by blank lines. Each sentence is encoded using a table (or grid) of values, where each line corresponds to a single word, and each column corresponds to an annotation type. The set of columns used by CoNLL-style files can vary from corpus to corpus; the ConllCorpusReader constructor therefore takes an argument, columntypes, which is used to specify the columns that are used by a given corpus.

To Do:
Instance Methods [hide private]
 
__init__(self, root, fileids, columntypes, chunk_types=None, top_node='S', pos_in_tree=False, srl_includes_roleset=True, encoding=None, tree_class=<class 'nltk.tree.Tree'>, tag_mapping_function=None) source code
 
raw(self, fileids=None) source code
 
words(self, fileids=None) source code
 
sents(self, fileids=None) source code
 
tagged_words(self, fileids=None, simplify_tags=False) source code
 
tagged_sents(self, fileids=None, simplify_tags=False) source code
 
chunked_words(self, fileids=None, chunk_types=None, simplify_tags=False) source code
 
chunked_sents(self, fileids=None, chunk_types=None, simplify_tags=False) source code
 
parsed_sents(self, fileids=None, pos_in_tree=None, simplify_tags=False) source code
 
srl_spans(self, fileids=None) source code
 
srl_instances(self, fileids=None, pos_in_tree=None, flatten=True) source code
list of tuple
iob_words(self, fileids=None, simplify_tags=False)
Returns: a list of word/tag/IOB tuples		 source code
list of list
iob_sents(self, fileids=None, simplify_tags=False)
Returns: a list of lists of word/tag/IOB tuples		 source code
 
_grids(self, fileids=None) source code
 
_read_grid_block(self, stream) source code
 
_get_words(self, grid) source code
 
_get_tagged_words(self, grid, simplify_tags=False) source code
 
_get_iob_words(self, grid, simplify_tags=False) source code
 
_get_chunked_words(self, grid, chunk_types, simplify_tags=False) source code
 
_get_parsed_sent(self, grid, pos_in_tree, simplify_tags=False) source code
 
_get_srl_spans(self, grid)
list of list of (start, end), tag) tuples		 source code
 
_get_srl_instances(self, grid, pos_in_tree) source code
 
_require(self, *columntypes) source code

Inherited from api.CorpusReader: __repr__, abspath, abspaths, encoding, fileids, open, readme

Inherited from api.CorpusReader (private): _get_root

    Deprecated since 0.9.7

Inherited from api.CorpusReader: files

    Deprecated since 0.9.1

Inherited from api.CorpusReader: items

Inherited from api.CorpusReader (private): _get_items

Static Methods [hide private]
 
_get_column(grid, column_index) source code
Class Variables [hide private]
  WORDS = 'words'
column type for words
  POS = 'pos'
column type for part-of-speech tags
  TREE = 'tree'
column type for parse trees
  CHUNK = 'chunk'
column type for chunk structures
  NE = 'ne'
column type for named entities
  SRL = 'srl'
column type for semantic role labels
  IGNORE = 'ignore'
column type for column that should be ignored
  COLUMN_TYPES = ('words', 'pos', 'tree', 'chunk', 'ne', 'srl', ...
A list of all column types supported by the conll corpus reader.
Instance Variables [hide private]

Inherited from api.CorpusReader (private): _encoding, _fileids, _root

Properties [hide private]

Inherited from api.CorpusReader: root

Method Details [hide private]

__init__(self, root, fileids, columntypes, chunk_types=None, top_node='S', pos_in_tree=False, srl_includes_roleset=True, encoding=None, tree_class=<class 'nltk.tree.Tree'>, tag_mapping_function=None)
(Constructor)

source code 
Parameters:
  • root - A path pointer identifying the root directory for this corpus. If a string is specified, then it will be converted to a PathPointer automatically.
  • fileids - A list of the files that make up this corpus. This list can either be specified explicitly, as a list of strings; or implicitly, as a regular expression over file paths. The absolute path for each file will be constructed by joining the reader's root to each file name.
  • encoding - The default unicode encoding for the files that make up the corpus. encoding's value can be any of the following:
    • A string: encoding is the encoding name for all files.
    • A dictionary: encoding[file_id] is the encoding name for the file whose identifier is file_id. If file_id is not in encoding, then the file contents will be processed using non-unicode byte strings.
    • A list: encoding should be a list of (regexp, encoding) tuples. The encoding for a file whose identifier is file_id will be the encoding value for the first tuple whose regexp matches the file_id. If no tuple's regexp matches the file_id, the file contents will be processed using non-unicode byte strings.
    • None: the file contents of all files will be processed using non-unicode byte strings.
  • tag_mapping_function - A function for normalizing or simplifying the POS tags returned by the tagged_words() or tagged_sents() methods.
Overrides: api.CorpusReader.__init__
(inherited documentation)

iob_words(self, fileids=None, simplify_tags=False)

source code 
Parameters:
  • fileids (None or str or list) - the list of fileids that make up this corpus
Returns: list of tuple
a list of word/tag/IOB tuples

iob_sents(self, fileids=None, simplify_tags=False)

source code 
Parameters:
  • fileids (None or str or list) - the list of fileids that make up this corpus
Returns: list of list
a list of lists of word/tag/IOB tuples

Class Variable Details [hide private]

COLUMN_TYPES

A list of all column types supported by the conll corpus reader.

Value:
('words', 'pos', 'tree', 'chunk', 'ne', 'srl', 'ignore')

   Home       Trees       Indices       Help   
nltk 2.0.1rc1
Generated by Epydoc 3.0.1 on Mon Apr 11 14:39:44 2011 http://epydoc.sourceforge.net