nltk.corpus.reader.ipipan.IPIPANCorpusView

type IPIPANCorpusView

object --+ | util.AbstractLazySequence --+ | util.StreamBackedCorpusView --+ | IPIPANCorpusView

Instance Methods

__init__(self, filename, startpos=0, **kwargs)
Create a new corpus view, based on the file fileid, and read with block_reader. source code

list of any

read_block(self, stream)
Read a block from the input stream.

source code

_read_data(self, stream)

source code

_seek(self, stream)

source code

_append_space(self, sentence)

source code

Inherited from util.StreamBackedCorpusView (private): _open

Class Variables

WORDS_MODE = 0

SENTS_MODE = 1

PARAS_MODE = 2

Create a new corpus view, based on the file fileid, and read with block_reader. See the class documentation for more information.

Parameters:

fileid - The path to the file that is read by this corpus view. fileid can either be a string or a PathPointer.
startpos - The file position at which the view will start reading. This can be used to skip over preface sections.
encoding - The unicode encoding that should be used to read the file's contents. If no encoding is specified, then the file's contents will be read as a non-unicode string (i.e., a str).
source - If specified, then use an SourcedStringStream to annotate all strings read from the file with information about their start offset, end ofset, and docid. The value of ``source`` will be used as the docid.

(inherited documentation)

Read a block from the input stream.

Parameters:

Returns: list of any

a block of tokens from the input stream

(inherited documentation)

type IPIPANCorpusView