pl.edu.agh.cast.importer.base.tokenizer.ack
Class AckTokenizer

java.lang.Object
  pl.edu.agh.cast.importer.base.tokenizer.AbstractImportTokenizer
      pl.edu.agh.cast.importer.base.tokenizer.ack.AckTokenizer

All Implemented Interfaces:

IImportTokenizer

public class AckTokenizer
extends AbstractImportTokenizer

Tokenizer for ACK text files.

Author:

AGH CAST Team

Field Summary

Fields inherited from class pl.edu.agh.cast.importer.base.tokenizer.AbstractImportTokenizer

options

Constructor Summary

AckTokenizer()

Method Summary

List<RawTabularData>

tokenize(InputStream dataIs, long rowsLimit, org.eclipse.core.runtime.IProgressMonitor monitor) Splits a given input stream into tokens, using specified tokenizer options.

Methods inherited from class pl.edu.agh.cast.importer.base.tokenizer.AbstractImportTokenizer

equals, getEncoding, getOptionValue, getTokenizerOptions, hashCode, removeEmptyCellsFromRowEnd, removeQualifier, setEncoding, setTokenizerOptions

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AckTokenizer

public AckTokenizer()

Method Detail

tokenize

public List<RawTabularData> tokenize(InputStream dataIs,
                                     long rowsLimit,
                                     org.eclipse.core.runtime.IProgressMonitor monitor)
                              throws IOException

Splits a given input stream into tokens, using specified tokenizer options.

Parameters:

dataIs - the data input stream to tokenize

rowsLimit - the maximum number of rows to be imported

monitor - the progress monitor for the tokenization operation

Returns:

the tokenized data in an unanalyzed tabular form

Throws:

IOException

See Also:

IImportTokenizer.tokenize(java.io.InputStream, long, org.eclipse.core.runtime.IProgressMonitor)