com.northconcepts.datapipeline.weblog.CombinedLogReader

public class CombinedLogReader extends ParsingReader

Obtains records from a webserver's access log file using the Combined Log format.

See Combined Log Format

Nested Class Summary

Nested classes/interfaces inherited from class com.northconcepts.datapipeline.core.DataEndpoint
DataEndpoint.State
Field Summary

Fields inherited from class com.northconcepts.datapipeline.core.ParsingReader
lineNumber, parser, valueBuffer

Fields inherited from class com.northconcepts.datapipeline.core.AbstractReader
currentRecord, fieldNames, lastRow, startingRow

Fields inherited from class com.northconcepts.datapipeline.core.DataReader
fieldLineage, recordLineage

Fields inherited from class com.northconcepts.datapipeline.core.DataEndpoint
lastRecord, PRODUCT, PRODUCT_VERSION, VENDOR, XML_INPUT_FACTORY_KEY

Fields inherited from class com.northconcepts.datapipeline.core.Endpoint
BUFFER_SIZE, captureElapsedTime, DEFAULT_READ_BUFFER_SIZE

Fields inherited from class com.northconcepts.datapipeline.core.DataObject
id, log, name, TIMESTAMP_FORMAT
Constructor Summary

Constructors

Constructor

Description

CombinedLogReader(File file)

Creates a reader for the log file; each record has the fields remoteHost, clientUsername, authenticatedUsername, date, request, status, bytes, referrer, userAgent and cookies.

CombinedLogReader(Reader reader)

Creates a reader for the log stream; each record has the fields remoteHost, clientUsername, authenticatedUsername, date, request, status, bytes, referrer, userAgent and cookies.
Method Summary

Modifier and Type

Method

Description

protected boolean

fillRecord(Record record)

Populates the given record with the next row's values; returns false at the end of the input.

Methods inherited from class com.northconcepts.datapipeline.core.ParsingReader
addExceptionProperties, addLineage, available, getCharsetName, getLineNumber, isDigit, isLetter, isLineageSupported, isNewLine, match, matchCHARACTER, matchDIGIT, matchDIGITS, matchDOUBLE, matchINTEGER, matchLINE, matchNEWLINE, matchNEWLINES, open, peekCHARACTER

Methods inherited from class com.northconcepts.datapipeline.core.AbstractReader
getFieldNames, getLastRow, getStartingRow, isFieldNamesInFirstRow, isSkipEmptyRows, read, readImpl, setFieldNames, setFieldNames, setFieldNamesInFirstRow, setLastRow, setSkipEmptyRows, setStartingRow

Methods inherited from class com.northconcepts.datapipeline.core.DataReader
getBufferSize, getNestedEndpoint, getNestedReader, getReader, getRootEndpoint, getRootReader, isExhausted, isSaveLineage, peek, pop, push, setSaveLineage, skip

Methods inherited from class com.northconcepts.datapipeline.core.DataEndpoint
close, decrementRecordCount, enableJmx, getLastRecord, getRecordCount, getRecordCountAsBigInteger, getRecordCountAsString, incrementRecordCount, isRecordCountBigInteger, resetRecordCount, toString

Methods inherited from class com.northconcepts.datapipeline.core.Endpoint
addElapsedtime, assertClosed, assertNotOpened, assertOpened, finalize, getClosedOn, getDescription, getElapsedTime, getElapsedTimeAsString, getOpenedOn, getOpenElapsedTime, getOpenElapsedTimeAsString, getSelfTime, getSelfTimeAsString, getState, isCaptureElapsedTime, isClosed, isOpen, setCaptureElapsedTime, setDescription

Methods inherited from class com.northconcepts.datapipeline.core.DataObject
exception, exception, exception, getId, getName, resetID

Methods inherited from class java.lang.Object
clone, equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Details
- CombinedLogReader
  
  public CombinedLogReader(File file) throws FileNotFoundException
  
  Creates a reader for the log file; each record has the fields remoteHost, clientUsername, authenticatedUsername, date, request, status, bytes, referrer, userAgent and cookies.
  
  Throws:
  
  FileNotFoundException
- CombinedLogReader
  
  public CombinedLogReader(Reader reader)
  
  Creates a reader for the log stream; each record has the fields remoteHost, clientUsername, authenticatedUsername, date, request, status, bytes, referrer, userAgent and cookies.
Method Details
- fillRecord
  
  protected boolean fillRecord(Record record) throws Throwable
  
  Description copied from class: AbstractReader
  
  Populates the given record with the next row's values; returns false at the end of the input.
  
  Overrides:
  
  fillRecord in class ParsingReader
  
  Throws:
  
  Throwable

Class CombinedLogReader

Nested Class Summary

Nested classes/interfaces inherited from class com.northconcepts.datapipeline.core.DataEndpoint

Field Summary

Fields inherited from class com.northconcepts.datapipeline.core.ParsingReader

Fields inherited from class com.northconcepts.datapipeline.core.AbstractReader

Fields inherited from class com.northconcepts.datapipeline.core.DataReader

Fields inherited from class com.northconcepts.datapipeline.core.DataEndpoint

Fields inherited from class com.northconcepts.datapipeline.core.Endpoint

Fields inherited from class com.northconcepts.datapipeline.core.DataObject

Constructor Summary

Method Summary

Methods inherited from class com.northconcepts.datapipeline.core.ParsingReader

Methods inherited from class com.northconcepts.datapipeline.core.AbstractReader

Methods inherited from class com.northconcepts.datapipeline.core.DataReader

Methods inherited from class com.northconcepts.datapipeline.core.DataEndpoint

Methods inherited from class com.northconcepts.datapipeline.core.Endpoint

Methods inherited from class com.northconcepts.datapipeline.core.DataObject

Methods inherited from class java.lang.Object

Constructor Details

CombinedLogReader

CombinedLogReader

Method Details

fillRecord