com.northconcepts.datapipeline.foundations.datamapping

Class DataMappingReader

java.lang.Object

com.northconcepts.datapipeline.core.DataObject

com.northconcepts.datapipeline.core.Endpoint

com.northconcepts.datapipeline.core.DataEndpoint

com.northconcepts.datapipeline.core.DataReader

com.northconcepts.datapipeline.core.ProxyReader

com.northconcepts.datapipeline.internal.lang.IntegrationProxyReader

com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader

public class DataMappingReader
extends IntegrationProxyReader

Nested Class Summary

Nested classes/interfaces inherited from class com.northconcepts.datapipeline.core.DataEndpoint

DataEndpoint.State

Field Summary

Fields inherited from class com.northconcepts.datapipeline.core.DataReader

fieldLineage, recordLineage

Fields inherited from class com.northconcepts.datapipeline.core.DataEndpoint

lastRecord, PRODUCT, PRODUCT_VERSION, VENDOR, XML_INPUT_FACTORY_KEY

Fields inherited from class com.northconcepts.datapipeline.core.Endpoint

BUFFER_SIZE, captureElapsedTime, DEFAULT_READ_BUFFER_SIZE

Fields inherited from class com.northconcepts.datapipeline.core.DataObject

id, log, name, TIMESTAMP_FORMAT

Constructor Summary

Constructors

Constructor and Description
DataMappingReader(DataReader nestedDataReader, DataMapping dataMapping)
DataMappingReader(DataReader nestedDataReader, DataMapping dataMapping, DataWriter discardWriter, String discardReasonFieldName)

Method Summary

Modifier and Type	Method and Description
DataException	addExceptionProperties(DataException exception) Adds this endpoint's current state to a DataException.
void	close() Indicates that this endpoint has finished reading or writing.
DataMapping	getDataMapping()
RecordExpressionContext	getExpressionContext()
protected Record	interceptRecord(Record record) Overridden by subclasses to transform, drop, or observe a record on its way through this proxy.
boolean	isLineageSupported()
boolean	isSendSkippedToDiscardWriter()
protected Record	onFailure(Record record, DataException exception, DataMappingResult result)
void	open() Makes this endpoint ready for reading or writing.
DataMappingReader	setSendSkippedToDiscardWriter(boolean sendSkippedToDiscardWriter)

Methods inherited from class com.northconcepts.datapipeline.core.ProxyReader

available, getNestedReader, map, map, readImpl, setNestedDataReader, setNestedDataReader

Methods inherited from class com.northconcepts.datapipeline.core.DataReader

addLineage, getBufferSize, getNestedEndpoint, getReader, getRootEndpoint, getRootReader, isExhausted, isSaveLineage, peek, pop, push, read, setSaveLineage, skip

Methods inherited from class com.northconcepts.datapipeline.core.DataEndpoint

decrementRecordCount, enableJmx, getLastRecord, getRecordCount, getRecordCountAsBigInteger, getRecordCountAsString, incrementRecordCount, isRecordCountBigInteger, resetRecordCount, toString

Methods inherited from class com.northconcepts.datapipeline.core.Endpoint

addElapsedtime, assertClosed, assertNotOpened, assertOpened, finalize, getClosedOn, getDescription, getElapsedTime, getElapsedTimeAsString, getOpenedOn, getOpenElapsedTime, getOpenElapsedTimeAsString, getSelfTime, getSelfTimeAsString, getState, isCaptureElapsedTime, isClosed, isOpen, setCaptureElapsedTime, setDescription

Methods inherited from class com.northconcepts.datapipeline.core.DataObject

exception, exception, exception, getId, getName, resetID

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

DataMappingReader

public DataMappingReader(DataReader nestedDataReader,
                         DataMapping dataMapping,
                         DataWriter discardWriter,
                         String discardReasonFieldName)

DataMappingReader

public DataMappingReader(DataReader nestedDataReader,
                         DataMapping dataMapping)

Method Detail

getExpressionContext

public RecordExpressionContext getExpressionContext()

getDataMapping

public DataMapping getDataMapping()

open

public void open()
          throws DataException

Description copied from class: DataEndpoint

Makes this endpoint ready for reading or writing.

Overrides:

open in class IntegrationProxyReader

Throws:

DataException

close

public void close()
           throws DataException

Description copied from class: DataEndpoint

Indicates that this endpoint has finished reading or writing.

Overrides:

close in class ProxyReader

Throws:

DataException

isLineageSupported

public boolean isLineageSupported()

Overrides:

isLineageSupported in class DataReader

interceptRecord

protected Record interceptRecord(Record record)
                          throws Throwable

Description copied from class: ProxyReader

Overridden by subclasses to transform, drop, or observe a record on its way through this proxy.

Contract for subclasses (see also docs/authoring/ProxyReader.md):

• Return the record (possibly modified) to pass it downstream.
• Return null to drop the record; the framework reads the next one.
• Throw to fail the pipeline; the framework wraps the throwable in a DataException with .setRecord(record).
• The nested DataReader is opened and closed for you; do not read from it here.
• Do not call DataEndpoint.incrementRecordCount() here.

Overrides:

interceptRecord in class ProxyReader

Throws:

Throwable

onFailure

protected Record onFailure(Record record,
                           DataException exception,
                           DataMappingResult result)

addExceptionProperties

public DataException addExceptionProperties(DataException exception)

Description copied from class: Endpoint

Adds this endpoint's current state to a DataException. Since this method is called whenever an exception is thrown, subclasses should override it to add their specific information.

Overrides:

addExceptionProperties in class ProxyReader

isSendSkippedToDiscardWriter

public boolean isSendSkippedToDiscardWriter()

setSendSkippedToDiscardWriter

public DataMappingReader setSendSkippedToDiscardWriter(boolean sendSkippedToDiscardWriter)