Class FieldLineage
java.lang.Object
com.northconcepts.datapipeline.lineage.FieldLineage
Convenience wrapper to read and write field-level data lineage properties.
-
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final StringThe catalog name of a column returned from the database for this field.static final StringThe class name of a column returned from the database for this field.static final StringThe column display size returned from the database for this field.static final Stringstatic final StringThe Java type mapped fromjava.sql.Types.static final StringThe column name returned from the database for this field.static final StringThe column isNullable value returned from the database for this field.static final StringThe column precision returned from the database for this field.static final StringThe column scale returned from the database for this field.static final StringThe schema name of a column returned from the database for this field.static final StringThe column isSigned value returned from the database for this field.static final StringThe column type returned from the database for this field.static final StringThe table name of a column returned from the database for this field.static final StringThe column type name returned from the database for this field.static final StringThe field's schema for ORC and Parquet files.static final StringThe index of a field set by the DataReader before any transformation or operation was performed.static final StringThe name of a field set by the DataReader before any transformation or operation was performed. -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptioncopyFrom(RecordLineage recordLineage) Copies the file, line and column numbers, database URL and query, and record number from the record's lineage, keeping any of these values this field already has.The catalog name of a column returned from the database for this field.The class name of a column returned from the database for this field.The column display size returned from the database for this field.TheFieldTypemapped from the Java type of the database column for this field.Class<?> The Java type mapped fromjava.sql.Types.The column name returned from the database for this field.The column isNullable value returned from the database for this field.The column precision returned from the database for this field.The column scale returned from the database for this field.The schema name of a column returned from the database for this field.The column isSigned value returned from the database for this field.The column type returned from the database for this field.The table name of a column returned from the database for this field.The column type name returned from the database for this field.The SQL statement used to query the database.The JDBC connection URL.getField()The field's schema for ORC and Parquet files.getFile()Thejava.io.Fileused to create the DataReader.The beginning column number in the input file starting with 0.The line number in the input file starting with 0.The index of a field set by the DataReader before any transformation or operation was performed.The name of a field set by the DataReader before any transformation or operation was performed.The sequential record number starting with 0.setDatabaseColumnCatalogName(String catalogName) The catalog name of a column returned from the database for this field.setDatabaseColumnClassName(String className) The class name of a column returned from the database for this field.setDatabaseColumnDisplaySize(int displaySize) The column display size returned from the database for this field.setDatabaseColumnFieldType(FieldType fieldType) TheFieldTypemapped from the Java type of the database column for this field.setDatabaseColumnJavaType(Class<?> javaType) The Java type mapped fromjava.sql.Types.setDatabaseColumnName(String columnName) The column name returned from the database for this field.setDatabaseColumnNullable(boolean nullable) The column isNullable value returned from the database for this field.setDatabaseColumnPrecision(int precision) The column precision returned from the database for this field.setDatabaseColumnScale(int scale) The column scale returned from the database for this field.setDatabaseColumnSchemaName(String schemaName) The schema name of a column returned from the database for this field.setDatabaseColumnSigned(boolean signed) The column isSigned value returned from the database for this field.setDatabaseColumnSqlType(int sqlType) The column type returned from the database for this field.setDatabaseColumnTableName(String tableName) The table name of a column returned from the database for this field.setDatabaseColumnTypeName(String typeName) The column type name returned from the database for this field.setDatabaseQuery(String queryString) The SQL statement used to query the database.setDatabaseUrl(String url) The JDBC connection URL.setFieldSchema(String fieldSchema) The field's schema for ORC and Parquet files.Thejava.io.Fileused to create the DataReader.setFileColumnNumber(Long columnNumber) The beginning column number in the input file starting with 0.setFileLineNumber(Long lineNumber) The line number in the input file starting with 0.setOriginalFieldIndex(int fieldIndex) The index of a field set by the DataReader before any transformation or operation was performed.setOriginalFieldName(String fieldName) The name of a field set by the DataReader before any transformation or operation was performed.setRecordNumber(long recordNumber) The sequential record number starting with 0.
-
Field Details
-
ORIGINAL_FIELD_INDEX
The index of a field set by the DataReader before any transformation or operation was performed.- See Also:
-
ORIGINAL_FIELD_NAME
The name of a field set by the DataReader before any transformation or operation was performed.- See Also:
-
DATABASE_COLUMN_NAME
The column name returned from the database for this field.- See Also:
-
FIELD_SCHEMA
The field's schema for ORC and Parquet files.- See Also:
-
DATABASE_COLUMN_SQL_TYPE
The column type returned from the database for this field.- See Also:
-
DATABASE_COLUMN_DISPLAY_SIZE
The column display size returned from the database for this field.- See Also:
-
DATABASE_COLUMN_SCALE
The column scale returned from the database for this field.- See Also:
-
DATABASE_COLUMN_PRECISION
The column precision returned from the database for this field.- See Also:
-
DATABASE_COLUMN_SCHEMA_NAME
The schema name of a column returned from the database for this field.- See Also:
-
DATABASE_COLUMN_CATALOG_NAME
The catalog name of a column returned from the database for this field.- See Also:
-
DATABASE_COLUMN_TABLE_NAME
The table name of a column returned from the database for this field.- See Also:
-
DATABASE_COLUMN_TYPE_NAME
The column type name returned from the database for this field.- See Also:
-
DATABASE_COLUMN_CLASS_NAME
The class name of a column returned from the database for this field.- See Also:
-
DATABASE_COLUMN_SIGNED
The column isSigned value returned from the database for this field.- See Also:
-
DATABASE_COLUMN_NULLABLE
The column isNullable value returned from the database for this field.- See Also:
-
DATABASE_COLUMN_JAVA_TYPE
The Java type mapped fromjava.sql.Types.- See Also:
-
DATABASE_COLUMN_FIELD_TYPE
- See Also:
-
-
Constructor Details
-
FieldLineage
public FieldLineage() -
FieldLineage
-
-
Method Details
-
getField
-
setField
-
getOriginalFieldIndex
The index of a field set by the DataReader before any transformation or operation was performed. -
setOriginalFieldIndex
The index of a field set by the DataReader before any transformation or operation was performed. -
getOriginalFieldName
The name of a field set by the DataReader before any transformation or operation was performed. -
setOriginalFieldName
The name of a field set by the DataReader before any transformation or operation was performed. -
getDatabaseUrl
The JDBC connection URL. -
setDatabaseUrl
The JDBC connection URL. -
getDatabaseQuery
The SQL statement used to query the database. -
setDatabaseQuery
The SQL statement used to query the database. -
getDatabaseColumnName
The column name returned from the database for this field. -
setDatabaseColumnName
The column name returned from the database for this field. -
getFile
Thejava.io.Fileused to create the DataReader. -
setFile
Thejava.io.Fileused to create the DataReader. -
getFileLineNumber
The line number in the input file starting with 0. -
setFileLineNumber
The line number in the input file starting with 0. -
getFileColumnNumber
The beginning column number in the input file starting with 0. -
setFileColumnNumber
The beginning column number in the input file starting with 0. -
getRecordNumber
The sequential record number starting with 0. -
setRecordNumber
The sequential record number starting with 0. -
getFieldSchema
The field's schema for ORC and Parquet files. -
setFieldSchema
The field's schema for ORC and Parquet files. -
getDatabaseColumnSqlType
The column type returned from the database for this field. -
setDatabaseColumnSqlType
The column type returned from the database for this field. -
getDatabaseColumnDisplaySize
The column display size returned from the database for this field. -
setDatabaseColumnDisplaySize
The column display size returned from the database for this field. -
getDatabaseColumnScale
The column scale returned from the database for this field. -
setDatabaseColumnScale
The column scale returned from the database for this field. -
getDatabaseColumnPrecision
The column precision returned from the database for this field. -
setDatabaseColumnPrecision
The column precision returned from the database for this field. -
getDatabaseColumnSchemaName
The schema name of a column returned from the database for this field. -
setDatabaseColumnSchemaName
The schema name of a column returned from the database for this field. -
getDatabaseColumnCatalogName
The catalog name of a column returned from the database for this field. -
setDatabaseColumnCatalogName
The catalog name of a column returned from the database for this field. -
getDatabaseColumnTableName
The table name of a column returned from the database for this field. -
setDatabaseColumnTableName
The table name of a column returned from the database for this field. -
getDatabaseColumnTypeName
The column type name returned from the database for this field. -
setDatabaseColumnTypeName
The column type name returned from the database for this field. -
getDatabaseColumnClassName
The class name of a column returned from the database for this field. -
setDatabaseColumnClassName
The class name of a column returned from the database for this field. -
getDatabaseColumnSigned
The column isSigned value returned from the database for this field. -
setDatabaseColumnSigned
The column isSigned value returned from the database for this field. -
getDatabaseColumnNullable
The column isNullable value returned from the database for this field. -
setDatabaseColumnNullable
The column isNullable value returned from the database for this field. -
getDatabaseColumnJavaType
The Java type mapped fromjava.sql.Types. -
setDatabaseColumnJavaType
The Java type mapped fromjava.sql.Types. -
getDatabaseColumnFieldType
TheFieldTypemapped from the Java type of the database column for this field. -
setDatabaseColumnFieldType
TheFieldTypemapped from the Java type of the database column for this field. -
copyFrom
Copies the file, line and column numbers, database URL and query, and record number from the record's lineage, keeping any of these values this field already has.
-