Package com.northconcepts.datapipeline.lineage

Class RecordLineage

java.lang.Object
com.northconcepts.datapipeline.lineage.RecordLineage
public class RecordLineage extends Object
Convenience wrapper to read and write record-level data lineage properties.

  • Field Details

  • Constructor Details

    • RecordLineage

      public RecordLineage()

    • RecordLineage

      public RecordLineage(Record record)

  • Method Details

    • getRecord

      public Record getRecord()

    • setRecord

      public RecordLineage setRecord(Record record)

    • getFile

      public File getFile()
      The java.io.File used to create the DataReader.

    • setFile

      public RecordLineage setFile(File file)
      The java.io.File used to create the DataReader.

    • getFileLineNumber

      public Long getFileLineNumber()
      The line number in the input file starting with 0.

    • setFileLineNumber

      public RecordLineage setFileLineNumber(Long lineNumber)
      The line number in the input file starting with 0.

    • getFileColumnNumber

      public Long getFileColumnNumber()
      Returns the column number in the input file starting with 0.

    • setFileColumnNumber

      public RecordLineage setFileColumnNumber(Long columnNumber)
      The beginning column number in the input file starting with 0.

    • getRecordNumber

      public Long getRecordNumber()
      The beginning column number in the input file starting with 0.

    • setRecordNumber

      public RecordLineage setRecordNumber(long recordNumber)
      Sets the sequential record number starting with 0.

    • getDatabaseUrl

      public String getDatabaseUrl()
      The JDBC connection URL.

    • setDatabaseUrl

      public RecordLineage setDatabaseUrl(String url)
      The JDBC connection URL.

    • getDatabaseQuery

      public String getDatabaseQuery()
      The SQL statement used to query the database.

    • setDatabaseQuery

      public RecordLineage setDatabaseQuery(String queryString)
      The SQL statement used to query the database.

    • getRecordSchema

      public String getRecordSchema()
      The schema for ORC and Parquet files.

    • setRecordSchema

      public RecordLineage setRecordSchema(String recordSchema)
      The schema for ORC and Parquet files.