Index
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form
A
- A3 - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
- A3 - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- A4 - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
- A4 - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- A5 - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
- A5 - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- abs(Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Absolute value of a number
- AbstractFieldMapping - Class in com.northconcepts.datapipeline.foundations.datamapping
-
Base class for field mappings that set one target field, with an optional condition, default value expression and type conversion.
- AbstractFieldMapping - Enum constant in enum class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPartType
- AbstractFieldMapping() - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- AbstractJob - Class in com.northconcepts.datapipeline.job
-
Used to run, pause, and cancel Runnables.
- AbstractJob() - Constructor for class com.northconcepts.datapipeline.job.AbstractJob
- AbstractJobCallback<R,
W> - Class in com.northconcepts.datapipeline.job -
A default, abstract implementation of JobCallback.
- AbstractJobCallback() - Constructor for class com.northconcepts.datapipeline.job.AbstractJobCallback
- AbstractPipeline - Class in com.northconcepts.datapipeline.foundations.pipeline
-
Base class for declarative pipelines that read records from a
PipelineInput, process them and write them to aPipelineOutput. - AbstractPipeline() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- AbstractReader - Class in com.northconcepts.datapipeline.core
-
Abstract super-class, with some common logic, for reading records.
- AbstractReader() - Constructor for class com.northconcepts.datapipeline.core.AbstractReader
- AbstractTwitterReader - Class in com.northconcepts.datapipeline.twitter2
-
Base class for Twitter API v2 readers; each page from
AbstractTwitterReader.search()yields one record perdataelement. - AbstractTwitterReader(TwitterCredentials) - Constructor for class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
- AbstractWriter - Class in com.northconcepts.datapipeline.core
-
Abstract super-class, with some common logic, for writing records.
- AbstractWriter() - Constructor for class com.northconcepts.datapipeline.core.AbstractWriter
- accept(Record) - Method in class com.northconcepts.datapipeline.group.AggregateReader.AggregateOperation
-
Deprecated.Updates this operation's result with a record passing through the reader.
- accept(ZipFile, ZipEntry) - Method in class com.northconcepts.datapipeline.filesystem.zip.RegexZipEntryFilter
- accept(ZipFile, ZipEntry) - Method in class com.northconcepts.datapipeline.filesystem.zip.WildcardZipEntryFilter
- accept(ZipFile, ZipEntry) - Method in interface com.northconcepts.datapipeline.filesystem.zip.ZipEntryFilter
- ACCESS_KEY - Static variable in class com.northconcepts.datapipeline.security.Credentials
- accessToken - Variable in class com.northconcepts.datapipeline.twitter.TwitterProvider
- accessToken - Variable in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
- AccessToken(String) - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyClient.AccessToken
- accessTokenSecret - Variable in class com.northconcepts.datapipeline.twitter.TwitterProvider
- accessTokenSecret - Variable in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
- ActionGroup - Enum Class in com.northconcepts.datapipeline.foundations.pipeline.action
-
Categories of built-in
PipelineActions (transform, convert, aggregate, filter and validate), each holding a default instance of the actions it lists. - ACTIVE - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraSprintReader.SprintState
- ACTIVE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.ProductStatus
- ACTIVE_LOCAL - Enum constant in enum class com.northconcepts.datapipeline.filesystem.ftp.DataConnectionMode
-
Data transfer mode where the server connects to the client's data port.
- add() - Method in class com.northconcepts.datapipeline.meter.Meter
-
Adds one unit to the count.
- add(boolean, boolean, String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ANDs (if
andConjunctionis true) or ORs a condition with its parameter values, first iffirstis true, and returns the root part. - add(boolean, String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ANDs (if
andConjunctionis true) or ORs a condition with its parameter values and returns the root part. - add(int, Record) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- add(int, Record) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Inserts a record at the specified position in this list, shifting any record at or after
indexto the right. - add(long) - Method in class com.northconcepts.datapipeline.meter.Meter
-
Adds the given number of units to the count.
- add(DataEndpoint...) - Method in class com.northconcepts.datapipeline.core.DataEndpointGroup
-
Adds endpoints to this group;
DataEndpointGroup.open()opens them in the order added andDataEndpointGroup.close()closes them in reverse order. - add(DataReader) - Method in class com.northconcepts.datapipeline.core.SequenceReader
-
Appends a reader to the sequence; must be called before
SequenceReader.open(). - add(DataReader...) - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
-
Adds source readers, each read on its own thread that also opens and closes it; must be called before
AsyncMultiReader.open(). - add(DataReader, String) - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
-
Adds the named field's value from every record in
source, which is opened, read to the end and closed here. - add(DataWriter...) - Method in class com.northconcepts.datapipeline.core.MultiWriter
-
Adds target writers; must be called before
MultiWriter.open(). - add(FieldList) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
-
Appends the fields in ascending order;
nullis ignored. - add(Record) - Method in class com.northconcepts.datapipeline.buffer.RecordBuffer
-
Appends the record and updates the last-added time; only allowed while the buffer is open.
- add(Record) - Method in class com.northconcepts.datapipeline.group.Window
-
Adds the record to the group(s) selected by its group-by field values; only allowed while this window is open.
- add(Record) - Method in class com.northconcepts.datapipeline.memory.MemoryReader
-
Appends the record to the underlying list, which is the caller's list when one was passed to the constructor.
- add(Record) - Method in class com.northconcepts.datapipeline.meter.RecordMeter
-
Counts the record according to the measure (its estimated size in bytes or one) and returns it; null is ignored.
- add(Record...) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- add(Record...) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Appends all the specified records to the end of this list.
- add(FieldFilterRule...) - Method in class com.northconcepts.datapipeline.filter.rule.OrRule
- add(Filter...) - Method in class com.northconcepts.datapipeline.filter.FilteringReader
-
Adds filters that every record must pass to be kept; they are applied in the order added.
- add(AggregateGroupFieldsAction.GroupByField) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
-
Adds a field to group by or to aggregate, depending on its operator.
- add(CopyFieldsAction.FieldMapping) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- add(AggregateReader.AggregateOperation...) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Adds operations to apply to each record; an operation replaces any existing one with the same name and field.
- add(GroupOperation<?>) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- add(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.AndPart
- add(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
- add(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.OrPart
- add(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
- add(Select...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
-
Appends queries to the union; at least one must be given.
- add(BasicFieldTransformer.Operation...) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Appends operations that run, in the order added, on each named field.
- add(Transformer...) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Appends transformers; each record passes through them in the order added.
- add(Transformer...) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Appends transformers; each record passes through them in the order added.
- add(Class<?>, String, String...) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Creates aliases for one or more public, static methods on the specified class using their simple names (for example
java.lang.Math.abs()will be aliased asabs). - add(Object[], Object) - Method in class com.northconcepts.datapipeline.transform.lookup.BasicLookup
-
Adds a result record for the composite key with
valueas its only field; requires exactly one result field. - add(Object[], Object[]) - Method in class com.northconcepts.datapipeline.transform.lookup.BasicLookup
-
Adds a result record for the composite key with one value per result field, in order.
- add(Object, Object) - Method in class com.northconcepts.datapipeline.transform.lookup.BasicLookup
-
Adds a result record for the key with
valueas its only field; requires exactly one result field. - add(Object, Object[]) - Method in class com.northconcepts.datapipeline.transform.lookup.BasicLookup
-
Adds a result record for the key with one value per result field, in order.
- add(String) - Method in class com.northconcepts.datapipeline.core.RecordComparator
-
Adds an ascending comparison on the given field name or
FieldPathexpression. - add(String) - Method in class com.northconcepts.datapipeline.core.SortingReader
-
Adds an ascending sort on the given field name or
FieldPathexpression, after any fields already added. - add(String) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- add(String) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- add(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- add(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- add(String...) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Appends all the specified fields to the end of this list.
- add(String...) - Method in class com.northconcepts.datapipeline.filter.rule.PatternMatch
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- add(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- add(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
-
Adds columns with null parameter values to the current (last) row.
- add(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertRow
-
Adds columns with null parameter values; a null array is ignored.
- add(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryGrouping
- add(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
-
Appends the fields in ascending order.
- add(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySelection
- add(String...) - Method in class com.northconcepts.datapipeline.transform.RemoveFields
-
Adds more fields to remove.
- add(String...) - Method in class com.northconcepts.datapipeline.transform.SelectFields
-
Appends fields to select, placed after those already added.
- add(String, boolean) - Method in class com.northconcepts.datapipeline.core.RecordComparator
-
Adds an ascending or descending comparison on the given field name or
FieldPathexpression. - add(String, boolean) - Method in class com.northconcepts.datapipeline.core.SortingReader
-
Adds an ascending or descending sort on the given field name or
FieldPathexpression, after any fields already added. - add(String, boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- add(String, boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
- add(String, boolean, Boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
-
Appends a field in the given order, adding
NULLS FIRSTorNULLS LASTunlessnullsFirstis null. - add(String, boolean, Collator) - Method in class com.northconcepts.datapipeline.core.RecordComparator
-
Adds a comparison on the given field name or
FieldPathexpression that uses the collator for string values. - add(String, boolean, Collator) - Method in class com.northconcepts.datapipeline.core.SortingReader
-
Adds a sort on the given field name or
FieldPathexpression that uses the collator for string values, after any fields already added. - add(String, int) - Method in class com.northconcepts.datapipeline.filter.rule.PatternMatch
-
Adds a regular expression compiled with the given
Patternflags, such asPattern.CASE_INSENSITIVE. - add(String, ConvertNullToValueAction.FieldType, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
-
Replaces nulls in the field with the value converted to the given type, or evaluated for
EXPRESSION; a blank value is ignored. - add(String, AddFieldsAction.FieldType, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
-
Sets the field to the value converted to the given type, or evaluated for
EXPRESSION; for the other types a blank value sets a typed null. - add(String, CredentialsResolver) - Method in class com.northconcepts.datapipeline.security.CredentialsResolverRegistry
-
Registers the resolver under the given id, replacing any resolver already registered with that id.
- add(String, Class<?>, String) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Creates a new alias for a public, static method on the specified class.
- add(String, Object) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
-
Adds a column and its parameter value to the current (last) row.
- add(String, Object) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertRow
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.h2.Insert
-
Adds a column-value pair to the current row.
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.h2.InsertRow
-
Adds a column-value pair to this row.
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.h2.Upsert
-
Adds a column-value pair to the current row.
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.mysql.Insert
-
Adds a column value (an SQL literal, written as-is) to the current row; only the first row's column names are used.
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.mysql.InsertRow
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.mysql.Upsert
-
Adds a column value (an SQL literal, written as-is) to the current row; only the first row's column names are used.
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.postgresql.Insert
-
Adds a column value (an SQL literal, written as-is) to the current row; only the first row's column names are used.
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.postgresql.InsertRow
- add(String, Object) - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
-
Adds a column value (an SQL literal, written as-is) to the current row; only the first row's column names are used.
- add(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.AndPart
- add(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
- add(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.OrPart
- add(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
-
Appends a condition and its parameter values as a child part.
- add(String, String) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Creates a new alias for a fully-qualified, public, static method.
- add(String, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
-
Copies the source field to the target field, leaving the target unchanged if it already exists.
- add(String, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
-
Renames the source field to the target name; a blank or identical target leaves the field unchanged.
- add(String, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
-
Adds a sort field with the direction
"ascending"or"descending"; any other non-null value sorts descending, while null is not supported. - add(String, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
-
Sets the regular expression the field's whole value must match, replacing any previous pattern for it.
- add(String, String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
-
Requires each of the given fields to match the regular expression, replacing any pattern already set for them.
- add(String, String, boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
-
Copies the source field to the target field;
overwritereplaces an existing target instead of leaving it unchanged. - add(Collection<String>) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Appends all the fields in the specified collection to the end of this list.
- add(Collection<String>) - Method in class com.northconcepts.datapipeline.transform.RemoveFields
-
Adds more fields to remove; a null collection is ignored.
- add(Collection<String>) - Method in class com.northconcepts.datapipeline.transform.SelectFields
-
Appends fields to select, placed after those already added; a null collection is ignored.
- add(T) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Appends the node as a child and returns the added node.
- add(T) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
-
Appends the node as a child and returns the added node.
- add(T...) - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
- addAction(PipelineAction) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- addAction(PipelineAction) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
-
Appends a nested action and attaches it to this action's pipeline.
- addAction(PipelineAction) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
-
Appends an action, attaches it to this pipeline and clears the redo history.
- addAction(Integer, PipelineAction) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
-
Inserts a nested action at the given 0-based index (or appends it if the index is null) and attaches it to this action's pipeline.
- addAction(Integer, PipelineAction) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
-
Inserts an action at the given 0-based index (or appends it if the index is null), attaches it to this pipeline and clears the redo history.
- addAll(ArrayValue) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Appends cloned copies of all elements from the specified array to this array.
- addAll(DataReader) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- addAll(DataReader) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Writes all the records in the specified reader to the end of this list.
- addAll(RecordList) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Appends all the records in the specified
recordListto the end of this list. - addAll(Class<?>, boolean, String...) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Creates aliases either for all public, static methods on the specified class and superclass using their simple names (for example
java.lang.Math.abs()will be aliased asabs) or just the specified methods. - addAll(Collection<?>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Adds all elements from the specified collection to this array.
- addAll(Collection<? extends Number>) - Method in class com.northconcepts.datapipeline.jsonata.Utils.RangeList
- addAll(Collection<Record>) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Appends all the records in the specified collection to the end of this list.
- addAll(Collection<String>) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- addBatch() - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Adds the applied values to the batch; called instead of
IInsert.executeUpdate()when the writer is batching. - addBatch() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- addBatch() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- addBatch() - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- addBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- addBatch() - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Adds the applied values to the batch; called instead of
IUpsert.executeUpdate()when the writer is batching. - addBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- addBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- addBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- addBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- addBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- addBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- addBlacklistPrefix(String...) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Prevents methods whose fully-qualified name starts with any of the supplied prefixes from executing.
- addChild(int, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Inserts a new child with the given name at the 0-based index and returns the child.
- addChild(Diff<?>) - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
-
Adds a child diff, changing this diff's type from
DiffType.NONEtoDiffType.CHANGEDif the child is not NONE. - addChild(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Moves the node from its current parent to the end of this node's children and returns it.
- addChild(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Appends a new child with the given name and returns the child.
- addChildProperty(DiffType, String, Object, Object) - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
-
Adds a
PropertyDiffchild built from the arguments, updating this diff's type asDiff.addChild(Diff)does. - addColumn(JdbcQueryColumn) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- addColumn(JdbcTableColumn) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Adds the column and sets this as its table.
- addColumn(CreateTableColumn) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Adds a column to this table.
- addColumn(CreateTableColumn) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
- addColumn(CreateTableColumn) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
- addCommonPatterns() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
-
Adds the built-in common patterns (new detectors already have them); duplicates are ignored.
- addCondition(DecisionTableCondition) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- addCondition(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Adds a condition without a variable, so its expression should not use the
?placeholder. - addCondition(String, String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Adds a condition whose expression can use
?forvariable, as in? > 0. - addCondition(Collection<DecisionTableCondition>) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- addCondition(Collection<LogicalExpression>) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Adds conditions that must all be true for a record to be mapped; otherwise the result has no target record.
- addCondition(LogicalExpression) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Adds a condition that must be true for a record to be mapped; otherwise the result has no target record.
- addConfig(String, String) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Adds a parameter to the Hadoopused to read the file.
invalid reference
Configuration - addConfig(Map<String, String>) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Sets the Orc configuration parameters.
- addConfiguration(String, String) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Sets the Orc configuration parameters.
- addConfiguration(Map<String, String>) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Sets the Orc configuration parameters.
- addCustomField(String, Object) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
-
Sets a field, such as a custom field, in the issue's fields record, replacing any existing value.
- addDataCellStyle(FieldLocationPredicate, ExcelCellStyleDecorator) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Adds cell styles to data cells matching the specified predicate.
- addDataHyperlink(FieldLocationPredicate, ExcelHyperlinkFunction) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Adds hyperlinks to data cells matching the specified predicate.
- addDataMetadata(Record) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Attaches the hyperlinks and cell styles registered for data cells to the record's fields; called only when metadata writing is enabled.
- addDateRange(String, String) - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
-
Adds a date range to the report, such as
GoogleAnalyticsReportReader.DATE_30_DAYS_AGOtoGoogleAnalyticsReportReader.DATE_TODAY; must be called beforeGoogleAnalyticsReportReader.open(). - addDebug(String, boolean) - Method in class com.northconcepts.datapipeline.core.Messages
-
Adds a debug message, optionally capturing the caller's current stack trace.
- addDebug(String, Throwable) - Method in class com.northconcepts.datapipeline.core.Messages
-
Adds a debug message that carries the given exception.
- addDefaultOutcome(DecisionTableOutcome) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds an outcome used when no rule fires.
- addDefaultOutcome(String, String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds an outcome, used when no rule fires, that sets
variableto the value ofexpression. - addDefaultOutcome(Collection<DecisionTableOutcome>) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds outcomes used when no rule fires.
- addDimension(String) - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
-
Adds a dimension to the report; must be called before
GoogleAnalyticsReportReader.open(). - ADDED - Enum constant in enum class com.northconcepts.datapipeline.foundations.difference.DiffType
- addElapsedtime(long) - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Adds
timemilliseconds to the total returned byEndpoint.getElapsedTime(). - addEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Appends the entity and makes this schema its parent.
- addEntityRelationship(EntityRelationshipDef) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Appends the entity relationship and makes this schema its parent.
- addEventBusLifecycleListener(EventBusLifecycleListener) - Static method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Registers a listener notified, via the system event bus, when any event bus is created or begins shutting down.
- addExceptionListener(EventFilter, ExceptionListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Registers an exception listener that only receives the exception events the filter allows.
- addExceptionListener(ExceptionListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Registers a listener notified when a listener on this bus throws an exception while receiving an event.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.avro.AvroReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.avro.AvroWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.buffer.RecordBuffer
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.AbstractReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.AbstractWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.AsyncReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.AsyncTaskReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.BinaryWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.DataEndpoint
- addExceptionProperties(DataException) - Method in interface com.northconcepts.datapipeline.core.DataExceptionContributor
-
Adds this object's current state to a
DataException. - addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.DataObject
-
Adds this object's current state to a
DataException. - addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.DataReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.DataWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Adds this endpoint's current state to a
DataException. - addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.LimitReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.LinedTextWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.MultiWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.ParsingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.PipedReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.PipedWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.ProxyReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.ProxyWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.SequenceReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.SequenceWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.TextReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.TextWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.core.TimedReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.email.EmailReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.file.FileReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.file.FileWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.filter.FieldCount
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.filter.FieldExists
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.filter.FieldNotExists
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.filter.Filter
-
Adds this filter's settings to the given exception and returns it; subclasses override it to add their own.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.filter.FilteringReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.core.Bean
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
Adds this object's current state to a
DataException. - addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaFilter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.google.GoogleApiReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.group.Window
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfFollowedByReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfFollowsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfMediaReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.instagram.InstagramTagMediaReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.instagram.InstagramTagReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.instagram.InstagramUserMediaReader
- addExceptionProperties(DataException) - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Adds this strategy's details, such as the generated SQL, to the exception and returns it.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- addExceptionProperties(DataException) - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Adds this strategy's details, such as the generated SQL, to the exception.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jira.JiraEpicReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jira.JiraIssueReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jira.JiraProjectReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jira.JiraReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jira.JiraSprintReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jms.JmsConnection
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jms.JmsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jms.JmsSettings
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.jms.JmsWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.job.DataReaderIterator
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.json.JsonReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.json.JsonRecordWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.kafka.KafkaReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.kafka.KafkaWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.latex.LatexWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.memory.CollectionReader
-
Adds exception properties for debugging purposes.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.memory.TailProxyReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.meter.Meter
-
Adds this meter's count and timer state to the given exception and returns it.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.meter.MeteredReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.meter.MeteredWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.meter.RecordMeter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.openfinancialexchange.OpenFinancialExchangeReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.pdf.PdfReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.retry.RetryingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.security.DecryptingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.security.EncryptingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.shopify.ShopifyCustomerReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.shopify.ShopifyEventReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryItemReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryLevelReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.shopify.ShopifyOrderReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.shopify.ShopifyProductReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.texttable.TextTableWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.throttle.Throttle
-
Adds this throttle's limit, peak rate and meter state to the given exception and returns it.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.throttle.ThrottledReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.throttle.ThrottledWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.Operation
-
Adds this operation's details to an exception raised while it runs; returns the same exception.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.transform.FlattenRecord
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Adds this transformer's details to an exception raised by its host reader or writer; returns the same exception.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardCardsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardListsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.trello.TrelloCardWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.trello.TrelloListCardsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowerIDsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowerListReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowingIDsReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowingListReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterListOwnershipReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Returns the exception unchanged; subclasses can override to add provider details.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Returns the exception unchanged; subclasses can override to add provider details.
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter.TwitterWriter
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter2.TwitterFollowerReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter2.TwitterFollowingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter2.TwitterSearchReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.validate.ValidatingReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.xml.SimpleXmlReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
- addExceptionProperties(DataException) - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
- addExceptionProperties(DataException, String) - Method in interface com.northconcepts.datapipeline.core.DataExceptionContributor
-
Adds this object's current state to a
DataException. - addExceptionProperties(DataException, String) - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
-
Adds this sequence's index, start time and starting record count to the exception, under names prefixed with
name. - addExceptionPropertiesImpl(DataException) - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Adds this reader's own state, but not the nested reader's (it runs on another thread), to the exception; subclasses override this instead of the final
AsyncReader.addExceptionProperties(DataException). - addExceptionPropertiesImpl(DataException) - Method in class com.northconcepts.datapipeline.core.AsyncWriter
-
Adds this writer's own state, but not the nested writer's (it runs on another thread), to the exception; subclasses override this instead of the final
AsyncWriter.addExceptionProperties(DataException). - addExcludedFields(String...) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Adds fields to be removed from the target.
- addExcludedFields(Collection<String>) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Adds fields to be removed from the target.
- addExcludedTables(String...) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Adds names of tables to skip, matched exactly against unqualified table names.
- addExportedKey(JdbcExportedKey) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Adds the exported key and sets this as its table.
- addField() - Method in class com.northconcepts.datapipeline.core.Record
-
Adds a new, unnamed field to this record and returns it for further configuration.
- addField(int, FixedWidthAlign, char) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- addField(Field, Dataset) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Adds the field's value (or each array element) to this column's stats, inferring string types as configured on the dataset.
- addField(Record, Field, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Adds the field to the stats of its column, creating the column if needed; runs on a column stats worker thread.
- addField(Record, Field, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- addField(FixedWidthField) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- addField(FixedWidthField) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
-
Appends a column; each record written must have exactly one field per column, matched by position.
- addField(FixedWidthField) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- addField(FixedWidthField) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- addField(CalculatedField) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds a calculated field, evaluated before the rules and available to them as a variable.
- addField(CalculatedField) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Adds a calculated field, evaluated before the tree is walked and available to it as a variable.
- addField(FieldDef) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Appends the field and makes this entity its parent.
- addField(XmlField) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- addField(XmlField) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- addField(XmlField) - Method in class com.northconcepts.datapipeline.json.JsonReader
- addField(XmlField) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- addField(String) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageFields
- addField(String, int) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
-
Appends a left-aligned column that uses the reader's fill character.
- addField(String, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Appends a left-aligned column that uses the input's fill character.
- addField(String, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Appends a left-aligned column that uses the output's fill character.
- addField(String, int, FixedWidthAlign, char) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- addField(String, int, FixedWidthAlign, Character) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Appends a column with its own alignment and fill character; a null fill character uses the input's.
- addField(String, int, FixedWidthAlign, Character) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Appends a column with its own alignment and fill character (null uses the output's).
- addField(String, Object) - Method in class com.northconcepts.datapipeline.core.Record
-
Adds a new field with the specified value to this record.
- addField(String, Object) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
-
Deprecated.
- addField(String, Object, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Adds a new field with the specified value to this record.
- addField(String, String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds a calculated field that sets
variableto the value ofexpressionbefore the rules are evaluated. - addField(String, String) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Adds a calculated field that sets
variableto the value ofexpressionbefore the tree is walked. - addField(String, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- addField(String, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Adds a field read from the nodes matching a location path such as
/teachers/teacher/@memberid. - addField(String, String) - Method in class com.northconcepts.datapipeline.json.JsonReader
- addField(String, String) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Identifies a new field using XPath in the XML stream.
- addField(String, String, boolean) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- addField(String, String, boolean) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- addField(String, String, boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- addField(String, String, boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Adds a field; with
cascadeValuesits last value is carried into later records until the path matches again. - addField(String, String, boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
- addField(String, String, boolean) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Identifies a new field using XPath in the XML stream.
- addField(String, String, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- addField(String, String, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Adds a field whose last value is carried into later records until a node matching
cascadeResetLocationPathclears it; a blank reset path turns cascading off. - addField(String, String, String) - Method in class com.northconcepts.datapipeline.json.JsonReader
- addField(String, String, String) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Identifies a new field using XPath in the XML stream.
- addField(Collection<CalculatedField>) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds calculated fields, evaluated before the rules and available to them as variables.
- addField(Collection<CalculatedField>) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Adds calculated fields, evaluated before the tree is walked and available to it as variables.
- addFieldIndex(JdbcFieldIndex) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- addFieldMapping(IFieldMapping) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- addFieldMapping(String, String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- addFieldMapping(Collection<IFieldMapping>) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- addFields(int...) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
-
Appends unnamed, left-aligned columns of the given widths that use the reader's fill character.
- addFields(int...) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
-
Appends left-aligned columns of the given widths that use the writer's fill character.
- addFields(int...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Appends unnamed, left-aligned columns of the given widths that use the input's fill character.
- addFields(int...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Appends left-aligned columns of the given widths that use the output's fill character.
- addFields(String...) - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
- addFields(String...) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
- addFields(String...) - Method in class com.northconcepts.datapipeline.security.DecryptingReader
-
Adds fields to decrypt; only allowed before the reader is opened.
- addFields(String...) - Method in class com.northconcepts.datapipeline.security.EncryptingReader
-
Adds fields to encrypt; only allowed before the reader is opened.
- addFields(String...) - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
- addFields(String...) - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
- addFields(Collection<String>) - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
- addFields(Collection<String>) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
- addFields(Collection<String>) - Method in class com.northconcepts.datapipeline.security.DecryptingReader
-
Adds fields to decrypt; only allowed before the reader is opened.
- addFields(Collection<String>) - Method in class com.northconcepts.datapipeline.security.EncryptingReader
-
Adds fields to encrypt; only allowed before the reader is opened.
- addFields(Collection<String>) - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
- addFields(Collection<String>) - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
- AddFieldsAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A
PipelineActionthat sets fields on every record, replacing existing ones, to a typed constant or the result of an expression. - AddFieldsAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
- AddFieldsAction.FieldType - Enum Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
The type a field's value is converted to, or
EXPRESSIONto evaluate it as an expression. - AddFieldsAction.TypeValue - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A field's value and the type it is converted to.
- addFieldValue(Field, Object) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- addFirst(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.AndPart
- addFirst(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
- addFirst(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.OrPart
- addFirst(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
- addFirst(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.AndPart
- addFirst(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
- addFirst(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.OrPart
- addFirst(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
-
Inserts a condition and its parameter values as the first child part.
- addForeignKeyFieldNames(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Appends one foreign key field name; null is rejected.
- addHeaderCellStyle(FieldLocationPredicate, ExcelCellStyleDecorator) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Adds cell styles to header cells matching the specified predicate.
- addHeaderHyperlink(FieldLocationPredicate, ExcelHyperlinkFunction) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Adds hyperlinks to header cells matching the specified predicate.
- addHeaderMetadata(Record) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Attaches the hyperlinks and cell styles registered for header cells to the header record's fields; called only when metadata writing is enabled.
- addImport(JavaCodeBuilder, AddFieldsAction.TypeValue) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Adds the imports needed by the generated code for the given value.
- addImport(Class<?>) - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
-
Add an import for an individual class.
- addImport(Class<?>, boolean) - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
-
Add an import for an individual class or all all classes in the specified class' package (if
allClassesInPackageis true). - addImport(String) - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
-
Add an import for a package, package wildcard, or individual class.
- addImportedKey(JdbcImportedKey) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Adds the imported key and sets this as its table.
- addImports(JavaCodeBuilder, boolean, boolean, List<String>) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Adds a generated class's imports, and the interfaces it implements to
implementsList; the flags tell if the superclass is alreadySerializableorRecordSerializable. - addIndex(JdbcIndex) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Adds the index and sets this as its table.
- addIndex(IndexDef) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Appends the index and makes this entity its parent.
- addIndexField(IndexFieldDef) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Appends the index field and makes this index its parent.
- addIndexFields(String...) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Appends an ascending index field for each of the named entity fields; a null or empty array is ignored.
- addInsertValue(String, Object, boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
-
Adds a column and its parameter value to the INSERT clause, rendered as
column=?unlessisInsertis true. - addInsertValues(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
-
Adds columns with null parameter values to the INSERT clause.
- addIssueComment(String, String) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
- addJobLifecycleListener(JobLifecycleListener) - Static method in class com.northconcepts.datapipeline.job.Job
- addLabelIds(String...) - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.core.DataReader
-
Called by
DataReader.read()for each record fromDataReader.readImpl()while lineage is saved; the default copiesrecordLineageinto every field along with its original index and name. - addLineage(Record) - Method in class com.northconcepts.datapipeline.core.ParsingReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.core.TextReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.json.JsonReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.xml.SimpleXmlReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- addLineage(Record) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
- addListener(EventFilter, UntypedEventListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Deprecated.
- addListener(EventFilter, UntypedEventListener, Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Deprecated.
- addListener(UntypedEventListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Deprecated.
- addListener(Class<T>, EventFilter, T) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Subscribes a listener to the events of its listener interface that the filter allows (
nullallows all). - addListener(Class<T>, EventFilter, T, Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Subscribes a listener to the events of its listener interface that the filter allows and, unless
topicis null, that carry an equal topic. - addListener(Class<T>, T) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Subscribes a listener to every event of its listener interface, whatever the topic.
- addListMember(String, ListMember) - Method in interface com.northconcepts.datapipeline.mailchimp.MailChimpClient
-
Adds the member to the list and returns the response as raw JSON.
- addMessage(Message) - Method in class com.northconcepts.datapipeline.core.Messages
- addMessageHeader(Message, Record) - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Adds the message's JMS headers as
jms_*fields and each message property as ajms_property_prefixed field. - addMetric(String) - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
-
Adds a metric expression to the report; must be called before
GoogleAnalyticsReportReader.open(). - addMetric(String, String) - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
-
Adds a metric expression with an alias to the report; must be called before
GoogleAnalyticsReportReader.open(). - addNode(DecisionTreeNode) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Adds a child node, which must have a condition.
- addNode(Collection<DecisionTreeNode>) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Adds child nodes, which must all have conditions.
- addNodeNameRule(NodeNameRule) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Adds a rule that classifies node names as dynamic; a name is dynamic if any rule says so.
- addNotRule(FieldFilterRule) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the given rule to fail.
- addNull(int, FieldType) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Inserts a typed
nullvalue at the given index. - addNull(FieldType) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Adds a typed
nullvalue to this container. - addNull(FieldType) - Method in class com.northconcepts.datapipeline.core.Field
- addNull(FieldType) - Method in interface com.northconcepts.datapipeline.core.ValueNodeContainer
-
Adds a typed
nullvalue to this container. - addOrUpdateListMember(String, String, ListMember) - Method in interface com.northconcepts.datapipeline.mailchimp.MailChimpClient
-
Adds or updates the member with the given
subscriber hash; returns raw JSON. - addOutcome(DecisionTableOutcome) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- addOutcome(DecisionTreeOutcome) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- addOutcome(String, String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Adds an outcome that sets
variableto the value ofexpressionwhen the rule fires. - addOutcome(String, String) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Adds an outcome that sets
variableto the value ofexpressionwhen this node is visited. - addOutcome(Collection<DecisionTableOutcome>) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- addOutcome(Collection<DecisionTreeOutcome>) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- addPageToBuffer(<any>, LinkedList<User>) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowerListReader
- addPageToBuffer(<any>, LinkedList<User>) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowingListReader
- addPageToBuffer(<any>, LinkedList<User>) - Method in class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
- addPageToBuffer(<any>, LinkedList<UserList>) - Method in class com.northconcepts.datapipeline.twitter.TwitterListOwnershipReader
- addPageToBuffer(C, LinkedList<E>) - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
-
Appends the elements of a fetched page to the buffer of elements still to be returned.
- addPageToBuffer(IDs, LinkedList<Long>) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowerIDsReader
- addPageToBuffer(IDs, LinkedList<Long>) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowingIDsReader
- addParameter(JdbcQueryParameter) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Adds a parameter for the next
?placeholder in the query. - addParameter(String, Class<?>, Integer, String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Adds a parameter for the next
?placeholder;sqlTypeis ajava.sql.Typescode or null. - addParameter(String, Class<?>, String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Adds a parameter for the next
?placeholder with no SQL type, letting the driver infer it. - addPattern(DateTimePattern) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
-
Adds a pattern to try after the existing ones; duplicates are ignored.
- addPattern(String) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
-
Adds a case-insensitive
DateTimePatternto try after the existing ones; duplicates are ignored. - addProperty(Property) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Adds a property passed to the JDBC driver by
JdbcConnection.createConnection(). - addProperty(String, String) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageFooter
-
Adds a value to the named property, keeping any values it already has.
- addProperty(String, String) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageHeader
-
Adds a value to the named property, keeping any values it already has.
- addProperty(String, String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Adds a property passed to the JDBC driver by
JdbcConnection.createConnection(). - addQuery(JdbcQuery) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Adds the query and sets this as its connection.
- addQuery(String, String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Adds a named SQL query;
JdbcConnection.loadQueries()reads its result columns. - addRecord(Record) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageData
- addRecordBreak(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- addRecordBreak(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Adds a location path, such as
/object/users/array/object, whose matching nodes are each read as a record. - addRecordBreak(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Adds a location path, such as
/teachers/teacher, whose matching nodes delimit records. - addRecordBreak(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Adds a location path, such as
/teachers/teacher, whose matching elements are each read as a record. - addRecordBreak(String) - Method in class com.northconcepts.datapipeline.json.JsonReader
- addRecordBreak(String) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Adds a location path (for example
//array/object) matching the JSON objects, arrays or fields to read as records. - addRecordBreak(String) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Adds a location path (for example
//book); a record is completed each time a matching element ends. - addRecordBreak(String) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Adds a location path (for example
//book) whose matching elements are each read as one record. - addRecordBreakOnArray(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.OptimizeTreeStructure
-
Marks the node as a record break if its parent is a JSON array.
- addRegexNodeNameRule(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Adds a
RegexNodeNameRuleso names matching the whole-name regular expression collapse to wildcards. - addRows(int, boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
-
Appends
rowCountrows, each pre-filled with the previous row's columns and values ifcopyLastRowValuesis true. - addRule(FieldFilterRule...) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds rules that every checked field must pass for the record to be kept.
- addRule(DecisionTableRule) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds a rule after the existing ones; only the first rule whose conditions all hold fires.
- addRule(SiblingSetRule) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.CollapseSiblingPatterns
-
Adds a rule, consulted after the existing ones.
- addRule(String, String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
-
Adds a filter rule to be used for streaming Tweets.
- addRule(Collection<DecisionTableRule>) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds rules after the existing ones; only the first rule whose conditions all hold fires.
- addSchema(JdbcSchema) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- addSegmentRule(NodeNameRule) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.AffixSiblingSetRule
-
Adds a rule for classifying middle segments; all the middle segments of a pattern must satisfy the same rule.
- addShutdownListener(EventFilter, ShutdownListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Registers a listener notified when this bus begins shutting down; the filter may be
null. - addSingleValueWildcardChildField(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.OptimizeTreeStructure
-
Gives a childless, non-array wildcard node a child field, suffixed
_value, that reads the node's text. - addTable(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Adds the table and sets this as its connection.
- addToPath(DecisionTreeNode) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeResult
-
Appends a node to the path, throwing an exception if it is already in the path (a cycle).
- addTransformer(int, TreeTransformer) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Inserts a pass at the given 0-based position in the run order.
- addTransformer(TreeTransformer) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Appends a pass to run after the existing ones.
- addUntypedEventListener(EventFilter, UntypedEventListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Subscribes a listener to every event on this bus that the filter allows (
nullallows all). - addUntypedEventListener(EventFilter, UntypedEventListener, Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Subscribes a listener to every event on this bus that the filter allows and, unless
topicis null, that carries an equal topic. - addUntypedEventListener(UntypedEventListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Subscribes a listener to every event published on this bus, whatever its listener interface or topic.
- addUpdateValue(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
-
Adds a
column=?assignment with a null parameter value to the UPDATE SET clause. - addUpdateValue(String, Object, boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
-
Adds a column and its parameter value to the UPDATE SET clause, rendered as
column=?unlessisInsertis true. - addValidation(Filter) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Adds a filter that records must pass during validation; each rejected record gets an error.
- addValidation(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Adds a validation rule from a logical expression (parsed as a
FilterExpression) that records must satisfy. - addValue(int, FieldType, Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Inserts a value with the specified
FieldTypeat the given index, shifting subsequent elements to the right. - addValue(int, Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Inserts a value at the given index, inferring the
FieldTypefrom the value's class. - addValue(long, Object) - Method in class com.northconcepts.datapipeline.xml.XmlField
-
Records a value matched at the node with the given sequence number.
- addValue(FieldType, Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Adds a value with the specified
FieldTypeto this container. - addValue(FieldType, Object) - Method in class com.northconcepts.datapipeline.core.Field
-
Adds a value to this field, converting the value to the appropriate type if necessary.
- addValue(FieldType, Object) - Method in interface com.northconcepts.datapipeline.core.ValueNodeContainer
-
Adds a value with the specified
FieldTypeto this container. - addValue(Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Adds a value to this container, inferring the
FieldTypefrom the value's class. - addValue(Object) - Method in class com.northconcepts.datapipeline.core.Field
-
Adds a value to this container, inferring the
FieldTypefrom the value's class. - addValue(Object) - Method in interface com.northconcepts.datapipeline.core.ValueNodeContainer
-
Adds a value to this container, inferring the
FieldTypefrom the value's class. - addValue(Object) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Adds the value to the value count and the null, blank, length, sample and unique-value stats without inferring its type.
- addValue(Object) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
- addWarning(String, boolean) - Method in class com.northconcepts.datapipeline.core.Messages
-
Adds a warning, optionally capturing the caller's current stack trace.
- addWarning(String, Throwable) - Method in class com.northconcepts.datapipeline.core.Messages
-
Adds a warning that carries the given exception.
- addWhitelistPrefix(String...) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Prevents methods whose fully-qualified name starts with any of the supplied prefixes from executing.
- addXmlNode(XmlNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Counts one occurrence of the XML node at this path and records its XPath expression, value and attributes.
- adjustInventoryLevel(String, String, int) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
-
Changes the inventory item's available quantity at the location by
availableAdjustment. - adjustInventoryLevel(String, String, int) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
- AffixSiblingSetRule - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Derives a
SiblingSetPatternfrom siblings sharing a fixed prefix/suffix around a varying dynamic segment — for exampleitem-1,item-2,item-3collapse toitem-*. - AffixSiblingSetRule() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.AffixSiblingSetRule
-
Creates a rule that classifies middle segments with a
StandardNodeNameRule. - afterColumnStatsLoaded() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Called during the data loading process after all the column stats have been loaded.
- afterColumnStatsLoaded() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- afterColumnStatsLoaded() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- afterLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Called at the end of the data loading process after all the records and column stats have been loaded.
- afterLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- afterLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- afterLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- afterLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- afterRecordsLoaded() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Called during the data loading process after all the records have been loaded.
- afterSequenceCreated() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
-
Called once a new sequence's writer has been created and opened; does nothing by default.
- afterSequenceFinished() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
-
Called when a sequence ends -- after the next sequence's writer is created, or when this writer is closed; does nothing by default.
- AGGREGATE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- AggregateGroupFieldsAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.aggregate
-
A
PipelineActionthat groups records by the fields markedGROUPBYand aggregates the others (count, sum, average, first, last, minimum or maximum) using aGroupByReader. - AggregateGroupFieldsAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- AggregateGroupFieldsAction.GroupByField - Class in com.northconcepts.datapipeline.foundations.pipeline.action.aggregate
-
A source field and the operator applied to it: either a grouping key (
GROUPBY) or an aggregate written to the target field. - AggregateGroupFieldsAction.OperatorType - Enum Class in com.northconcepts.datapipeline.foundations.pipeline.action.aggregate
-
The operator applied to a
AggregateGroupFieldsAction.GroupByField:GROUPBYmarks a grouping key and the others are aggregates. - AggregateOperation(String, String) - Constructor for class com.northconcepts.datapipeline.group.AggregateReader.AggregateOperation
-
Deprecated.Creates an operation; its
name(such assum) andfieldNametogether identify it in the reader. - AggregateReader - Class in com.northconcepts.datapipeline.group
-
Deprecated.use
GroupByReaderinstead. GroupByReader provides the same functionality and can return continuous results - AggregateReader(DataReader) - Constructor for class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.
- AggregateReader.AggregateOperation - Class in com.northconcepts.datapipeline.group
-
Deprecated.Base class for the set functions an
AggregateReaderapplies to each record passing through it. - ALIVE - Enum constant in enum class com.northconcepts.datapipeline.core.Record.State
-
Record is in normal, unmodified state.
- ALIVE - Enum constant in enum class com.northconcepts.datapipeline.eventbus.EventBus.State
- all() - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches all field locations.
- ALL - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraSprintReader.SprintState
- ALL - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardFilter
- ALL - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardLists
- ALL - Enum constant in enum class com.northconcepts.datapipeline.trello.CardFilter
- ALL - Enum constant in enum class com.northconcepts.datapipeline.trello.ListFilter
- ALL_MAIL - Static variable in interface com.northconcepts.datapipeline.email.GmailFolders
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.FieldFilterRule
-
Returns true if the given field satisfies this rule; called by
FieldFilterwith each field it checks. - allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.Contains
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.DateIs
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.DateIsAfter
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.DateIsBefore
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.IsEmpty
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.IsFieldType
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.IsInstanceOfJavaType
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.IsJavaType
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.IsNotEmpty
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.IsNotNull
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.IsNull
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.NotRule
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.OrRule
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.PatternMatch
- allow(Field) - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
- allow(Record) - Method in class com.northconcepts.datapipeline.filter.FieldCount
- allow(Record) - Method in class com.northconcepts.datapipeline.filter.FieldExists
- allow(Record) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
- allow(Record) - Method in class com.northconcepts.datapipeline.filter.FieldNotExists
- allow(Record) - Method in class com.northconcepts.datapipeline.filter.Filter
-
Tests whether a record passes this filter.
- allow(Record) - Method in class com.northconcepts.datapipeline.filter.FilterExpression
- allow(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaFilter
- allow(Event<?>, Object) - Method in interface com.northconcepts.datapipeline.eventbus.EventFilter
-
Returns true to deliver the event to the given listener; called on the bus's delivery thread.
- allow(Event<?>, Object) - Method in class com.northconcepts.datapipeline.eventbus.filter.AndFilter
- allow(Event<?>, Object) - Method in class com.northconcepts.datapipeline.eventbus.filter.EventListenerClassFilter
- allow(Event<?>, Object) - Method in class com.northconcepts.datapipeline.eventbus.filter.EventSourceFilter
- allow(Event<?>, Object) - Method in class com.northconcepts.datapipeline.eventbus.filter.NotFilter
- allow(Event<?>, Object) - Method in class com.northconcepts.datapipeline.eventbus.filter.NullFilter
- allow(Event<?>, Object) - Method in class com.northconcepts.datapipeline.eventbus.filter.OrFilter
- allow(Event<?>, Object) - Method in class com.northconcepts.datapipeline.eventbus.filter.TopicFilter
- AmazonS3File - Class in com.northconcepts.datapipeline.amazons3
-
Base class for a file in Amazon S3, located by bucket name and path and accessed through an
AmazonS3FileSystemthat other files may share. - AmazonS3File() - Constructor for class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Creates a file with its own new
AmazonS3FileSystem. - AmazonS3File(AmazonS3FileSystem) - Constructor for class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Creates a file that uses the given file system, or a new one if it is
null. - AmazonS3FileSink - Class in com.northconcepts.datapipeline.amazons3
-
A
FileSinkthat writes an Amazon S3 object with a multipart upload through anAmazonS3FileSystem, connecting on demand if the file system is not open. - AmazonS3FileSink() - Constructor for class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- AmazonS3FileSource - Class in com.northconcepts.datapipeline.amazons3
-
A
FileSourcethat reads an Amazon S3 object through anAmazonS3FileSystem, connecting on demand if the file system is not open. - AmazonS3FileSource() - Constructor for class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- amazonS3FileSystem - Variable in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- AmazonS3FileSystem - Class in com.northconcepts.datapipeline.amazons3
-
Class for accessing an Amazon S3 file system.
- AmazonS3FileSystem() - Constructor for class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Constructs an Amazon S3 file system instance.
- AmazonS3FileSystem.CredentialsResolverBridge - Class in com.northconcepts.datapipeline.amazons3
-
Adapts the backend-neutral
CredentialsResolverseam to the AWS SDK'sso resolved credentials flow through the native client natively.invalid reference
AwsCredentialsProvider - AmazonS3Util - Class in com.northconcepts.datapipeline.amazons3
-
Static helpers that write and read object expiration rules in an S3 bucket's lifecycle configuration through an
S3ControlClient. - AmazonS3Util() - Constructor for class com.northconcepts.datapipeline.amazons3.AmazonS3Util
- ancestor - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- and(boolean, QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ANDs the part with the existing conditions (first if
firstis true) and returns the rootAndPart. - and(boolean, String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ANDs a condition with its parameter values (first if
firstis true) and returns the rootAndPart. - and(BufferStrategy...) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers if all of the supplied strategies request it.
- and(ExcelCellStyleDecorator) - Method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a composed decorator that applies this decorator and then the other decorator.
- and(CloseWindowStrategy...) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes windows if all of the supplied strategies request it.
- and(CreateWindowStrategy...) - Static method in class com.northconcepts.datapipeline.group.CreateWindowStrategy
-
Opens a new window if all of the supplied strategies request it.
- and(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ANDs the part after the existing conditions and returns the root
AndPart. - and(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ANDs a condition, such as
"id = ?", with its parameter values and returns the rootAndPart. - AndFilter - Class in com.northconcepts.datapipeline.eventbus.filter
-
Matches all filers -- filer A invalid input: '&'invalid input: '&' filer B invalid input: '&'invalid input: '&' filer C.
- AndFilter(EventFilter...) - Constructor for class com.northconcepts.datapipeline.eventbus.filter.AndFilter
- AndPart - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
A
ConjunctivePartthat joins its parts with AND. - AndPart() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.AndPart
- ANIMATED_GIFS_ARE_NOT_ALLOWED - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- ANY - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FulfillmentStatus
- ANY - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.OrderStatus
- ANY - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.PublishedStatus
- ApiLimitPolicy - Enum Class in com.northconcepts.datapipeline.twitter
-
Indicates the action to take when the Twitter API call limits are reached.
- append(Object, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Append second argument to first
- append(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Appends
suffixto each value, treating null values as empty strings. - APPEND - Enum constant in enum class com.northconcepts.datapipeline.core.Node.DuplicateNodeAction
-
Combines the fields into an array if either (or both) are either arrays or single valued fields, otherwise combines the fields into a single record.
- appendRow(List<Object>) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- APPLICATION_CANNOT_PERFORM_WRITE_ACTIONS - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- apply(double) - Method in class com.northconcepts.datapipeline.transform.format.Rounder
-
Rounds the value in double arithmetic; the UNNECESSARY policy returns it unchanged.
- apply(A, B, C) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn3
- apply(A, B, C, D) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn4
- apply(A, B, C, D, E) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn5
- apply(A, B, C, D, E, F) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn6
- apply(A, B, C, D, E, F, G) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn7
- apply(A, B, C, D, E, F, G, H) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn8
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- apply(DataReader) - Method in interface com.northconcepts.datapipeline.foundations.pipeline.action.DataReaderAction
-
Returns a reader that applies this action to the records of the given reader, usually by wrapping it.
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- apply(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- apply(Field) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.Operation
-
Applies this operation to the field, updating its value in place.
- apply(Field) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- apply(Record, Field) - Method in class com.northconcepts.datapipeline.group.GroupOperationField
-
Adds a record of the group to this result;
fieldis the record's source field or null if the operation has none. - apply(Tree) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Runs every
TreeTransformeragainst the supplied tree, in order. - apply(GroupByReader, AggregateGroupFieldsAction.GroupByField) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
-
Adds this operator's aggregate for the field to the reader; does nothing for
GROUPBY, whose fields are the reader's grouping keys. - apply(BasicFieldTransformer, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
-
Adds the operation that replaces nulls with the value, converted to this type, to the transformer.
- apply(TransformingReader, FieldPath, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Adds a transformer to the reader that sets the field to the value converted to this type, or to a typed null if the value is blank.
- apply(BigDecimal) - Method in class com.northconcepts.datapipeline.transform.format.Rounder
-
Returns the value with its scale set to the decimal places using this policy, or
nullfor null; HALF_ODD is not supported. - apply(BigInteger) - Method in class com.northconcepts.datapipeline.transform.format.Rounder
-
Rounds the value as a
BigDecimal, so only negative decimal places change it; returnsnullfor null. - applyCode(CodeWriter, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
-
Same as
ConvertStringToDateTimeAction.FieldType.applyCodeChain(CodeWriter, String), but indented one level. - applyCode(CodeWriter, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
-
Same as
ConvertStringToNumberAction.FieldType.applyCodeChain(CodeWriter, String), but indented one level. - applyCodeChain(CodeWriter, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
-
Writes this type's
BasicFieldTransformerconversion call for the pattern. - applyCodeChain(CodeWriter, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
-
Writes this type's
BasicFieldTransformerconversion call for the pattern. - applyDataMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Re-applies an existing DataMapping on the source dataset along with the existing sorting and page number.
- applyDataMapping(DataMapping) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Applies a new DataMapping on the source dataset along with the existing sorting and page number.
- applyDataProcessing(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Wraps the reader with the source entity transformer, this pipeline's own processing and the target entity transformer, in that order.
- applyDataProcessingImpl(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Wraps the reader with this pipeline's own processing; called between the source and target entity transformers.
- applyDataProcessingImpl(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- applyDataProcessingImpl(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.NullPipeline
- applyDataProcessingImpl(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- applyImpl(SingleValue) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
-
Returns the replacement for
input; returninputitself to leave it unchanged ornullto store a null ofreturnType. - applyImpl(SingleValue) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.StringOperation
- applyImpl(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.StringOperation
-
Returns the transformed string or
nullto store a null;valueisnullonly for operations that apply to nulls. - applyMethod(BasicFieldTransformer, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
-
Adds this type's string conversion, using the pattern, to the transformer.
- applyMethod(BasicFieldTransformer, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
-
Adds this type's string conversion, using the pattern if not blank, to the transformer.
- applyPagination() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Re-applies the existing sorting and page number to the existing mapped data from the source dataset.
- applyPagination(int) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Applies a new sorting and page number to the existing mapped data from the source dataset.
- applySourceEntityTransformer(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Wraps the reader to convert and validate records against the source entity, if one is set, in its own thread when multithreaded.
- applyTargetEntityTransformer(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Wraps the reader to convert and validate records against the target entity, if one is set, in its own thread when multithreaded.
- applyToArrayValue(ArrayValue, int, SingleValue) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
-
Applies
applyImplto the array element at the 0-basedindexand stores the result in the array. - applyToFieldValue(Field, SingleValue) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
-
Applies
applyImplto a field's single value and stores the result in the field. - applyToNullArray(ArrayValue) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- applyToNulls - Variable in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- AQUA - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- archived - Enum constant in enum class com.northconcepts.datapipeline.mailchimp.list.ListMemberStatus
- ARCHIVED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.ProductStatus
- ARCHIVED_DATE - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
- array() - Method in class com.northconcepts.datapipeline.json.builder.JsonArray
- array() - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- array() - Method in class com.northconcepts.datapipeline.json.builder.JsonDetailMarker
- array() - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Adds an anonymous array element and returns it; only arrays (and the template root) accept one.
- array() - Method in class com.northconcepts.datapipeline.json.builder.JsonTemplate
- array(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- array(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonDetailMarker
- array(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Adds an array-valued field and returns the new array; only valid on object nodes.
- array(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonObject
- ARRAY - Enum constant in enum class com.northconcepts.datapipeline.core.Node.NodeType
- ARRAY - Enum constant in enum class com.northconcepts.datapipeline.json.builder.JsonNodeType
- ArrayTemplateModel - Class in com.northconcepts.datapipeline.template
-
Exposes an
ArrayValueto FreeMarker templates as a sequence whose elements are wrapped by the object wrapper. - ArrayTemplateModel() - Constructor for class com.northconcepts.datapipeline.template.ArrayTemplateModel
- ArrayTemplateModel(ArrayValue, ObjectWrapper) - Constructor for class com.northconcepts.datapipeline.template.ArrayTemplateModel
- arrayTooLarge(String, Number, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- arrayTooSmall(String, Number, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- ArrayValue - Class in com.northconcepts.datapipeline.core
-
ArrayValue holds an ordered collection (also known as a sequence) of persistent data.
- ArrayValue() - Constructor for class com.northconcepts.datapipeline.core.ArrayValue
-
Creates a new empty array with an
FieldType.UNDEFINEDdefault type. - ArrayValue(FieldType) - Constructor for class com.northconcepts.datapipeline.core.ArrayValue
-
Creates a new empty array.
- ArrayValue(Object...) - Constructor for class com.northconcepts.datapipeline.core.ArrayValue
-
Creates a new array populated with the given objects.
- ARTICLE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- asArray(FieldType, Object) - Static method in class com.northconcepts.datapipeline.core.ValueNode
-
Wraps the given value as an
ArrayValue. - asArrayValue() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Casts this value node to an
ArrayValue. - asc(String) - Method in class com.northconcepts.datapipeline.core.SortingReader
-
Adds an ascending sort on the given field name or
FieldPathexpression, after any fields already added. - ASCENDING - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.SortDirection
- ASCII - Enum constant in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferType
-
Files to be transferred will be treated as ASCII.
- asRecord() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Casts this value node to a
Record. - assembleLine(Record, StringBuilder) - Method in class com.northconcepts.datapipeline.core.LinedTextWriter
-
Appends the record's output line, without a line terminator, to the empty buffer; also called for the header row (see
AbstractWriter.isHeaderRow()). - assembleLine(Record, StringBuilder) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
- assembleLine(Record, StringBuilder) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- assembleLine(Record, StringBuilder) - Method in class com.northconcepts.datapipeline.json.JsonLinesWriter
- assertAlive() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Asserts that this endpoint has started reading or writing, otherwise an exception is thrown.
- assertClosed() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Asserts that this endpoint has finished reading or writing, otherwise an exception is thrown.
- assertFn(boolean, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- assertNotAncestorOf(Node) - Method in class com.northconcepts.datapipeline.core.Node
-
Throws a
DataExceptionif the proposed parent is this node or one of its descendants, which would create a cycle. - assertNotOpened() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Asserts that this endpoint has not yet started reading or writing, otherwise an exception is thrown.
- assertOpened() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Asserts that this endpoint has started reading or writing, otherwise an exception is thrown.
- assertType(JsonNodeType, String) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Throws a
DataExceptionwith the given message unless this node is of the given type. - assertValid() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Throws a
DataExceptionif this file has noAmazonS3FileSystem. - assertValid() - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
Throws a
DataExceptionif this object is invalid, otherwise returns it; the base implementation checks nothing. - assertValid() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- assertValid() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- assertValid() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- assertValid() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- assertValid() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- assertValid() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- assertValid() - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- assertValid() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- assertValid() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- assertValid(Collection<? extends FoundationObject>) - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
Calls
FoundationObject.assertValid()on each of the given objects; a null collection is ignored. - assign(String, Object) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- asSingleValue() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Casts this value node to a
SingleValue. - ASTNode - Interface in com.northconcepts.datapipeline.expression
-
The public API for a node in the expression language's abstract syntax tree.
- AsymmetricDecryptingReader - Class in com.northconcepts.datapipeline.security
-
A
DecryptingReaderfor fields written by anAsymmetricEncryptingReader; it recovers the symmetric key from the first value it decrypts, using the private key, and uses it for all values. - AsymmetricDecryptingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
- AsymmetricDecryptingReader(DataReader, String, PrivateKey) - Constructor for class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
- AsymmetricEncryptingReader - Class in com.northconcepts.datapipeline.security
-
An
EncryptingReaderthat encrypts fields with a symmetric key and appends that key, encrypted with a public key, to every value after a-; read the values back with anAsymmetricDecryptingReader. - AsymmetricEncryptingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
- AsymmetricEncryptingReader(DataReader, String, PublicKey) - Constructor for class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
- AsyncMultiReader - Class in com.northconcepts.datapipeline.core
-
AsyncMultiReader reads from one or more source DataReaders asynchronously using a separate thread for each one.
- AsyncMultiReader(DataReader...) - Constructor for class com.northconcepts.datapipeline.core.AsyncMultiReader
- AsyncMultiReader.ReaderThread - Class in com.northconcepts.datapipeline.core
-
Thread that opens one source reader, copies its records into the
AsyncMultiReader's buffer and closes it. - AsyncReader - Class in com.northconcepts.datapipeline.core
-
A proxy that reads data asynchronously using a separate thread.
- AsyncReader(DataReader) - Constructor for class com.northconcepts.datapipeline.core.AsyncReader
- AsyncTaskReader - Class in com.northconcepts.datapipeline.core
-
A proxy that uses multiple threads to process incoming data, where the work applied to the incoming data is specified by the a
DataReaderDecorator. - AsyncTaskReader(DataReader, DataReaderDecorator, int) - Constructor for class com.northconcepts.datapipeline.core.AsyncTaskReader
-
Creates a new AsyncTaskReader to process incoming data using multiple threads.
- AsyncWriter - Class in com.northconcepts.datapipeline.core
-
A proxy that writes data asynchronously using a separate thread.
- AsyncWriter(DataWriter) - Constructor for class com.northconcepts.datapipeline.core.AsyncWriter
-
Creates an
AsyncWriterobject, with the givenDataWriterand default capacity of 500 records that can be queued. - AsyncWriter(DataWriter, int) - Constructor for class com.northconcepts.datapipeline.core.AsyncWriter
-
Creates an
AsyncWriterobject, with the givenDataWriterand maximum number of records that can be queued. - ATTACHMENT_URL_PARAMETER_IS_INVALID - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- attribute(String, String) - Method in class com.northconcepts.datapipeline.xml.builder.XmlElement
-
Adds an attribute whose name and value are expressions (quote literal text) and returns this element.
- Attributes - Class in com.northconcepts.datapipeline.foundations.core
-
User-defined name-value pairs that attach arbitrary metadata to schema, entity, relationship and field definitions; kept sorted by name.
- Attributes() - Constructor for class com.northconcepts.datapipeline.foundations.core.Attributes
- AUTHORIZATION_FAILURE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- AUTHORIZATION_PENDING - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- AUTHORIZATION_SUCCESS - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- AUTHORIZED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
- AUTO - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.PrimaryKeyType
- AUTO - Enum constant in enum class com.northconcepts.datapipeline.jms.JmsAcknowledgeMode
- AUTOMATIC - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- available() - Method in class com.northconcepts.datapipeline.core.AsyncReader
- available() - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- available() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Returns the number of records that can probably be read without blocking.
- available() - Method in class com.northconcepts.datapipeline.core.DataWriter
-
Returns the number of records that can probably be written without blocking.
- available() - Method in class com.northconcepts.datapipeline.core.ParsingReader
- available() - Method in class com.northconcepts.datapipeline.core.PipedReader
- available() - Method in class com.northconcepts.datapipeline.core.ProxyReader
- available() - Method in class com.northconcepts.datapipeline.core.ProxyWriter
- available() - Method in class com.northconcepts.datapipeline.core.SequenceReader
- available() - Method in class com.northconcepts.datapipeline.core.TextReader
- available() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
- available() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset.ColumnsDataReader
- available() - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- available() - Method in class com.northconcepts.datapipeline.job.DataReaderIterator
- available() - Method in class com.northconcepts.datapipeline.memory.MemoryReader
- AvailableCapacityWriteStrategy() - Constructor for class com.northconcepts.datapipeline.core.MultiWriter.AvailableCapacityWriteStrategy
- average(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Adds an operation averaging the field's non-null values as a
Double(NaN if there are none). - average(List<Number>) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Average function
- AVERAGE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
- avg(FieldPath, FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the average of the source field as a
BigDecimalwith 5 decimal places (HALF_UP), written to the target field; null values count as zero. - avg(FieldPath, FieldPath, int, RoundingMode) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the average of the source field rounded to
scaledecimal places, written to the target field; null values count as zero. - avg(String, String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the average of the source field as a
BigDecimalwith 5 decimal places (HALF_UP), written to the target field; null values count as zero. - avg(String, String, int, RoundingMode) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the average of the source field rounded to
scaledecimal places, written to the target field; null values count as zero. - AVRO - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- AVRO_SCHEMA - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- AvroPipelineInput - Class in com.northconcepts.datapipeline.avro.pipeline.input
-
A pipeline input that reads Apache Avro data from a
FileSourceusing anAvroReader. - AvroPipelineInput() - Constructor for class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- AvroPipelineOutput - Class in com.northconcepts.datapipeline.avro.pipeline.output
-
A pipeline output that writes Apache Avro data to a
FileSinkusing anAvroWriter. - AvroPipelineOutput() - Constructor for class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- AvroReader - Class in com.northconcepts.datapipeline.avro
-
Read an Apache Avro file and convert the contents into
Records. - AvroReader(File) - Constructor for class com.northconcepts.datapipeline.avro.AvroReader
-
Read an Avro file.
- AvroReader(InputStream) - Constructor for class com.northconcepts.datapipeline.avro.AvroReader
-
Read a stream of Avro data.
- AvroWriter - Class in com.northconcepts.datapipeline.avro
-
Write
Recordsto an Apache Avro file. - AvroWriter(File, DataWriter) - Constructor for class com.northconcepts.datapipeline.avro.AvroWriter
-
Write Avro data to the specified file.
- AvroWriter(OutputStream, DataWriter) - Constructor for class com.northconcepts.datapipeline.avro.AvroWriter
-
Write Avro data to an
OutputStream.
B
- B4 - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- B5 - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- backgroundColor(ExcelColor) - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that sets the background color.
- backgroundColor(ExcelColorPalette) - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that sets the background color using a palette color.
- BACKWARD - Enum constant in enum class com.northconcepts.datapipeline.email.EmailReadDirection
- BACKWARD - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterPageableReader.Direction
- BAD_AUTHENTICATION_DATA - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- base64decode(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Base64 decode a string
- base64encode(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Base64 encode a string
- BasicFieldTransformer - Class in com.northconcepts.datapipeline.transform
-
See
FieldPathfor supported field name expressions. - BasicFieldTransformer(String) - Constructor for class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- BasicFieldTransformer(String...) - Constructor for class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- BasicFieldTransformer(Collection<String>) - Constructor for class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- BasicFieldTransformer.Operation - Class in com.northconcepts.datapipeline.transform
-
A named step that a
BasicFieldTransformerapplies to each of its fields. - BasicFieldTransformer.SingleValueOperation - Class in com.northconcepts.datapipeline.transform
-
An
BasicFieldTransformer.Operationapplied to each single value in a field, including array elements and values in nested records. - BasicFieldTransformer.StringOperation - Class in com.northconcepts.datapipeline.transform
-
A
BasicFieldTransformer.SingleValueOperationthat transforms the string form of each value into a new string. - BasicLookup - Class in com.northconcepts.datapipeline.transform.lookup
-
An in-memory
Lookupfilled withaddcalls, where each key maps to one or more result records. - BasicLookup(FieldList) - Constructor for class com.northconcepts.datapipeline.transform.lookup.BasicLookup
-
Creates an empty lookup whose result records have the given fields, filled in order from the values passed to
add. - batchedInserts - Variable in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
- batchedInserts - Variable in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- batchedInserts - Variable in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- batchSize - Variable in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
- batchSize - Variable in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- batchSize - Variable in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- Bean - Class in com.northconcepts.datapipeline.foundations.core
-
Base class for Java beans wishing to participate in Java, Record, XML, and JSON serialization; adding their properties to DataException; and having a dynamic toString().
- Bean() - Constructor for class com.northconcepts.datapipeline.foundations.core.Bean
- beforeLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Called at the start of the data loading process, but before any records or column stats have been loaded.
- beforeLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- beforeLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- beforeLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- beforeLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- beforeSequenceCreated() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
-
Called before the factory creates the writer for a new sequence; does nothing by default.
- BEST_FIT - Enum constant in enum class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset.FieldTypeSelectionMode
- BEST_FIT_INFERRED - Enum constant in enum class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset.FieldTypeSelectionMode
- bestRowIdentifiersLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- BIG_DECIMAL - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- BIG_INTEGER - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- BIGDECIMAL - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- BIGDECIMAL - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
- BIGDECIMAL - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- BIGINT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- BIGINT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- BIGINT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- BIGINTEGER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- BIGINTEGER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
- BIGINTEGER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- BIGSERIAL - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- BINARY - Enum constant in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferType
-
Files to be transferred will be treated as a binary image, i.e..
- BINARY - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- BINARY - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- BINARY - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- binaryFieldAllowedValuesNotSupported() - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- BinaryFieldDef - Class in com.northconcepts.datapipeline.foundations.schema
-
A
FieldDeffor binary (byte[]) values with optional minimum and maximum lengths; allowed values are not supported. - BinaryFieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- BinaryFieldDef(String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- BinaryFieldDef(String, FieldType) - Constructor for class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- BinaryWriter - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for writing records to a binary stream.
- BinaryWriter(File) - Constructor for class com.northconcepts.datapipeline.core.BinaryWriter
-
Creates a writer to the given file, which is created (or truncated) immediately rather than when the writer is opened.
- BinaryWriter(OutputStream) - Constructor for class com.northconcepts.datapipeline.core.BinaryWriter
-
Creates a writer to the given stream, wrapped in a
BufferedOutputStreamunless it already is one; the stream is closed when this writer is closed. - bind(String, Jsonata.Fn0<R>) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- bind(String, Jsonata.Fn1<A, R>) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- bind(String, Jsonata.Fn2<A, B, R>) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- bind(String, Jsonata.JFunction) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- bind(String, Object) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- BIT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- BIT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- BIT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- BIT_VARYING - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- BLACK - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- BLACK1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- blankTextIsNotAllowed(String, int) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- BLOB - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- BLOB - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- BLOB - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- BLOCK - Enum constant in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferMode
-
Transfer files as a series of blocks.
- BLOG - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- BloombergMessage - Class in com.northconcepts.datapipeline.bloomberg
-
A Bloomberg message parsed by
BloombergMessage.parse(Reader)into its header, field list, data records and footer. - BloombergMessage() - Constructor for class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- BloombergMessageData - Class in com.northconcepts.datapipeline.bloomberg
-
The data section of a
BloombergMessage, holding one record per data line. - BloombergMessageData() - Constructor for class com.northconcepts.datapipeline.bloomberg.BloombergMessageData
- BloombergMessageFields - Class in com.northconcepts.datapipeline.bloomberg
- BloombergMessageFields() - Constructor for class com.northconcepts.datapipeline.bloomberg.BloombergMessageFields
- BloombergMessageFooter - Class in com.northconcepts.datapipeline.bloomberg
-
The
name=valueproperties that follow the data section of aBloombergMessage; a name can have several values. - BloombergMessageFooter() - Constructor for class com.northconcepts.datapipeline.bloomberg.BloombergMessageFooter
- BloombergMessageHeader - Class in com.northconcepts.datapipeline.bloomberg
-
The
name=valueproperties that precede the data section of aBloombergMessage; a name can have several values. - BloombergMessageHeader() - Constructor for class com.northconcepts.datapipeline.bloomberg.BloombergMessageHeader
- BloombergMessageReader - Class in com.northconcepts.datapipeline.bloomberg
-
Reads the data records of a Bloomberg message; the whole message is parsed into memory on open and stays available from
BloombergMessageReader.getMessage(). - BloombergMessageReader(File) - Constructor for class com.northconcepts.datapipeline.bloomberg.BloombergMessageReader
- BloombergMessageReader(Reader) - Constructor for class com.northconcepts.datapipeline.bloomberg.BloombergMessageReader
-
Creates a reader for the message in the given stream;
BloombergMessageReader.open()parses and closes the stream, so this reader can be opened only once. - BLUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- BLUE_GREY - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- BLUE1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- BoardFilter - Enum Class in com.northconcepts.datapipeline.trello
-
Selects which boards
TrelloBoardsReaderreads;toString()gives the lowercase value sent to Trello. - BoardLists - Enum Class in com.northconcepts.datapipeline.trello
-
Selects which of each board's lists
TrelloBoardsReaderrequests;toString()gives the lowercase value sent to Trello. - bold() - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that makes text bold.
- BOOL - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- BOOL - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- BOOL - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- BOOLEAN - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- BOOLEAN - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- BOOLEAN - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- BOOLEAN - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- BOOLEAN - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- BOOLEAN - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- BooleanFieldDef - Class in com.northconcepts.datapipeline.foundations.schema
-
A
FieldDeffor boolean values. - BooleanFieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- BooleanFieldDef(String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- BooleanFieldDef(String, FieldType) - Constructor for class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- boolize(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- BOX - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- BRIGHT_GREEN - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- BRIGHT_GREEN1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- BROADCAST - Enum constant in enum class com.northconcepts.datapipeline.multiplex.DeMux.Strategy
-
Sends a copy of each record to every downstream reader.
- BROADCAST - Enum constant in enum class com.northconcepts.datapipeline.multiplex.SplitWriter.Strategy
-
Sends a copy of each record to every downstream reader.
- BROWN - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- bsonDocumentToRecord(BsonDocument) - Static method in class com.northconcepts.datapipeline.mongodb.MongoTypeConverter
-
Converts a BSON document to a record with one field per key, converting nested documents and arrays recursively.
- bsonValueToValueNode(BsonValue) - Static method in class com.northconcepts.datapipeline.mongodb.MongoTypeConverter
-
Converts a BSON value to a value node (null for a BSON null); documents become records and object IDs become strings.
- bucketName - Variable in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- buffer - Variable in class com.northconcepts.datapipeline.core.AsyncMultiReader
- buffer - Variable in class com.northconcepts.datapipeline.security.EncryptingReader
- BUFFER_SIZE - Static variable in class com.northconcepts.datapipeline.core.Endpoint
- BUFFER_SIZE - Static variable in class com.northconcepts.datapipeline.pdf.PdfWriter
- BufferedReader - Class in com.northconcepts.datapipeline.buffer
-
A proxy that organizes incoming data by collecting records of the same type (using values in a subset of fields) to release them downstream together.
- BufferedReader(DataReader, int, FieldList) - Constructor for class com.northconcepts.datapipeline.buffer.BufferedReader
-
Creates a reader that groups records by the values of the given fields; a background thread reads up to
queueSizerecords ahead from the nested reader. - BufferedReader(DataReader, int, String...) - Constructor for class com.northconcepts.datapipeline.buffer.BufferedReader
-
Creates a reader that groups records by the values of the given fields; a background thread reads up to
queueSizerecords ahead from the nested reader. - BufferStrategy - Class in com.northconcepts.datapipeline.buffer
-
Determines when
BufferedReadercloses an open sliding buffer. - BufferStrategy() - Constructor for class com.northconcepts.datapipeline.buffer.BufferStrategy
- build() - Method in class com.northconcepts.datapipeline.security.Credentials.Builder
-
Returns new credentials holding copies of the values set so far.
- buildDetail(Record, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonTemplate
-
Writes the detail marker's nodes for the given record; throws a
DataExceptionifJsonTemplate.buildHeader(JsonGenerator)found no detail marker. - buildDetail(Record, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlTemplate
-
Writes the detail marker's nodes for the given record; throws a
DataExceptionifXmlTemplate.buildHeader(CodeWriter)found no detail marker. - builder() - Static method in class com.northconcepts.datapipeline.security.Credentials
-
Creates a builder for assembling credentials one key at a time, with an optional expiry.
- buildFooter(JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonTemplate
-
Writes the nodes after the detail marker, closing the objects and arrays the header opened.
- buildFooter(CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlTemplate
-
Writes the nodes after the detail marker, closing the elements the header opened.
- buildHeader(JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonTemplate
-
Writes the nodes that come before the detail marker; call it once before writing records.
- buildHeader(CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlTemplate
-
Writes the declaration and the nodes that come before the detail marker; call it once before writing records.
- buildSql(JdbcWriter, Record, int) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
-
Returns the INSERT SQL with
rowCountrows of?placeholders, using the record's field names as columns. - BYTE - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- BYTE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- BYTE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
- BYTE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- BYTEA - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- BYTES - Enum constant in enum class com.northconcepts.datapipeline.meter.RecordMeter.MeterUnit
- bytesToUuid() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts 16-byte values (most significant bits first) to UUIDs; other lengths cause an exception.
C
- CachedLookup - Class in com.northconcepts.datapipeline.transform.lookup
-
A
Lookupthat lazily caches the results of successful lookups performed by another instance. - CachedLookup(Lookup) - Constructor for class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Creates a new CachedLookup that has no limit and never clears itself.
- CachedLookup(Lookup, int) - Constructor for class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Creates a new limited CachedLookup that never clears itself.
- CachedLookup(Lookup, Integer, Scheduler) - Constructor for class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Creates a new CachedLookup.
- cacheFieldIndexes - Variable in class com.northconcepts.datapipeline.core.RecordComparator
- cacheNextLine() - Method in class com.northconcepts.datapipeline.core.LineParser
- CachingCredentialsResolver - Class in com.northconcepts.datapipeline.security
-
A
CredentialsResolverdecorator that caches its delegate's credentials, re-fetching when: the cached credentials report expiry withinCachingCredentialsResolver.getExpirySkewMilliseconds()(seeCredentials.isExpired(long)), the optional time-to-live has elapsed, orCachingCredentialsResolver.refresh()is called. Gives rotation with backpressure — remote secret stores are only called when needed. - CachingCredentialsResolver(CredentialsResolver) - Constructor for class com.northconcepts.datapipeline.security.CachingCredentialsResolver
-
Caches the delegate's credentials until they expire or
CachingCredentialsResolver.refresh()is called. - CachingCredentialsResolver(CredentialsResolver, long) - Constructor for class com.northconcepts.datapipeline.security.CachingCredentialsResolver
-
Caches the delegate's credentials for at most
timeToLiveMilliseconds(zero for no time-to-live). - CalculatedField - Class in com.northconcepts.datapipeline.foundations.expression
-
A variable computed from an expression before a decision table or tree evaluates its rules; the result is stored in the expression context under the variable's name.
- CalculatedField() - Constructor for class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- CalculatedField(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.expression.CalculatedField
-
Creates a field that is not included in the outcome.
- CalculatedField(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- call(Class, Object, String, List<Object>) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- call(Object, Method, List<Object>) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- call(Object, List) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.JFunction
- call(Object, List) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.JFunctionCallable
- call(Callable<T>) - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Calls the callable, retrying failures with the strategy's delays for up to
RetryingOperation.getMaxRetryCount()attempts in total; rethrows the last exception if none succeeds or the retry predicate declines. - callback(Parser.Symbol, Object, Jsonata.Frame) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.EntryCallback
- callback(Parser.Symbol, Object, Jsonata.Frame, Object) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.ExitCallback
- cancel() - Method in class com.northconcepts.datapipeline.job.AbstractJob
- cancel() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Interrupts the run thread and cancels the child job; does nothing unless this job is running and not yet cancelled.
- cancel() - Method in class com.northconcepts.datapipeline.job.Job
- CANCELLED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- CANCELLED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.OrderStatus
- cancelLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Gracefully terminate the asynchronous data loading and column stats calculation, waiting up to 10 seconds in total.
- CANNOT_MUTE_YOURSELF - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- CANNOT_REPORT_YOURSELF_FOR_SPAM - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- canonicalizeNodeName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Returns the node name used to key tree nodes while the tree is being built: the XPath wildcard (
*) whenoptimizeTreeStructureis set and anyNodeNameRuleclassifies the name as dynamic, otherwise the name unchanged. - CAPTURE_FAILURE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- CAPTURE_PENDING - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- CAPTURE_SUCCESS - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- captureElapsedTime - Static variable in class com.northconcepts.datapipeline.core.Endpoint
- CardFilter - Enum Class in com.northconcepts.datapipeline.trello
-
Selects which cards
TrelloBoardCardsReaderandTrelloBoardListsReaderrequest;toString()gives the lowercase value sent to Trello. - CASCADE - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
- CASCADE - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.ForeignKeyAction
- CASCADE - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.ForeignKeyAction
- CASCADE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.ForeignKeyAction
- CATEGORY - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
- ceil(Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Rounds a number up to integer
- CEILING - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
Behaves the same as
UPif the value is positive orDOWNif the value is negative. - CHANGED - Enum constant in enum class com.northconcepts.datapipeline.foundations.difference.DiffType
- CHAR - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- CHAR - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- CHAR - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- CHAR - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- CHARACTER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- CHARACTER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- CHARACTER - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- CHARACTER_VARYING - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- characteristics() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetSpliterator
- checkChildren(List<SchemaProblem>, List<T>, boolean) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds each child's problems, including those of its descendants if requested; a null list is ignored.
- checkCyclicalFieldDependency(List<SchemaProblem>, RecordFieldDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the entity referenced by the record field refers back to itself, directly or through other record fields.
- checkEntitiesExists(List<SchemaProblem>, SchemaDef, SchemaPart, String, List<String>) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem for each name with no matching entity in the schema; nothing is checked when the schema or the list is null.
- checkEntityExists(List<SchemaProblem>, SchemaDef, SchemaPart, String, String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the schema is not null and has no entity with the given name.
- checkEntityExistsInRelationship(List<SchemaProblem>, SchemaDef, SchemaPart, String, String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the entity name is empty or the schema, when not null, has no entity with that name.
- checkEntityRelationshipCardinality(List<SchemaProblem>, EntityRelationshipDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the relationship has no cardinality or its foreign key fields contradict it, such as a one-to-one foreign key field that is not part of the foreign entity's primary key.
- checkEntityRelationshipKeys(List<SchemaProblem>, EntityRelationshipDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the primary entity has no primary key or the foreign key fields differ from it in count, existence or type.
- checkFieldExists(List<SchemaProblem>, SchemaPart, EntityDef, String, String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the entity is not null and neither it nor its super entities have a field with the given name.
- checkFieldsExists(List<SchemaProblem>, SchemaPart, EntityDef, String, List<String>) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem for each name with no matching field in the entity or its super entities; nothing is checked when the entity or the list is null.
- checkIndexHasFields(List<SchemaProblem>, SchemaPart, List<T>, boolean, String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the index has no fields (
childrenis null or empty). - checkMinimumAndMaximumValues(List<SchemaProblem>, SchemaPart, Number, Number, String, String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds the same problems as the overload taking
negativeNumberAllowed, with negative numbers disallowed. - checkMinimumAndMaximumValues(List<SchemaProblem>, SchemaPart, Number, Number, String, String, boolean) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if both values are set and their classes differ, the minimum exceeds the maximum or, unless
negativeNumberAllowedis true, either is a negative Integer or Long. - checkMinimumAndMaximumValues(List<SchemaProblem>, SchemaPart, TemporalAccessor, TemporalAccessor, String, String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if both values are set but of different classes; the minimum is not compared to the maximum.
- checkNameExists(List<DataMappingProblem>, DataMappingPart, String, String) - Static method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingValidator
-
Adds a problem, naming the value
identifierName, ifidentifieris null or empty. - checkNegativeValue(List<SchemaProblem>, SchemaPart, Number, String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
- checkParentExists(List<SchemaProblem>, SchemaPart, String, SchemaObject) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
- checkPrecisionAndScale(List<SchemaProblem>, SchemaPart, Integer, Integer, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the precision is negative, an integer type has a positive scale or the absolute scale exceeds the precision.
- checkPrimaryKeyPositions(List<SchemaProblem>, EntityDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the entity's primary key positions are not the consecutive 0-based sequence 0, 1, 2 and so on.
- checkUniqueChildNames(List<DataMappingProblem>, DataMappingPart, String, List<T>, Function<T, String>) - Static method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingValidator
-
Adds a problem for each non-empty name that
nameExtractorreturns for more than one child. - checkUniqueChildNames(List<SchemaProblem>, SchemaPart, String, List<T>, Function<T, String>) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem for each non-empty name shared by more than one child, comparing names case-sensitively.
- checkUniqueIndexFieldNames(List<SchemaProblem>, SchemaPart, List<IndexDef>) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem for each list of field names, in the same order, shared by more than one index.
- checkUrl(String) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- checkValidCondition(List<DataMappingProblem>, DataMappingPart, String, LogicalExpression) - Static method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingValidator
- checkValidExpression(List<DataMappingProblem>, DataMappingPart, String, Expression) - Static method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingValidator
-
Adds a problem if
expressionis an unparsable expression kept by lenient parsing, such as when a field mapping is loaded from JSON or XML. - checkValidIdentifier(List<SchemaProblem>, SchemaPart, String, String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
-
Adds a problem if the identifier is empty or does not start with a letter, underscore, at sign or dollar sign.
- CIDR - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- cipher - Variable in class com.northconcepts.datapipeline.security.DecryptingReader
- cipher - Variable in class com.northconcepts.datapipeline.security.EncryptingReader
- CIRCLE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- classNameAndSignedParametersLoaded(JdbcConnection, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
-
Called after the class name, signedness and Java type of every table's columns are resolved.
- cleaned - Enum constant in enum class com.northconcepts.datapipeline.mailchimp.list.ListMemberStatus
- cleanupGarbage() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Removes the listeners whose soft references were garbage collected; called after each delivery.
- clear() - Method in class com.northconcepts.datapipeline.core.FieldList
-
Removes all the fields from this list.
- clear() - Method in class com.northconcepts.datapipeline.core.RecordList
- clear() - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- clear() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
- clear() - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.
- clear() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
- clear() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryGrouping
- clear() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
- clear() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- clear() - Method in class com.northconcepts.datapipeline.security.Credentials
-
Overwrites all secret values with zeros and empties this bundle.
- clear() - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Removes all cached results; the hit and miss counts are not reset.
- clearCurrent() - Static method in class com.northconcepts.datapipeline.core.Messages
-
Removes the thread-local instance if one exists.
- clearFileSize() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Forgets the kept file size so the next
AmazonS3File.getFileSize()looks it up in S3 again. - clearHaving() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- clearLimit() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- clearNodeNameRules() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Removes all node name rules, including the default
StandardNodeNameRule. - clearPatterns() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
- clearRules() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.CollapseSiblingPatterns
-
Removes all rules, including the default
AffixSiblingSetRule. - clearSegmentRules() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.AffixSiblingSetRule
-
Removes all segment rules, including the default
StandardNodeNameRule. - clearTransformers() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Removes all passes, including the standard detection passes.
- clearWhere() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- client - Variable in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
- CLIENT - Enum constant in enum class com.northconcepts.datapipeline.jms.JmsAcknowledgeMode
- clone() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a deep copy of this array, cloning every element.
- clone() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- clone() - Method in class com.northconcepts.datapipeline.core.FieldComparator
- clone() - Method in class com.northconcepts.datapipeline.core.FieldDeclarations
- clone() - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns a new FieldList that is a copy of this FieldList.
- clone() - Method in class com.northconcepts.datapipeline.core.Record
- clone() - Method in class com.northconcepts.datapipeline.core.RecordComparator
- clone() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns a new RecordList that is a copy of this RecordList.
- clone() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns a deep copy of this single value.
- clone() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns a deep copy of this value node.
- clone() - Method in class com.northconcepts.datapipeline.core.ValueNodeComparator
- clone() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
- clone() - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
- clone() - Method in class com.northconcepts.datapipeline.excel.ExcelFont
- clone() - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
- clone() - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- clone() - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
- clone() - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- clone() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- clone() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- clone() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- clone() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- clone() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- clone() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
- clone() - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Returns a new, unprepared copy with the same settings;
JdbcMultiWriteruses one for each connection. - clone() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.insert.MySqlPreparedStatementInsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowInsertAllStatementInsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowSelectUnionAllStatementInsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- clone() - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Returns a new, unprepared copy with the same settings;
JdbcMultiUpsertWriteruses one for each connection. - clone() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- clone() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- clone() - Method in class com.northconcepts.datapipeline.job.AbstractJob
- clone() - Method in class com.northconcepts.datapipeline.job.Job
- clone(T) - Static method in class com.northconcepts.datapipeline.jsonata.Parser
- close() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Closes the Amazon S3 connection — or, while a source or sink stream or a size lookup is still using it, as soon as the last of them finishes.
- close() - Method in class com.northconcepts.datapipeline.avro.AvroReader
- close() - Method in class com.northconcepts.datapipeline.avro.AvroWriter
- close() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
- close() - Method in class com.northconcepts.datapipeline.buffer.RecordBuffer
- close() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
- close() - Method in class com.northconcepts.datapipeline.core.AsyncReader
- close() - Method in class com.northconcepts.datapipeline.core.AsyncTaskReader
- close() - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- close() - Method in class com.northconcepts.datapipeline.core.BinaryWriter
- close() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Indicates that this endpoint has finished reading or writing.
- close() - Method in class com.northconcepts.datapipeline.core.DataEndpointGroup
- close() - Method in class com.northconcepts.datapipeline.core.DebugReader
- close() - Method in class com.northconcepts.datapipeline.core.DebugWriter
- close() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Indicates that this endpoint has finished reading or writing.
- close() - Method in interface com.northconcepts.datapipeline.core.IParser
- close() - Method in class com.northconcepts.datapipeline.core.LineParser
- close() - Method in class com.northconcepts.datapipeline.core.MultiWriter
- close() - Method in class com.northconcepts.datapipeline.core.Parser
- close() - Method in class com.northconcepts.datapipeline.core.PipedWriter
- close() - Method in class com.northconcepts.datapipeline.core.ProxyReader
- close() - Method in class com.northconcepts.datapipeline.core.ProxyWriter
- close() - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
- close() - Method in class com.northconcepts.datapipeline.core.SequenceReader
- close() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
- close() - Method in class com.northconcepts.datapipeline.core.SortingReader
- close() - Method in class com.northconcepts.datapipeline.core.StreamWriter
- close() - Method in class com.northconcepts.datapipeline.core.StringParser
- close() - Method in class com.northconcepts.datapipeline.core.TeeReader
- close() - Method in class com.northconcepts.datapipeline.core.TextReader
- close() - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
- close() - Method in class com.northconcepts.datapipeline.core.TextWriter
- close() - Method in class com.northconcepts.datapipeline.core.TimedReader
- close() - Method in class com.northconcepts.datapipeline.email.EmailReader
- close() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
- close() - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
- close() - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
-
The method can be called when this document can be discarded, but it will be called automatically in the finalize() method.
- close() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- close() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
- close() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- close() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- close() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- close() - Method in class com.northconcepts.datapipeline.file.FileReader
- close() - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
- close() - Method in class com.northconcepts.datapipeline.file.FileWriter
- close() - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Closes the DropBox connection.
- close() - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Closes the connection from an FTP server.
- close() - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Closes the HDFS connection.
- close() - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Closes the connection from an SFTP server.
- close() - Method in class com.northconcepts.datapipeline.filesystem.zip.ZipFileSystem
- close() - Method in class com.northconcepts.datapipeline.filter.Filter
-
Called by
FilteringReaderwhenFilteringReader.close()is called (after reading ends). - close() - Method in class com.northconcepts.datapipeline.filter.FilteringReader
- close() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Closes the dataset of mapped records; applying a mapping again loads a new one.
- close() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
- close() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
- close() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- close() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- close() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- close() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- close() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- close() - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- close() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- close() - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
- close() - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- close() - Method in class com.northconcepts.datapipeline.google.GoogleApiReader
- close() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Forgets the spreadsheet; the transport is shut down only when this document created it.
- close() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- close() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- close() - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Closes the Google Drive connection.
- close() - Method in class com.northconcepts.datapipeline.group.GroupByReader
- close() - Method in class com.northconcepts.datapipeline.group.Window
- close() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
- close() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationReader
- close() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfFollowedByReader
- close() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfFollowsReader
- close() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfMediaReader
- close() - Method in class com.northconcepts.datapipeline.instagram.InstagramTagMediaReader
- close() - Method in class com.northconcepts.datapipeline.instagram.InstagramTagReader
- close() - Method in class com.northconcepts.datapipeline.instagram.InstagramUserMediaReader
- close() - Method in class com.northconcepts.datapipeline.internal.lang.FileSystem
-
Wipes this connection cycle's credentials snapshot, then closes this endpoint.
- close() - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Releases the statement(s); called when the writer is closed.
- close() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- close() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- close() - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- close() - Method in interface com.northconcepts.datapipeline.jdbc.JdbcConnectionFactory
-
Releases any resources held by the factory itself (does nothing by default).
- close() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
- close() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- close() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- close() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- close() - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Releases the statement(s); called when the writer is closed.
- close() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- close() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- close() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- close() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- close() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- close() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- close() - Method in class com.northconcepts.datapipeline.jira.client.JiraClient.JiraStub
- close() - Method in class com.northconcepts.datapipeline.jira.client.JiraService
- close() - Method in class com.northconcepts.datapipeline.jira.JiraReader
- close() - Method in class com.northconcepts.datapipeline.jms.JmsConnection
- close() - Method in class com.northconcepts.datapipeline.jms.JmsReader
- close() - Method in class com.northconcepts.datapipeline.jms.JmsWriter
- close() - Method in class com.northconcepts.datapipeline.job.DataReaderIterator
- close() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
- close() - Method in class com.northconcepts.datapipeline.json.JsonRecordWriter
- close() - Method in class com.northconcepts.datapipeline.json.JsonWriter
- close() - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
- close() - Method in class com.northconcepts.datapipeline.json.SimpleJsonWriter
- close() - Method in class com.northconcepts.datapipeline.kafka.KafkaReader
- close() - Method in class com.northconcepts.datapipeline.kafka.KafkaWriter
- close() - Method in class com.northconcepts.datapipeline.kafka.RecordDeserializer
- close() - Method in class com.northconcepts.datapipeline.kafka.RecordSerializer
- close() - Method in class com.northconcepts.datapipeline.latex.LatexWriter
- close() - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
- close() - Method in class com.northconcepts.datapipeline.meter.MeteredInputStream
- close() - Method in class com.northconcepts.datapipeline.meter.MeteredOutputStream
- close() - Method in class com.northconcepts.datapipeline.meter.MeteredReader
- close() - Method in class com.northconcepts.datapipeline.meter.MeteredWriter
- close() - Method in class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
- close() - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
- close() - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
- close() - Method in class com.northconcepts.datapipeline.multiplex.SplitReader
- close() - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
- close() - Method in class com.northconcepts.datapipeline.openfinancialexchange.OpenFinancialExchangeReader
- close() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
- close() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
- close() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
- close() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
- close() - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
- close() - Method in class com.northconcepts.datapipeline.pdf.PdfReader
- close() - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
- close() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
- close() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
- close() - Method in class com.northconcepts.datapipeline.rtf.RtfWriter
- close() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyClient.ShopifyStub
-
Closes the RESTEasy client behind the proxy.
- close() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Closes the underlying RESTEasy client.
- close() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
- close() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Flushes and closes the underlying writer or stream.
- close() - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
- close() - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- close() - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlUpsertWriter
- close() - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- close() - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
- close() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
- close() - Method in class com.northconcepts.datapipeline.texttable.TextTableWriter
- close() - Method in class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
- close() - Method in class com.northconcepts.datapipeline.transform.lookup.Lookup
-
Called when the
LookupTransformerusing this lookup is closed; override to release resources. - close() - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
- close() - Method in class com.northconcepts.datapipeline.transform.lookup.ProxyLookup
- close() - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Called by
TransformingReaderorTransformingWriterwhen theirclose()method is called (after reading or writing ends). - close() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
- close() - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
- close() - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
- close() - Method in class com.northconcepts.datapipeline.trello.TrelloApiWriter
- close() - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- close() - Method in class com.northconcepts.datapipeline.twitter.TwitterSampleStreamReader
- close() - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
- close() - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Shuts down the stream if one was created; a later reader open creates a new one.
- close() - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
- close() - Method in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
- close() - Method in class com.northconcepts.datapipeline.xml.SimpleXmlReader
- close() - Method in class com.northconcepts.datapipeline.xml.SimpleXmlWriter
- close() - Method in class com.northconcepts.datapipeline.xml.XmlReader
- close() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
- close() - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
- close() - Method in class com.northconcepts.datapipeline.xml.XmlWriter
- CLOSE_BUFFER_MARGIN_MILLIS - Static variable in class com.northconcepts.datapipeline.buffer.BufferStrategy
- CLOSE_WINDOW_MARGIN_MILLIS - Static variable in class com.northconcepts.datapipeline.group.CloseWindowStrategy
- closeConnection(Connection) - Method in interface com.northconcepts.datapipeline.jdbc.JdbcConnectionFactory
-
Releases a connection obtained from
JdbcConnectionFactory.createConnection()(closes it by default). - CLOSED - Enum constant in enum class com.northconcepts.datapipeline.core.DataEndpoint.State
- CLOSED - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraSprintReader.SprintState
- CLOSED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- CLOSED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.OrderStatus
- CLOSED - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardFilter
- CLOSED - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardLists
- CLOSED - Enum constant in enum class com.northconcepts.datapipeline.trello.CardFilter
- CLOSED - Enum constant in enum class com.northconcepts.datapipeline.trello.ListFilter
- CloseWindowStrategy - Class in com.northconcepts.datapipeline.group
-
Determines when
GroupByReadercloses an open sliding window. - CloseWindowStrategy() - Constructor for class com.northconcepts.datapipeline.group.CloseWindowStrategy
- CodeWriter - Class in com.northconcepts.datapipeline.sourcecode
-
A programming-language agnostic class for emitting formatted code using indentation and line breaks.
- CodeWriter() - Constructor for class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Creates a writer that keeps the code in memory for
CodeWriter.getSourceString(). - CodeWriter(OutputStream) - Constructor for class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Creates a writer for the stream, encoding text with the platform's default charset.
- CodeWriter(Writer) - Constructor for class com.northconcepts.datapipeline.sourcecode.CodeWriter
- collapseChildren(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.CollapseSiblingPatterns
-
Merges the parent's children that match the first pattern a rule derives into one wildcard node; called for every node, children before parents.
- CollapseSiblingPatterns - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Collapses down (merges) sibling tree-node-paths whose names share a derivable naming/wildcard pattern (see
SiblingSetRule) into a single wildcard node, mirroring what the build-timeNodeNameRules produce for individually dynamic names: the collapsed node is named*, its XPath expression ends innode(), member names become its values, and descendant XPaths collapse the merged segment to*. - CollapseSiblingPatterns() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.CollapseSiblingPatterns
-
Creates a pass with a single
AffixSiblingSetRule. - collect(FieldPath, boolean, boolean, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Collects the individual values into an array, using the source field name as the target field name.
- collect(FieldPath, FieldPath, boolean, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Collects the individual values into an array, excluding nulls by default.
- collect(FieldPath, FieldPath, boolean, boolean, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Collects the individual values into an array.
- collect(String, boolean, boolean, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Collects the individual values into an array, using the source field name as the target field name.
- collect(String, String, boolean, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Collects the individual values into an array, excluding nulls by default.
- collect(String, String, boolean, boolean, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Collects the individual values into an array.
- collect(String, Collection) - Method in class com.northconcepts.datapipeline.memory.CollectionWriter
- COLLECTION - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- CollectionReader<T> - Class in com.northconcepts.datapipeline.memory
- CollectionReader(Collection<T>, Function<T, Record>) - Constructor for class com.northconcepts.datapipeline.memory.CollectionReader
-
Creates a CollectionReader from a Collection.
- CollectionReader(Iterator<T>, Function<T, Record>) - Constructor for class com.northconcepts.datapipeline.memory.CollectionReader
-
Creates a CollectionReader from an Iterator.
- CollectionReader(Stream<T>, Function<T, Record>) - Constructor for class com.northconcepts.datapipeline.memory.CollectionReader
-
Creates a CollectionReader from a Stream.
- CollectionWriter - Class in com.northconcepts.datapipeline.memory
-
Copies the values in specific fields to an in-memory
Collection. - CollectionWriter() - Constructor for class com.northconcepts.datapipeline.memory.CollectionWriter
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.conflict.OnConflict
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.delete.Delete
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertRow
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertValue
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.MergeValue
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConditionPart
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.NotPart
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.SqlPart
-
Appends the values for this part's
?parameters to the list in order; adds nothing by default. - collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.update.Update
- collectParameterValues(List<Object>) - Method in class com.northconcepts.datapipeline.jdbc.sql.update.UpdateValue
- collectQuerySourceSqlFragment(CodeWriter, QuerySource) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Writes a FROM source, in parentheses if
QuerySource.shouldWrapWhenNested()is true, followed by its nested alias if any. - collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.conflict.OnConflict
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.delete.Delete
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertRow
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertValue
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.MergeValue
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConditionPart
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.FullJoin
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.InnerJoin
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.LeftJoin
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.NotPart
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryGrouping
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySelection
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.RightJoin
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.SqlPart
-
Writes this part's SQL to the writer; used by
SqlPart.getSqlFragment()and by enclosing parts. - collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.update.Update
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.jdbc.sql.update.UpdateValue
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Generates DDL from
CreateH2DdlFromSchemaDef.schemaDefand writes the output towriter. - collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.DropTableConstraint
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.Insert
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.InsertRow
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.InsertValue
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.h2.Upsert
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Generates DDL from
CreateMySqlDdlFromSchemaDef.schemaDefand writes the output towriter. - collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTableConstraint
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.Insert
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.InsertRow
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.InsertValue
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.mysql.Upsert
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Generates DDL from
CreatePostgreSqlDdlFromSchemaDef.schemaDefand writes the output towriter. - collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.Insert
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.InsertRow
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.InsertValue
- collectSqlFragment(CodeWriter) - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
- column - Variable in class com.northconcepts.datapipeline.jsonata.Location
-
The column number, starting at 1.
- Column - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Holds the metadata and statistics for each field in a dataset.
- Column() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- Column(String, int) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- Column(String, int, Map<Object, LongAdder>) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Creates a column that collects its unique values and their counts in the given map.
- COLUMN_STATS_READER_THREADS - Static variable in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
- columnCountMismatchInLocalFileDataset(int, int) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- ColumnsDataReader(List<Column>) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset.ColumnsDataReader
- columnsLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- com.northconcepts.datapipeline.amazons3 - package com.northconcepts.datapipeline.amazons3
-
Read and write to Amazon-S3.
- com.northconcepts.datapipeline.avro - package com.northconcepts.datapipeline.avro
-
Read and write Apache Avro files.
- com.northconcepts.datapipeline.avro.pipeline.input - package com.northconcepts.datapipeline.avro.pipeline.input
- com.northconcepts.datapipeline.avro.pipeline.output - package com.northconcepts.datapipeline.avro.pipeline.output
- com.northconcepts.datapipeline.bloomberg - package com.northconcepts.datapipeline.bloomberg
-
Read Bloomberg Message data.
- com.northconcepts.datapipeline.buffer - package com.northconcepts.datapipeline.buffer
-
Organize incoming data into groups of sequential records without aggregation or transformation.
- com.northconcepts.datapipeline.core - package com.northconcepts.datapipeline.core
-
Core DataPipeline classes for reading, writing, and processing data.
- com.northconcepts.datapipeline.csv - package com.northconcepts.datapipeline.csv
-
Read and write comma separated values (CSV) and other delimited data.
- com.northconcepts.datapipeline.diagnostic - package com.northconcepts.datapipeline.diagnostic
-
Troubleshoot DataPipeline's setup and environment.
- com.northconcepts.datapipeline.email - package com.northconcepts.datapipeline.email
-
Read emails.
- com.northconcepts.datapipeline.eventbus - package com.northconcepts.datapipeline.eventbus
-
In-memory, publish-subscribe hub using simple Java interfaces or loosely-coupled readers and writers.
- com.northconcepts.datapipeline.eventbus.filter - package com.northconcepts.datapipeline.eventbus.filter
- com.northconcepts.datapipeline.excel - package com.northconcepts.datapipeline.excel
-
Read and write Microsoft Excel documents.
- com.northconcepts.datapipeline.expression - package com.northconcepts.datapipeline.expression
-
Parse and execute DataPipeline's expression language.
- com.northconcepts.datapipeline.file - package com.northconcepts.datapipeline.file
-
Read and write records using DataPipeline's native binary format.
- com.northconcepts.datapipeline.filesystem.dropbox - package com.northconcepts.datapipeline.filesystem.dropbox
-
Read and write to Dropbox.
- com.northconcepts.datapipeline.filesystem.ftp - package com.northconcepts.datapipeline.filesystem.ftp
-
Read and write files to an FTP Server.
- com.northconcepts.datapipeline.filesystem.hdfs - package com.northconcepts.datapipeline.filesystem.hdfs
-
Read and write files to Hadoop Distributed File System.
- com.northconcepts.datapipeline.filesystem.sftp - package com.northconcepts.datapipeline.filesystem.sftp
-
Read and write files to an SFTP Server.
- com.northconcepts.datapipeline.filesystem.zip - package com.northconcepts.datapipeline.filesystem.zip
-
Read and write data by treating Zips as a file system.
- com.northconcepts.datapipeline.filter - package com.northconcepts.datapipeline.filter
-
Filter or exclude data by criteria.
- com.northconcepts.datapipeline.filter.rule - package com.northconcepts.datapipeline.filter.rule
- com.northconcepts.datapipeline.fixedwidth - package com.northconcepts.datapipeline.fixedwidth
-
Read and write fixed-width / fixed-length records.
- com.northconcepts.datapipeline.foundations.core - package com.northconcepts.datapipeline.foundations.core
- com.northconcepts.datapipeline.foundations.datamapping - package com.northconcepts.datapipeline.foundations.datamapping
-
Model and execute source-target data mapping using expressions and functions.
- com.northconcepts.datapipeline.foundations.decisiontable - package com.northconcepts.datapipeline.foundations.decisiontable
-
Decision table rule engine.
- com.northconcepts.datapipeline.foundations.decisiontree - package com.northconcepts.datapipeline.foundations.decisiontree
-
Decision tree rule engine.
- com.northconcepts.datapipeline.foundations.difference - package com.northconcepts.datapipeline.foundations.difference
-
Common classes for comparing objects to detect elements that were added, removed, renamed, and changed.
- com.northconcepts.datapipeline.foundations.expression - package com.northconcepts.datapipeline.foundations.expression
- com.northconcepts.datapipeline.foundations.file - package com.northconcepts.datapipeline.foundations.file
- com.northconcepts.datapipeline.foundations.i18n - package com.northconcepts.datapipeline.foundations.i18n
- com.northconcepts.datapipeline.foundations.internal - package com.northconcepts.datapipeline.foundations.internal
- com.northconcepts.datapipeline.foundations.jdbc - package com.northconcepts.datapipeline.foundations.jdbc
-
Database metadata model and code generation.
- com.northconcepts.datapipeline.foundations.number - package com.northconcepts.datapipeline.foundations.number
-
Detect number patterns in strings.
- com.northconcepts.datapipeline.foundations.pipeline - package com.northconcepts.datapipeline.foundations.pipeline
-
Declarative pipeline modeling and execution.
- com.northconcepts.datapipeline.foundations.pipeline.action - package com.northconcepts.datapipeline.foundations.pipeline.action
- com.northconcepts.datapipeline.foundations.pipeline.action.aggregate - package com.northconcepts.datapipeline.foundations.pipeline.action.aggregate
- com.northconcepts.datapipeline.foundations.pipeline.action.convert - package com.northconcepts.datapipeline.foundations.pipeline.action.convert
- com.northconcepts.datapipeline.foundations.pipeline.action.datamapping - package com.northconcepts.datapipeline.foundations.pipeline.action.datamapping
- com.northconcepts.datapipeline.foundations.pipeline.action.decision - package com.northconcepts.datapipeline.foundations.pipeline.action.decision
- com.northconcepts.datapipeline.foundations.pipeline.action.filter - package com.northconcepts.datapipeline.foundations.pipeline.action.filter
- com.northconcepts.datapipeline.foundations.pipeline.action.transform - package com.northconcepts.datapipeline.foundations.pipeline.action.transform
- com.northconcepts.datapipeline.foundations.pipeline.action.validate - package com.northconcepts.datapipeline.foundations.pipeline.action.validate
- com.northconcepts.datapipeline.foundations.pipeline.dataset - package com.northconcepts.datapipeline.foundations.pipeline.dataset
- com.northconcepts.datapipeline.foundations.pipeline.input - package com.northconcepts.datapipeline.foundations.pipeline.input
- com.northconcepts.datapipeline.foundations.pipeline.output - package com.northconcepts.datapipeline.foundations.pipeline.output
- com.northconcepts.datapipeline.foundations.pipeline.tree - package com.northconcepts.datapipeline.foundations.pipeline.tree
- com.northconcepts.datapipeline.foundations.pipeline.tree.detect - package com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Pluggable algorithms to detect record breaks and fields in a
Tree, including collapsing down (merging) tree-node-paths where a naming/wildcard pattern can be derived. - com.northconcepts.datapipeline.foundations.schema - package com.northconcepts.datapipeline.foundations.schema
-
Schema models for validation, mapping, and code generation.
- com.northconcepts.datapipeline.foundations.schema.diff - package com.northconcepts.datapipeline.foundations.schema.diff
-
Compare schema models to detect elements that were added, removed, renamed, and changed.
- com.northconcepts.datapipeline.foundations.time - package com.northconcepts.datapipeline.foundations.time
-
Detect date-time patterns in strings.
- com.northconcepts.datapipeline.foundations.tools - package com.northconcepts.datapipeline.foundations.tools
-
DataPipeline Foundation tools for generating code and models.
- com.northconcepts.datapipeline.google - package com.northconcepts.datapipeline.google
- com.northconcepts.datapipeline.google.analytics - package com.northconcepts.datapipeline.google.analytics
-
Read Google Analytics Report.
- com.northconcepts.datapipeline.google.calendar - package com.northconcepts.datapipeline.google.calendar
-
Read Google Calendar Events.
- com.northconcepts.datapipeline.google.contacts - package com.northconcepts.datapipeline.google.contacts
-
Read Google Contacts.
- com.northconcepts.datapipeline.google.gmail - package com.northconcepts.datapipeline.google.gmail
-
Read Gmail messages.
- com.northconcepts.datapipeline.google.sheets - package com.northconcepts.datapipeline.google.sheets
- com.northconcepts.datapipeline.googledrive - package com.northconcepts.datapipeline.googledrive
-
Read and write files to Google Drive.
- com.northconcepts.datapipeline.group - package com.northconcepts.datapipeline.group
-
Summarize batch and streaming data similar to "group by" in SQL.
- com.northconcepts.datapipeline.group.operation - package com.northconcepts.datapipeline.group.operation
- com.northconcepts.datapipeline.instagram - package com.northconcepts.datapipeline.instagram
-
Search and read Instagram media and user data.
- com.northconcepts.datapipeline.internal.lang - package com.northconcepts.datapipeline.internal.lang
- com.northconcepts.datapipeline.io - package com.northconcepts.datapipeline.io
- com.northconcepts.datapipeline.javabean - package com.northconcepts.datapipeline.javabean
-
Read Java Beans as a job's data source.
- com.northconcepts.datapipeline.jdbc - package com.northconcepts.datapipeline.jdbc
-
Database reading and writing via JDBC.
- com.northconcepts.datapipeline.jdbc.insert - package com.northconcepts.datapipeline.jdbc.insert
-
Insert strategies for
JdbcWriterandJdbcMultiWriter. - com.northconcepts.datapipeline.jdbc.sql - package com.northconcepts.datapipeline.jdbc.sql
-
Common SQL generation classes.
- com.northconcepts.datapipeline.jdbc.sql.conflict - package com.northconcepts.datapipeline.jdbc.sql.conflict
- com.northconcepts.datapipeline.jdbc.sql.delete - package com.northconcepts.datapipeline.jdbc.sql.delete
-
SQL generation classes for DELETE.
- com.northconcepts.datapipeline.jdbc.sql.insert - package com.northconcepts.datapipeline.jdbc.sql.insert
-
SQL generation classes for INSERT.
- com.northconcepts.datapipeline.jdbc.sql.merge - package com.northconcepts.datapipeline.jdbc.sql.merge
-
SQL generation classes for MERGE.
- com.northconcepts.datapipeline.jdbc.sql.select - package com.northconcepts.datapipeline.jdbc.sql.select
-
SQL generation classes for SELECT.
- com.northconcepts.datapipeline.jdbc.sql.update - package com.northconcepts.datapipeline.jdbc.sql.update
-
SQL generation classes for UPDATE.
- com.northconcepts.datapipeline.jdbc.upsert - package com.northconcepts.datapipeline.jdbc.upsert
-
Upsert strategies for
JdbcUpsertWriterandJdbcMultiUpsertWriter. - com.northconcepts.datapipeline.jira - package com.northconcepts.datapipeline.jira
-
Read Jira project, sprint and issue data.
- com.northconcepts.datapipeline.jira.client - package com.northconcepts.datapipeline.jira.client
-
RESTful client and Java wrapper for Jira.
- com.northconcepts.datapipeline.jms - package com.northconcepts.datapipeline.jms
-
Read and write Java Message Service data.
- com.northconcepts.datapipeline.job - package com.northconcepts.datapipeline.job
-
Running, tracking, and managing data transfer pipelines.
- com.northconcepts.datapipeline.json - package com.northconcepts.datapipeline.json
-
JSON reading and writing.
- com.northconcepts.datapipeline.json.builder - package com.northconcepts.datapipeline.json.builder
-
Programmatic JSON creation.
- com.northconcepts.datapipeline.jsonata - package com.northconcepts.datapipeline.jsonata
-
Apply JSONata transformations.
- com.northconcepts.datapipeline.jsonata.utils - package com.northconcepts.datapipeline.jsonata.utils
- com.northconcepts.datapipeline.kafka - package com.northconcepts.datapipeline.kafka
-
Read and write Apache Kafka distributed messaging system data.
- com.northconcepts.datapipeline.latex - package com.northconcepts.datapipeline.latex
- com.northconcepts.datapipeline.latex.output - package com.northconcepts.datapipeline.latex.output
- com.northconcepts.datapipeline.lineage - package com.northconcepts.datapipeline.lineage
-
Extract data lineage from records and fields.
- com.northconcepts.datapipeline.mailchimp - package com.northconcepts.datapipeline.mailchimp
-
Read MailChimp lists.
- com.northconcepts.datapipeline.mailchimp.list - package com.northconcepts.datapipeline.mailchimp.list
- com.northconcepts.datapipeline.memory - package com.northconcepts.datapipeline.memory
-
Reading and writing data to and from in-memory buffers.
- com.northconcepts.datapipeline.meter - package com.northconcepts.datapipeline.meter
-
Measures the rate (bytes/second or records/second) at which data is read or written.
- com.northconcepts.datapipeline.microsoft.word - package com.northconcepts.datapipeline.microsoft.word
-
Writes records to a Microsoft Word (OOXML .docx) document stream.
- com.northconcepts.datapipeline.microsoft.word.output - package com.northconcepts.datapipeline.microsoft.word.output
- com.northconcepts.datapipeline.mongodb - package com.northconcepts.datapipeline.mongodb
-
Read and write data in MongoDB.
- com.northconcepts.datapipeline.multiplex - package com.northconcepts.datapipeline.multiplex
-
Strategies to convert a single source
DataReaderinto many downstream readers. - com.northconcepts.datapipeline.openfinancialexchange - package com.northconcepts.datapipeline.openfinancialexchange
-
Read OFX / QFX (Quicken) / QBO (QuickBooks) files.
- com.northconcepts.datapipeline.openfinancialexchange.pipeline.input - package com.northconcepts.datapipeline.openfinancialexchange.pipeline.input
- com.northconcepts.datapipeline.orc - package com.northconcepts.datapipeline.orc
-
Read and write Apache ORC columnar files.
- com.northconcepts.datapipeline.orc.input - package com.northconcepts.datapipeline.orc.input
- com.northconcepts.datapipeline.orc.output - package com.northconcepts.datapipeline.orc.output
- com.northconcepts.datapipeline.parquet - package com.northconcepts.datapipeline.parquet
-
Read and Write Apache Parquet columnar files.
- com.northconcepts.datapipeline.parquet.file - package com.northconcepts.datapipeline.parquet.file
- com.northconcepts.datapipeline.parquet.input - package com.northconcepts.datapipeline.parquet.input
- com.northconcepts.datapipeline.parquet.output - package com.northconcepts.datapipeline.parquet.output
- com.northconcepts.datapipeline.parquet.tools - package com.northconcepts.datapipeline.parquet.tools
- com.northconcepts.datapipeline.pdf - package com.northconcepts.datapipeline.pdf
-
Write data to a PDF file.
- com.northconcepts.datapipeline.pdf.input - package com.northconcepts.datapipeline.pdf.input
- com.northconcepts.datapipeline.pdf.output - package com.northconcepts.datapipeline.pdf.output
- com.northconcepts.datapipeline.retry - package com.northconcepts.datapipeline.retry
-
Classes to retry and continue reading or writing data on failure.
- com.northconcepts.datapipeline.rtf - package com.northconcepts.datapipeline.rtf
-
Writes records to an RTF document stream.
- com.northconcepts.datapipeline.schedule - package com.northconcepts.datapipeline.schedule
-
Common task scheduling.
- com.northconcepts.datapipeline.security - package com.northconcepts.datapipeline.security
-
Encrypt and decrypt data.
- com.northconcepts.datapipeline.shopify - package com.northconcepts.datapipeline.shopify
-
Read data from Shopify.
- com.northconcepts.datapipeline.shopify.client - package com.northconcepts.datapipeline.shopify.client
-
REST client to read and write Shopify store data.
- com.northconcepts.datapipeline.sourcecode - package com.northconcepts.datapipeline.sourcecode
-
Code generation classes.
- com.northconcepts.datapipeline.sql.h2 - package com.northconcepts.datapipeline.sql.h2
-
Generate SQL code for the H2 database with default mode.
- com.northconcepts.datapipeline.sql.mysql - package com.northconcepts.datapipeline.sql.mysql
-
Generate SQL code for the MySQL database.
- com.northconcepts.datapipeline.sql.postgresql - package com.northconcepts.datapipeline.sql.postgresql
-
Generate SQL code for the PostgreSQL database.
- com.northconcepts.datapipeline.template - package com.northconcepts.datapipeline.template
-
Write data to a text stream using FreeMarker template.
- com.northconcepts.datapipeline.texttable - package com.northconcepts.datapipeline.texttable
-
Write records as an easy-to-read, plain-text table with padded, aligned columns.
- com.northconcepts.datapipeline.throttle - package com.northconcepts.datapipeline.throttle
-
Limits the rate (bytes/second or records/second) at which data is read or written.
- com.northconcepts.datapipeline.transform - package com.northconcepts.datapipeline.transform
-
Restructure data using a variety of built-in and customizable operations.
- com.northconcepts.datapipeline.transform.format - package com.northconcepts.datapipeline.transform.format
- com.northconcepts.datapipeline.transform.lookup - package com.northconcepts.datapipeline.transform.lookup
-
Enrich data by with data from another source.
- com.northconcepts.datapipeline.transform.net - package com.northconcepts.datapipeline.transform.net
- com.northconcepts.datapipeline.trello - package com.northconcepts.datapipeline.trello
-
Read and write data to a Trello board and cards.
- com.northconcepts.datapipeline.twitter - package com.northconcepts.datapipeline.twitter
-
Search and read Twitter users and tweets.
- com.northconcepts.datapipeline.twitter2 - package com.northconcepts.datapipeline.twitter2
-
Search and read Twitter users and tweets using Twitter v2 Api.
- com.northconcepts.datapipeline.validate - package com.northconcepts.datapipeline.validate
-
Validate data while reading.
- com.northconcepts.datapipeline.weblog - package com.northconcepts.datapipeline.weblog
-
Read web server logs.
- com.northconcepts.datapipeline.xml - package com.northconcepts.datapipeline.xml
-
XML reading and writing.
- com.northconcepts.datapipeline.xml.builder - package com.northconcepts.datapipeline.xml.builder
-
Programmatic XML creation.
- CombinedLogReader - Class in com.northconcepts.datapipeline.weblog
-
Obtains records from a webserver's access log file using the Combined Log format.
- CombinedLogReader(File) - Constructor for class com.northconcepts.datapipeline.weblog.CombinedLogReader
-
Creates a reader for the log file; each record has the fields remoteHost, clientUsername, authenticatedUsername, date, request, status, bytes, referrer, userAgent and cookies.
- CombinedLogReader(Reader) - Constructor for class com.northconcepts.datapipeline.weblog.CombinedLogReader
-
Creates a reader for the log stream; each record has the fields remoteHost, clientUsername, authenticatedUsername, date, request, status, bytes, referrer, userAgent and cookies.
- CommaSeparatedList - Class in com.northconcepts.datapipeline.trello
-
A list of values parsed from one comma-separated line;
toString()joins them back with commas. - CommaSeparatedList(String) - Constructor for class com.northconcepts.datapipeline.trello.CommaSeparatedList
-
Parses the values of the given comma-separated line as CSV, so values may be enclosed in double quotes.
- CommaSeparatedValues - Class in com.northconcepts.datapipeline.csv
-
A collection of comma delimited values.
- CommaSeparatedValues() - Constructor for class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- CommaSeparatedValues(String) - Constructor for class com.northconcepts.datapipeline.csv.CommaSeparatedValues
-
Parses the first line of the given comma-separated text; unquoted values are trimmed and become null when empty.
- CommaSeparatedValues(Collection<String>) - Constructor for class com.northconcepts.datapipeline.csv.CommaSeparatedValues
-
Creates an instance backed by the given collection when it is an
ArrayList(changes are shared), otherwise by a copy of it. - COMMENT - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- compare(Field, Field) - Method in class com.northconcepts.datapipeline.core.FieldComparator
- compare(Record, Record) - Method in class com.northconcepts.datapipeline.core.RecordComparator
- compare(ValueNode, ValueNode) - Method in class com.northconcepts.datapipeline.core.ValueNodeComparator
-
Compares two ValueNode instances for ordering.
- compareRecord(Record, Record, boolean) - Method in class com.northconcepts.datapipeline.core.FieldComparator
-
Compares two records by their field at
FieldComparator.getFieldName(), throwing if either lacks it;cacheFieldIndexesis ignored. - compareTo(Field) - Method in class com.northconcepts.datapipeline.core.Field
-
Compares this field to another by their values using natural ordering.
- compareTo(Field, Collator) - Method in class com.northconcepts.datapipeline.core.Field
-
Compares this field to another by their values, optionally using the specified
Collatorfor string comparisons. - compareTo(Record) - Method in class com.northconcepts.datapipeline.core.Record
-
Compares this record to another using the default
RecordComparator. - compareTo(Record, RecordComparator) - Method in class com.northconcepts.datapipeline.core.Record
-
Compares this record to another using the specified
RecordComparator, or the default ifnull. - compareTo(ValueNode<ArrayValue>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Compares this array to another by length first, then element-by-element.
- compareTo(ValueNode<Record>) - Method in class com.northconcepts.datapipeline.core.Record
-
Compares this record to another value node by delegating to
Record.compareTo(Record). - compareTo(ValueNode<Object>) - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Compares this single value to another by their underlying values using natural ordering.
- compareTo(ValueNode<Object>, Collator) - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Compares this single value to another by their underlying values, optionally using the specified
Collatorfor string comparisons. - compareTo(DateTimePattern) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePattern
- CompositePipelineAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action
-
A
PipelineActionthat applies a list of nested actions in order, as a single step. - CompositePipelineAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- CompositeValue - Class in com.northconcepts.datapipeline.core
-
A fixed-size list of values used as a composite key (for example in lookups, grouping and duplicate removal); a single-value instance hashes like, and equals, that value itself.
- CompositeValue(int) - Constructor for class com.northconcepts.datapipeline.core.CompositeValue
-
Creates an instance with
valueCountnull values to fill in withCompositeValue.set(int, Object). - CompositeValue(Object...) - Constructor for class com.northconcepts.datapipeline.core.CompositeValue
-
Creates an instance backed by the given array, which is not copied.
- CompositeValue(List<?>) - Constructor for class com.northconcepts.datapipeline.core.CompositeValue
-
Creates an instance holding a copy of the list's values.
- COMPRESSED - Enum constant in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferMode
-
Transfer files as FTP compressed data.
- ConcurrentRecordList - Class in com.northconcepts.datapipeline.core
-
A
RecordListthat guards many of its methods with a read-write lock; others, such assize()andclear(), are unguarded, as are the iterators, streams and lists it hands out. - ConcurrentRecordList() - Constructor for class com.northconcepts.datapipeline.core.ConcurrentRecordList
- ConcurrentRecordList(int) - Constructor for class com.northconcepts.datapipeline.core.ConcurrentRecordList
- ConcurrentRecordList(DataReader) - Constructor for class com.northconcepts.datapipeline.core.ConcurrentRecordList
- ConcurrentRecordList(Record...) - Constructor for class com.northconcepts.datapipeline.core.ConcurrentRecordList
- ConditionPart - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
A single SQL condition, such as
"price > ?", with the values for its?parameters. - ConditionPart(String, Object...) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.ConditionPart
- configure(Map<String, ?>, boolean) - Method in class com.northconcepts.datapipeline.kafka.RecordDeserializer
- configure(Map<String, ?>, boolean) - Method in class com.northconcepts.datapipeline.kafka.RecordSerializer
- CONFIRMED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- ConflictAction - Enum Class in com.northconcepts.datapipeline.sql.postgresql
- ConjunctivePart - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Base class for parts that join their child parts with an operator such as AND or OR, parenthesizing each child when more than one applies.
- ConjunctivePart(String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
-
Creates a part that joins its children with the given SQL operator, such as
"AND". - cons - Variable in class com.northconcepts.datapipeline.jsonata.Utils.JList
- consarray - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- CONSTANT_BACKOFF - Enum constant in enum class com.northconcepts.datapipeline.retry.RetryStrategy
- Constants - Class in com.northconcepts.datapipeline.jsonata.utils
-
Constants required by DateTimeUtils
- Constants() - Constructor for class com.northconcepts.datapipeline.jsonata.utils.Constants
- consume() - Method in interface com.northconcepts.datapipeline.core.IParser
- consume() - Method in class com.northconcepts.datapipeline.core.LineParser
- consume() - Method in class com.northconcepts.datapipeline.core.Parser
- consume() - Method in class com.northconcepts.datapipeline.core.StringParser
- consume(int) - Method in interface com.northconcepts.datapipeline.core.IParser
- consume(int) - Method in class com.northconcepts.datapipeline.core.LineParser
- consume(int) - Method in class com.northconcepts.datapipeline.core.Parser
- consume(int) - Method in class com.northconcepts.datapipeline.core.StringParser
- consumerKey - Variable in class com.northconcepts.datapipeline.twitter.TwitterProvider
- consumerKey - Variable in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
- consumerSecret - Variable in class com.northconcepts.datapipeline.twitter.TwitterProvider
- consumerSecret - Variable in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
- consumeWhitespace() - Method in interface com.northconcepts.datapipeline.core.IParser
- consumeWhitespace() - Method in class com.northconcepts.datapipeline.core.LineParser
- consumeWhitespace() - Method in class com.northconcepts.datapipeline.core.Parser
- consumeWhitespace() - Method in class com.northconcepts.datapipeline.core.StringParser
- consumeWhitespace(char[]) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Skips whitespace at the current position, stopping where the given string (such as a field separator) begins.
- consumeWhitespace(char[]) - Method in class com.northconcepts.datapipeline.core.LineParser
- consumeWhitespace(char[]) - Method in class com.northconcepts.datapipeline.core.Parser
- consumeWhitespace(char[]) - Method in class com.northconcepts.datapipeline.core.StringParser
- consumeWhitespace(int) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Skips spaces and tabs at the current position, stopping early at the given character.
- consumeWhitespace(int) - Method in class com.northconcepts.datapipeline.core.LineParser
- consumeWhitespace(int) - Method in class com.northconcepts.datapipeline.core.Parser
- consumeWhitespace(int) - Method in class com.northconcepts.datapipeline.core.StringParser
- consumeWhitespace(CharSequence) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Skips whitespace at the current position, stopping where the given string (such as a field separator) begins.
- consumeWhitespace(CharSequence) - Method in class com.northconcepts.datapipeline.core.LineParser
- consumeWhitespace(CharSequence) - Method in class com.northconcepts.datapipeline.core.Parser
- consumeWhitespace(CharSequence) - Method in class com.northconcepts.datapipeline.core.StringParser
- containedWithin(String...) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns
trueif the supplied fieldNames contains all the fields names in this list. - containedWithin(List<String>) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns
trueif the supplied fieldNames contains all the fields names in this list. - contains(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Deprecated.
- contains(Record) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Deprecated.
- contains(String) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- contains(String) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- contains(String) - Method in class com.northconcepts.datapipeline.security.Credentials
-
Returns true if a value is present for the given key (
falsefor every key afterCredentials.clear()). - contains(String...) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns
trueif the supplied fieldNames all are existing in this list. - contains(String, boolean) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value, as a string, to contain the given text; null values fail.
- contains(String, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Tests if the str contains the token
- contains(List<String>) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns
trueif the supplied fieldNames all are existing in this list. - Contains - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields whose value, as a string, contains the given text; null values are rejected. - Contains(String) - Constructor for class com.northconcepts.datapipeline.filter.rule.Contains
-
Creates a case-sensitive rule for the given text.
- Contains(String, boolean) - Constructor for class com.northconcepts.datapipeline.filter.rule.Contains
- containsEntity(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns true if this schema contains an
EntityDefwith the specifiedname. - containsEntityRelationship(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns true if this schema contains an
EntityRelationshipDefwith the specifiedname. - containsField(FieldList) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns true if all fields and sub fields in a nested path exists.
- containsField(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Indicates if this record contains a matching field for the specified path.
- containsField(Record) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns true if this path leads to a field (not an array element) in the record.
- containsField(String) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns
trueif this record contains a field with the given name. - containsField(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns true if this entity contains a
FieldDefwith the specifiedname. - containsField(String) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns true if this index contains an
IndexFieldDefwith the specifiedname. - containsForeignKeyFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns true if the foreign key field names include the given name, ignoring case.
- containsIndex(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns true if this entity contains an
IndexDefwith the specifiedname. - containsInheritedField(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns true if this entity or any of its super entities contains a
FieldDefwith the specifiedname. - containsInheritedIndex(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns true if this entity or any of its super entities contains an
IndexDefwith the specifiedname. - containsKey(Object) - Method in class com.northconcepts.datapipeline.jsonata.JsonObject
- containsKeyImpl(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
- containsNonNull(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Deprecated.
- containsNonNullField(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Indicates if this record contains a field at the specified path that is not null.
- containsNonNullField(Record) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns true if this path leads to a field in the record whose value is not null.
- containsNonNullField(String) - Method in class com.northconcepts.datapipeline.core.Record
-
Indicates if this record contains a field at the specified path with a non-null value.
- containsNonNullValue(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Indicates if this record contains a field or value at the specified path where the value is not null.
- containsNonNullValue(Record) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns true if this path leads to a field or array element in the record whose value is not null.
- containsSessionProperty(Class<T>) - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif a session property exists for the given type. - containsSessionProperty(Class<T>) - Method in interface com.northconcepts.datapipeline.core.Session
-
Returns
trueif a session property exists for the given type. - containsSessionProperty(Class<T>) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- containsSessionProperty(Class<T>, String) - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif a session property exists for the given type and name combination. - containsSessionProperty(Class<T>, String) - Method in interface com.northconcepts.datapipeline.core.Session
-
Returns
trueif a session property exists for the given type and name combination. - containsSessionProperty(Class<T>, String) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- containsSessionProperty(String) - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif a session property exists with the given name. - containsSessionProperty(String) - Method in interface com.northconcepts.datapipeline.core.Session
-
Returns
trueif a session property exists with the given name. - containsSessionProperty(String) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- containsTable(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySource
-
Returns true if this source, a nested source or a join refers to the table (ignoring case).
- containsTable(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- containsTable(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- containsTable(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- containsValue(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Indicates if this record contains a matching field or value for the specified path.
- containsValue(Record) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns true if this path leads to anything in the record (a field or an array element), even if it holds null.
- contributeExceptionProperties(DataExceptionContributor...) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Adds the properties of each non-null contributor to this exception and returns it.
- contributeExceptionProperties(Throwable, DataExceptionContributor...) - Static method in interface com.northconcepts.datapipeline.core.DataExceptionContributor
-
A utility method to add properties from a list of
DataExceptionContributorto the supplied exception. - contributeExceptionProperties(Throwable, String, DataExceptionContributor...) - Static method in interface com.northconcepts.datapipeline.core.DataExceptionContributor
-
A utility method to add properties from a list of
DataExceptionContributorto the supplied exception with the given name prefix. - convert(EntityDef) - Static method in class com.northconcepts.datapipeline.foundations.tools.ConvertSnakeCaseToCamelCase
-
Converts the entity and super-entity names to UpperCamelCase, along with the entity's fields and indexes, in place.
- convert(EntityRelationshipDef) - Static method in class com.northconcepts.datapipeline.foundations.tools.ConvertSnakeCaseToCamelCase
- convert(FieldDef) - Static method in class com.northconcepts.datapipeline.foundations.tools.ConvertSnakeCaseToCamelCase
-
Converts the field name to lowerCamelCase, and a record field's referenced entity name to UpperCamelCase, in place.
- convert(IndexDef) - Static method in class com.northconcepts.datapipeline.foundations.tools.ConvertSnakeCaseToCamelCase
-
Converts the index name and its field names to lowerCamelCase, in place.
- convert(IndexFieldDef) - Static method in class com.northconcepts.datapipeline.foundations.tools.ConvertSnakeCaseToCamelCase
-
Converts the indexed field's name to lowerCamelCase, in place.
- convert(SchemaDef) - Static method in class com.northconcepts.datapipeline.foundations.tools.ConvertSnakeCaseToCamelCase
-
Converts the schema name to UpperCamelCase, along with its entities and relationships, in place.
- CONVERT - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- ConvertDateTimeToStringAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
A
PipelineActionthat converts the selected date/time fields to strings, optionally using aSimpleDateFormatpattern. - ConvertDateTimeToStringAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- convertNulls(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- ConvertNullToValueAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
A
PipelineActionthat replaces null values in the selected fields with a typed constant or the result of an expression. - ConvertNullToValueAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
- ConvertNullToValueAction.FieldType - Enum Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
The type a replacement value is converted to, or
EXPRESSIONto evaluate it;DATETIME,DATEandTIMEvalues use theyyyy-MM-dd HH:mm:ss,yyyy-MM-ddandHH:mm:ssformats. - ConvertNullToValueAction.TypeValue - Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
A replacement value and the type it is converted to.
- convertNumber(Number) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- ConvertNumberToStringAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
A
PipelineActionthat converts the selected numeric fields to strings, optionally using aDecimalFormatpattern. - ConvertNumberToStringAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- ConvertSnakeCaseToCamelCase - Class in com.northconcepts.datapipeline.foundations.tools
-
Renames schema definitions in place from database-style snake_case names to Java-style camel case.
- ConvertSnakeCaseToCamelCase() - Constructor for class com.northconcepts.datapipeline.foundations.tools.ConvertSnakeCaseToCamelCase
- ConvertStringToBooleanAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
A
PipelineActionthat converts the selected string fields to booleans; only"true", ignoring case, becomes true. - ConvertStringToBooleanAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- ConvertStringToDateTimeAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
A
PipelineActionthat parses the selected string fields into date-time, date or time values using aSimpleDateFormatpattern. - ConvertStringToDateTimeAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- ConvertStringToDateTimeAction.FieldType - Enum Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
The temporal type strings are parsed into: a date-time (
java.util.Date), a date (java.sql.Date) or a time (java.sql.Time). - ConvertStringToNumberAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
A
PipelineActionthat parses the selected string fields into numbers of the chosen type, optionally using aDecimalFormatpattern. - ConvertStringToNumberAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- ConvertStringToNumberAction.FieldType - Enum Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
The number type strings are parsed into;
SHORT,BYTEandFLOATleave values unconverted when a pattern is set. - ConvertValueToStringAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.convert
-
A
PipelineActionthat converts the values of the selected fields, whatever their type, to strings. - ConvertValueToStringAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- copy() - Method in class com.northconcepts.datapipeline.security.Credentials
-
Returns an independent copy of these credentials.
- copy(DataReader, DataWriter) - Static method in class com.northconcepts.datapipeline.core.SortingReader
-
Writes every remaining record from the source to the sink without opening or closing either.
- COPY_FIELD - Enum constant in enum class com.northconcepts.datapipeline.xml.XmlReader.DuplicateFieldPolicy
- COPY_RECORD - Enum constant in enum class com.northconcepts.datapipeline.xml.XmlReader.DuplicateFieldPolicy
- CopyField - Class in com.northconcepts.datapipeline.transform
-
Creates a duplicate field with the specified target name.
- CopyField(String, String) - Constructor for class com.northconcepts.datapipeline.transform.CopyField
-
Always overwrites the target field.
- CopyField(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.transform.CopyField
-
Creates a transformer that copies the source field's value into the target field (created if missing) unless the target already exists and
overwriteis false. - CopyFieldsAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A
PipelineActionthat copies the values of source fields to target fields. - CopyFieldsAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- CopyFieldsAction.FieldMapping - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A copy of one source field to a target field, optionally overwriting an existing target.
- copyForm(Property) - Method in class com.northconcepts.datapipeline.foundations.core.Property
-
Copies the name and value of the given property into this one.
- copyFrom(Field) - Method in class com.northconcepts.datapipeline.core.Field
-
Copies all properties (name, value, and session properties) from the specified field into this one.
- copyFrom(FieldComparator) - Method in class com.northconcepts.datapipeline.core.FieldComparator
-
Copies the field name, sort direction and collator from the given comparator.
- copyFrom(Field, boolean) - Method in class com.northconcepts.datapipeline.core.Field
-
Copies properties from the specified field into this one.
- copyFrom(Record) - Method in class com.northconcepts.datapipeline.core.Record
-
Copy all the fields and child fields from the specified record into this one, creating new unique fields when target fields with the same name already exists (
Node.DuplicateNodeAction.APPEND). - copyFrom(Record, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Copy all the fields and child fields from the specified record into this one.
- copyFrom(Record, Node.DuplicateNodeAction) - Method in class com.northconcepts.datapipeline.core.Record
-
Copy all the fields and child fields from the specified record into this one.
- copyFrom(Attributes) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- copyFrom(Tags) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
-
Adds all of the given tags to this set, keeping the existing ones.
- copyFrom(RecordLineage) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
Copies the file, line and column numbers, database URL and query, and record number from the record's lineage, keeping any of these values this field already has.
- copySessionPropertiesFrom(Session) - Method in class com.northconcepts.datapipeline.core.Node
-
Copies all session properties from the given source session into this one.
- copySessionPropertiesFrom(Session) - Method in interface com.northconcepts.datapipeline.core.Session
-
Copies all session properties from the given source session into this one.
- copySessionPropertiesFrom(Session) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- copyToRecord(E, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
-
Populates a new, empty record from one buffered element.
- copyToRecord(Long, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowerIDsReader
- copyToRecord(Long, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowingIDsReader
- copyToRecord(UserList, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterListOwnershipReader
- copyToRecord(User, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowerListReader
- copyToRecord(User, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowingListReader
- copyToRecord(User, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
- CORAL - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- CORNFLOWER_BLUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- COULD_NOT_AUTHENTICATE_YOU - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- COULD_NOT_AUTHENTICATE_YOU_2 - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- count(FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds a count of the records in each group, written to the target field.
- count(FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- count(Filter) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Counts the number of records in this list that pass the specified filter.
- count(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Adds an operation counting the records whose field is not null.
- count(String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds a count of the records in each group, written to the target field.
- count(String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- count(Predicate<ValueNode<?>>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the number of elements in this array that match the given predicate.
- count(List<Object>) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Count function
- COUNT - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
- create() - Method in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- create(long) - Method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
- CREATE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- CREATE_UNIQUE - Enum constant in enum class com.northconcepts.datapipeline.core.Node.DuplicateNodeAction
-
Creates a new, unique target field by appending a number to the name.
- createColumnsDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns a reader that emits one summary record per column of this dataset (see
Dataset.ColumnsDataReader). - createConnection() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- createConnection() - Method in interface com.northconcepts.datapipeline.jdbc.JdbcConnectionFactory
-
Returns a connection to use; factories from
JdbcConnectionFactory.wrap(Connection)return the same connection on every call. - createConsumer(JmsSettings, JmsConnection) - Method in enum class com.northconcepts.datapipeline.jms.JmsDestinationType
-
Creates the consumer a
JmsReaderreceives messages from; topics use a durable subscriber named by the client ID. - createDataReader() - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Reads all data cached in this Dataset.
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DatasetPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineInput
- createDataReader() - Method in interface com.northconcepts.datapipeline.job.DataReaderFactory
- createDataReader() - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- createDataReader() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- createDataReader(long, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Reads a subset of data cached in this Dataset.
- createDataReader(ZipFile, ZipEntry) - Method in interface com.northconcepts.datapipeline.filesystem.zip.ZipDataReaderFactory
- createDataReaderImpl(InputStream) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- createDataReaderImpl(InputStream) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Creates the reader for the file's stream;
XmlPipelineInput.createDataReader()then applies this input's settings. - createDataset(JdbcDataset.DatabaseProvider, JdbcConnectionFactory, String, AbstractPipeline) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Creates a persistent dataset stored in a database determined by the provided
JdbcDataset.DatabaseProvider. - createDataset(JdbcDataset.DatabaseProvider, JdbcConnectionFactory, String, DataReaderFactory) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Creates a persistent dataset stored in a database determined by the provided
JdbcDataset.DatabaseProvider. - createDataset(File, AbstractPipeline) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
-
Creates a persistent dataset on disk in the specified
databaseFile. - createDataset(String, String, AbstractPipeline) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Creates a persistent dataset on disk in the specified
rootFolderdirectory. - createDataset(String, String, DataReaderFactory) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Creates a persistent dataset on disk in the specified
rootFolderdirectory. - createDataWriter() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Writes records to this dataset's cache after clearing it.
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineOutput
- createDataWriter() - Method in interface com.northconcepts.datapipeline.job.DataWriterFactory
- createDataWriter() - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- createDataWriter() - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- createDataWriter(SequenceWriter.Sequence, Record) - Method in interface com.northconcepts.datapipeline.core.SequenceWriter.DataWriterFactory
-
Returns the writer for a new sequence, given the first record it will receive; the
SequenceWriteropens and closes it. - createEmptyRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Creates a record with a typed null (or an empty array for array fields) for each field of this entity and its super entities.
- createEntity(Dataset) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Returns an entity with a field for each column of the loaded dataset, marking fields required when the column had no null or blank values.
- createFactory() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Creates the Jackson factory that the
FileandReaderconstructors parse with; the default allows comments, single quotes and unquoted field names. - createField() - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Creates the accumulator that computes this operation's result for one group; called once per group in each window.
- createField() - Method in class com.northconcepts.datapipeline.group.operation.GroupAverage
- createField() - Method in class com.northconcepts.datapipeline.group.operation.GroupCollect
- createField() - Method in class com.northconcepts.datapipeline.group.operation.GroupCount
- createField() - Method in class com.northconcepts.datapipeline.group.operation.GroupFirst
- createField() - Method in class com.northconcepts.datapipeline.group.operation.GroupLast
- createField() - Method in class com.northconcepts.datapipeline.group.operation.GroupMaximum
- createField() - Method in class com.northconcepts.datapipeline.group.operation.GroupMinimum
- createField() - Method in class com.northconcepts.datapipeline.group.operation.GroupSum
- createFieldDef(Column) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Returns a field definition typed according to
GenerateEntityFromDataset.getFieldTypeSelectionMode(); text fields get a maximum length rounded up to the next multiple of 100. - createFieldName(TreeNode, Set<String>) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Builds a normalized field name for the supplied node that is unique within
fieldNames(which this method adds it to): wildcard nodes use theirname patternhint orid, collisions gain the parent-name prefix and then a numeric suffix. - CreateForeignKey - Class in com.northconcepts.datapipeline.sql.h2
-
Generates an
ALTER TABLE...ADD CONSTRAINTstatement to add a foreign key constraint in H2. - CreateForeignKey - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates an
ALTER TABLE...ADD CONSTRAINTstatement to add a foreign key constraint in MySQL. - CreateForeignKey - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates an
ALTER TABLE...ADD CONSTRAINTstatement to add a foreign key constraint in PostgreSQL. - CreateForeignKey() - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
- CreateForeignKey() - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- CreateForeignKey() - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- CreateForeignKey(String, String, String) - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Constructs a CreateForeignKey with the specified constraint, primary table, and foreign table names.
- CreateForeignKey(String, String, String) - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Creates a foreign key named
constraintNameonforeignTableNamethat referencesprimaryTableName. - CreateForeignKey(String, String, String) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Creates a foreign key named
constraintNameonforeignTableNamethat referencesprimaryTableName. - createFrame() - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
-
Create frame
- createFrame(Jsonata.Frame) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- CreateH2DdlFromSchemaDef - Class in com.northconcepts.datapipeline.sql.h2
-
Generates H2 DDL from
SchemaDef - CreateH2DdlFromSchemaDef(SchemaDef) - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
- createHeaderRecord(Record) - Method in class com.northconcepts.datapipeline.core.AbstractWriter
-
Builds the header row from the first record: a copy whose field values are the field names, without session properties.
- CreateIndex - Class in com.northconcepts.datapipeline.sql.h2
-
Generates a
CREATE INDEXstatement for H2. - CreateIndex - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates a
CREATE INDEXstatement for MySQL. - CreateIndex - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates a
CREATE INDEXstatement for PostgreSQL. - CreateIndex() - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateIndex
- CreateIndex() - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- CreateIndex() - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- CreateIndex(String, String, String...) - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Constructs a CreateIndex with the specified index name, table name, and column names.
- CreateIndex(String, String, String...) - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- CreateIndex(String, String, String...) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- createInputStream() - Method in interface com.northconcepts.datapipeline.io.InputStreamFactory
-
Returns a newly opened stream; the caller closes it.
- createIssue(JiraIssue) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
- createIssue(JiraIssue) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
- createIssue(String, String, int) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
- createIssue(String, String, int, Map<String, String>) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
-
Creates an issue of the given type ID in the project with the given key; a
parententry inoptionalFieldssets the parent issue's key and the other entries are set as issue fields. - createJdbcUpsertWriter(Connection, String, IUpsert) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
- createJdbcWriter(Connection, String, IInsert) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Creates the writer for a connection obtained in
JdbcMultiWriter.open(); the default copies this writer's settings and makes the new writer close the connection. - createJob() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Creates, but does not run, a job that reads the processed input and writes it to the output.
- CreateMySqlDdlFromSchemaDef - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates MySQL DDL from
SchemaDef - CreateMySqlDdlFromSchemaDef(SchemaDef) - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
- createOrOverwrite(long) - Method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
- CreatePostgreSqlDdlFromSchemaDef - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates PostgreSQL DDL from
SchemaDef - CreatePostgreSqlDdlFromSchemaDef(SchemaDef) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
- createProducer(JmsSettings, JmsConnection) - Method in enum class com.northconcepts.datapipeline.jms.JmsDestinationType
-
Creates the producer a
JmsWriteruses to send messages to the connection's destination. - createReader() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Creates a reader that receives source records according to the strategy; create all readers before running the feeder so none miss records.
- createReader() - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
-
Creates a reader that receives the written records according to the strategy; create all readers before writing so none miss records.
- createRecord() - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Starts a new current record with one field per added
XmlField, copying the values of cascading fields from the previous record. - createSequence() - Static method in class com.northconcepts.datapipeline.jsonata.Utils
-
Create an empty sequence to contain query results
- createSequence(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- createSpreadsheet(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Creates a new spreadsheet and remembers its id; follow with
GoogleSheetDocument.open(). - CreateTable - Class in com.northconcepts.datapipeline.sql.h2
-
Generates a
CREATE TABLEstatement for H2. - CreateTable - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates a
CREATE TABLEstatement for MySQL. - CreateTable - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates a
CREATE TABLEstatement for PostgreSQL. - CreateTable() - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateTable
- CreateTable() - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateTable
- CreateTable() - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateTable
- CreateTable(String) - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Constructs a CreateTable with the specified table name.
- CreateTable(String) - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateTable
- CreateTable(String) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateTable
- CreateTableColumn - Class in com.northconcepts.datapipeline.sql.h2
-
Generates a column definition for a
CREATE TABLEstatement for H2. - CreateTableColumn - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates a column definition for a
CREATE TABLEstatement for MySQL. - CreateTableColumn - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates a column definition for a
CREATE TABLEstatement for PostgreSQL. - CreateTableColumn() - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
- CreateTableColumn() - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- CreateTableColumn() - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- CreateTableColumn(String, TableColumnType) - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Constructs a CreateTableColumn with the specified column name and type.
- CreateTableColumn(String, TableColumnType, Integer) - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Constructs a CreateTableColumn with the specified column name, type, and length.
- CreateTableColumn(String, TableColumnType, Integer, Integer) - Constructor for class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Constructs a CreateTableColumn with the specified column name, type, length, and scale.
- CreateTableColumn(String, TableColumnType) - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- CreateTableColumn(String, TableColumnType, Integer) - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- CreateTableColumn(String, TableColumnType, Integer, Integer) - Constructor for class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- CreateTableColumn(String, TableColumnType) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- CreateTableColumn(String, TableColumnType, Integer) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- CreateTableColumn(String, TableColumnType, Integer, Integer) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- createTableConfig(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Creates the class name, package and file settings used to generate a table's class; override to change them per table.
- createTempDataset(AbstractPipeline) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
-
Creates a temporary dataset on disk that will be deleted when the dataset is closed or when the JVM exits.
- createTempDataset(File, AbstractPipeline) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
-
Creates a temporary dataset on disk that will be deleted when the dataset is closed or when the JVM exits.
- createTempDataset(String, String, AbstractPipeline) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Creates a temporary dataset on disk that will be deleted when the dataset is closed or when the JVM exits.
- createTempDataset(String, String, DataReaderFactory) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Creates a temporary dataset on disk that will be deleted when the dataset is closed or when the JVM exits.
- createUpsert(JdbcUpsertWriter, Record) - Method in interface com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert.IUpsertFactory
-
Returns a new strategy for records with the given record's field names (in the same order); the caller prepares it.
- createVariable(String) - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
-
Reserves and returns a unique variable name: the given name if unused, otherwise the name plus the first free suffix from 0 to 99 (throws when all are taken).
- CreateWindowStrategy - Class in com.northconcepts.datapipeline.group
-
Determines when
GroupByReaderopens a new sliding window. - CreateWindowStrategy() - Constructor for class com.northconcepts.datapipeline.group.CreateWindowStrategy
- credentials - Variable in class com.northconcepts.datapipeline.google.GoogleApiReader
- Credentials - Class in com.northconcepts.datapipeline.security
-
An immutable bundle of resolved secret values keyed by name, with an optional expiry.
- CREDENTIALS_EXPIRY_SKEW_MILLISECONDS - Static variable in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
How long before a credentials snapshot's reported expiry the
AmazonS3FileSystem.CredentialsResolverBridgere-resolves from theCredentialsResolver. - Credentials.Builder - Class in com.northconcepts.datapipeline.security
-
Assembles
Credentialsfrom key-value pairs and an optional expiry; seeCredentials.builder(). - CredentialsResolver - Interface in com.northconcepts.datapipeline.security
-
Resolves
Credentialson demand. - CredentialsResolverBridge(AmazonS3FileSystem) - Constructor for class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem.CredentialsResolverBridge
- CredentialsResolverRegistry - Class in com.northconcepts.datapipeline.security
-
A thread-safe mapping of logical ids to
CredentialsResolvers, enabling "reference, not secret" late binding: serialized pipelines and sources/sinks carry only a resolver id and are re-wired to the live resolver on load. - CredentialsResolverRegistry() - Constructor for class com.northconcepts.datapipeline.security.CredentialsResolverRegistry
- credentialValue(Credentials, String, String) - Static method in class com.northconcepts.datapipeline.internal.lang.FileSystem
-
Returns the value for the given key from the resolved credentials or
fallbackwhen the credentials arenullor don't contain the key. - CRITICAL - Enum constant in enum class com.northconcepts.datapipeline.core.Message.Level
- CSV - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- CsvPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Reads a pipeline's source data from a CSV or other delimited
FileSourceusing aCSVReader. - CsvPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- CsvPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline.output
- CsvPipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- CSVReader - Class in com.northconcepts.datapipeline.csv
-
Obtains records from a Comma Separated Value (CSV) or delimited stream.
- CSVReader(File) - Constructor for class com.northconcepts.datapipeline.csv.CSVReader
- CSVReader(Reader) - Constructor for class com.northconcepts.datapipeline.csv.CSVReader
- CSVWriter - Class in com.northconcepts.datapipeline.csv
-
Writes records to a Comma Separated Value (CSV) stream.
- CSVWriter(File) - Constructor for class com.northconcepts.datapipeline.csv.CSVWriter
- CSVWriter(File, boolean) - Constructor for class com.northconcepts.datapipeline.csv.CSVWriter
- CSVWriter(Writer) - Constructor for class com.northconcepts.datapipeline.csv.CSVWriter
- CSVWriter.IValuePolicy - Interface in com.northconcepts.datapipeline.csv
-
The interface used by null and empty string writers.
- CSVWriter.ValuePolicy - Enum Class in com.northconcepts.datapipeline.csv
-
The default implementation used to write null and empty string.
- currentRecord - Variable in class com.northconcepts.datapipeline.core.AbstractReader
- currentRecord - Variable in class com.northconcepts.datapipeline.core.AbstractWriter
- currentRecord - Variable in class com.northconcepts.datapipeline.jdbc.JdbcReader
- currentRecord - Variable in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- currentRecord - Variable in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- currentRecord - Variable in class com.northconcepts.datapipeline.xml.XmlReader
- cyclicDependency(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
D
- DARK_BLUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- DARK_GREEN - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- DARK_RED - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- DARK_TEAL - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- DARK_YELLOW - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- darken(double) - Method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Darkens a color.
- DATABASE_COLUMN_CATALOG_NAME - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The catalog name of a column returned from the database for this field.
- DATABASE_COLUMN_CLASS_NAME - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The class name of a column returned from the database for this field.
- DATABASE_COLUMN_DISPLAY_SIZE - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column display size returned from the database for this field.
- DATABASE_COLUMN_FIELD_TYPE - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
- DATABASE_COLUMN_JAVA_TYPE - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The Java type mapped from
java.sql.Types. - DATABASE_COLUMN_NAME - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column name returned from the database for this field.
- DATABASE_COLUMN_NULLABLE - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column isNullable value returned from the database for this field.
- DATABASE_COLUMN_PRECISION - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column precision returned from the database for this field.
- DATABASE_COLUMN_SCALE - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column scale returned from the database for this field.
- DATABASE_COLUMN_SCHEMA_NAME - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The schema name of a column returned from the database for this field.
- DATABASE_COLUMN_SIGNED - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column isSigned value returned from the database for this field.
- DATABASE_COLUMN_SQL_TYPE - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column type returned from the database for this field.
- DATABASE_COLUMN_TABLE_NAME - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The table name of a column returned from the database for this field.
- DATABASE_COLUMN_TYPE_NAME - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column type name returned from the database for this field.
- DATABASE_QUERY - Static variable in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The SQL statement used to query the database.
- DATABASE_URL - Static variable in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The JDBC connection URL.
- DataConnectionMode - Enum Class in com.northconcepts.datapipeline.filesystem.ftp
-
Selects whether an
FtpFileSystemuses active or passive mode for its data connections. - DataEndpoint - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for reading and writing records.
- DataEndpoint() - Constructor for class com.northconcepts.datapipeline.core.DataEndpoint
- DataEndpoint.State - Enum Class in com.northconcepts.datapipeline.core
-
Lifecycle states of an endpoint:
NEWuntil opened, thenOPENED, thenCLOSED. - DataEndpointGroup - Class in com.northconcepts.datapipeline.core
-
Helper class--makes it easy to work with multiple readers and writers as a single unit.
- DataEndpointGroup() - Constructor for class com.northconcepts.datapipeline.core.DataEndpointGroup
- DataException - Exception Class in com.northconcepts.datapipeline.core
-
Indicates an error has occurred during the course of execution.
- DataException() - Constructor for exception class com.northconcepts.datapipeline.core.DataException
-
Constructs a new exception.
- DataException(String) - Constructor for exception class com.northconcepts.datapipeline.core.DataException
-
Constructs a new exception with the specified detail message.
- DataException(String, Throwable) - Constructor for exception class com.northconcepts.datapipeline.core.DataException
-
Constructs a new exception with the specified detail message and cause.
- DataException(Throwable) - Constructor for exception class com.northconcepts.datapipeline.core.DataException
-
Constructs a new exception with the specified cause.
- DataExceptionContributor - Interface in com.northconcepts.datapipeline.core
-
An interface for classes capable of adding context/information to exceptions usually to aid in identifying and troubleshooting issues.
- dataFormat(String) - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that sets the data format string for the cell.
- dataLoadingNotStarted() - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- DataMapping - Class in com.northconcepts.datapipeline.foundations.datamapping
-
The top-level abstraction to map a set of values from source to target using the DataPipeline Expression Language or custom implementation.
- DataMapping - Enum constant in enum class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPartType
- DataMapping() - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- DataMappingAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.datamapping
-
A
PipelineActionthat maps each record to a new record using aDataMapping. - DataMappingAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- DataMappingEditor - Class in com.northconcepts.datapipeline.foundations.datamapping
-
Applies a
DataMappingto records from aDataReaderFactoryand pages through the mapped results in memory, keeping a sample of the records that failed. - DataMappingEditor(DataReaderFactory) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Creates an editor that reads the source with a new reader each time a mapping is applied.
- DataMappingExpressionContext - Class in com.northconcepts.datapipeline.foundations.datamapping
-
The expression context used by a
DataMapping, exposing thesource,target,previousSourceandpreviousTargetcontexts to expressions by name. - DataMappingExpressionContext(ExpressionContext, ExpressionContext) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
- DataMappingExpressionContext(ExpressionContext, ExpressionContext, ExpressionContext, ExpressionContext) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
- DataMappingObject - Class in com.northconcepts.datapipeline.foundations.datamapping
-
Base class for the data mapping classes:
DataMappingParts, problems and results. - DataMappingObject() - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingObject
- DataMappingPart - Class in com.northconcepts.datapipeline.foundations.datamapping
-
Base class for the elements of a data mapping -- the
DataMappingitself and its field mappings -- thatDataMappingProblems refer to. - DataMappingPart() - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPart
- DataMappingPartType - Enum Class in com.northconcepts.datapipeline.foundations.datamapping
-
The kinds of
DataMappingPartthatDataMappingProblems can refer to. - DataMappingPipeline - Class in com.northconcepts.datapipeline.foundations.pipeline
-
A pipeline that maps each input record to a new record using a
DataMapping; records failing the mapping go to the discard writer, if one is set, instead of stopping the pipeline. - DataMappingPipeline() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- DataMappingProblem - Class in com.northconcepts.datapipeline.foundations.datamapping
-
Describes an issue found when checking a data mapping and the
DataMappingPartit was found in. - DataMappingProblem() - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblem
- DataMappingProblem(DataMappingPart, String, Object...) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblem
-
Creates a problem for the given part; when arguments are passed,
detailsis aString.format(String, Object...)pattern. - DataMappingProblemsSupplier - Interface in com.northconcepts.datapipeline.foundations.datamapping
-
Implemented by data mapping elements that can check themselves, and optionally their children, for
DataMappingProblems. - DataMappingReader - Class in com.northconcepts.datapipeline.foundations.datamapping
-
Maps each record read from a nested reader with a
DataMappingand returns the target record instead; records failing a mapping condition are skipped. - DataMappingReader(DataReader, DataMapping) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
-
Creates a reader that throws an exception for the first record whose mapping throws or fails validation; records failing a mapping condition are skipped.
- DataMappingReader(DataReader, DataMapping, DataWriter, String) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
-
Creates a reader that sends records whose mapping throws or fails validation to
discardWriter(throwing instead if it is null), with the reason in thediscardReasonFieldNamefield when that is not null. - DataMappingResult - Class in com.northconcepts.datapipeline.foundations.datamapping
-
The outcome of mapping one record with a
DataMapping: the target record plus any failed condition, field mapping exceptions and schema validation results. - DataMappingResult() - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- DataMappingValidator - Class in com.northconcepts.datapipeline.foundations.datamapping
-
Static checks that data mapping parts use to add
DataMappingProblems to a list. - DataMappingValidator() - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingValidator
- DataMappingWriter - Class in com.northconcepts.datapipeline.foundations.datamapping
-
Maps each record with a
DataMappingand writes the target record to a nested writer instead; records failing a mapping condition are not written. - DataMappingWriter(DataWriter, DataMapping) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
-
Creates a writer that throws an exception for the first record whose mapping throws or fails validation; records failing a mapping condition are skipped.
- DataMappingWriter(DataWriter, DataMapping, DataWriter, String) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
-
Creates a writer that sends records whose mapping throws or fails validation to
discardWriter(throwing instead if it is null), with the reason in thediscardReasonFieldNamefield when that is not null. - DataObject - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for classes that work with data and require a consistent error handling mechanism.
- DataObject() - Constructor for class com.northconcepts.datapipeline.core.DataObject
- DataReader - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for reading records.
- DataReader() - Constructor for class com.northconcepts.datapipeline.core.DataReader
- DataReaderAction - Interface in com.northconcepts.datapipeline.foundations.pipeline.action
-
A processing step, such as a conversion, filter or transformation, applied to records by wrapping their
DataReader. - DataReaderDecorator<T> - Interface in com.northconcepts.datapipeline.job
-
A Decorator that allows a DataReader to be wrapped in new behavior.
- DataReaderFactory - Interface in com.northconcepts.datapipeline.job
-
A factory to create new DataReaders.
- DataReaderIterator - Class in com.northconcepts.datapipeline.job
-
A DataReader that sequentially reads from an Iterator of other DataReaders.
- DataReaderIterator(Iterator<DataReader>) - Constructor for class com.northconcepts.datapipeline.job.DataReaderIterator
- DataReaderLookup - Class in com.northconcepts.datapipeline.transform.lookup
-
A
Lookupthat loads all records from aDataReaderinto memory, keyed by the parameter fields; the reader is read and closed in the constructor. - DataReaderLookup(DataReader, FieldList) - Constructor for class com.northconcepts.datapipeline.transform.lookup.DataReaderLookup
-
Add all result fields.
- DataReaderLookup(DataReader, FieldList, FieldList) - Constructor for class com.northconcepts.datapipeline.transform.lookup.DataReaderLookup
-
Adds selected result fields.
- DataReaderPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
- DataReaderPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
-
Creates an input with no factory; call
DataReaderPipelineInput.setFactory(DataReaderFactory)beforeDataReaderPipelineInput.createDataReader(). - DataReaderPipelineInput(DataReaderFactory) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- Dataset - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
The base class for caching records produced by a
PipelineorDataMappingPipeline. - Dataset(AbstractPipeline) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Creates a dataset that caches the given pipeline's records once
Dataset.load()is called. - Dataset.ColumnsDataReader - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Reads one summary record per column, with its name, counts, inferred type, lengths and sample value.
- DatasetIterator - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Obtains records from those cached in a
Dataset. - DatasetIterator(Dataset) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetIterator
-
Creates an iterator over the dataset's records; it stops when it catches up with loading instead of waiting for more.
- DatasetPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
- DatasetPipelineInput(Dataset) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.DatasetPipelineInput
- DatasetReader - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Obtains records from those cached in a
Dataset. - DatasetReader(Dataset) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetReader
-
Creates a reader for all the dataset's records; reads wait for records it is still loading.
- DatasetReader(Dataset, long, int) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetReader
-
Creates a reader for up to
countrecords starting at the 0-basedoffset(0 or less reads to the end). - DatasetSpliterator - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Traverses records from those cached in a
Dataset. - DatasetSpliterator(Dataset) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetSpliterator
-
Creates a spliterator over the records loaded when it is created; records loaded later are not included.
- DataWriter - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for writing records.
- DataWriter() - Constructor for class com.northconcepts.datapipeline.core.DataWriter
- DataWriterDecorator<T> - Interface in com.northconcepts.datapipeline.job
-
A Decorator that allows a DataWriter to be wrapped in new behavior.
- DataWriterFactory - Interface in com.northconcepts.datapipeline.job
-
A factory to create new DataWriters.
- DataWriterPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline.output
-
Writes a pipeline's records to the
DataWritercreated by aDataWriterFactory. - DataWriterPipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
-
Creates an output with no factory; call
DataWriterPipelineOutput.setFactory(DataWriterFactory)beforeDataWriterPipelineOutput.createDataWriter(). - DataWriterPipelineOutput(DataWriterFactory) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- DATE - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- DATE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- DATE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
- DATE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- DATE - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- DATE - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- DATE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- DATE_14_DAYS_AGO - Static variable in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- DATE_30_DAYS_AGO - Static variable in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- DATE_60_DAYS_AGO - Static variable in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- DATE_7_DAYS_AGO - Static variable in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- DATE_90_DAYS_AGO - Static variable in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- DATE_FORMAT - Variable in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- DATE_TIME_FORMAT - Variable in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- DATE_TIME_FORMATTER - Static variable in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
- DATE_TODAY - Static variable in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- DATE_YESTERDAY - Static variable in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- dateIs(String) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's date-time value to equal the given
yyyy-MM-ddoryyyy-MM-dd HH:mm[:ss[.SSS]]date to the millisecond. - dateIs(Date) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's date-time value to equal the given date to the millisecond.
- DateIs - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields whose date-time value equals the given date to the millisecond. - DateIs(String) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIs
-
Creates a rule from a
yyyy-MM-ddoryyyy-MM-dd HH:mm[:ss[.SSS]]date string. - DateIs(LocalDateTime) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIs
- DateIs(Date) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIs
- dateIsAfter(String) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's date-time value to be after the given
yyyy-MM-ddoryyyy-MM-dd HH:mm[:ss[.SSS]]date; null values fail. - dateIsAfter(Date) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's date-time value to be after the given date; null values fail.
- DateIsAfter - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields whose date-time value is after the given date; null values are rejected. - DateIsAfter(String) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIsAfter
-
Creates a rule from a
yyyy-MM-ddoryyyy-MM-dd HH:mm[:ss[.SSS]]date string. - DateIsAfter(LocalDateTime) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIsAfter
- DateIsAfter(Date) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIsAfter
- dateIsBefore(String) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's date-time value to be null or before the given
yyyy-MM-ddoryyyy-MM-dd HH:mm[:ss[.SSS]]date. - dateIsBefore(Date) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's date-time value to be null or before the given date.
- DateIsBefore - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields whose date-time value is before the given date; null values are also allowed. - DateIsBefore(String) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIsBefore
-
Creates a rule from a
yyyy-MM-ddoryyyy-MM-dd HH:mm[:ss[.SSS]]date string. - DateIsBefore(LocalDateTime) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIsBefore
- DateIsBefore(Date) - Constructor for class com.northconcepts.datapipeline.filter.rule.DateIsBefore
- DateParam - Class in com.northconcepts.datapipeline.trello
-
A date parameter that can be created from a
yyyy-MM-ddstring or aDate. - DateParam(String) - Constructor for class com.northconcepts.datapipeline.trello.DateParam
-
Parses a
yyyy-MM-dddate; a null or empty string gives a null date and an unparseable one throws aDataException. - DateParam(Date) - Constructor for class com.northconcepts.datapipeline.trello.DateParam
- DATETIME - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- DATETIME - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- DATETIME - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
- DATETIME - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- DATETIME - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- DATETIME - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- dateTimeFromMillis(Number, String, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Converts milliseconds since the epoch to an ISO 8601 timestamp
- DateTimeNodeNameRule - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Classifies date/timestamp names (for example
2024-01-15map keys) as dynamic using aDateTimePatternDetector. - DateTimeNodeNameRule() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DateTimeNodeNameRule
- DateTimePattern - Class in com.northconcepts.datapipeline.foundations.time
-
A serializable, comparable wrapper for
DateTimeFormatterthat can be used as keys inMapand values inSet. - DateTimePattern() - Constructor for class com.northconcepts.datapipeline.foundations.time.DateTimePattern
- DateTimePattern(String) - Constructor for class com.northconcepts.datapipeline.foundations.time.DateTimePattern
-
Creates a new instance using a date-time pattern for case-insensitive parsing.
- DateTimePatternDetector - Class in com.northconcepts.datapipeline.foundations.time
-
A utility for parsing date, time, and date-time values from string using a set of possible patterns.
- DateTimePatternDetector() - Constructor for class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
- DateTimePatternMatch - Class in com.northconcepts.datapipeline.foundations.time
-
An immutable value parsed from string using
DateTimePattern. - DateTimePatternMatch(DateTimePattern, TemporalAccessor) - Constructor for class com.northconcepts.datapipeline.foundations.time.DateTimePatternMatch
- dateTimeToDate() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- dateTimeToMillis(String, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Converts an ISO 8601 timestamp to milliseconds since the epoch
- dateTimeToString(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Formats date-time values using the given
SimpleDateFormatpattern in the default time zone. - dateTimeToString(String, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Formats date-time values using the given
SimpleDateFormatpattern in the given time zone (an unknown ID falls back to GMT). - dateTimeToString(DateFormat) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- dateTimeToTime() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- DateTimeUtils - Class in com.northconcepts.datapipeline.jsonata.utils
- DateTimeUtils() - Constructor for class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
- dateToString(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Formats date values using the given
SimpleDateFormatpattern in the default time zone. - dateToString(String, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Formats date values using the given
SimpleDateFormatpattern in the given time zone (an unknown ID falls back to GMT). - dateToString(DateFormat) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- daysToDate() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of days since the epoch to dates (midnight in the default time zone); other values are left unchanged.
- daysToDateTime() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of days since the epoch to date-times; other values are left unchanged.
- DEBUG - Enum constant in enum class com.northconcepts.datapipeline.core.Message.Level
- DebugReader - Class in com.northconcepts.datapipeline.core
-
A proxy that prints records passing through to a stream in a human-readable format
- DebugReader(DataReader) - Constructor for class com.northconcepts.datapipeline.core.DebugReader
-
Creates a reader that prints each record to
System.outunder a header showing the iddebugand the record count. - DebugReader(DataReader, String) - Constructor for class com.northconcepts.datapipeline.core.DebugReader
-
Creates a reader that prints each record to
System.outunder a header showingidand the record count. - DebugReader(DataReader, String, OutputStream) - Constructor for class com.northconcepts.datapipeline.core.DebugReader
-
Creates a reader that prints each record to
outputStreamunder a header showingidand the record count. - DebugReader(DataReader, String, Writer) - Constructor for class com.northconcepts.datapipeline.core.DebugReader
-
Creates a reader that prints each record to
writerunder a header showingidand the record count. - DebugWriter - Class in com.northconcepts.datapipeline.core
-
A proxy that prints records passing through to a stream in a human-readable format
- DebugWriter(DataWriter) - Constructor for class com.northconcepts.datapipeline.core.DebugWriter
-
Creates a writer that prints each record to
System.outunder a header showing the iddebugand the record count. - DebugWriter(DataWriter, String) - Constructor for class com.northconcepts.datapipeline.core.DebugWriter
-
Creates a writer that prints each record to
System.outunder a header showingidand the record count. - DebugWriter(DataWriter, String, OutputStream) - Constructor for class com.northconcepts.datapipeline.core.DebugWriter
-
Creates a writer that prints each record to
outputStreamunder a header showingidand the record count. - DebugWriter(DataWriter, String, Writer) - Constructor for class com.northconcepts.datapipeline.core.DebugWriter
-
Creates a writer that prints each record to
writerunder a header showingidand the record count. - DEC - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- DEC - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- DECIMAL - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- DECIMAL - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- DECIMAL - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- DecisionTable - Class in com.northconcepts.datapipeline.foundations.decisiontable
-
Evaluates rules in order against a record and returns the outcomes of the first rule whose conditions all hold, or the default outcomes if none does.
- DecisionTable() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- DecisionTableAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.decision
-
A
PipelineActionthat evaluates aDecisionTablefor each record and copies the resulting outcome fields into it. - DecisionTableAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- DecisionTableCondition - Class in com.northconcepts.datapipeline.foundations.decisiontable
-
A condition of a
DecisionTableRule: a logical expression in which?stands for the condition's variable. - DecisionTableCondition() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- DecisionTableCondition(String) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
-
Creates a condition without a variable, so its expression should not use the
?placeholder. - DecisionTableCondition(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
-
Creates a condition whose expression can use
?forvariable, as in? > 0. - DecisionTableObject - Class in com.northconcepts.datapipeline.foundations.decisiontable
-
Base class for the decision table classes: the table, its rules, conditions and outcomes, and its results.
- DecisionTableObject() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableObject
- DecisionTableOutcome - Class in com.northconcepts.datapipeline.foundations.decisiontable
-
An outcome of a
DecisionTableRule, or a default outcome of aDecisionTable: sets the result field named by its variable to the value of its expression. - DecisionTableOutcome() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- DecisionTableOutcome(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- DecisionTableReader - Class in com.northconcepts.datapipeline.foundations.decisiontable
-
Evaluates a
DecisionTablefor each record read from a nested reader and adds the outcome fields to the record. - DecisionTableReader(DataReader, DecisionTable) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableReader
- DecisionTableResult - Class in com.northconcepts.datapipeline.foundations.decisiontable
-
The result of evaluating a
DecisionTable: the rule that fired and the outcome fields. - DecisionTableResult() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableResult
- DecisionTableRule - Class in com.northconcepts.datapipeline.foundations.decisiontable
-
A rule of a
DecisionTablethat fires when all its conditions hold, setting the result fields with its outcomes. - DecisionTableRule() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- DecisionTableWriter - Class in com.northconcepts.datapipeline.foundations.decisiontable
-
Evaluates a
DecisionTablefor each record and adds the outcome fields to it before writing it to a nested writer. - DecisionTableWriter(DataWriter, DecisionTable) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableWriter
- DecisionTree - Class in com.northconcepts.datapipeline.foundations.decisiontree
-
Evaluates a record by walking from the root node, at each node entering the first child whose condition holds (or else the default node), and combines the outcomes of every node visited.
- DecisionTree() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- DecisionTreeAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.decision
-
A
PipelineActionthat evaluates aDecisionTreefor each record and copies the resulting outcome fields into it. - DecisionTreeAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- DecisionTreeNode - Class in com.northconcepts.datapipeline.foundations.decisiontree
-
A node of a
DecisionTree: the condition for entering it, the outcomes it sets when visited, its child nodes and the default node entered when no child's condition holds. - DecisionTreeNode() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- DecisionTreeNode(String) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- DecisionTreeNode(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- DecisionTreeObject - Class in com.northconcepts.datapipeline.foundations.decisiontree
-
Base class for the decision tree classes: the tree, its nodes and outcomes, and its results.
- DecisionTreeObject() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeObject
- DecisionTreeOutcome - Class in com.northconcepts.datapipeline.foundations.decisiontree
-
An outcome of a
DecisionTreeNode: sets the result field named by its variable to the value of its expression. - DecisionTreeOutcome() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- DecisionTreeOutcome(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- DecisionTreeReader - Class in com.northconcepts.datapipeline.foundations.decisiontree
-
Evaluates a
DecisionTreefor each record read from a nested reader and adds the outcome fields to the record. - DecisionTreeReader(DataReader, DecisionTree) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeReader
- DecisionTreeResult - Class in com.northconcepts.datapipeline.foundations.decisiontree
-
The result of evaluating a
DecisionTree: the path of nodes entered and the combined outcome fields. - DecisionTreeResult() - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeResult
- DecisionTreeVisitor - Interface in com.northconcepts.datapipeline.foundations.decisiontree
-
Callback for
DecisionTree.visit(DecisionTreeVisitor), called once for each node of the tree. - DecisionTreeWriter - Class in com.northconcepts.datapipeline.foundations.decisiontree
-
Evaluates a
DecisionTreefor each record and adds the outcome fields to it before writing it to a nested writer. - DecisionTreeWriter(DataWriter, DecisionTree) - Constructor for class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeWriter
- decode(Object) - Method in class com.northconcepts.datapipeline.foundations.core.Encoder.NullEncoder
- decode(String) - Method in class com.northconcepts.datapipeline.foundations.core.Encoder.HexEncoder
- decode(T) - Method in interface com.northconcepts.datapipeline.foundations.core.Encoder
- decodeUrl(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Decode a string from a url
- decodeUrlComponent(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Decode a string from a component for a url
- decorate(FieldLocation, ExcelCellStyle) - Method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Applies styling to the given Excel cell style based on the field location.
- decorate(T) - Method in interface com.northconcepts.datapipeline.job.DataReaderDecorator
-
Returns the reader to use in place of the given one, typically a proxy that wraps it.
- decorate(T) - Method in interface com.northconcepts.datapipeline.job.DataWriterDecorator
-
Returns the writer to use in place of the given one, typically a proxy that wraps it.
- decrementRecordCount() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Reduces this endpoint's record-count by 1.
- decryptField(Field) - Method in class com.northconcepts.datapipeline.security.DecryptingReader
-
Decrypts the field with
DecryptingReader.decryptFieldImpl(Field), re-initializing the cipher if that fails. - decryptFieldImpl(Field) - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
- decryptFieldImpl(Field) - Method in class com.northconcepts.datapipeline.security.DecryptingReader
-
Replaces the field's encrypted value in place with the original type and value.
- decryptFieldImpl(Field) - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
- DecryptingReader - Class in com.northconcepts.datapipeline.security
-
Base class for proxy readers that decrypt the selected fields of each record in place, or every field when none are selected.
- DecryptingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.security.DecryptingReader
- DEFAULT - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.SortDirection
- DEFAULT - Static variable in class com.northconcepts.datapipeline.core.ValueNodeComparator
-
A default instance of ValueNodeComparator that can be reused.
- DEFAULT - Static variable in interface com.northconcepts.datapipeline.jdbc.JdbcValueReader
-
Deprecated.use
JdbcValueReader.ORIGINALto replicate the pre-8.0.0 default behavior. Maps database types to java types using the original DataPipeline algorithm. This mapping should no longer be used and replaced withJdbcValueReader.OPINIONATED(orJdbcValueReader.STRICT) instead. - DEFAULT - Static variable in interface com.northconcepts.datapipeline.job.JobTemplate
- DEFAULT - Static variable in interface com.northconcepts.datapipeline.twitter.ITwitterConverter
- DEFAULT - Static variable in class com.northconcepts.datapipeline.twitter.TwitterConverter
- DEFAULT_BATCH_SIZE - Static variable in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- DEFAULT_EXPIRY_SKEW_MILLISECONDS - Static variable in class com.northconcepts.datapipeline.security.CachingCredentialsResolver
- DEFAULT_MAXIMUM_NAME_LENGTH - Static variable in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DateTimeNodeNameRule
- DEFAULT_MINIMUM_SIBLINGS - Static variable in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.AffixSiblingSetRule
- DEFAULT_MINIMUM_SIBLINGS - Static variable in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
- DEFAULT_MINIMUM_SIMILARITY - Static variable in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
- DEFAULT_QUEUE_SIZE - Static variable in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
- DEFAULT_QUEUE_SIZE - Static variable in class com.northconcepts.datapipeline.multiplex.SplitWriter
- DEFAULT_READ_BUFFER_SIZE - Static variable in class com.northconcepts.datapipeline.core.Endpoint
- DEFAULT_RETRY_AFTER_SECONDS - Static variable in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
- defaultBlockSize() - Method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
- DefaultJobCallback - Class in com.northconcepts.datapipeline.job
-
A default implementation of JobCallback.
- DefaultJobCallback() - Constructor for class com.northconcepts.datapipeline.job.DefaultJobCallback
- delete() - Method in class com.northconcepts.datapipeline.core.Record
-
Marks this record as
Record.State.DELETED. - delete(int, int) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Removes the characters from the 0-based
start(inclusive) toend(exclusive, capped at the value's length). - Delete - Class in com.northconcepts.datapipeline.jdbc.sql.delete
-
Builds a
DELETE FROM table WHERE ...statement with its parameter values. - Delete(String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.delete.Delete
- DELETED - Enum constant in enum class com.northconcepts.datapipeline.core.Record.State
-
Record has been marked for deletion and will be filtered out.
- DELETED_DATE - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
- deleteFile(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Deletes an S3 object from the specified bucket.
- deleteIssue(String) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
- deleteIssue(String) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
- deliverEvent(Event<T>) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Delivers the event to the matching typed listeners, then to the untyped listeners, with
EventBus.getCurrentEvent()set; runs on an executor thread. - DeMux - Class in com.northconcepts.datapipeline.multiplex
-
Converts a single source DataReader into many using one of the provided strategies.
- DeMux(DataReader, DeMux.IStrategy) - Constructor for class com.northconcepts.datapipeline.multiplex.DeMux
- DeMux.IStrategy - Interface in com.northconcepts.datapipeline.multiplex
-
Strategy for distributing the source records among the readers created by
DeMux.createReader(). - DeMux.Strategy - Enum Class in com.northconcepts.datapipeline.multiplex
-
The built-in strategies: send every record to all readers or each record to one reader in turn.
- derivePattern(TreeNode, List<TreeNode>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.AffixSiblingSetRule
- derivePattern(TreeNode, List<TreeNode>) - Method in interface com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetRule
-
Returns the pattern shared by the candidate children of
parent, or null;CollapseSiblingPatternspasses its named children, excluding attributes, wildcards and JSON containers. - derivePattern(TreeNode, List<TreeNode>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
- desc(String) - Method in class com.northconcepts.datapipeline.core.SortingReader
-
Adds a descending sort on the given field name or
FieldPathexpression, after any fields already added. - DESCENDING - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.SortDirection
- deserialize(JsonParser, DeserializationContext) - Method in class com.northconcepts.datapipeline.json.RecordJsonDeserializer
- deserialize(String, byte[]) - Method in class com.northconcepts.datapipeline.kafka.RecordDeserializer
- deserializer - Variable in class com.northconcepts.datapipeline.security.DecryptingReader
- DESTROY - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- detail() - Method in class com.northconcepts.datapipeline.json.builder.JsonFragment
- detail() - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Adds and returns the detail marker; the nodes added to it are written once for each record.
- detail() - Method in class com.northconcepts.datapipeline.json.builder.JsonValue
- detail() - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
-
Adds and returns the detail marker; the nodes added to it are written once for each record.
- DetectFieldCandidates - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Marks every
TreeNodethat held at least one text value as a field, assigns its initial field name, and flags values that should cascade across multiple output records. - DetectFieldCandidates() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DetectFieldCandidates
- detectFileType() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Detects the file type from the file's extension or content, replacing any type already set.
- detectFileType() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- detectFileType() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- detectPrimaryKeys(RecordList) - Static method in class com.northconcepts.datapipeline.foundations.tools.DetectPrimaryKeysInDataset
-
Returns a list with the first of the smallest field combinations whose values are unique across the records, or an empty list if there is none.
- detectPrimaryKeys(RecordList, int, boolean) - Static method in class com.northconcepts.datapipeline.foundations.tools.DetectPrimaryKeysInDataset
-
Returns the combinations of up to
maxKeyFieldCountfields whose values are unique across the records, smallest first and skipping supersets of keys already found; stops at the first one ifstopOnFirstMatchis true. - DetectPrimaryKeysInDataset - Class in com.northconcepts.datapipeline.foundations.tools
-
Finds the fields, or smallest field combinations, whose values are unique across all records of a
RecordList. - DetectPrimaryKeysInDataset() - Constructor for class com.northconcepts.datapipeline.foundations.tools.DetectPrimaryKeysInDataset
- DetectRecordBreakCandidates - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Marks the repeating
TreeNodes that represent one record per instance. - DetectRecordBreakCandidates() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DetectRecordBreakCandidates
- Diagnostic - Class in com.northconcepts.datapipeline.diagnostic
-
Helps diagnose environmental issues by collecting properties and logging them to the console.
- Diagnostic() - Constructor for class com.northconcepts.datapipeline.diagnostic.Diagnostic
-
Collects all the properties up front, which includes running a test job that transfers 100 million records.
- diff(EntityDef, EntityDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.diff.EntityDefDiff
-
Compares two versions of an entity, matching fields and indexes by exact name; validation rules are not compared.
- diff(EntityRelationshipDef, EntityRelationshipDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.diff.EntityRelationshipDefDiff
-
Compares the properties of two versions of a relationship; a null argument yields an
ADDEDorREMOVEDdiff. - diff(FieldDef, FieldDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.diff.FieldDefDiff
-
Compares the properties of two versions of a field; a null argument yields an
ADDEDorREMOVEDdiff. - diff(IndexDef, IndexDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.diff.IndexDefDiff
-
Compares two versions of an index, matching its index fields by exact field name; a null argument yields an
ADDEDorREMOVEDdiff. - diff(IndexFieldDef, IndexFieldDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.diff.IndexFieldDefDiff
-
Compares the properties of two versions of an index field; a null argument yields an
ADDEDorREMOVEDdiff. - diff(SchemaDef, SchemaDef) - Static method in class com.northconcepts.datapipeline.foundations.schema.diff.SchemaDefDiff
-
Compares two versions of a schema, matching entities and relationships by exact name; a null argument yields an
ADDEDorREMOVEDdiff. - diff(String, Record, Record) - Static method in class com.northconcepts.datapipeline.foundations.difference.RecordDiff
-
Compares two records field by field, recursing into nested records; a null old record gives an
DiffType.ADDEDdiff and a null new record aDiffType.REMOVEDone. - diff(String, Record, Record, String...) - Static method in class com.northconcepts.datapipeline.foundations.difference.RecordDiff
-
Compares two records like
RecordDiff.diff(String, Record, Record), skipping the named top-level fields. - diff(String, Record, Record, Set<String>) - Static method in class com.northconcepts.datapipeline.foundations.difference.RecordDiff
-
Compares two records like
RecordDiff.diff(String, Record, Record), skipping the named top-level fields; null skips none. - Diff<T> - Class in com.northconcepts.datapipeline.foundations.difference
-
A node in a tree of differences: whether a named value was added, removed, changed or left unchanged, with its old and new values and the diffs of its children.
- Diff() - Constructor for class com.northconcepts.datapipeline.foundations.difference.Diff
- Diff(DiffType, String, T, T) - Constructor for class com.northconcepts.datapipeline.foundations.difference.Diff
- DiffType - Enum Class in com.northconcepts.datapipeline.foundations.difference
-
The kind of difference recorded by a
Diff. - DIRECT_MESSAGE_TEXT_TOO_LONG - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- discard(Record, Filter) - Method in class com.northconcepts.datapipeline.filter.FilteringReader
-
Handles a record rejected by
filter; writes it to the discard writer (adding the discard reason field if configured) and returns null so it is dropped. - discard(Record, Filter) - Method in class com.northconcepts.datapipeline.validate.ValidatingReader
- displayText - Variable in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- distinct(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Returns the values that appear in a sequence, with duplicates eliminated.
- DO_NOTHING - Enum constant in enum class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert.ConflictAction
- DO_NOTHING - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.ConflictAction
- DOCUMENT - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelHyperlinkType
-
A hyperlink to another location in the same Excel document.
- DOCX - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- DOUBLE - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- DOUBLE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- DOUBLE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
- DOUBLE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- DOUBLE - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- DOUBLE - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- DOUBLE_PRECISION - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- DOUBLE_PRECISION - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- DOUBLE_PRECISION - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- DOWN - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
Discards the digits based on decimal places and never increments the digit prior to discarded fraction.
- DRAFT - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.ProductStatus
- DRAFTS - Static variable in interface com.northconcepts.datapipeline.email.GmailFolders
- DropBoxFileSystem - Class in com.northconcepts.datapipeline.filesystem.dropbox
-
Class for accessing the DropBox file system.
- DropBoxFileSystem() - Constructor for class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Enables access to DropBox with the access token supplied through a
CredentialsResolver(seeDropBoxFileSystem.setCredentialsResolver(CredentialsResolver)). - DropBoxFileSystem(String) - Constructor for class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Creates a file system that uses the given DropBox access token unless a
CredentialsResolversupplies one. - DropTable - Class in com.northconcepts.datapipeline.sql.h2
-
Generates a
DROP TABLEstatement for H2. - DropTable - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates a
DROP TABLEstatement for MySQL. - DropTable - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates a
DROP TABLEstatement for PostgreSQL. - DropTable() - Constructor for class com.northconcepts.datapipeline.sql.h2.DropTable
- DropTable() - Constructor for class com.northconcepts.datapipeline.sql.mysql.DropTable
- DropTable() - Constructor for class com.northconcepts.datapipeline.sql.postgresql.DropTable
- DropTable(String...) - Constructor for class com.northconcepts.datapipeline.sql.h2.DropTable
-
Constructs a DropTable with the specified table names.
- DropTable(String...) - Constructor for class com.northconcepts.datapipeline.sql.mysql.DropTable
- DropTable(String...) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.DropTable
- DropTableConstraint - Class in com.northconcepts.datapipeline.sql.h2
-
Generates a
ALTER TABLE...DROP CONSTRAINTstatement for H2. - DropTableConstraint - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates a
ALTER TABLE...DROP CONSTRAINTstatement for MySQL. - DropTableConstraint - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates a
ALTER TABLE...DROP CONSTRAINTstatement for PostgreSQL. - DropTableConstraint() - Constructor for class com.northconcepts.datapipeline.sql.h2.DropTableConstraint
- DropTableConstraint() - Constructor for class com.northconcepts.datapipeline.sql.mysql.DropTableConstraint
- DropTableConstraint() - Constructor for class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- DropTableConstraint(String, String) - Constructor for class com.northconcepts.datapipeline.sql.h2.DropTableConstraint
-
Constructs a DropTableConstraint with the specified table and constraint names.
- DropTableConstraint(String, String) - Constructor for class com.northconcepts.datapipeline.sql.mysql.DropTableConstraint
- DropTableConstraint(String, String) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- duplicateChildName(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- duplicateIndexFields(String, String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- DUPLICATES_OK - Enum constant in enum class com.northconcepts.datapipeline.jms.JmsAcknowledgeMode
E
- E - Static variable in class com.northconcepts.datapipeline.meter.Meter
- each(Map, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- ElapsedTimeSequenceStrategy(long) - Constructor for class com.northconcepts.datapipeline.core.SequenceWriter.ElapsedTimeSequenceStrategy
-
Creates a strategy that ends each sequence after
elapsedTimemilliseconds. - element(String) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
-
Adds and returns a child element named by the given expression; quote a fixed name, as in
'actor'. - elementIsWrongType(String, int, FieldType, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- elementToRecord(T) - Method in class com.northconcepts.datapipeline.memory.CollectionReader
-
Converts an element to a Record using the converter function.
- EMAIL - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelHyperlinkType
-
A hyperlink to an email address.
- EmailReadDirection - Enum Class in com.northconcepts.datapipeline.email
-
The order in which an
EmailReaderreads the messages it found: first to last or last to first. - EmailReader - Class in com.northconcepts.datapipeline.email
-
Reads emails (and their attachments) from IMAP mailboxes.
- EmailReader(MailStore, String, int, String, String) - Constructor for class com.northconcepts.datapipeline.email.EmailReader
- EmailReader(MailStore, String, String, String) - Constructor for class com.northconcepts.datapipeline.email.EmailReader
-
Creates a reader that connects to the mail store's default port.
- EmailType - Enum Class in com.northconcepts.datapipeline.mailchimp.list
-
Email format (HTML or text) of a MailChimp
ListMember. - EMPTY_STRING - Enum constant in enum class com.northconcepts.datapipeline.csv.CSVWriter.ValuePolicy
-
Writes an unquoted blank value.
- EMPTY_STRING - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- emptyToNull() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts empty string to
null, otherwise the original value is returned. - enableDateTimeNodeNames() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Adds a
DateTimeNodeNameRuleso date/timestamp names collapse to wildcards. - enableJmx() - Static method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Turns JMX (Java Management Extensions) monitoring invalid input: '&' management on and exposes running Jobs and EventBuses as managed beans.
- enableSiblingPatternCollapse() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Inserts a
CollapseSiblingPatternspass ahead of the detection passes so siblings with a derivable naming pattern (for exampleitem-1,item-2,item-3) collapse into one wildcard node. - enableStructureSiblingCollapse() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Ensures a
CollapseSiblingPatternspass is present (inserting one ahead of the detection passes when missing) and that it includes aStructureSiblingSetRule, so structurally similar siblings collapse regardless of their names. - encode(Object) - Method in class com.northconcepts.datapipeline.foundations.core.Encoder.NullEncoder
- encode(String) - Method in class com.northconcepts.datapipeline.foundations.core.Encoder.HexEncoder
- encode(S) - Method in interface com.northconcepts.datapipeline.foundations.core.Encoder
-
Returns the encoded form of the value;
Encoder.decode(Object)must turn it back into the original. - Encoder<S,
T> - Interface in com.northconcepts.datapipeline.foundations.core -
Converts values to and from an encoded form, such as the password stored by a
JdbcConnection. - Encoder.HexEncoder - Class in com.northconcepts.datapipeline.foundations.core
-
An
Encoderthat converts strings to and from the hexadecimal form of their UTF-8 bytes; null and empty strings are returned unchanged. - Encoder.NullEncoder - Class in com.northconcepts.datapipeline.foundations.core
-
An
Encoderthat returns values unchanged. - encodeUrl(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Encode a string into a url
- encodeUrlComponent(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Encode a string into a component for a url
- encryptField(Field) - Method in class com.northconcepts.datapipeline.security.EncryptingReader
-
Encrypts the field with
EncryptingReader.encryptFieldImpl(Field), re-initializing the cipher if that fails. - encryptFieldImpl(Field) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
- encryptFieldImpl(Field) - Method in class com.northconcepts.datapipeline.security.EncryptingReader
-
Replaces the field's value in place with its encrypted form.
- encryptFieldImpl(Field) - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
- EncryptingReader - Class in com.northconcepts.datapipeline.security
-
Base class for proxy readers that encrypt the selected fields of each record in place, or every field when none are selected.
- EncryptingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.security.EncryptingReader
- endArray(A) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of an array in the JSON input.
- endArray(ArrayValue) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called after all of the array's elements have been visited.
- endArray(ArrayValue) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- endArray(ArrayValue) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- endArray(List) - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- endArrayValue(A) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of an array element in the JSON input.
- endArrayValue(ArrayValue, int, ValueNode<?>) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called after the element at the given 0-based index has been visited.
- endArrayValue(ArrayValue, int, ValueNode<?>) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- endArrayValue(ArrayValue, int, ValueNode<?>) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- endArrayValue(List) - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- endBoolean(boolean) - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- endBoolean(boolean) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of a boolean literal (
trueorfalse) in the JSON input. - endField(Field) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called last for a field, after
INodeVisitor.endFieldValue(Field, ValueNode). - endField(Field) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- endField(Field) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- endFieldValue(Field, ValueNode<?>) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called after the field's value node has been visited.
- endFieldValue(Field, ValueNode<?>) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- endFieldValue(Field, ValueNode<?>) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- endNull() - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- endNull() - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of a
nullliteral in the JSON input. - endNumber(String) - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- endNumber(String) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of a number in the JSON input.
- endObject(Map) - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- endObject(O) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of an object in the JSON input.
- endObjectName(O, String) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of an object member name in the JSON input.
- endObjectValue(Map, String) - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- endObjectValue(O, String) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of an object member value in the JSON input.
- Endpoint - Class in com.northconcepts.datapipeline.core
-
Base class for anything that is opened and closed, such as readers, writers and file systems; tracks its state, open and close times, and elapsed time.
- Endpoint() - Constructor for class com.northconcepts.datapipeline.core.Endpoint
- ENDPOINT_RETIRED - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- endReading() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- endReading() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- endReading() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- endReadingImpl() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- endReadingImpl() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- endReadingImpl() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- endRecord(Record) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called after all of the record's fields have been visited.
- endRecord(Record) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- endRecord(Record) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- endRecord(Record, int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- endRecord(Record, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- endRecord(Record, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- endSequence(SequenceWriter.Sequence, Record) - Method in class com.northconcepts.datapipeline.core.SequenceWriter.ElapsedTimeSequenceStrategy
- endSequence(SequenceWriter.Sequence, Record) - Method in interface com.northconcepts.datapipeline.core.SequenceWriter.ISequenceStrategy
-
Returns true to end the current sequence before the given record is written, so that the record starts a new one.
- endSequence(SequenceWriter.Sequence, Record) - Method in class com.northconcepts.datapipeline.core.SequenceWriter.OrSequenceStrategy
- endSequence(SequenceWriter.Sequence, Record) - Method in class com.northconcepts.datapipeline.core.SequenceWriter.RecordCountSequenceStrategy
- endSequence(SequenceWriter.Sequence, Record) - Method in class com.northconcepts.datapipeline.core.SequenceWriter.SchedulerSequenceStrategy
- endString(String) - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- endString(String) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the end of a string in the JSON input.
- endWriting() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- endWriting() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- endWriting() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- endWritingImpl() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- endWritingImpl() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- endWritingImpl() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- ensureCapacity(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Increases the capacity of this array's internal list, if necessary, to ensure it can hold at least the specified number of elements without reallocating.
- ensureCapacity(int) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Increases the capacity of this
RecordListto allow it to hold the specified number of elements if needed. - ensureFields(String...) - Method in class com.northconcepts.datapipeline.core.Record
-
Ensures that all specified field names exist in this record, creating any missing ones.
- ensureFields(Collection<String>) - Method in class com.northconcepts.datapipeline.core.Record
-
Ensures that all specified field names exist in this record, creating any missing ones.
- ensureSoloDescendantsAreNotRecordBreaks(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.OptimizeTreeStructure
-
Clears the record-break flag of each only child below the parent, recursively; not called by
OptimizeTreeStructure.transform(Tree). - entitiesToArray(TweetEntity[], String) - Method in interface com.northconcepts.datapipeline.twitter.ITwitterConverter
-
Returns
entityPrefixplusITwitterConverter.entityToString(TweetEntity)for each entity, or null if there are none. - entitiesToArray(TweetEntity[], String) - Method in class com.northconcepts.datapipeline.twitter.TwitterConverter
- entitiesToString(TweetEntity[], String, String) - Method in interface com.northconcepts.datapipeline.twitter.ITwitterConverter
-
Joins the entities' prefixed texts with
separator, or returns null if there are no entities. - entitiesToString(TweetEntity[], String, String) - Method in class com.northconcepts.datapipeline.twitter.TwitterConverter
- ENTITY - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
- ENTITY_RELATIONSHIP - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
- EntityDef - Class in com.northconcepts.datapipeline.foundations.schema
-
The metadata structure defining a file, JSON object, database table, or class for validation and mapping.
- EntityDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.EntityDef
- EntityDef(String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.EntityDef
- EntityDefDiff - Class in com.northconcepts.datapipeline.foundations.schema.diff
-
The differences between two versions of an
EntityDef, with child diffs for its properties, fields and indexes. - EntityDefDiff() - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.EntityDefDiff
- EntityDefDiff(DiffType, String, EntityDef, EntityDef) - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.EntityDefDiff
- EntityExpansionPolicy - Enum Class in com.northconcepts.datapipeline.twitter
-
Indicates how multi-valued values should be returned.
- entityHasNoSchema(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- entityMissingInSchema(String, String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- EntityRelationshipDef - Class in com.northconcepts.datapipeline.foundations.schema
-
The metadata model for relating two entities in a schema.
- EntityRelationshipDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- EntityRelationshipDef(String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- EntityRelationshipDefDiff - Class in com.northconcepts.datapipeline.foundations.schema.diff
-
The property differences between two versions of an
EntityRelationshipDef. - EntityRelationshipDefDiff() - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.EntityRelationshipDefDiff
- EntityRelationshipDefDiff(DiffType, String, EntityRelationshipDef, EntityRelationshipDef) - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.EntityRelationshipDefDiff
- entityToString(TweetEntity) - Method in interface com.northconcepts.datapipeline.twitter.ITwitterConverter
-
Returns the entity's text, using the expanded URL for URL entities when present, or null for a null entity.
- entityToString(TweetEntity) - Method in class com.northconcepts.datapipeline.twitter.TwitterConverter
- entrySet() - Method in class com.northconcepts.datapipeline.jsonata.JsonObject
- environment - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- EnvironmentCredentialsResolver - Class in com.northconcepts.datapipeline.security
-
A
CredentialsResolverthat reads credential values from environment variables at each resolve. - EnvironmentCredentialsResolver() - Constructor for class com.northconcepts.datapipeline.security.EnvironmentCredentialsResolver
- EOF - Static variable in interface com.northconcepts.datapipeline.core.IParser
- EOF - Static variable in class com.northconcepts.datapipeline.core.PipedWriter
- EOF - Static variable in class com.northconcepts.datapipeline.core.TextReader
- EOF - Static variable in class com.northconcepts.datapipeline.multiplex.DeMux
- EOF - Static variable in class com.northconcepts.datapipeline.multiplex.SplitWriter
- EOF - Static variable in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- EOF - Static variable in class com.northconcepts.datapipeline.twitter.TwitterReader
- EOF - Static variable in class com.northconcepts.datapipeline.twitter.TwitterWriter
- EOF - Static variable in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
- equals(Record, RecordComparator) - Method in class com.northconcepts.datapipeline.core.Record
-
Indicates whether this record is equal to another using the specified
RecordComparator. - equals(Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Indicates whether the given object is an
ArrayValuewith equal elements. - equals(Object) - Method in class com.northconcepts.datapipeline.core.CompositeValue
- equals(Object) - Method in class com.northconcepts.datapipeline.core.Field
-
Indicates whether the given object is a
Fieldwith an equal value. - equals(Object) - Method in class com.northconcepts.datapipeline.core.FieldDeclarations
- equals(Object) - Method in class com.northconcepts.datapipeline.core.FieldList
- equals(Object) - Method in class com.northconcepts.datapipeline.core.FieldLocation
- equals(Object) - Method in class com.northconcepts.datapipeline.core.FieldPath
- equals(Object) - Method in class com.northconcepts.datapipeline.core.Record
-
Indicates whether the given object is a
Recordwith equal fields. - equals(Object) - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Indicates whether the given object is a
SingleValuewith an equal underlying value. - equals(Object) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- equals(Object) - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
- equals(Object) - Method in class com.northconcepts.datapipeline.excel.ExcelColor
- equals(Object) - Method in class com.northconcepts.datapipeline.excel.ExcelFont
- equals(Object) - Method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
- equals(Object) - Method in class com.northconcepts.datapipeline.filter.FieldCount
- equals(Object) - Method in class com.northconcepts.datapipeline.filter.FieldExists
- equals(Object) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
- equals(Object) - Method in class com.northconcepts.datapipeline.filter.FieldNotExists
- equals(Object) - Method in class com.northconcepts.datapipeline.filter.FilterExpression
- equals(Object) - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaFilter
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- equals(Object) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePattern
- equals(Object) - Method in class com.northconcepts.datapipeline.jsonata.Location
- equals(Object, Collator) - Method in class com.northconcepts.datapipeline.core.Field
- ERR_MSG_DIFF_DECIMAL_GROUP - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- ERR_MSG_INVALID_NAME_MODIFIER - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- ERR_MSG_INVALID_OPTIONS_SINGLE_CHAR - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- ERR_MSG_INVALID_OPTIONS_STRING - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- ERR_MSG_MISSING_FORMAT - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- ERR_MSG_NO_CLOSING_BRACKET - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- ERR_MSG_SEQUENCE_UNSUPPORTED - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- ERR_MSG_TIMEZONE_FORMAT - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- ERR_MSG_UNKNOWN_COMPONENT_SPECIFIER - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- error - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- error(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- ERROR - Enum constant in enum class com.northconcepts.datapipeline.core.Message.Level
- errors - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- escapeJavaString(String) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
-
Escapes double quotes so the string can be placed in a generated Java string literal; other characters, such as backslashes, are left as-is.
- escapeKeyword(String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset.DatabaseProvider
-
Escapes a SQL keyword to make it safe for use as an identifier.
- escapeKeyword(String) - Static method in class com.northconcepts.datapipeline.sql.h2.H2SqlPart
-
Escapes a SQL keyword by wrapping it in double quotes.
- escapeKeyword(String) - Static method in class com.northconcepts.datapipeline.sql.mysql.MySqlPart
-
Returns the given name wrapped in double quotes, without escaping any double quotes inside it.
- escapeKeyword(String) - Static method in class com.northconcepts.datapipeline.sql.postgresql.PostgresSqlPart
-
Returns the given name wrapped in double quotes, without escaping any double quotes inside it.
- estimateSize() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetSpliterator
- evaluate() - Method in class com.northconcepts.datapipeline.group.AggregateReader.AggregateOperation
-
Deprecated.Returns this operation's result so far.
- evaluate(ValueNode<?>) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- evaluate(ValueNode<?>, Jsonata.Frame) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- evaluate(DefaultExpressionContext) - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
-
Evaluates the expression in the given context and stores the result there under the variable name; throws a
DataExceptionif this field is invalid or the evaluation fails. - evaluate(ExpressionContext) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Evaluates the calculated fields, then the rules in order, and returns the first rule that fires with its outcome, or the default outcomes if none fires.
- evaluate(ExpressionContext) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
-
Returns true if the expression holds in the given context; called by the containing
DecisionTableRule. - evaluate(ExpressionContext) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Validates the rule and returns true if all its conditions hold in the given context.
- evaluate(ExpressionContext) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Evaluates the calculated fields, then walks the tree from the root node and returns the path taken and the combined outcome fields; outcomes of deeper nodes replace same-named fields set by earlier ones.
- evaluate(ExpressionContext) - Method in class com.northconcepts.datapipeline.json.builder.JsonExpression
- evaluate(ExpressionContext, Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
-
Evaluates the expression and stores the result in the record field named by the variable; called when the rule containing this outcome fires.
- evaluate(ExpressionContext, Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
-
Evaluates the expression and stores the result in the record field named by the variable; called when evaluation visits the node containing this outcome.
- evaluate(String) - Method in class com.northconcepts.datapipeline.core.Record
-
Evaluates the given expression string against this record and returns the result.
- evaluateMatcher(Pattern, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Evaluate the matcher function against the str arg
- evaluateOutcome(ExpressionContext, Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Evaluates each outcome into the given record; called when the rule fires.
- evenFieldIndex() - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations with even field indexes (columns).
- evenRowIndex() - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations with even row indexes.
- Event<T> - Class in com.northconcepts.datapipeline.eventbus
-
A method call made on an
EventBuspublisher, captured with its arguments for delivery to the bus's listeners. - Event(Object, Object, Class<T>, Object, Method, Object[]) - Constructor for class com.northconcepts.datapipeline.eventbus.Event
- EventBus - Class in com.northconcepts.datapipeline.eventbus
-
An asynchronous, in-memory, event delivery service.
- EventBus() - Constructor for class com.northconcepts.datapipeline.eventbus.EventBus
-
Creates a bus using a single thread to deliver events.
- EventBus(ExecutorService) - Constructor for class com.northconcepts.datapipeline.eventbus.EventBus
-
Creates a bus using the specified ExecutorService to deliver events to listeners.
- EventBus.State - Enum Class in com.northconcepts.datapipeline.eventbus
-
The lifecycle states of a bus; listeners, publishers and events are only accepted while
ALIVE. - EventBusLifecycleListener - Interface in com.northconcepts.datapipeline.eventbus
-
Notified when any
EventBusis created or begins shutting down; register withEventBus.addEventBusLifecycleListener(EventBusLifecycleListener). - EventBusReader - Class in com.northconcepts.datapipeline.eventbus
-
Reads the records published to an
EventBuson the given topics (all topics if none are given), for example by anEventBusWriter. - EventBusReader(EventBus, int, Object...) - Constructor for class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Creates a reader that queues at most
queueCapacityrecords; a full queue blocks the bus thread delivering to it. - EventBusReader(EventBus, Object...) - Constructor for class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Creates a reader with an unbounded queue for the records published on any of the given topics.
- EventBusWriter - Class in com.northconcepts.datapipeline.eventbus
-
Writes records to an event bus under a specific topic.
- EventBusWriter(EventBus, Object) - Constructor for class com.northconcepts.datapipeline.eventbus.EventBusWriter
-
Creates a new
EventBusWriter. - EventFilter - Enum Class in com.northconcepts.datapipeline.shopify.client
-
Resource types for
ShopifyEventCriteria.setFilters(EventFilter...);EventFilter.toString()returns the lower-case name. - EventFilter - Interface in com.northconcepts.datapipeline.eventbus
-
Decides which events a listener receives; supplied when the listener is added to an
EventBus. - EventListenerClassFilter - Class in com.northconcepts.datapipeline.eventbus.filter
-
Matches events published through any one of a set of listener interfaces (all events if none are given).
- EventListenerClassFilter(Class<?>...) - Constructor for class com.northconcepts.datapipeline.eventbus.filter.EventListenerClassFilter
- EventSourceFilter - Class in com.northconcepts.datapipeline.eventbus.filter
-
Matches events whose source is one of a set of objects, compared by identity (all events if none are given).
- EventSourceFilter(Object...) - Constructor for class com.northconcepts.datapipeline.eventbus.filter.EventSourceFilter
- EventSourceInvocationHandler<T> - Class in com.northconcepts.datapipeline.eventbus
-
Backs the publisher proxies returned by
EventBus.getPublisher(Object, Class, Object), publishing each method call to the bus as anEvent. - EventSourceInvocationHandler(EventBus, Object, Class<T>, Object) - Constructor for class com.northconcepts.datapipeline.eventbus.EventSourceInvocationHandler
- EventVerb - Enum Class in com.northconcepts.datapipeline.shopify.client
-
Event verbs for
ShopifyEventCriteria.setVerb(EventVerb);EventVerb.toString()returns the lower-case name. - Example of record returned: - Search tag in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
- Section
- ExcelCellStyle - Class in com.northconcepts.datapipeline.excel
-
Represents the styling properties that can be applied to an Excel cell.
- ExcelCellStyle() - Constructor for class com.northconcepts.datapipeline.excel.ExcelCellStyle
- ExcelCellStyleDecorator - Interface in com.northconcepts.datapipeline.excel
-
A functional interface for applying styling to Excel cells based on their location.
- ExcelColor - Class in com.northconcepts.datapipeline.excel
-
Represents a color that can be used in Excel cells.
- ExcelColor(int, int, int) - Constructor for class com.northconcepts.datapipeline.excel.ExcelColor
-
Creates an ExcelColor from RGB components.
- ExcelColor(Integer, Integer, Integer, Integer) - Constructor for class com.northconcepts.datapipeline.excel.ExcelColor
-
Creates an ExcelColor with the specified palette index and RGB components.
- ExcelColorPalette - Enum Class in com.northconcepts.datapipeline.excel
-
Excel-compatible indexed color palette (BIFF legacy)
- ExcelDocument - Class in com.northconcepts.datapipeline.excel
-
The in-memory abstraction for an Excel workbook.
- ExcelDocument() - Constructor for class com.northconcepts.datapipeline.excel.ExcelDocument
-
Creates an empty workbook that uses the
ExcelDocument.ProviderType.POI_XSSF(.xlsx) provider. - ExcelDocument(ExcelDocument.ProviderType) - Constructor for class com.northconcepts.datapipeline.excel.ExcelDocument
-
Creates an empty workbook that uses the given provider; use an
openmethod to load existing content. - ExcelDocument.ProviderType - Enum Class in com.northconcepts.datapipeline.excel
-
Selects the Excel library (Apache POI or JXL) and workbook format an
ExcelDocumentuses. - ExcelFieldMetadata - Class in com.northconcepts.datapipeline.excel
-
Provides access to Excel-specific metadata attached to a
Field. - ExcelFieldMetadata() - Constructor for class com.northconcepts.datapipeline.excel.ExcelFieldMetadata
-
Creates a new ExcelFieldMetadata with no associated field.
- ExcelFieldMetadata(Field) - Constructor for class com.northconcepts.datapipeline.excel.ExcelFieldMetadata
-
Creates a new ExcelFieldMetadata for the specified field.
- ExcelFont - Class in com.northconcepts.datapipeline.excel
-
Represents font styling options for Excel cells.
- ExcelFont() - Constructor for class com.northconcepts.datapipeline.excel.ExcelFont
- ExcelHyperlink - Class in com.northconcepts.datapipeline.excel
-
Represents a hyperlink that can be attached to an Excel cell.
- ExcelHyperlink(ExcelHyperlinkType, String) - Constructor for class com.northconcepts.datapipeline.excel.ExcelHyperlink
-
Creates a new ExcelHyperlink with the specified type and location.
- ExcelHyperlinkFunction - Interface in com.northconcepts.datapipeline.excel
-
A functional interface that creates
ExcelHyperlinkinstances based on aFieldLocation. - ExcelHyperlinkType - Enum Class in com.northconcepts.datapipeline.excel
-
Enumeration of the types of hyperlinks supported in Excel.
- ExcelPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Reads a pipeline's source data from a sheet of an Excel
FileSourceusing anExcelReader. - ExcelPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- ExcelPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline.output
-
A pipeline output that writes to an Excel file using the
ExcelWriter. - ExcelPipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- ExcelReader - Class in com.northconcepts.datapipeline.excel
-
Obtains records from a Microsoft Excel document.
- ExcelReader(ExcelDocument) - Constructor for class com.northconcepts.datapipeline.excel.ExcelReader
- ExcelReader.FailedExpressionStrategy - Enum Class in com.northconcepts.datapipeline.excel
-
Indicates how to handle failures when evaluating cell formulas/expressions.
- ExcelWriter - Class in com.northconcepts.datapipeline.excel
-
Writes records to a Microsoft Excel document.
- ExcelWriter(ExcelDocument) - Constructor for class com.northconcepts.datapipeline.excel.ExcelWriter
-
Creates a writer for the document and applies
ExcelWriter.initStyles(), enabling metadata writing on POI providers. - exception(String) - Method in class com.northconcepts.datapipeline.core.AsyncReader
- exception(String) - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- exception(String) - Method in interface com.northconcepts.datapipeline.core.DataExceptionContributor
-
Creates an exception with the specified message and containing this endpoint's properties (name-value pairs).
- exception(String) - Method in class com.northconcepts.datapipeline.core.DataObject
-
Creates an exception with the specified message and containing this endpoint's properties (name-value pairs).
- exception(String) - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
Creates an exception with the specified message and containing this endpoint's properties (name-value pairs).
- exception(String, Throwable) - Method in class com.northconcepts.datapipeline.core.AsyncReader
- exception(String, Throwable) - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- exception(String, Throwable) - Method in interface com.northconcepts.datapipeline.core.DataExceptionContributor
-
Converts an exception to a
DataException, prefixing the original message with the specified text and adding this endpoint's properties (name-value pairs). - exception(String, Throwable) - Method in class com.northconcepts.datapipeline.core.DataObject
-
Converts an exception to a
DataException, prefixing the original message with the specified text and adding this endpoint's properties (name-value pairs). - exception(String, Throwable) - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
Converts an exception to a
DataException, prefixing the original message with the specified text and adding this endpoint's properties (name-value pairs). - exception(Throwable) - Method in class com.northconcepts.datapipeline.core.AsyncReader
- exception(Throwable) - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- exception(Throwable) - Method in interface com.northconcepts.datapipeline.core.DataExceptionContributor
-
Converts an exception to a
DataExceptionand adds this endpoint's properties (name-value pairs). - exception(Throwable) - Method in class com.northconcepts.datapipeline.core.DataObject
-
Converts an exception to a
DataExceptionand adds this endpoint's properties (name-value pairs). - exception(Throwable) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Wraps the exception in a
DataExceptionand adds the parser's buffer and position as properties. - exception(Throwable) - Method in class com.northconcepts.datapipeline.core.LineParser
- exception(Throwable) - Method in class com.northconcepts.datapipeline.core.Parser
- exception(Throwable) - Method in class com.northconcepts.datapipeline.core.StringParser
- exception(Throwable) - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
Converts an exception to a
DataExceptionand adds this endpoint's properties (name-value pairs). - exception(Throwable) - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- exception(Throwable) - Method in class com.northconcepts.datapipeline.json.builder.JsonField
- exception(Throwable) - Method in class com.northconcepts.datapipeline.json.builder.JsonFragment
- exception(Throwable) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Wraps the throwable in a
DataExceptionwith this node's type, class and children; subclasses add their own details. - exception(Throwable) - Method in class com.northconcepts.datapipeline.json.builder.JsonPrimitive
- ExceptionListener - Interface in com.northconcepts.datapipeline.eventbus
-
Notified when a listener on an
EventBusthrows an exception while receiving an event; register withEventBus.addExceptionListener(ExceptionListener). - exceptionMappingValue(String, String, Object, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- excludeFields(FieldList) - Method in class com.northconcepts.datapipeline.core.Record
-
Removes all fields whose names appear in the given list.
- excludeFields(Iterable<FieldPath>) - Method in class com.northconcepts.datapipeline.core.Record
-
Removes all fields matching the given
FieldPathiterable that exist in this record. - excludeFields(Set<String>) - Method in class com.northconcepts.datapipeline.core.Record
-
Removes all fields whose names appear in the given set.
- ExcludeFields - Class in com.northconcepts.datapipeline.transform
-
Deprecated.use
RemoveFields - ExcludeFields(String...) - Constructor for class com.northconcepts.datapipeline.transform.ExcludeFields
-
Deprecated.
- ExcludeFields(Collection<String>) - Constructor for class com.northconcepts.datapipeline.transform.ExcludeFields
-
Deprecated.
- executeBatch() - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Executes the batch; called each time the writer's batch size is reached and on close if records remain.
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- executeBatch() - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Executes the batch; called each time the writer's batch size is reached and on close if records remain.
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- executeBatch() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- executeUpdate() - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Executes the statement with the values applied; called after each record when the writer is not batching.
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowInsertAllStatementInsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowSelectUnionAllStatementInsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- executeUpdate() - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Executes the upsert with the values applied; called after each record when the writer is not batching.
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- executeUpdate() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- exists(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Determines if the argument is undefined
- exists(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Checks if an S3 object exists in the specified bucket.
- expandAndPushRecords(Record) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- expandEntities(TweetEntity[], String, ITwitterConverter) - Method in interface com.northconcepts.datapipeline.twitter.IEntityExpansionPolicy
-
Returns the value to store for the given entities, such as a joined string or an array.
- expandListFieldsAsFields(Record) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- expandToFit(NumberDescriptor) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
-
Widens this descriptor to also fit the other number: keeps the larger digit counts and becomes negative if either is.
- EXPONENTIAL_BACKOFF - Enum constant in enum class com.northconcepts.datapipeline.retry.RetryStrategy
- EXPONENTIAL_RANDOM_BACKOFF - Enum constant in enum class com.northconcepts.datapipeline.retry.RetryStrategy
- exportedKeysLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- expr - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- EXPRESSION - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- EXPRESSION - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- ExpressionHelper - Class in com.northconcepts.datapipeline.expression
-
Parses expression-language text into a syntax tree (
ASTNode).
F
- FAIL - Enum constant in enum class com.northconcepts.datapipeline.core.Node.DuplicateNodeAction
-
Throw an exception and stop the copy/merge.
- FAIL - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelReader.FailedExpressionStrategy
-
Throw exception when cell formula/expression evaluation fails -- causing the pipeline/job to abort.
- FAIL - Enum constant in enum class com.northconcepts.datapipeline.excel.LargeCellHandler
- FAIL - Enum constant in enum class com.northconcepts.datapipeline.twitter.ApiLimitPolicy
-
Stop the reader with an exception if the Twitter API call limit is reached.
- FastRenameField - Class in com.northconcepts.datapipeline.transform
-
An performant alternative to
RenameFieldthat assumes 1) a flat table structure (no nested fields or arrays), 2) columns are always in the same position from row to row 3) no missing fields (nulls field values are okay), and 4) the target name does not already exist (otherwise there will be two fields with the same name). - FastRenameField(Integer, String) - Constructor for class com.northconcepts.datapipeline.transform.FastRenameField
-
Creates a transformer that renames the field at the given 0-based position.
- FastRenameField(String, String) - Constructor for class com.northconcepts.datapipeline.transform.FastRenameField
-
Creates a transformer that renames the field named
oldName; its position is looked up in the first record and reused for all later records. - field(String, String) - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- field(String, String) - Method in class com.northconcepts.datapipeline.json.builder.JsonDetailMarker
- field(String, String) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Adds a scalar field whose name and value are computed by the given expressions; only valid on object nodes.
- field(String, String) - Method in class com.northconcepts.datapipeline.json.builder.JsonObject
- Field - Class in com.northconcepts.datapipeline.core
-
Field holds persistent key-value data as part of a record.
- Field(Record) - Constructor for class com.northconcepts.datapipeline.core.Field
- FIELD - Enum constant in enum class com.northconcepts.datapipeline.core.Node.NodeType
- FIELD - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
- FIELD - Enum constant in enum class com.northconcepts.datapipeline.json.builder.JsonNodeType
- FIELD_SCHEMA - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The field's schema for ORC and Parquet files.
- FieldComparator - Class in com.northconcepts.datapipeline.core
-
See
FieldPathfor supported field name expressions. - FieldComparator() - Constructor for class com.northconcepts.datapipeline.core.FieldComparator
- FieldCount - Class in com.northconcepts.datapipeline.filter
-
A filter that checks for the total number of fields
- FieldCount(int) - Constructor for class com.northconcepts.datapipeline.filter.FieldCount
-
Creates a filter that keeps records with exactly
countfields. - FieldDeclarations - Class in com.northconcepts.datapipeline.core
-
Declares the Java type of named fields for expressions such as
FilterExpressionandSetCalculatedField; declared types take precedence over those inferred from each record. - FieldDeclarations() - Constructor for class com.northconcepts.datapipeline.core.FieldDeclarations
- FieldDef - Class in com.northconcepts.datapipeline.foundations.schema
-
The metadata structure of one column or property in a file, JSON object, database table, or class for validation and mapping.
- FieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.FieldDef
- FieldDef(String, FieldType) - Constructor for class com.northconcepts.datapipeline.foundations.schema.FieldDef
- FieldDefDiff - Class in com.northconcepts.datapipeline.foundations.schema.diff
-
The property differences between two versions of a
FieldDef. - FieldDefDiff() - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.FieldDefDiff
- FieldDefDiff(DiffType, String, FieldDef, FieldDef) - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.FieldDefDiff
- fieldEquals(Object) - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations where the field value equals the given value.
- fieldEquals(String, Object) - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations where the specified field in the record equals the given value.
- FieldExists - Class in com.northconcepts.datapipeline.filter
-
A filter that checks if all the specified field exists.
- FieldExists(String) - Constructor for class com.northconcepts.datapipeline.filter.FieldExists
- FieldExists(String...) - Constructor for class com.northconcepts.datapipeline.filter.FieldExists
-
Creates a filter that keeps records containing all of the given fields; at least one name is required.
- FieldFilter - Class in com.northconcepts.datapipeline.filter
-
See
FieldPathfor supported field name expressions. - FieldFilter(String) - Constructor for class com.northconcepts.datapipeline.filter.FieldFilter
- FieldFilter(String...) - Constructor for class com.northconcepts.datapipeline.filter.FieldFilter
-
Creates a filter whose rules each of the given fields must pass; at least one name is required.
- FieldFilter(String, FieldFilterRule...) - Constructor for class com.northconcepts.datapipeline.filter.FieldFilter
-
Creates a filter that keeps records whose named field passes all of the given rules.
- FieldFilterRule - Class in com.northconcepts.datapipeline.filter
-
Base class for the per-field conditions of a
FieldFilter; a record is kept only if every rule allows each checked field. - FieldFilterRule() - Constructor for class com.northconcepts.datapipeline.filter.FieldFilterRule
- fieldHasHyperlink() - Static method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
-
Creates a field location predicate that matches fields containing an ExcelHyperlink in their metadata.
- fieldHasNoEntity(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldIndexes(int...) - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations where the field index is one of the specified indexes.
- fieldIsArray(String, int) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldIsWrongType(String, FieldType, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldIsWrongType(String, Object, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- FieldKeyValuePair - Class in com.northconcepts.datapipeline.template
-
A FreeMarker key/value pair holding a
Field's name and value, both wrapped by the object wrapper. - FieldKeyValuePair() - Constructor for class com.northconcepts.datapipeline.template.FieldKeyValuePair
- FieldKeyValuePair(Field, ObjectWrapper) - Constructor for class com.northconcepts.datapipeline.template.FieldKeyValuePair
- FieldKeyValuePairIterator - Class in com.northconcepts.datapipeline.template
-
Iterates over a
Record's fields in order as FreeMarker key/value pairs (FieldKeyValuePairs). - FieldKeyValuePairIterator() - Constructor for class com.northconcepts.datapipeline.template.FieldKeyValuePairIterator
- FieldKeyValuePairIterator(Record, ObjectWrapper) - Constructor for class com.northconcepts.datapipeline.template.FieldKeyValuePairIterator
- fieldLineage - Variable in class com.northconcepts.datapipeline.core.DataReader
- FieldLineage - Class in com.northconcepts.datapipeline.lineage
-
Convenience wrapper to read and write field-level data lineage properties.
- FieldLineage() - Constructor for class com.northconcepts.datapipeline.lineage.FieldLineage
- FieldLineage(Field) - Constructor for class com.northconcepts.datapipeline.lineage.FieldLineage
- FieldList - Class in com.northconcepts.datapipeline.core
-
See
FieldPathfor supported field name expressions. - FieldList(String...) - Constructor for class com.northconcepts.datapipeline.core.FieldList
- FieldLocation - Class in com.northconcepts.datapipeline.core
-
Represents the location of a field within a data pipeline context.
- FieldLocation() - Constructor for class com.northconcepts.datapipeline.core.FieldLocation
-
Creates a new FieldLocation with default values.
- FieldLocationPredicate - Interface in com.northconcepts.datapipeline.core
-
A functional interface for predicates that test
FieldLocationinstances. - FieldMapping - Class in com.northconcepts.datapipeline.foundations.datamapping
-
A field mapping that sets one target field to the result of an expression evaluated in a
DataMappingExpressionContext. - FieldMapping - Enum constant in enum class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPartType
- FieldMapping() - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- FieldMapping() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction.FieldMapping
- FieldMapping(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- FieldMapping(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction.FieldMapping
-
Creates a mapping that leaves an existing target field unchanged.
- FieldMapping(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction.FieldMapping
- FieldMapping(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction.FieldMapping
- fieldMetadata - Variable in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- fieldMetadata - Variable in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- fieldMetadata - Variable in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- fieldMissingInEntity(String, String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldName - Variable in class com.northconcepts.datapipeline.group.AggregateReader.AggregateOperation
-
Deprecated.
- fieldNames - Variable in class com.northconcepts.datapipeline.core.AbstractReader
- fieldNames(String...) - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations where the field name is one of the specified names.
- fieldNotArray(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- FieldNotExists - Class in com.northconcepts.datapipeline.filter
-
A filter that checks if all the specified field does not exist.
- FieldNotExists(String) - Constructor for class com.northconcepts.datapipeline.filter.FieldNotExists
- FieldNotExists(String...) - Constructor for class com.northconcepts.datapipeline.filter.FieldNotExists
-
Creates a filter that keeps records containing none of the given fields; at least one name is required.
- FieldPath - Class in com.northconcepts.datapipeline.core
-
An abstract representation for the location of a field within a record.
- FieldPath() - Constructor for class com.northconcepts.datapipeline.core.FieldPath
- fields - Variable in class com.northconcepts.datapipeline.security.DecryptingReader
- fields - Variable in class com.northconcepts.datapipeline.security.EncryptingReader
- fields - Variable in class com.northconcepts.datapipeline.xml.XmlReader
- FieldTransformer - Class in com.northconcepts.datapipeline.transform
-
See
FieldPathfor supported field name expressions. - FieldTransformer(String) - Constructor for class com.northconcepts.datapipeline.transform.FieldTransformer
- FieldTransformer(String...) - Constructor for class com.northconcepts.datapipeline.transform.FieldTransformer
- FieldTransformer(Collection<String>) - Constructor for class com.northconcepts.datapipeline.transform.FieldTransformer
- FieldType - Enum Class in com.northconcepts.datapipeline.core
-
FieldType lists of all field data types used in records.
- fieldTypeEquals(FieldType) - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations where the field type equals the specified field type.
- fieldTypeIsNotBinary(String, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldTypeIsNotBooelan(String, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldTypeIsNotNumeric(String, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldTypeIsNotRecord(String, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldTypeIsNotTemporal(String, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldTypeIsNotText(String, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldTypeIsNotUuid(String, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- fieldTypeNotSupportedByRecordSerializationTool(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- file - Variable in class com.northconcepts.datapipeline.xml.XmlReader
- FILE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelHyperlinkType
-
A hyperlink to a file.
- FILE - Static variable in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The
java.io.Fileused to create the DataReader. - FILE_COLUMN_NUMBER - Static variable in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The beginning column number in the input file starting with 0.
- FILE_LINE_NUMBER - Static variable in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The line number in the input file starting with 0.
- FileCredentialsResolver - Class in com.northconcepts.datapipeline.security
-
A
CredentialsResolverthat reads credential values from a Java properties file, re-reading it whenever the file's last-modified time changes. - FileCredentialsResolver(File) - Constructor for class com.northconcepts.datapipeline.security.FileCredentialsResolver
- FileCredentialsResolver(String) - Constructor for class com.northconcepts.datapipeline.security.FileCredentialsResolver
- FileDetector - Class in com.northconcepts.datapipeline.foundations.file
-
Detects the
FileTypeof a file or stream from its name's extension or, failing that, by sampling its first bytes. - FileDetector(File) - Constructor for class com.northconcepts.datapipeline.foundations.file.FileDetector
- FileDetector(InputStream) - Constructor for class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Creates a detector that samples the stream's content, closing the stream once it is read.
- FileDetector(InputStream, String) - Constructor for class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Creates a detector that checks the file name's extension first and otherwise samples the stream, closing it once read.
- fileIndexOutOfBound(long, long) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- fileNotFound(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- FileReader - Class in com.northconcepts.datapipeline.file
-
Obtains records from a binary stream previously written using a
FileWriter. - FileReader(DataInput) - Constructor for class com.northconcepts.datapipeline.file.FileReader
-
Creates a reader for uncompressed records read directly from the given input.
- FileReader(File) - Constructor for class com.northconcepts.datapipeline.file.FileReader
-
Creates a reader for an uncompressed file, such as one written by
FileWriter(File). - FileReader(File, boolean) - Constructor for class com.northconcepts.datapipeline.file.FileReader
- FileReader(InputStream, boolean) - Constructor for class com.northconcepts.datapipeline.file.FileReader
- FileSink - Interface in com.northconcepts.datapipeline.foundations.file
-
A local or remote file to write, supplying an
OutputStreamfor its content. - FileSinkPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline.output
-
Base class for pipeline outputs that write their data to a
FileSink. - FileSinkPipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.FileSinkPipelineOutput
- FileSource - Interface in com.northconcepts.datapipeline.foundations.file
-
A local or remote file to read, supplying an
InputStreamfor its content. - FileSourcePipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Base class for pipeline inputs that read their data from a
FileSource. - FileSourcePipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.FileSourcePipelineInput
- FileSystem - Class in com.northconcepts.datapipeline.internal.lang
-
Abstract class for reading and writing to virtual file systems.
- FileSystem() - Constructor for class com.northconcepts.datapipeline.internal.lang.FileSystem
-
Creates the file system or throws a
DataExceptionif the edition or license does not allow file systems. - FileSystemInfoReader - Class in com.northconcepts.datapipeline.file
-
Creates records from the metadata of files within a directory.
- FileSystemInfoReader(File) - Constructor for class com.northconcepts.datapipeline.file.FileSystemInfoReader
- FileTransferMode - Enum Class in com.northconcepts.datapipeline.filesystem.ftp
-
Selects how an
FtpFileSystemtransfers file data: as a stream, in blocks or compressed. - FileTransferType - Enum Class in com.northconcepts.datapipeline.filesystem.ftp
-
Selects whether an
FtpFileSystemtransfers files as ASCII text or as binary. - FileType - Enum Class in com.northconcepts.datapipeline.foundations.file
-
File formats known to DataPipeline, each with a display name, MIME type, binary flag and default file extension.
- FileWriter - Class in com.northconcepts.datapipeline.file
-
Writes records to a binary stream that can be later read using a
FileReader. - FileWriter(DataOutput) - Constructor for class com.northconcepts.datapipeline.file.FileWriter
-
Creates an uncompressed writer that writes directly to the given output.
- FileWriter(File) - Constructor for class com.northconcepts.datapipeline.file.FileWriter
-
Creates an uncompressed writer that replaces the file's contents.
- FileWriter(File, boolean) - Constructor for class com.northconcepts.datapipeline.file.FileWriter
-
Creates an uncompressed writer that appends to the file (if it exists) when
appendis true. - FileWriter(File, boolean, boolean) - Constructor for class com.northconcepts.datapipeline.file.FileWriter
- FileWriter(OutputStream, boolean) - Constructor for class com.northconcepts.datapipeline.file.FileWriter
- fillCache() - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Runs on the background thread, reading the nested reader into the buffer (pausing while it is full) until the input ends, this reader is closed or a read fails.
- fillRecord(Record) - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Populates the given record with the next row's values; returns false at the end of the input.
- fillRecord(Record) - Method in class com.northconcepts.datapipeline.core.ParsingReader
- fillRecord(Record) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- fillRecord(Record) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- fillRecord(Record) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- fillRecord(Record) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- fillRecord(Record) - Method in class com.northconcepts.datapipeline.weblog.CombinedLogReader
- filter(ClientRequestContext) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyClient.AccessToken
- filter(ClientRequestContext, ClientResponseContext) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyClient.HeaderFilter
- filter(List, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Create a map from an array of arguments
- Filter - Class in com.northconcepts.datapipeline.filter
-
Base class for conditions that decide whether a record is kept or discarded, for example by a
FilteringReader. - Filter() - Constructor for class com.northconcepts.datapipeline.filter.Filter
- FILTER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- FilterExpression - Class in com.northconcepts.datapipeline.filter
-
A
Filterthat keeps records for which a logical expression-language condition evaluates to true. - FilterExpression(String) - Constructor for class com.northconcepts.datapipeline.filter.FilterExpression
- FilterExpression(String, FieldDeclarations) - Constructor for class com.northconcepts.datapipeline.filter.FilterExpression
-
Creates a filter for the given logical expression, which is parsed immediately; field types declared in
fieldDeclarationstake precedence over those inferred from each record. - FilterFieldExistsAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.filter
-
A
PipelineActionthat keeps only the records containing all the selected fields. - FilterFieldExistsAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- FilterFieldMatchesPatternAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.filter
-
A
PipelineActionthat keeps only the records whose fields each fully match their regular expression. - FilterFieldMatchesPatternAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
- FilterFieldNotNullAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.filter
-
A
PipelineActionthat keeps only the records whose selected fields are all non-null. - FilterFieldNotNullAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- FilteringReader - Class in com.northconcepts.datapipeline.filter
-
A proxy that chooses records using a filter criteria.
- FilteringReader(DataReader) - Constructor for class com.northconcepts.datapipeline.filter.FilteringReader
-
Accepts the DataReader to filter.
- FilteringReader(DataReader, DataWriter) - Constructor for class com.northconcepts.datapipeline.filter.FilteringReader
-
Accepts the DataReader to filter and the DataWriter to send discarded records to.
- FilteringReader(DataReader, DataWriter, String) - Constructor for class com.northconcepts.datapipeline.filter.FilteringReader
-
Accepts the DataReader to filter and the DataWriter to send discarded records to.
- FilterMatchExpression - Class in com.northconcepts.datapipeline.foundations.pipeline.action.filter
-
A
PipelineActionthat keeps only the records for which a boolean expression evaluates to true. - FilterMatchExpression() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- finalize() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Disconnects even with leases outstanding: this file system being unreachable, the streams holding them were dropped without being closed.
- finalize() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Closes this endpoint if it's still open.
- finalize() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
- finalize() - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
- finalize() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- FinancialStatus - Enum Class in com.northconcepts.datapipeline.shopify.client
-
Order financial statuses for
ShopifyOrder.setFinancialStatus(FinancialStatus);FinancialStatus.toString()returns the lower-case name. - findAll(Filter) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- findAll(Filter) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns a new list with the records the filter allows; the records are shared, not copied.
- findAll(Predicate<ValueNode<?>>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a new ArrayValue containing all elements that match the given predicate.
- findFirst(Filter, int) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- findFirst(Filter, int) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns the index of the first record at or after
fromthat the filter allows, or -1 if none; a negativefromstarts at 0. - findFirst(Predicate<ValueNode<?>>, int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the index of the first element in this array that matches the given predicate, starting at the specified index, or -1 if no element matches.
- findLast(Filter, int) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- findLast(Filter, int) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns the index of the last record at or before
fromthat the filter allows, or -1 if none; afromof -1 or past the end starts at the last record. - findLast(Predicate<ValueNode<?>>, int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the index of the last element in this array that matches the given predicate, searching backward from the specified index, or -1 if no element matches.
- first(FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the first value of the field in each group, written to the same field path.
- first(FieldPath, FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the first non-null value of the source field in each group, written to the target field.
- first(FieldPath, FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- first(String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the first value of the field in each group, written to a field of the same name.
- first(String, String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the first non-null value of the source field in each group, written to the target field.
- first(String, String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- FIRST - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
- FIRST_PAGE - Static variable in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- FIXED_WIDTH - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- FixedWidthAlign - Enum Class in com.northconcepts.datapipeline.fixedwidth
-
Alignment of a value within its fixed-width column; the fill character pads (when writing) or is trimmed from (when reading) the opposite side.
- FixedWidthField - Class in com.northconcepts.datapipeline.fixedwidth
-
Describes one column (name, width, alignment and fill character) of the records handled by
FixedWidthReaderandFixedWidthWriter. - FixedWidthField() - Constructor for class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- FixedWidthPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Reads a pipeline's source data from a fixed-width text
FileSourceusing aFixedWidthReader. - FixedWidthPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- FixedWidthPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline.output
-
Writes a pipeline's records to a fixed-width text
FileSinkusing aFixedWidthWriter. - FixedWidthPipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- FixedWidthReader - Class in com.northconcepts.datapipeline.fixedwidth
-
Obtains records from a fixed width stream.
- FixedWidthReader(File) - Constructor for class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- FixedWidthReader(Reader) - Constructor for class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- FixedWidthWriter - Class in com.northconcepts.datapipeline.fixedwidth
-
Writes records to a fixed width stream.
- FixedWidthWriter(File) - Constructor for class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- FixedWidthWriter(File, boolean) - Constructor for class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- FixedWidthWriter(Writer) - Constructor for class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- FlattenRecord - Class in com.northconcepts.datapipeline.transform
-
Flattens an array field by creating one record for each value.
- FlattenRecord() - Constructor for class com.northconcepts.datapipeline.transform.FlattenRecord
- flattenToString(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces array and record values with a string of their nested values separated by
fieldSeparator; null fields are left as is. - FLOAT - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- FLOAT - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- FLOAT - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
- FLOAT - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- FLOAT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- FLOAT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- FLOAT4 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- FLOAT8 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- floor(Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Rounds a number down to integer
- FLOOR - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
Behaves the same as
DOWNif the value is positive orUPif the value is negative. - flush() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
- flushRows() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Sends the buffered rows to the next free rows of the block in one request and empties the buffer, whether or not the request succeeds; the sheet's grid is enlarged first when the rows would not fit.
- focus - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- FOLDER_DELIMITER - Static variable in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Pass to
AmazonS3FileSystem.setDelimiter(String)to list one folder level at a time. - foldLeft(List, Object, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Fold left function
- fontColor(ExcelColor) - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that sets the font color.
- fontColor(ExcelColorPalette) - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that sets the font color using a palette color.
- forCell(String, int, int) - Static method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
-
Creates a hyperlink to another cell in the same Excel workbook.
- forceValueAsArray() - Method in class com.northconcepts.datapipeline.core.Field
-
Converts this field's value to an array if it's not already one, otherwise no change is made.
- forEach(Consumer<? super Field>) - Method in class com.northconcepts.datapipeline.core.Record
-
Performs the given action for each field in this list.
- forEach(Consumer<? super Record>) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- forEach(Consumer<? super Record>) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Performs the given action for each record in this list.
- forEach(Consumer<? super Record>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Performs the given action for each record cached in this dataset.
- forEach(Consumer<? super ValueNode<?>>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Performs the given action for each element in this array.
- forEach(Consumer<? super String>) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Performs the given action for each field in this record.
- forEachArrayValue(Consumer<ArrayValue>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Performs the given action for each ArrayValue element in this array.
- forEachGrandChildElement(Element, String, String, Consumer<Element>) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Passes each
grandchildTagNameelement under the parent's firstchildTagNamechild to the consumer. - forEachRecord(Consumer<Record>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Performs the given action for each Record element in this array.
- forEachSingleValue(Consumer<SingleValue>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Performs the given action for each SingleValue element in this array.
- ForeignKeyAction - Enum Class in com.northconcepts.datapipeline.foundations.schema
-
A foreign key's ON UPDATE or ON DELETE referential action in an
EntityRelationshipDef. - ForeignKeyAction - Enum Class in com.northconcepts.datapipeline.sql.h2
-
Represents foreign key constraint actions for H2.
- ForeignKeyAction - Enum Class in com.northconcepts.datapipeline.sql.mysql
- ForeignKeyAction - Enum Class in com.northconcepts.datapipeline.sql.postgresql
- forEmail(String) - Static method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
-
Creates a hyperlink to an email address.
- forFile(String) - Static method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
-
Creates a hyperlink to a file.
- formatBase(Number, Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Converts a number to a string using a specified number base
- formatDateTime(long, String, String) - Static method in class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
- formatInteger(long, String) - Static method in class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
- formatInteger(Number, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Formats an integer as specified by the XPath fn:format-integer function See https://www.w3.org/TR/xpath-functions-31/#func-format-integer
- formatNumber(Number, String, Map) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Formats a number into a decimal string representation using XPath 3.1 Finvalid input: '&O' fn:format-number spec
- forUrl(String) - Static method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
-
Creates a hyperlink to a URL.
- FORWARD - Enum constant in enum class com.northconcepts.datapipeline.email.EmailReadDirection
- FORWARD - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterPageableReader.Direction
- FoundationMessages - Class in com.northconcepts.datapipeline.foundations.i18n
-
Formats the error messages used across DataPipeline Foundations; each static method returns one message built from its arguments.
- FoundationMessages() - Constructor for class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- FoundationObject - Class in com.northconcepts.datapipeline.foundations.core
-
Abstract super-class for DP Foundation classes that require a consistent error handling mechanism.
- FoundationObject() - Constructor for class com.northconcepts.datapipeline.foundations.core.FoundationObject
- Frame(Jsonata.Frame) - Constructor for class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- from(FieldType, Object) - Static method in class com.northconcepts.datapipeline.core.ValueNode
- from(Object) - Static method in class com.northconcepts.datapipeline.core.ValueNode
-
Converts the given object to the appropriate
ValueNodesubtype. - fromArray(Object) - Static method in class com.northconcepts.datapipeline.core.ArrayValue
-
Converts a Java array (primitive or object) to an
ArrayValue, typing its elements by the component type when that maps to aFieldType; null yields an empty array. - fromArray(String...) - Static method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
-
Creates an instance holding the given values or returns null if the array is null or empty.
- fromArrayValue(ArrayValue) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Replaces this list's contents with the array's elements, which must be records; a null array leaves the list empty.
- fromArrayValue(Record, String, C) - Static method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Clears the collection and adds the string form of each element in the named array field.
- fromArrayValue(Record, String, Class<T>, C) - Static method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Clears the collection and adds one
componentTypeobject, created with its no-arg constructor, per record in the named array field. - fromArrayValue(Record, String, Class<T>, C, boolean) - Static method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Clears the collection and adds one object per record in the named array field;
useNewInstanceFromRecordcreates each from itsRecordSerializable.SERIALIZED_CLASS_NAMEfield instead ofcomponentType's no-arg constructor. - fromBigDecimal(BigDecimal) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
-
Describes the given value: its sign, whole digits (precision minus scale) and fraction digits (scale).
- fromBigInteger(BigInteger) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
-
Describes the given whole number: its sign and digit count.
- fromBinary(byte[]) - Static method in class com.northconcepts.datapipeline.core.Record
-
Deserializes a record or array from a binary byte array.
- fromBinary(byte[]) - Static method in class com.northconcepts.datapipeline.core.RecordList
-
Creates a list from bytes produced by
RecordList.toBinary(). - fromBinary(DataInput) - Static method in class com.northconcepts.datapipeline.core.Record
-
Deserializes a record or array from a binary data input.
- fromBinary(DataInput) - Static method in class com.northconcepts.datapipeline.core.RecordList
-
Reads a list in binary format from the input, then closes the input if it is
Closeable. - fromBinary(InputStream) - Static method in class com.northconcepts.datapipeline.core.Record
-
Deserializes a record or array from a binary input stream.
- fromBinary(InputStream) - Static method in class com.northconcepts.datapipeline.core.RecordList
-
Reads a list in binary format from the stream, then closes the stream.
- fromExcelHyperlinkType(ExcelHyperlinkType) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- fromExcelHyperlinkType(ExcelHyperlinkType) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- fromHex(String) - Static method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Finds a palette color by its hexadecimal representation.
- fromIndex(int) - Static method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Creates an ExcelColor from an Excel color palette index.
- fromIndex(int) - Static method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Finds a palette color by its index.
- fromJson(InputStream) - Method in class com.northconcepts.datapipeline.core.FieldPath
- fromJson(InputStream) - Method in interface com.northconcepts.datapipeline.core.JsonSerializable
-
Loads this object's state from the UTF-8 encoded JSON in the stream.
- fromJson(InputStream) - Method in interface com.northconcepts.datapipeline.core.RecordSerializable
- fromJson(InputStream) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- fromJson(InputStream) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- fromJson(InputStream) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- fromJson(InputStream) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- fromJson(Reader) - Static method in class com.northconcepts.datapipeline.core.Record
-
Deserializes a record or array from a JSON reader.
- fromJson(String) - Method in class com.northconcepts.datapipeline.core.FieldPath
- fromJson(String) - Method in interface com.northconcepts.datapipeline.core.JsonSerializable
-
Loads this object's state from the given JSON text.
- fromJson(String) - Static method in class com.northconcepts.datapipeline.core.Record
-
Deserializes a record or array from a JSON string.
- fromJson(String) - Method in interface com.northconcepts.datapipeline.core.RecordSerializable
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- fromJson(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- fromMinutes(int...) - Static method in class com.northconcepts.datapipeline.schedule.HourlyScheduler
-
Creates a schedule at each of the given minutes past the hour.
- fromMinutesPeriod(int, int) - Static method in class com.northconcepts.datapipeline.schedule.HourlyScheduler
-
Creates a schedule at
firstMinutespast each hour and then everyperiodInMinutesminutes until the hour ends (for example, 5 and 20 give 5, 25 and 45 minutes past each hour). - fromName(String) - Static method in class com.northconcepts.datapipeline.core.FieldPath
-
Converts a single field name into a FieldPath.
- fromPath(Path, Configuration) - Static method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
-
Creates an output file for the path qualified by its file system, turning off checksum writing on that file system if it is a checksum file system.
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.core.FieldPath
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.core.RecordList
- fromRecord(Record) - Method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Loads this instance's state from a record and returns
this(for fluid API call chaining). - fromRecord(Record) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.core.Bean
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.core.Encoder.HexEncoder
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.core.Encoder.NullEncoder
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.core.Property
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.difference.PropertyDiff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.difference.RecordDiff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- fromRecord(Record) - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
- fromRecord(Record) - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcExportedKey
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcSchema
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DatasetPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.diff.EntityDefDiff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.diff.EntityRelationshipDefDiff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.diff.FieldDefDiff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.diff.IndexDefDiff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.diff.IndexFieldDefDiff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.diff.SchemaDefDiff
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- fromRecord(Record) - Method in class com.northconcepts.datapipeline.xml.XmlField
- fromRgb(byte[]) - Static method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Creates an ExcelColor from an RGB byte array.
- fromRgb(int, int, int) - Static method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Finds a palette color by its RGB components.
- fromValue(String) - Static method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
-
Parses the given comma-separated text or returns null if it is null or blank.
- fromXml(InputStream) - Method in class com.northconcepts.datapipeline.core.FieldPath
- fromXml(InputStream) - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Parses the XML in the stream and loads this object's state from its root element.
- fromXml(InputStream) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- fromXml(InputStream) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- fromXml(InputStream) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- fromXml(InputStream) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- fromXml(InputStream) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- fromXml(InputStream) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- fromXml(InputStream) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- fromXml(Reader) - Static method in class com.northconcepts.datapipeline.core.Record
-
Deserializes a record or array from an XML reader.
- fromXml(String) - Method in class com.northconcepts.datapipeline.core.FieldPath
- fromXml(String) - Static method in class com.northconcepts.datapipeline.core.Record
-
Deserializes a record or array from an XML string.
- fromXml(String) - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
- fromXml(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- fromXml(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- fromXml(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- fromXml(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- fromXml(String) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.core.FieldPath
- fromXmlElement(Element) - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DatasetPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- fromXmlElement(Element) - Method in class com.northconcepts.datapipeline.xml.XmlField
- FtpFileSystem - Class in com.northconcepts.datapipeline.filesystem.ftp
-
Class for accessing the FTP file system.
- FtpFileSystem() - Constructor for class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Connects to the FTP server on localhost (port 21) as an anonymous user.
- FtpFileSystem(String, int) - Constructor for class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Connects to the specified FTP server with credentials supplied through a
CredentialsResolver(seeFtpFileSystem.setCredentialsResolver(CredentialsResolver)). - FtpFileSystem(String, int, String, String) - Constructor for class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Connects to the specified FTP server.
- FULFILLMENT_CANCELLED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- FULFILLMENT_PENDING - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- FULFILLMENT_SUCCESS - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- FulfillmentStatus - Enum Class in com.northconcepts.datapipeline.shopify.client
-
Order fulfillment statuses for
ShopifyOrder.setFulfillmentStatus(FulfillmentStatus);FulfillmentStatus.toString()returns the lower-case name. - fullJoin(String, String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- FullJoin - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Generates a full join clause.
- FullJoin(String, String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.FullJoin
- funcApply(Object, List) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Call helper for Java
- function(String, Jsonata.Fn0<R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.Fn1<A, R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.Fn2<A, B, R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.Fn3<A, B, C, R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.Fn4<A, B, C, D, R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.Fn5<A, B, C, D, E, R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.Fn6<A, B, C, D, E, F, R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.Fn7<A, B, C, D, E, F, G, R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.Fn8<A, B, C, D, E, F, G, H, R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, Jsonata.FnVarArgs<R>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- function(String, String, Class, Object, String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
- functionClone(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Clones an object
- functionEval(String, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
parses and evaluates the supplied expression
- Functions - Class in com.northconcepts.datapipeline.core
-
Functions is the entry point for adding new method aliases to the dynamic expression language.
- Functions - Class in com.northconcepts.datapipeline.jsonata
- Functions() - Constructor for class com.northconcepts.datapipeline.jsonata.Functions
- FUTURE - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraSprintReader.SprintState
G
- G - Static variable in class com.northconcepts.datapipeline.meter.Meter
- geEndpoint() - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Deprecated.Use
Transformer.getEndpoint()instead. - generate() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Runs each query registered with the connection and generates its class, writing a file or printing it per
GenerateQueryDaoClasses.isWriteToFile(). - generate() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSchemaFromRecord
-
Builds an entity from the root record and one per nested record field, inferring boolean, numeric and date types from text values, and returns the schema.
- generate(String, String, String, String...) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSchemaFromJdbc
-
Adds the tables matching the given
DatabaseMetaData.getTablesarguments, with their relationships and indexes, to this generator's schema and returns it. - generate(String, String, String, String...) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Generates a JPA entity and a
JpaRepositoryinterface for each table matching the givenDatabaseMetaData.getTablesarguments, writing files or printing them perGenerateSpringDataJpaClasses.isWriteToFile(). - generate(String, String, String, String...) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Generates a data access class for each non-excluded table matching the given
DatabaseMetaData.getTablesarguments; when writing files, code below the custom code marker comment of an existing file is kept. - generate(String, String, List<String>, String...) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSchemaFromJdbc
- generate(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEqualsAndHashCodeMethods
-
Prints
hashCode()andequals()methods for each fully qualified class name to standard output. - generate(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateRecordSerializers
-
Prints
toRecord()andfromRecord(Record)methods for each fully qualified class name to the print writer, with TODO comments for fields it cannot serialize. - generateCode(CodeWriter, AggregateGroupFieldsAction.GroupByField) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
-
Writes the
GroupByReadermethod call for this operator; writes nothing forGROUPBY, whose fields are passed to the constructor. - generateCode(CodeWriter, String, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Writes the Java code that sets the field to the value, or to a typed null if the value is blank.
- generateCode(JavaCodeBuilder, CodeWriter, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
-
Writes the
BasicFieldTransformercall that replaces nulls with the value, adding any imports it needs. - generateCodeByFunction(CodeWriter, AggregateGroupFieldsAction.GroupByField, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
-
Writes a call to the named
GroupByReadermethod (such asfirstormax) with the field's source, target and exclude-nulls arguments. - generateCodeForNonNull(CodeWriter, String, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Writes the Java code that sets the field to a non-blank value; called by
AddFieldsAction.FieldType.generateCode(CodeWriter, String, String). - generateConstructor(JavaCodeBuilder, CodeWriter) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- generateConstructor(JavaCodeBuilder, CodeWriter) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- generateConstructor(JavaCodeBuilder, CodeWriter) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Writes the constructor call that starts this field's generated Java code; subclasses override it to match their constructors.
- generateConstructor(JavaCodeBuilder, CodeWriter) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- generateEntity(DataReader) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Samples the reader until
GenerateEntityFromDataset.getMinRecords()records are loaded or the wait time runs out, then returns an entity with a field for each column. - GenerateEntityFromDataset - Class in com.northconcepts.datapipeline.foundations.tools
-
A utility class for generating EntityDef code from a DataReader.
- GenerateEntityFromDataset() - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
- GenerateEntityFromDataset.FieldTypeSelectionMode - Enum Class in com.northconcepts.datapipeline.foundations.tools
-
Enumeration of field type selection modes for determining how to select field types from column statistics.
- GenerateEqualsAndHashCodeMethods - Class in com.northconcepts.datapipeline.foundations.tools
-
Prints generated
hashCode()andequals()methods covering the non-static, non-transient fields declared by the given classes. - GenerateEqualsAndHashCodeMethods() - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateEqualsAndHashCodeMethods
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.core.FieldPath
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DatasetPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- generateJavaCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- generateJavaCode(JavaCodeBuilder) - Method in interface com.northconcepts.datapipeline.sourcecode.JavaCodeGenerator
-
Appends Java source code representing this object to the given builder.
- generateJavaCodeImpl(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Writes the Java code for this pipeline's own processing, between the input and output code.
- generateJavaCodeImpl(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- generateJavaCodeImpl(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.NullPipeline
- generateJavaCodeImpl(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- generateJavaCodeImpl(JavaCodeBuilder, CodeWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- generateJavaCodeImpl(JavaCodeBuilder, CodeWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Writes the reader declaration (and any format-specific setters), leaving the writer indented for the common setters.
- generateJavaCodePostProcess(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Writes the output's Java code and, when both an input and an output are set, the code that runs the job.
- generateJavaCodePreProcess(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Writes the input's Java code; called before
AbstractPipeline.generateJavaCodeImpl(JavaCodeBuilder). - GenerateQueryDaoClasses - Class in com.northconcepts.datapipeline.foundations.tools
-
Generates a class for each query registered with a
JdbcConnection, with a field per result column and staticexecuteQuerymethods. - GenerateQueryDaoClasses(JdbcConnection, File, String) - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
- GenerateRecordSerializers - Class in com.northconcepts.datapipeline.foundations.tools
-
A utility class for generating toRecord() and fromRecord(Record source) methods from existing Java beans.
- GenerateRecordSerializers() - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateRecordSerializers
- generateSaveCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- generateSaveCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- generateSaveCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FileSinkPipelineOutput
-
Writes the generated code that saves the output after
Job.run(reader, writer); does nothing by default. - generateSaveCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- generateSaveCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- generateSaveCode(JavaCodeBuilder) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- generateSchemaDef(InputFile) - Method in class com.northconcepts.datapipeline.parquet.tools.GenerateSchemaDefFromParquet
-
Reads the schema of the Parquet input file and generates a schema definition from it.
- generateSchemaDef(File) - Method in class com.northconcepts.datapipeline.parquet.tools.GenerateSchemaDefFromParquet
-
Reads the schema of the Parquet file and generates a schema definition from it.
- generateSchemaDef(MessageType) - Method in class com.northconcepts.datapipeline.parquet.tools.GenerateSchemaDefFromParquet
-
Generates a schema definition from the Parquet schema and keeps the schema for
GenerateSchemaDefFromParquet.getParquetSchema(). - GenerateSchemaDefFromParquet - Class in com.northconcepts.datapipeline.parquet.tools
- GenerateSchemaDefFromParquet(String, String) - Constructor for class com.northconcepts.datapipeline.parquet.tools.GenerateSchemaDefFromParquet
- GenerateSchemaFromJdbc - Class in com.northconcepts.datapipeline.foundations.tools
-
Builds a
SchemaDeffrom JDBC metadata: an entity per table, relationships from foreign keys, and the indexes other than primary keys. - GenerateSchemaFromJdbc(JdbcConnection) - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateSchemaFromJdbc
- GenerateSchemaFromRecord - Class in com.northconcepts.datapipeline.foundations.tools
-
A utility class for generating SchemaDef code from a Record or JSON object.
- GenerateSchemaFromRecord(String, String, Record, File, String) - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateSchemaFromRecord
-
Creates a generator that builds the schema from
rootRecord;baseFolderandtargetPackageare not used. - GenerateSpringDataJpaClasses - Class in com.northconcepts.datapipeline.foundations.tools
-
A utility class for generating Spring Data JPA entities and repositories using the metadata from a live database.
- GenerateSpringDataJpaClasses(JdbcConnection, File, String, String) - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
- generateSqlSelect(QuerySource...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- generateSqlSelect(QuerySource...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
- generateSqlSelect(QuerySource...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- generateSqlSelect(QuerySource...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- generateSqlSelect(QuerySource...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- generateSqlSelect(QuerySource...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- generateSqlSelect(QuerySource...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- generateSqlSelect(QuerySource...) - Method in interface com.northconcepts.datapipeline.jdbc.sql.select.SqlSelectGenerator
-
Generates a SQL SELECT statement from the given query sources.
- generateSqlSelect(Select) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.GroupByField
-
Adds this field to the SQL select as a grouped column or an aggregate expression;
FIRSTandLASTthrowUnsupportedOperationException. - generateSqlSelect(Select, AggregateGroupFieldsAction.GroupByField) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
-
Adds the SQL for this operator applied to the given field to the select.
- generateSqlSelect(Select, String, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Adds a column with the given name and value to the SQL select, using a typed
NULLif the value is blank. - generateSqlSelectForNonNull(Select, String, String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Adds the column for a non-blank value to the SQL select; by default the value is inserted as-is, unquoted.
- GenerateTableDaoClasses - Class in com.northconcepts.datapipeline.foundations.tools
-
A utility class for generating data access Java beans using the metadata from a live database.
- GenerateTableDaoClasses(JdbcConnection, File, String) - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
- GenerateTableDaoClasses.TableConfig - Class in com.northconcepts.datapipeline.foundations.tools
-
The class name, package and output file used to generate the class for one table.
- GenericUpsert - Class in com.northconcepts.datapipeline.jdbc.upsert
-
An upsert strategy that attempts to either:
- GenericUpsert() - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- geoLocationToString(GeoLocation[][]) - Method in interface com.northconcepts.datapipeline.twitter.ITwitterConverter
-
Formats the coordinates as comma-separated
[[lat,long],...]groups, or returns null if they are null. - geoLocationToString(GeoLocation[][]) - Method in class com.northconcepts.datapipeline.twitter.TwitterConverter
- GEOMETRY - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- GEOMETRY - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- GEOMETRYCOLLECTION - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- GEOMETRYCOLLECTION - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- get(int) - Method in class com.northconcepts.datapipeline.core.CompositeValue
- get(int) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- get(int) - Method in class com.northconcepts.datapipeline.core.DataEndpointGroup
- get(int) - Method in class com.northconcepts.datapipeline.core.FieldList
- get(int) - Method in class com.northconcepts.datapipeline.core.MultiWriter
-
Returns the target writer at the given 0-based index.
- get(int) - Method in class com.northconcepts.datapipeline.core.RecordComparator
-
Returns the comparator for the field added at the given 0-based index.
- get(int) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns the record at the specified position in this list.
- get(int) - Method in class com.northconcepts.datapipeline.core.SequenceReader
-
Returns the reader at the given 0-based position in the sequence.
- get(int) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- get(int) - Method in class com.northconcepts.datapipeline.filter.FilteringReader
-
Returns the filter at the given 0-based index.
- get(int) - Method in class com.northconcepts.datapipeline.filter.rule.OrRule
- get(int) - Method in class com.northconcepts.datapipeline.filter.rule.PatternMatch
- get(int) - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
- get(int) - Method in class com.northconcepts.datapipeline.jsonata.JsonArray
- get(int) - Method in class com.northconcepts.datapipeline.jsonata.Utils.RangeList
- get(int) - Method in class com.northconcepts.datapipeline.template.ArrayTemplateModel
- get(int) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Returns the transformer at the given 0-based index.
- get(int) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Returns the transformer at the given 0-based index.
- get(Object) - Method in class com.northconcepts.datapipeline.jsonata.JsonObject
- get(Object...) - Method in class com.northconcepts.datapipeline.transform.lookup.BasicLookup
- get(Object...) - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
- get(Object...) - Method in class com.northconcepts.datapipeline.transform.lookup.DataReaderLookup
- get(Object...) - Method in class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
- get(Object...) - Method in class com.northconcepts.datapipeline.transform.lookup.Lookup
-
Returns the records that match the supplied composite lookup key.
- get(Object...) - Method in class com.northconcepts.datapipeline.transform.lookup.ProxyLookup
- get(Object...) - Method in class com.northconcepts.datapipeline.transform.lookup.RecordListLookup
-
Retrieves records matching the specified lookup keys.
- get(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the value mapped to the specified key or
null. - get(String) - Method in class com.northconcepts.datapipeline.core.FieldDeclarations
-
Returns the declared type of the field or null if it has none.
- get(String) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Returns the fully-qualified method name for a function alias or
null. - get(String) - Static method in class com.northconcepts.datapipeline.mailchimp.MailChimpClient.Proxy
-
Creates a client authenticated with the given API key; the text after the key's first dash (such as
us5) names the data center, so the key must contain a dash. - get(String) - Method in class com.northconcepts.datapipeline.security.Credentials
-
Returns the value for the given key or
nullif it's absent (or this instance was cleared). - get(String) - Method in class com.northconcepts.datapipeline.security.CredentialsResolverRegistry
-
Returns the resolver registered under the given id or
nullif there isn't one. - get(String) - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- get(String, String) - Static method in class com.northconcepts.datapipeline.shopify.client.ShopifyClient.Proxy
-
Creates a stub for the store at
domain, a base URL such ashttps://example.myshopify.com, that authenticates withapiKeyas an access token; close the stub when done. - get(String, String, String) - Static method in class com.northconcepts.datapipeline.jira.client.JiraClient.Proxy
-
Creates a client for the Jira site at the
domainbase URL using basic authentication with the trimmed API key; all arguments must be non-empty. - get(List<?>) - Method in class com.northconcepts.datapipeline.transform.lookup.Lookup
-
Returns the records matching the list's values as a composite key; a null or empty list is passed on as a null array.
- getAbsolutePaths() - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
-
Indicates if the path and parent fields keep the root directory's path as given instead of being relative to it (default is false).
- getAcknowledgeMode() - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Indicates how received messages should be acknowledged (default to
JmsAcknowledgeMode.AUTO). - getActionCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- getActionCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- getActions() - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
-
Returns one default instance of each action in this group.
- getActions() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
-
Returns a read-only view of the nested actions.
- getActions() - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
-
Returns a read-only view of the actions, in the order they are applied.
- getAdaptedObject(Class<?>) - Method in class com.northconcepts.datapipeline.template.ArrayTemplateModel
- getAdaptedObject(Class<?>) - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- getAdditionalProperties() - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
-
Returns the JSON properties that are not mapped to a dedicated field.
- getAdditionalProperties() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
-
Returns the JSON properties that are not mapped to a dedicated field.
- getAdditionalProperties() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
-
Returns the JSON properties that are not mapped to a dedicated field.
- getAdditionalProperties() - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
-
Returns the JSON properties that are not mapped to a dedicated field.
- getAdditionalProperties() - Method in class com.northconcepts.datapipeline.mailchimp.list.Tag
-
Returns the JSON properties that are not mapped to a dedicated field.
- getAddress1() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getAddress2() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getAfterFieldName() - Method in class com.northconcepts.datapipeline.transform.MoveFieldAfter
- getAliases() - Static method in class com.northconcepts.datapipeline.core.Functions
-
Returns all the aliases.
- getAlign() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
-
Returns the side this column's value is aligned to (defaults to LEFT); the fill character goes on the other side.
- getAll() - Method in class com.northconcepts.datapipeline.core.CompositeValue
-
Returns the backing array of values, not a copy; change values with
CompositeValue.set(int, Object)so the cached hash code is reset. - getAll() - Static method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns all the event buses in the JVM/classloader that have not been terminated.
- getAll() - Method in class com.northconcepts.datapipeline.foundations.core.Tags
-
Returns a sorted copy of the tags.
- getAll() - Static method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns all the
AbstractJobs currently running in the JVM/classloader, not includingJobs. - getAll() - Static method in class com.northconcepts.datapipeline.job.Job
-
Returns all the live jobs in the JVM/classloader.
- getAllDraftOrders() - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- getAllDraftOrders() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
- getAllFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Returns the nodes marked as fields, depth-first with parents before their children.
- getAllNodes() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Returns every node, including the root, depth-first with parents before their children.
- getAllowedValues() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The optional set of values this field allows.
- getAllRecordBreaks() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Returns the nodes marked as record breaks, depth-first with parents before their children.
- getAllTweets(String, LocalDateTime, LocalDateTime, int, String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Currently only available via the Academic Research product track https://developer.twitter.com/en/docs/twitter-api/tweets/search/api-reference
- getAmazonS3FileSystem() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- getApiKey() - Method in class com.northconcepts.datapipeline.twitter2.TwitterCredentials
- getApiLimitPolicy() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Returns the action taken when the API call limit is reached (defaults to
ApiLimitPolicy.FAIL). - getApiLimitPolicy() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Returns the action taken when the API call limit is reached (defaults to
ApiLimitPolicy.FAIL). - getApiLimitPolicy() - Method in class com.northconcepts.datapipeline.twitter.TwitterWriter
- getApiSecret() - Method in class com.northconcepts.datapipeline.twitter2.TwitterCredentials
- getApplicableChildCount() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
-
Returns the number of child parts that render SQL.
- getApplicationName() - Method in class com.northconcepts.datapipeline.google.GoogleApiReader
-
Returns the application name passed to the Google API client (defaults to
"DataPipeline Analytics Reporting"). - getApplicationName() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getArguments() - Method in class com.northconcepts.datapipeline.eventbus.Event
-
Returns the arguments passed to the listener method or
nullif the method takes none. - getArray() - Method in class com.northconcepts.datapipeline.template.ArrayTemplateModel
- getArrayValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of array values seen, null arrays included.
- getAsBoolean(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the value mapped to the specified key as a
booleanor throwsNullPointeException. - getAsDatetime(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the value mapped to the specified key as a
Dateornull. - getAsDouble(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the value mapped to the specified key as a
doubleor throwsNullPointeException. - getAsInteger(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the value mapped to the specified key as an
intor throwsNullPointeException. - getAsLong(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the value mapped to the specified key as a
longor throwsNullPointeException. - getAsString(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the value mapped to the specified key as a
Stringornull. - getAsymmetricAlgorithm() - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
-
Returns the algorithm used with the private key to decrypt the symmetric key, such as
RSA; required to open the reader. - getAsymmetricAlgorithm() - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Returns the algorithm used with the public key to encrypt the symmetric key, such as
RSA; required to open the reader. - getAsymmetricKey() - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
-
Returns the private key used to decrypt the symmetric key; required to open the reader.
- getAsymmetricKey() - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Returns the public key used to encrypt the symmetric key; required to open the reader.
- getAsyncWriter(int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Returns the asynchronous writer feeding the connection at the 0-based index or
nullbeforeJdbcMultiUpsertWriter.open(). - getAsyncWriter(int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Returns the asynchronous writer feeding the connection at the 0-based index or
nullbeforeJdbcMultiWriter.open(). - getAttribute(Element, String) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the attribute's value or null if it is missing or empty.
- getAttribute(Element, String, FieldType) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the attribute converted to the field type's Java class or null if it is missing or blank.
- getAttribute(Element, String, FieldType, T) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the attribute converted to the field type's Java class or the default if it is missing or blank.
- getAttribute(Element, String, Boolean) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns true if the attribute is
trueoryes(ignoring case), false for other text, or the default if it is missing or blank. - getAttribute(Element, String, Character) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the first character of the attribute or the default if it is missing or empty.
- getAttribute(Element, String, Class<? extends T>) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the attribute converted to the given type (byte arrays from hex) or null if it is missing or blank.
- getAttribute(Element, String, Class<? extends T>, T) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the attribute converted to the given type (byte arrays from hex) or the default if it is missing or blank.
- getAttribute(Element, String, Integer) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the attribute parsed as an integer or the default if it is missing or blank.
- getAttribute(Element, String, Long) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the attribute parsed as a long or the default if it is missing or blank.
- getAttribute(Element, String, String) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the attribute's value or the default if it is missing or empty.
- getAttributes() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
User-defined key-value pairs to attached arbitrary metadata to this entity.
- getAttributes() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
User-defined key-value pairs to attached arbitrary metadata to this entityRelationShip.
- getAttributes() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
User-defined key-value pairs to attached arbitrary metadata to this field.
- getAttributes() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
User-defined key-value pairs to attached arbitrary metadata to this schema.
- getAttributes() - Method in class com.northconcepts.datapipeline.xml.builder.XmlElement
- getAutoCloseConnection() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Indicates if the database connection in this endpoint should be closed when the endpoint is closed.
- getAutoCloseConnection() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Indicates if the database connection in this endpoint should be closed when the endpoint is closed.
- getAutoCloseConnection() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Indicates if the database connection in this endpoint should be closed when the endpoint is closed.
- getAverage(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Returns the current result of
AggregateReader.average(String)for the field; throws if that operation was not added. - getAverageLength() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns
Column.getLengthSum()divided by the value count, nulls included, rounded down (0 if there are no values). - getBackgroundColor() - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Gets the background color of the cell.
- getBatchSize() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Returns the number of records sent per batch update; 1 or less turns batching off (defaults to -1).
- getBatchSize() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Returns the number of events requested per page (defaults to 50).
- getBatchSize() - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
-
Returns the number of contacts requested per page (defaults to 50).
- getBatchSize() - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
-
Returns the number of messages requested per page (defaults to 25).
- getBatchSize() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- getBatchSize() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Returns the number of records to chunk together in batch updates; 1 or less (the default is -1) disables batching.
- getBatchSize() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Returns the number of records to chunk together in batch updates; 1 or less (the default is -1) disables batching.
- getBatchSize() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Returns the number of records to chunk together in batch updates; 1 or less (the default is -1) disables batching.
- getBatchSize() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Returns the number of records to chunk together in batch updates; 1 or less (the default is -1) disables batching.
- getBatchSize() - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Indicates the number of items to retrieve per batch.
- getBatchSize() - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
-
Returns the number of records inserted together per batch; 1 or less inserts records one at a time (default is -1).
- getBatchSize() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Indicates the maximum number of records to buffer when reading ORC data (default 1024).
- getBatchSize() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Indicates the maximum number of records to buffer when reading ORC data (default 1024).
- getBatchSize() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the maximum number of records to buffer when writing ORC data (default 1024).
- getBatchSize() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates the maximum number of records to buffer when writing ORC data (default 1024).
- getBatchSize() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Returns the number of records requested per page (defaults to 250, the maximum).
- getBatchSize() - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Returns the batch size.
- getBatchSize() - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
-
Returns the number of records to chunk together in batch inserts; inserts are not batched if it is 1 or less (default -1).
- getBatchSize() - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
-
Returns the number of records to chunk together in batch inserts; inserts are not batched if it is 1 or less (default -1).
- getBatchSize() - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
-
Returns the page size sent to Trello as
limit(always 1000); a smaller page ends the read. - getBatchSize() - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Returns the number of records looked up per API request (default is 100).
- getBefore() - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
-
Returns the date sent to Trello as the
beforeparameter, or null if none (the default). - getBeforeFieldName() - Method in class com.northconcepts.datapipeline.transform.MoveFieldBefore
- getBestFitFieldType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns a field type that can hold every value seen or null if none were seen.
- getBestFitInferredFieldType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the best fit inferred field type for the column.
- getBigDecimalLiteral(BigDecimal) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getBigDecimalPrecision() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Returns default precision value for BigDecimal type of values.
- getBigDecimalPrecision() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Returns default precision value for BigDecimal type of values.
- getBigDecimalScale() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the scale used when writing BigDecimal values (default 10).
- getBigDecimalScale() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates the scale used when writing BigDecimal values (default 10).
- getBigIntegerLiteral(BigInteger) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getBigNumberDescriptor() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns NumberDescriptor with necessary details for BigInteger invalid input: '&' BigDecimal numbers only.
- getBlankCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of empty-string values; whitespace-only values are not counted as blank.
- getBlockFileSystems() - Static method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
-
Returns the URI schemes of the file systems treated as supporting block sizes (
hdfs,webhdfs,viewfs). - getBlue() - Method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Gets the blue component of this color.
- getBlue() - Method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Gets the blue component of the color.
- getBoardId() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardCardsReader
- getBoardId() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardListsReader
- getBooleanLiteral(boolean) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Returns
TRUEorFALSE. - getBucketName() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- getBucketName() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectListing
- getBuffer() - Method in class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Returns the sampled bytes (up to 2048, see
FileDetector.getBufferSize()), or null if the content has not been read. - getBufferByFields() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
- getBufferedRowCount() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getBuffersClosed() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
- getBuffersCreated() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
- getBufferSize() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Returns the number of records in this
DataReaders buffer. - getBufferSize() - Method in class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Returns the number of valid bytes in
FileDetector.getBuffer(): -1 for empty content and 0 before the content is read. - getBufferSizeInBytes() - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Returns the estimated size in bytes of the records buffered but not yet read.
- getBufferSizeInBytes() - Method in class com.northconcepts.datapipeline.core.AsyncWriter
-
Returns the estimated size in bytes of the records queued but not yet passed to the nested writer.
- getBufferStrategy() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
-
Returns the strategy that decides when an open buffer is closed and its records released (defaults to closing 200 milliseconds after the last record was added or once it holds 100 records).
- getByteCount() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the maximum length in bytes of a character column (JDBC
CHAR_OCTET_LENGTH). - getByteLiteral(byte) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getBytesLiteral(byte[]) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getCacheFolder() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- getCacheFolder() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates the folder to store cached files during dynamic schema generation with
LocalFileDatasetor null if schema generation should be performed completely in memory usingMemoryDataset/> See alsoParquetDataWriter.getRecordsPerCacheFile() - getCalendarId() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Returns the ID of the calendar to read (defaults to
"primary"). - getCallback() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the callback notified of this job's progress and outcome (defaults to
JobCallback.NULL). - getCancelledOn() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the time this job instance was cancelled.
- getCancelledOn() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the time this job instance was cancelled.
- getCancelledOn() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the time this job instance was cancelled.
- getCandidateSiblings(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.CollapseSiblingPatterns
-
Returns the children eligible for pattern derivation: named element/field nodes, excluding attributes, existing wildcards, JSON container nodes, and nodes without an XPath expression.
- getCardFilter() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardCardsReader
-
Returns which of the board's cards are read (defaults to
CardFilter.OPEN). - getCardFilter() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardListsReader
-
Returns which cards are requested along with the board's lists (defaults to
CardFilter.NONE). - getCardinality() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Returns the number of unique values in the index, or of rows in the table for a
tableIndexStatisticentry. - getCardinality() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Returns whether the query returns many rows or one (default is
JdbcQuery.Cardinality.MANY). - getCardinality() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getCascadeResetLocationPath() - Method in class com.northconcepts.datapipeline.xml.XmlField
-
Returns the location path whose matching elements clear the cascaded value, or null if none is set.
- getCatalog() - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Returns the catalog name passed to
DatabaseMetaData.getTables; null (the default) does not filter by catalog. - getCatalogName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- getCatalogName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcSchema
- getCatalogName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- getCatalogNames() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the database's catalog names, as filled by
JdbcConnection.loadCatalogAndSchemas(). - getCellCount(int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- getCellCount(int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- getCellCount(int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- getCellCount(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getCellValues() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
The values loaded by
startReading, or the rows waiting to be flushed when writing. - getCharset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Returns the character set used to read the file (defaults to UTF-8); blank uses the platform default.
- getCharset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Returns the character set used to read the file (defaults to UTF-8); blank uses the platform default.
- getCharset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Returns the character set used to write the file (defaults to UTF-8); blank uses the platform default.
- getCharset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Returns the character set used to write the file (defaults to UTF-8); blank uses the platform default.
- getCharset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Returns the character set used to write the file (defaults to UTF-8); blank uses the platform default.
- getCharset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Returns the character set used to write the file (defaults to UTF-8); blank uses the platform default.
- getCharsetName() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Returns the charset name given to the constructor or null if the default charset or a
Readeris used. - getCheckConstraintCondition() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns the check constraint condition.
- getCheckConstraintCondition() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Returns the condition written verbatim inside
CHECK (...); null or blank omits the check constraint. - getCheckConstraintCondition() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Returns the condition written verbatim inside
CHECK (...); null or blank omits the check constraint. - getCheckConstraintName() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns the check constraint name.
- getCheckConstraintName() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Returns the name of the check constraint; an unnamed
CHECKis written when it is null or blank. - getCheckConstraintName() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Returns the name of the check constraint; an unnamed
CHECKis written when it is null or blank. - getChild() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the thread-local child job of this one while this job is running.
- getChild() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the thread-local child job of this one while this job is running.
- getChild() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the thread-local child job of this one while this job is running.
- getChildByName(String) - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
-
Returns the first child with the given name (case-sensitive), or
nullif there is none. - getChildElement(Element, String) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the first direct child element with the given tag name, or null if there is none or the parent is null.
- getChildElements(Element, String) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns the direct child elements with the given tag name; empty if there are none or the parent is null.
- getChildNode(String, boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the child with the given name (ignoring case, after the tree's detection strategy canonicalizes it); a missing child is created if
createis true, otherwise null is returned. - getChildNode(XmlNode, boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Same as
TreeNode.getChildNode(String, boolean)using the XML node's local name; returns null if the node has no name. - getChildNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlConditionalNode
- getChildNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlDetailMarker
- getChildNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Returns the children to write in the given context, or null for leaf nodes and for conditional nodes whose condition is false.
- getChildNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
- getChildren() - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- getChildren() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- getChildrenValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the total number of values held by the direct children.
- getCity() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getClassName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Returns the fully-qualified class name of the values the JDBC driver returns for this column.
- getClassName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the fully-qualified class name of the values the JDBC driver returns for this column.
- getClient() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the AWS SDK client, or
nullif none was supplied and this file system is not connected. - getClient() - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Returns the Jira REST client created by
JiraReader.open(); only valid while the reader is open. - getClient() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyClient.ShopifyStub
- getClientId() - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Returns the connection's client ID, also used as the durable subscription name when reading a topic.
- getClosedOn() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the time in milliseconds when this endpoint was closed or zero (0) if it hasn't yet been closed.
- getClosedWindows() - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Returns the closed windows whose summary records have not all been read yet.
- getCloseStream() - Method in class com.northconcepts.datapipeline.core.StreamWriter
-
Indicates if the stream is closed when this writer is closed (defaults to false, or true when writing to a file).
- getCloseWindowStrategy() - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Returns the strategy that decides when open windows are closed (defaults to
CloseWindowStrategy.never()). - getCloseWriterOnClose() - Method in class com.northconcepts.datapipeline.core.DebugReader
-
Indicates if the debug output is closed when this reader is closed (default is false).
- getCloseWriterOnClose() - Method in class com.northconcepts.datapipeline.core.DebugWriter
-
Indicates if the debug output is closed when this writer is closed (default is false).
- getCode() - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- getCode() - Method in interface com.northconcepts.datapipeline.foundations.pipeline.action.DataReaderAction
-
Returns the identifier of this kind of action, such as
"data-mapping". - getCode() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- getCode() - Method in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- getCollator() - Method in class com.northconcepts.datapipeline.core.FieldComparator
-
Returns the collator used to compare string values or null for natural ordering (the default).
- getCollection() - Method in class com.northconcepts.datapipeline.memory.CollectionReader
-
Gets the underlying collection, if available.
- getCollection(String) - Method in class com.northconcepts.datapipeline.memory.CollectionWriter
-
Returns the collection registered for the field path with
CollectionWriter.collect(String, Collection), or null if none. - getCollectionId() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getColumn() - Method in interface com.northconcepts.datapipeline.core.IParser
-
Returns the number of characters consumed so far (within the current line for
LineParser). - getColumn() - Method in class com.northconcepts.datapipeline.core.LineParser
- getColumn() - Method in class com.northconcepts.datapipeline.core.Parser
- getColumn() - Method in class com.northconcepts.datapipeline.core.StringParser
- getColumn() - Method in exception class com.northconcepts.datapipeline.jsonata.ParseException
-
Deprecated.Use
ParseException.getLocation()instead - getColumn(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- getColumn(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getColumn(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getColumn(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- getColumn(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getColumn(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the column with the given name, ignoring case, or
nullif there is none. - getColumn(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns the column with the given name or null if there is none.
- getColumn(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getColumn(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getColumn(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- getColumn(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getColumnCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- getColumnCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getColumnCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getColumnCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- getColumnCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getColumnName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
- getColumnName() - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertValue
- getColumnName() - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.MergeValue
- getColumnName() - Method in class com.northconcepts.datapipeline.jdbc.sql.update.UpdateValue
- getColumnName() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns the column name.
- getColumnName() - Method in class com.northconcepts.datapipeline.sql.h2.InsertValue
-
Returns the column name.
- getColumnName() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- getColumnName() - Method in class com.northconcepts.datapipeline.sql.mysql.InsertValue
- getColumnName() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- getColumnName() - Method in class com.northconcepts.datapipeline.sql.postgresql.InsertValue
- getColumnNames() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- getColumnNames() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getColumnNames() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getColumnNames() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- getColumnNames() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getColumnNames() - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Returns the column names.
- getColumnNames() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- getColumnNames() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- getColumnNumber() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Returns the 0-based character offset the parser has reached in the current line (not a field index).
- getColumns() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Returns the result columns, as filled by
JdbcConnection.loadQueries(). - getColumns() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- getColumns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- getColumns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getColumns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getColumns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- getColumns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getColumns() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Indicates the columns to read from ORC file.
- getColumns() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Indicates the columns to read from ORC file.
- getColumns() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Returns the list of columns.
- getColumns() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
- getColumns() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
- getColumns(String...) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the columns with the given names, ignoring case, in the order given; unknown names are skipped.
- getColumns(Collection<String>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the columns with the given names, ignoring case, in the order given; unknown names are skipped.
- getColumnSeparator() - Method in class com.northconcepts.datapipeline.texttable.TextTableWriter
-
Returns the string written between columns (defaults to two spaces).
- getColumnStatsException() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns the last exception thrown while collecting column stats or null if there was none.
- getColumnStatsReaderThreads() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
The number of threads to use to process column stats (default 2).
- getColumnStatsReaderThreads() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).
- getColumnStatsReaderThreads() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Returns the number of threads that collect column statistics when the schema is inferred from the records (default is 2).
- getCommonPrefixes() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectListing
-
Returns the key prefixes rolled up by the file system's
delimiter(nevernull). - getCompany() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getCompletedTaskCount() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the approximate total number of tasks that have completed execution by this bus' executorService or -1 if unknown.
- getCompressionCodecName() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates the compression used for writing (default UNCOMPRESSED).
- getCompressionCodecName() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates the compression used for writing (default UNCOMPRESSED).
- getCompressionKind() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the compression used for writing (default NONE).
- getCompressionKind() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates the compression used for writing (default NONE).
- getCondition() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
-
Returns the condition for computing the field's value; when it is false the field gets the default value or null.
- getCondition() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Returns the condition for entering this node from its parent; it is not evaluated for root and default nodes.
- getCondition() - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
-
Returns the ON condition that decides between updating and inserting.
- getCondition() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Join
- getCondition() - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- getCondition() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Returns the condition under which this transformation applies or
nullif it always applies. - getCondition() - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Returns the condition under which this transformation applies or
nullif it always applies. - getCondition() - Method in class com.northconcepts.datapipeline.xml.builder.XmlAttribute
-
Returns the condition that must be true for the attribute to be written, or null if it is always written.
- getCondition() - Method in class com.northconcepts.datapipeline.xml.builder.XmlConditionalNode
- getConditionAsSource() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- getConditionAsString() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- getConditionCount() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConditionPart
- getConditionCount() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
-
Returns the number of conditions (
ConditionParts) in this part's subtree. - getConditionFailedSource() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the expression text of the failed condition, or null if none failed.
- getConditions() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Returns the conditions that must all be true for a record to be mapped; otherwise the result has no target record.
- getConditions() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- getConditionsSource() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- getConfig() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Returns the Orc configuration parameters.
- getConfig() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Returns the Orc configuration parameters.
- getConfig() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Returns the Orc configuration parameters.
- getConfig() - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Returns the twitter4j configuration used to create the client; changes after the first API call have no effect.
- getConfig() - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Returns the twitter4j configuration applied when the stream is created (when a reader is opened).
- getConfiguration() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Returns the Orc configuration parameters.
- getConfiguration() - Method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
- getConfiguration() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Returns the Parquet configuration parameters.
- getConfiguration() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Returns the Parquet configuration parameters.
- getConfiguration() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Returns the Parquet configuration parameters.
- getConfiguration() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Returns the Parquet configuration parameters.
- getConfiguration() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Returns the FreeMarker configuration that loads the templates named in the
Stringtemplate setters. - getConflictAction() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
-
Returns the action to perform on conflict (default ConflictAction.UPDATE).
- getConflictAction() - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Indicates the action to perform on conflict, or null if not set, in which case
ConflictAction.UPDATEis used. - getConflictAction() - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
-
Indicates the action to perform on conflict (default ConflictAction.UPDATE).
- getConnection() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Returns the connection this query was added to, or null.
- getConnection() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the connection this table was added to, or
null. - getConnection() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- getConnection() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- getConnection() - Method in class com.northconcepts.datapipeline.jms.JmsConnection
-
Returns the underlying JMS connection or null before
JmsConnection.open()is called. - getConnection() - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Returns the JMS connection or null if the reader has not been opened.
- getConnection() - Method in class com.northconcepts.datapipeline.jms.JmsWriter
-
Returns the JMS connection or null if the writer has not been opened.
- getConnectionFactory() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the factory
JdbcConnection.createConnection()uses in place of the driver, URL, credentials and properties, or null. - getConnections() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Returns the number of connections, each written to by its own thread.
- getConnections() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Returns the number of connections, each written to by its own thread.
- getConstraintName() - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Returns the constraint name.
- getConstraintName() - Method in class com.northconcepts.datapipeline.sql.h2.DropTableConstraint
-
Returns the constraint name.
- getConstraintName() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- getConstraintName() - Method in class com.northconcepts.datapipeline.sql.mysql.DropTableConstraint
- getConstraintName() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- getConstraintName() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- getContent() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
- getContentType() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Returns
null; the S3 object's content type is not looked up. - getContentType() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
- getContentType() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
- getContentType() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Returns null since no content type is tracked for local files.
- getContentType() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- getConverter() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Returns the converter that copies Twitter objects into records (defaults to
ITwitterConverter.DEFAULT). - getConverter() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Returns the converter that copies Twitter objects into records (defaults to
ITwitterConverter.DEFAULT). - getConverter() - Method in class com.northconcepts.datapipeline.twitter.TwitterWriter
-
Returns the converter that copies Twitter objects into records (defaults to
ITwitterConverter.DEFAULT). - getCorePoolSize() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the core number of threads in this bus' executorService or -1 if unknown.
- getCost() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- getCount() - Method in class com.northconcepts.datapipeline.core.DataEndpointGroup
-
Returns the number of endpoints in this group.
- getCount() - Method in class com.northconcepts.datapipeline.core.FieldDeclarations
- getCount() - Static method in class com.northconcepts.datapipeline.core.Functions
-
Returns the number of aliased functions.
- getCount() - Method in class com.northconcepts.datapipeline.core.MultiWriter
-
Returns the number of target writers.
- getCount() - Method in class com.northconcepts.datapipeline.core.RecordComparator
-
Returns the number of fields added for comparison.
- getCount() - Method in class com.northconcepts.datapipeline.core.SequenceReader
-
Returns the number of readers in the sequence.
- getCount() - Method in class com.northconcepts.datapipeline.filter.FilteringReader
-
Returns the number of filters in this reader.
- getCount() - Method in class com.northconcepts.datapipeline.filter.rule.OrRule
- getCount() - Method in class com.northconcepts.datapipeline.filter.rule.PatternMatch
- getCount() - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
- getCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetReader
-
Returns the maximum number of records to read; 0 or less means no limit.
- getCount() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Returns the maximum number of rows to return or
nullif unlimited. - getCount() - Method in class com.northconcepts.datapipeline.meter.Meter
- getCount() - Method in class com.northconcepts.datapipeline.security.CredentialsResolverRegistry
- getCount() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Returns the number of transformers added.
- getCount() - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Returns the number of transformers added.
- getCount(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Returns the current result of
AggregateReader.count(String)for the field; throws if that operation was not added. - getCountry() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getCountryCode() - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- getCountryCode() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getCreatedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- getCreatedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- getCreatedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getCreatedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getCreatedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- getCreatedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- getCreatedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getCreatedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getCreatedOn() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the time in milliseconds when this record was created.
- getCreatedOn() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
The time this job instance was created.
- getCreatedOn() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the time this job instance was created.
- getCreatedOn() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the time this job instance was created.
- getCreatedOn() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the time this job instance was created.
- getCreateTableSql(String) - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset.DatabaseProvider
-
Returns the SQL statement to create a table with the given name.
- getCreateWindowStrategy() - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Returns the strategy that decides when new windows are opened (defaults to
limitOpened(1)). - getCreationDate() - Method in class com.northconcepts.datapipeline.amazons3.S3Bucket
- getCredentials() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getCredentials() - Method in class com.northconcepts.datapipeline.security.CachingCredentialsResolver
- getCredentials() - Method in interface com.northconcepts.datapipeline.security.CredentialsResolver
-
Resolves and returns the current credentials.
- getCredentials() - Method in class com.northconcepts.datapipeline.security.EnvironmentCredentialsResolver
- getCredentials() - Method in class com.northconcepts.datapipeline.security.FileCredentialsResolver
- getCredentials() - Method in class com.northconcepts.datapipeline.security.StaticCredentialsResolver
- getCredentials() - Method in class com.northconcepts.datapipeline.security.SuppliedCredentialsResolver
- getCredentials() - Method in class com.northconcepts.datapipeline.security.SystemPropertyCredentialsResolver
- getCredentialsProvider() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Returns the AWS SDK credentials provider that this file's
AmazonS3FileSystemuses when noCredentialsResolveris set. - getCredentialsProvider() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the AWS SDK credentials provider used when no
CredentialsResolveris set (defaults to the standard AWS credentials provider chain). - getCredentialsResolver() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Returns the credentials resolver of this file's
AmazonS3FileSystemornullif there is none. - getCredentialsResolver() - Method in class com.northconcepts.datapipeline.internal.lang.FileSystem
-
Returns the resolver supplying this file system's credentials or
nullif none is set. - getCriteria() - Method in class com.northconcepts.datapipeline.jdbc.sql.delete.Delete
- getCriteria() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Deprecated.
- getCriteria() - Method in class com.northconcepts.datapipeline.jdbc.sql.update.Update
- getCsvFieldSeparator() - Method in class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Returns the separator (comma, tab, pipe, semicolon or caret) that outnumbers all the others combined in CSV content, or -1 if the type is not CSV or none does.
- getCurrent() - Static method in class com.northconcepts.datapipeline.core.Messages
-
Returns the current thread's container, creating it if needed (a discarding container while collection is disabled).
- getCurrent() - Static method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the
AbstractJobcurrently running in this thread ornullif there is none. - getCurrent() - Static method in class com.northconcepts.datapipeline.job.Job
-
Returns the job currently running in this thread.
- getCurrent() - Method in exception class com.northconcepts.datapipeline.jsonata.JException
-
Returns the current token
- getCurrent(boolean) - Static method in class com.northconcepts.datapipeline.core.Messages
-
Returns the current thread's container, creating it only if
createis true (otherwise null when there is none); returns a discarding container while collection is disabled. - getCurrentCredentials() - Method in class com.northconcepts.datapipeline.internal.lang.FileSystem
-
Returns the credentials snapshot resolved for this connection cycle or
nullif there isn't one. - getCurrentEvent() - Static method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the event currently being delivered on this thread.
- getCurrentField() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Returns the field most recently checked by
FieldFilter.allow(Record)or null if none was. - getCurrentField() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Returns the field being transformed or null if the field last looked up is missing from the record.
- getCurrentFilter() - Method in class com.northconcepts.datapipeline.filter.FilteringReader
-
Returns the filter most recently used by this reader (such as the one that rejected the current record) or null if none was.
- getCurrentRecord() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Returns the record being transformed, for use in
FieldTransformer.transformField(Field). - getCurrentRule() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Returns the rule most recently applied by
FieldFilter.allow(Record)(the failing one when a rule rejects the record) or null if none was. - getCurrentSequence() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
-
Returns the current Sequence in use by this writer,
nullif it hasn't started writing, or the last sequence if it has finished writing. - getCustomerCriteria() - Method in class com.northconcepts.datapipeline.shopify.ShopifyCustomerReader
-
Returns the criteria for the customers to read or null for none; it is modified in place when later pages are requested.
- getCustomers(ShopifyCustomerCriteria, int, String) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- getCustomers(ShopifyCustomerCriteria, Integer, String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Returns a page of customers whose
nextfield holds the cursor of the following page, if any. - getCustomStyle() - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
-
Returns the custom CSS style applied to the PDF document (default
null). - getCustomStyle() - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
-
Returns the custom CSS style applied to the PDF document (default
null). - getData() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- getData() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Returns the data model given to the templates, holding
writer,recordand the current record's fields by name; entries added here are visible to the templates too. - getDatabaseColumnCatalogName() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The catalog name of a column returned from the database for this field.
- getDatabaseColumnClassName() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The class name of a column returned from the database for this field.
- getDatabaseColumnDisplaySize() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column display size returned from the database for this field.
- getDatabaseColumnFieldType() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The
FieldTypemapped from the Java type of the database column for this field. - getDatabaseColumnJavaType() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The Java type mapped from
java.sql.Types. - getDatabaseColumnName() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column name returned from the database for this field.
- getDatabaseColumnNullable() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column isNullable value returned from the database for this field.
- getDatabaseColumnPrecision() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column precision returned from the database for this field.
- getDatabaseColumnScale() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column scale returned from the database for this field.
- getDatabaseColumnSchemaName() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The schema name of a column returned from the database for this field.
- getDatabaseColumnSigned() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column isSigned value returned from the database for this field.
- getDatabaseColumnSqlType() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column type returned from the database for this field.
- getDatabaseColumnTableName() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The table name of a column returned from the database for this field.
- getDatabaseColumnTypeName() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column type name returned from the database for this field.
- getDatabaseFile() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getDatabaseQuery() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The SQL statement used to query the database.
- getDatabaseQuery() - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The SQL statement used to query the database.
- getDatabaseTypeName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- getDatabaseTypeName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- getDatabaseUrl() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The JDBC connection URL.
- getDatabaseUrl() - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The JDBC connection URL.
- getDataConnectionMode() - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Returns the data connection mode applied at
FtpFileSystem.open()(defaults toDataConnectionMode.ACTIVE_LOCAL). - getDataFile(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Returns the data file holding the given 0-based chunk of
LocalFileDataset.getRecordsPerFile()records. - getDataFormat() - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Gets the data format string for the cell (e.g., "0.00" for decimals, "m/d/yy" for dates).
- getDataFormats() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Returns the Excel data formats set per field type, applied over the writer's defaults, or null if none were set.
- getDataFormats(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Returns the data formats per field type, first creating an empty map if
createis true and there is none. - getDataLoadException() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns the exception that failed the current or last load or null if there was none.
- getDataMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- getDataMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
- getDataMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPart
-
Returns the data mapping containing this part (itself for a
DataMapping) or null if it is not known. - getDataMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
- getDataMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
- getDataMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- getDataMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- getDataMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- getDataMappingName() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPart
-
Returns the name of the data mapping containing this part or null if it is not known.
- getDataMappingPart() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblem
- getDataMappingPartContainer() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- getDataMappingPartContainer() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPart
-
Returns the data mapping part containing this one or null if there is none.
- getDataMappingPartContainer() - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- getDataMappingPartContainerName() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPart
-
Returns the name of the
containing partor null if there is none. - getDataMappingPartContainerType() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPart
-
Returns the type of the
containing partor null if there is none. - getDataMappingPartName() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- getDataMappingPartName() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- getDataMappingPartName() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPart
-
Returns the name identifying this part: the data mapping's name or a field mapping's target field name.
- getDataMappingPartType() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- getDataMappingPartType() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPart
-
Returns the kind of part this is, such as
DataMappingPartType.FieldMapping. - getDataMappingPartType() - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- getDataMappingProblems() - Method in interface com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblemsSupplier
-
Returns the problems found in this element without checking its children.
- getDataMappingProblems(boolean) - Method in interface com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblemsSupplier
-
Returns a new list with this element's problems, plus those of its children when
includeChildrenis true. - getDataMappingProblems(List<DataMappingProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- getDataMappingProblems(List<DataMappingProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- getDataMappingProblems(List<DataMappingProblem>, boolean) - Method in interface com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblemsSupplier
-
Adds this element's problems to the list, plus those of its children when
includeChildrenis true; the default adds none. - getDataMappingProblems(List<DataMappingProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- getDataMappingResult(Record) - Static method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the result attached to the record by
DataMappingResult.setDataMappingResult(Record, DataMappingResult), or null if there is none. - getDataset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetIterator
- getDataset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetReader
- getDatasetAfterDataMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Returns the dataset containing the mapped data that hasn't been sorted.
- getDataTableName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Gets the name of the data table in the database.
- getDate() - Method in class com.northconcepts.datapipeline.filter.rule.DateIs
- getDate() - Method in class com.northconcepts.datapipeline.filter.rule.DateIsAfter
- getDate() - Method in class com.northconcepts.datapipeline.filter.rule.DateIsBefore
- getDate() - Method in class com.northconcepts.datapipeline.trello.DateParam
- getDateLiteral(Date) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Returns the value as a JDBC date escape,
{d 'yyyy-MM-dd'}. - getDateTimeLiteral(Date) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Returns the value as a JDBC timestamp escape,
{ts 'yyyy-MM-dd HH:mm:ss.SSS'}. - getDateTimePatternDetector() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Returns the detector a
Datasetbuilt on this pipeline uses to infer date/time values in text columns. - getDateTimePatternDetector() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DateTimeNodeNameRule
-
Returns the detector used to recognize date/time names.
- getDateTimeRenderOption() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getDecimalPlaces() - Method in class com.northconcepts.datapipeline.transform.format.Rounder
-
Returns the number of decimal places to round to; negative values round to the left of the decimal point.
- getDecimals() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the number of fractional digits (0 where not applicable).
- getDecisionTable() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableReader
- getDecisionTable() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableWriter
- getDecisionTable() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- getDecisionTree() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeReader
- getDecisionTree() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeWriter
- getDecisionTree() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- getDeclaration() - Method in class com.northconcepts.datapipeline.xml.builder.XmlTemplate
-
Returns the text written verbatim on its own line before the template's nodes, typically an XML declaration (default is null, for none).
- getDefaultBigDecimalPrecision() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Returns the default precision of
FieldType.BIG_DECIMAL(default 20). - getDefaultBigDecimalPrecision() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Returns the default precision of
FieldType.BIG_DECIMAL(default 20). - getDefaultBigDecimalPrecision() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Returns the default precision of
FieldType.BIG_DECIMAL(default 20). - getDefaultBigDecimalScale() - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Returns the default scale used when writing BigDecimal values (default 5).
- getDefaultBigDecimalScale() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Returns the default scale used when writing BigDecimal values (default 5).
- getDefaultBigDecimalScale() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Returns the default scale used when writing BigDecimal values (default 5).
- getDefaultBigDecimalScale() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Returns the default scale used when writing BigDecimal values (default 5).
- getDefaultBigDecimalScale() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Sets the default scale of
FieldType.BIG_DECIMAL(default 5). - getDefaultBigDecimalScale() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Sets the default scale of
FieldType.BIG_DECIMAL(default 5). - getDefaultBigDecimalScale() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Sets the default scale of
FieldType.BIG_DECIMAL(default 5). - getDefaultBigIntegerPrecision() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Returns the default precision of
FieldType.BIG_INTEGER(default 20). - getDefaultBigIntegerPrecision() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Returns the default precision of
FieldType.BIG_INTEGER(default 20). - getDefaultBigIntegerPrecision() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Returns the default precision of
FieldType.BIG_INTEGER(default 20). - getDefaultBigNumberPrecision() - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Returns the default precision used when writing BigDecimal invalid input: '&' BigInteger values (default 25).
- getDefaultBigNumberPrecision() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Returns the default precision used when writing BigDecimal invalid input: '&' BigInteger values (default 25).
- getDefaultBigNumberPrecision() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Returns the default precision used when writing BigDecimal invalid input: '&' BigInteger values (default 25).
- getDefaultBigNumberPrecision() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Returns the default precision used when writing BigDecimal invalid input: '&' BigInteger values (default 25).
- getDefaultFileExtension() - Method in enum class com.northconcepts.datapipeline.foundations.file.FileType
-
Returns the usual file extension, without the leading dot.
- getDefaultFontColor() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
-
Returns default font color for XLSX file type.
- getDefaultFontColor() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
-
Returns default font color for XLSX file type.
- getDefaultNode() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Returns the node entered when no child node's condition holds, or null to stop here.
- getDefaultOutcomes() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Returns the outcomes used when no rule fires.
- getDefaultPort() - Method in enum class com.northconcepts.datapipeline.email.MailStore
- getDefaultType() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the default
FieldTypeused when this array is empty. - getDefaultValue() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the column's default value as unparsed text reported by the database, or
null. - getDefaultValue() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns the default value.
- getDefaultValue() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Returns the SQL expression written verbatim after
DEFAULT; null or blank omits the clause. - getDefaultValue() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Returns the SQL expression written verbatim after
DEFAULT; null or blank omits the clause. - getDefaultValueAsJavaString() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Converts the default value to a Java string literal suitable for code generation.
- getDefaultValueExpression() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
-
Returns the expression that supplies the field's value when the mapped value is null or the condition is false.
- getDefaultValueExpression() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The calculated value to set in the data if the field is null or missing.
- getDefaultValueExpressionAsString() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- getDefaultValueExpressionAsString() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The calculated value to set in the data if the field is null or missing.
- getDeferrability() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns whether checking of this foreign key can be deferred, as a
DatabaseMetaDatacode such asimportedKeyInitiallyDeferred. - getDeleteRule() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns what happens to the foreign key when the referenced primary key is deleted, as a
DatabaseMetaDatacode such asimportedKeyCascade. - getDelimiter() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
The delimiter sent with every listing.
- getDepth() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the number of ancestors above this node (0 for the root).
- getDescendantValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the number of values held by this node and all its descendants.
- getDescription() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the optional text shown for this endpoint in
Endpoint.toString()and exception properties. - getDescription() - Method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Gets the description of the color.
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- getDescription() - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
The human-readable summary of this entity.
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The human-readable summary of this field.
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- getDescription() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
The human-readable summary of this schema.
- getDescription() - Method in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
-
Returns a longer explanation of when this error occurs.
- getDescriptionField() - Method in class com.northconcepts.datapipeline.trello.TrelloCardWriter
-
Returns the name of the record field holding the card description (defaults to
"description"). - getDestination() - Method in class com.northconcepts.datapipeline.jms.JmsConnection
-
Returns the queue or topic named in the settings or null before
JmsConnection.open()is called. - getDetailedErrorMessage() - Method in exception class com.northconcepts.datapipeline.jsonata.JException
-
Returns the error message with error details in the text.
- getDetails() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblem
- getDetails() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaProblem
- getDetailTemplate() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Returns the template written for each record.
- getDetectionStrategy() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Returns the detection strategy; a tree without one, such as a deserialized tree, gets
standard(false). - getDirection() - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Returns the order in which the messages are read (default is
FORWARD). - getDirection() - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
-
Returns whether paging follows the next or the previous cursors (defaults to
TwitterPageableReader.Direction.FORWARD). - getDiscardedRecordCount() - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Returns the number of discarded
Records - getDiscardReasonFieldName() - Method in class com.northconcepts.datapipeline.filter.FilteringReader
-
Returns the field in the record to place the description of the filter that disallowed it or
nullif one should not be added. - getDiscardReasonFieldName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Returns the name of the field added to discarded records to hold the failure message, or null if none.
- getDiscardReasonFieldName() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the field in the record to place the description of the exception that was thrown by the failing read or
nullif one should not be added. - getDiscardReasonFieldName() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the field in the record to place the description of the exception that was thrown by the failing write or
nullif one should not be added. - getDiscardReasonFieldName() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Returns the the field in the record to place the description of the transformation that failed along with the exception message.
- getDiscardReasonFieldName() - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Returns the the field in the record to place the description of the transformation that failed along with the exception message.
- getDiscardWriter() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Returns the writer that receives records not matching the Avro schema or null if such records fail the write.
- getDiscardWriter() - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Returns the discard sink for discarded records or
nullif one was not assigned. - getDiscardWriter() - Method in class com.northconcepts.datapipeline.filter.FilteringReader
-
Returns the discard sink for disallowed records or
nullif one was not assigned. - getDiscardWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Returns the writer that receives records failing source or target entity validation, instead of stopping the pipeline, or null if none.
- getDiscardWriter() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the discard sink for failing records or
nullif one was not assigned. - getDiscardWriter() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the discard sink for failing records or
nullif one was not assigned. - getDiscardWriter() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Returns the discard sink for bad records or
nullif one was not assigned. - getDiscardWriter() - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Returns the discard sink for bad records or
nullif one was not assigned. - getDiscardWriter() - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Returns the discard sink for records where the lookup failed or
nullif one was not assigned. - getDisplayName() - Method in enum class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPartType
-
Returns the human-readable name of this type, such as
Field Mapping. - getDisplayName() - Method in enum class com.northconcepts.datapipeline.foundations.file.FileType
- getDisplayName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetPattern
-
Returns the pattern for display purposes (for example
item-*). - getDisplayName() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The user-friendly name for this field.
- getDisplayName() - Method in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
-
Returns the human-readable name of this type, such as
Entity Relationship. - getDisplayNameOrName() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The user-friendly name for this field if one is set or the
FieldDef.getName()value otherwise. - getDisplayText() - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- getDisplayText() - Method in interface com.northconcepts.datapipeline.foundations.pipeline.action.DataReaderAction
-
Returns the human-readable name of this action, such as
"Data Mapping". - getDisplayText() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- getDisplayText() - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Returns the type's display name, including the expected format for date and time types (such as
Date (yyyy-MM-dd)). - getDocument() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- getDocument() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
- getDocument() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- getDocument() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- getDocumentStatistics() - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
-
Returns the page, image and text statistics (computed once, then cached) or null if none are cached and the document is not open.
- getDocumentStatistics() - Method in class com.northconcepts.datapipeline.pdf.PdfReader
- getDoneFilter() - Method in class com.northconcepts.datapipeline.jira.JiraEpicReader
-
Indicates which epics to return: true=done, false=not done, null=all (default is all).
- getDoubleLiteral(double) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getDriverClassName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- getDstoff() - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- getDuplicateFieldAction() - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Returns how looked-up fields that clash with existing field names are merged (default is APPEND).
- getDuplicateFieldPolicy() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Returns how a field matched more than once within a record is stored (defaults to
XmlReader.DuplicateFieldPolicy.USE_LAST_VALUE). - getDuplicateFieldPolicy() - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Returns how a field matched more than once in a record is handled (default is
XmlReader.DuplicateFieldPolicy.USE_LAST_VALUE). - getDuplicateRecordCount() - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Returns the number of duplicate records that have been read.
- getElapsedTime() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the total time in milliseconds this endpoint spent reading (inside
DataReader.read()) or writing (insideDataWriter.write(Record)) if the captureElapsedTime flag is set (Endpoint.setCaptureElapsedTime(boolean)was called with true). - getElapsedTime() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
-
The time this sequence has been running while this sequence is current.
- getElapsedTime() - Method in class com.northconcepts.datapipeline.meter.Meter
-
Returns the milliseconds elapsed since the meter was created or last reset, up to when its timer was stopped (at least 1).
- getElapsedTimeAsString() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the total time (as a human readable string) this endpoint spent reading (inside
DataReader.read()) or writing (insideDataWriter.write(Record)) if the captureElapsedTime flag is set (Endpoint.setCaptureElapsedTime(boolean)was called with true). - getElementDepth() - Method in class com.northconcepts.datapipeline.xml.builder.XmlElement
- getElementDepth() - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Returns how many elements enclose this node, including itself if it is an element; used for indentation.
- getEmailAddress() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getEmailClient() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getEmailType() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getEmptyStringValuePolicy() - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Returns the object responsible for writing empty string values (defaults to ValuePolicy.QUOTED_EMPTY_STRING).
- getEmptyStringValuePolicy() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Returns how empty strings are written (defaults to
CSVWriter.ValuePolicy.QUOTED_EMPTY_STRING, a pair of quotes). - getEncodedPassword() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the password as encoded by the
password encoder(hex by default). - getEndDate() - Method in class com.northconcepts.datapipeline.twitter2.TwitterSearchReader
-
Indicates the newest UTC timestamp search criteria.
- getEndDate() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Indicates the newest UTC timestamp search criteria.
- getEndingQuote() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Returns the string used to mark the ending of text values that may contain commas and other special characters (defaults to double quote - ").
- getEndingQuote() - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Returns the string used to mark the ending of text values that may contain commas and other special characters (defaults to double quote - ").
- getEndingQuote() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Returns the string that ends a quoted value (defaults to a double quote).
- getEndingQuote() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Returns the string that ends a quoted value (defaults to a double quote).
- getEndpoint() - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Returns the reader or writer this transformer was added to (the reader if both) or null if neither.
- getEndpointOverride() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the S3 service endpoint override or
nullif none is set. - getEntities() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the entities in this schema or null if none were added.
- getEntities(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the entities, creating the list if it is null and
createis true. - getEntities(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns all entities whose name matches the given name, ignoring case; empty if none match or the name is empty.
- getEntity() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaFilter
- getEntity() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- getEntity(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the
EntityDefthat matches the specified name. - getEntityCount() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- getEntityDef() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The parent entity containing this field.
- getEntityDef() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the entity containing this index or null if it has not been added to one.
- getEntityDef() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaTransformer
- getEntityExpansionPolicy() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Returns how multi-valued entity fields are stored (defaults to
EntityExpansionPolicy.TO_STRING). - getEntityExpansionPolicy() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Returns how multi-valued entity fields are stored (defaults to
EntityExpansionPolicy.TO_STRING). - getEntityExpansionPolicy() - Method in class com.northconcepts.datapipeline.twitter.TwitterWriter
-
Returns how multi-valued entity fields are stored (defaults to
EntityExpansionPolicy.TO_STRING). - getEntityFile() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses.TableConfig
-
Returns the
.javafile for the table's class in the target package's folder under the base folder. - getEntityFile(String) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Returns the
.javafile for the given class name in the target package's folder under the base folder. - getEntityName() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
- getEntityNames() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- getEntityNames() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Returns entity names that are specified by
CreateH2DdlFromSchemaDef.setEntityNames(java.util.List<java.lang.String>)to be included in the output DDL. - getEntityNames() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Returns entity names that are specified by
CreateMySqlDdlFromSchemaDef.setEntityNames(java.util.List<java.lang.String>)to be included in the output DDL. - getEntityNames() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Returns entity names that are specified by
CreatePostgreSqlDdlFromSchemaDef.setEntityNames(java.util.List<java.lang.String>)to be included in the output DDL. - getEntityQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Returns the qualified name that includes the name of this field and the
EntityDefabove it separated by period. - getEntityQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the qualified name that includes the name of this index and the
EntityDefabove it separated by period. - getEntityRelationship(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the
EntityRelationshipDefthat matches the specified name. - getEntityRelationshipByForeignKeyName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns a relationship whose name matches the given foreign key name, ignoring case, or null if there is none.
- getEntityRelationshipCount() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the number of entity relationships in this schema.
- getEntityRelationshipNames() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the names of all entity relationships in this schema.
- getEntityRelationships() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the entity relationships in this schema or null if none were added.
- getEntityRelationships(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the entity relationships, creating the list if it is null and
createis true. - getEntityRelationshipsByForeignKeyName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- getEntitySuperClass() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Returns the superclass of the generated classes, or null for none; generated record serialization also calls a
RecordSerializablesuperclass. - getEntitySuperClass() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Returns the superclass of the generated entities, or null for none; generated record serialization also calls a
RecordSerializablesuperclass. - getEntitySuperClass() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Returns the superclass of the generated entities, or null for none; the fields, getters and setters it already declares are reused.
- getEntries() - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Returns the number of cached elements.
- getEpics(int, int, int, Boolean) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
-
Returns a page of the board's epics as JSON; a null
doneomits the done filter. - getError() - Method in exception class com.northconcepts.datapipeline.jsonata.JException
-
Returns the error code, i.e.
- getErrorCount() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the number of exceptions this bus has experienced.
- getErrors() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the source and target entity validation errors combined, or an empty list if there are none.
- getErrors() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
-
Returns the errors or null if none were added.
- getErrors() - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- getErrors(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
-
Returns the errors, creating the list if it is null and
createis true. - getETag() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectSummary
- getEventBus() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
- getEventBus() - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
- getEventCriteria() - Method in class com.northconcepts.datapipeline.shopify.ShopifyEventReader
-
Returns the criteria for the events to read or null for none; it is modified in place when later pages are requested.
- getEventFilter() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Returns the extra filter events must pass besides the topic check or
nullif there is none. - getEventListenerClass() - Method in class com.northconcepts.datapipeline.eventbus.Event
-
Returns the listener interface whose method was called on the publisher.
- getEventPublisher() - Method in class com.northconcepts.datapipeline.eventbus.Event
-
Returns the publisher proxy whose method call produced this event.
- getEvents(ShopifyEventCriteria, int, String) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- getEvents(ShopifyEventCriteria, Integer, String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Returns a page of events whose
nextfield holds the cursor of the following page, if any. - getEventsActive() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the approximate number of threads that are actively delivering events using this bus' executorService or -1 if unknown.
- getEventsDelivered() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the combined number of events each listener on this event bus has received (typically
EventBus.getEventsPublished()*EventBus.getListenerCount()). - getEventSource() - Method in class com.northconcepts.datapipeline.eventbus.Event
-
Returns the source the publisher was created with or
nullif it has none. - getEventSource() - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
-
Returns the source attached to this writer's events (defaults to the writer itself).
- getEventsPublished() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the number of events sent to this event bus for delivery to listeners.
- getEventsQueued() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the number of events waiting to be executed by this bus' executorService or -1 if unknown.
- getExample() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
A human-readable example of values supported by this field.
- getExampleValue() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
-
Evaluates the example value expression and converts the result to the Java type; returns null if there is no expression.
- getExampleValueExpression() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
-
Returns the DataPipeline expression whose result, converted to the Java type, is the example value; null means a null value.
- getExcelCellStyle() - Method in class com.northconcepts.datapipeline.excel.ExcelFieldMetadata
-
Gets the ExcelCellStyle attached to the field, if any.
- getExcelColor() - Method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Gets the ExcelColor instance for this palette color.
- getExcelColorPaletteIndex() - Method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Gets the Excel color palette index if this color matches a palette color.
- getExcelFont() - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Gets the font styling for the cell.
- getExcelHyperlink() - Method in class com.northconcepts.datapipeline.excel.ExcelFieldMetadata
-
Gets the ExcelHyperlink attached to the field, if any.
- getExcelReader() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- getExcelReader() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- getExcelReader() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- getExcelWriter() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- getExcelWriter() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- getExcelWriter() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- getException() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
-
Returns the first exception thrown by a source reader or null if none failed.
- getException() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader.ReaderThread
-
Returns the exception that stopped this thread or null if it ended normally.
- getException() - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Returns the first exception thrown by the background thread or null if there was none.
- getException() - Method in class com.northconcepts.datapipeline.core.AsyncWriter
-
Returns the background thread's failure that has not yet been rethrown to the caller or null if there is none.
- getException() - Method in class com.northconcepts.datapipeline.core.Message
-
Returns the exception attached to this message or null if there is none.
- getException() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Returns the pending error recorded by this reader (such as a failed batch request) or null; the next read throws it.
- getException() - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
-
Returns the pending error recorded by this reader (such as a failed batch request) or null; the next read throws it.
- getException() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Returns an exception thrown by one of the internal AsyncWriters if any.
- getException() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Returns an exception thrown by one of the internal AsyncWriters if any.
- getException() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the last exception thrown while running.
- getException() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the last exception thrown while running.
- getException() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the last exception thrown while running.
- getException() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Returns the last exception an operation threw on the most recently transformed field or
nullif none did. - getException() - Method in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
-
Returns the exception raised while streaming, which the next read throws, or null if none occurred.
- getExceptionCount() - Method in class com.northconcepts.datapipeline.retry.RetryContext
-
Returns the total number of failures the operation has seen, including those of earlier calls.
- getExceptionCount() - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Returns the total number of exceptions/failures seen by this reader.
- getExceptionCount() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the total number of exceptions/failures seen by this reader.
- getExceptionCount() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the total number of exceptions/failures seen by this writer.
- getExceptionFromCause(Class<T>) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns
causeClassif this exception was caused by (or one of its nested exceptions was caused by) the specified exception. - getExceptions() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the exceptions thrown by field mappings, keyed by target field name, or null if none were recorded.
- getExceptions() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Returns all exceptions thrown by the internal AsyncWriters (the list will not be null, but may contain no elements).
- getExceptions() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Returns all exceptions thrown by the internal AsyncWriters (the list will not be null, but may contain no elements).
- getExceptions(boolean) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the exceptions thrown by field mappings, keyed by target field name, creating the map first if
createis true (otherwise null when none were recorded). - getExcludedFields() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
The set of fields to be removed from the target.
- getExcludedTables() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Returns the names of the tables to skip, matched exactly against unqualified table names.
- getExcludedWords() - Method in class com.northconcepts.datapipeline.transform.SplitWords
-
Returns the words (matched case-sensitively) left out of the result or null if none are excluded.
- getExcludeNulls() - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Indicates if this operation skips records whose source field is null (defaults to false; ignored when there is no source field).
- getExpected() - Method in exception class com.northconcepts.datapipeline.jsonata.JException
-
Returns the expected token
- getExpirationDays(S3ControlClient, String, String, String) - Static method in class com.northconcepts.datapipeline.amazons3.AmazonS3Util
-
Returns the expiration days of the first enabled lifecycle rule on
bucketthat has an expiration and whose filter prefixes, if any, all equalpathPrefix, ornullif no rule matches. - getExpiresOn() - Method in class com.northconcepts.datapipeline.security.Credentials
-
Returns the time in milliseconds when these credentials expire or zero (0) if no expiry is known.
- getExpirySkewMilliseconds() - Method in class com.northconcepts.datapipeline.security.CachingCredentialsResolver
-
Returns how long before the credentials' reported expiry they are considered stale (defaults to
CachingCredentialsResolver.DEFAULT_EXPIRY_SKEW_MILLISECONDS). - getExportedKey(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the first exported key entry whose primary key constraint name matches, ignoring case, or
null. - getExportedKeyColumns(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns this table's primary key columns referenced by another table's named foreign key (ignoring case), in key sequence order.
- getExportedKeys() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the other tables' foreign keys that reference this table's primary key, one entry per key column.
- getExpression() - Method in class com.northconcepts.datapipeline.filter.FilterExpression
- getExpression() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- getExpression() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- getExpression() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- getExpression() - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- getExpression() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- getExpression() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- getExpression() - Method in class com.northconcepts.datapipeline.json.builder.JsonExpression
- getExpression() - Method in class com.northconcepts.datapipeline.json.builder.JsonLogicalExpression
- getExpression() - Method in class com.northconcepts.datapipeline.transform.SetCalculatedField
- getExpression() - Method in class com.northconcepts.datapipeline.xml.builder.XmlExpression
- getExpression() - Method in class com.northconcepts.datapipeline.xml.builder.XmlLogicalExpression
- getExpressionAsString() - Method in exception class com.northconcepts.datapipeline.expression.ParseException
-
Returns the expression that failed to parse or null if it was not set.
- getExpressionAsString() - Method in class com.northconcepts.datapipeline.filter.FilterExpression
- getExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
- getExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
- getExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableReader
- getExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableWriter
- getExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeReader
- getExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeWriter
- getExpressionSource() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- getExpressionSource() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- getExpressionSource() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- getExpressionSource() - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
-
Returns the expression's source text, or
nullif none is set. - getFactory() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
- getFactory() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- getFactory() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- getFailedCondition() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the first mapping condition that was false, or null if none failed.
- getFailedExpressionStrategy() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Indicates how to handle failures when evaluating cell formulas/expressions (default
ExcelReader.FailedExpressionStrategy.FAIL). - getFailedExpressionStrategy() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Returns how a failed formula evaluation is handled (defaults to
ExcelReader.FailedExpressionStrategy.FAIL). - getFailedRecords() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Returns the records which failed mapping along with the failure details in a sess\ion property (limited torecords).
invalid reference
#getMaxSavedFailedRecords() - getFetchSize() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
The fetch size to set on the
StatementusingStatement.setFetchSize(int)ornullif the connection's default should be used (defaultnull). - getField() - Method in class com.northconcepts.datapipeline.core.FieldLocation
-
Gets the field at this location.
- getField() - Method in class com.northconcepts.datapipeline.excel.ExcelFieldMetadata
-
Gets the field associated with this metadata.
- getField() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- getField() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
- getField() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
- getField() - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePair
- getField(int) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field at the specified index (for zero or positive indexes) or from the end of the list (for negative indexes by adding index to the size of the list).
- getField(int, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field at the specified index, creating new fields as needed if
createFieldistrue. - getField(FieldList, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Retrieves a nested child field.
- getField(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field at the specified
FieldPath. - getField(FieldPath, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field at the specified
FieldPath, optionally creating intermediate fields. - getField(FieldPath, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field at the specified
FieldPath, optionally creating intermediate fields. - getField(Record, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns the field at this path, creating missing parts if
createis true; if the path does not resolve it returns null, or throws whenthrowExceptionis true. - getField(String) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the first field with the given name or throws an exception if none are found.
- getField(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the
FieldDefthat matches the specified name. - getField(String, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the first field with the given name.
- getFieldAsJavaIdentifierName(JavaCodeBuilder, JdbcQueryColumn, int) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Returns the unique Java field name for the query column at the given index of the class being generated, creating it on first use.
- getFieldCount() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the number of fields in this record.
- getFieldCount() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the number of fields declared in this entity, excluding inherited ones.
- getFieldFilter() - Method in class com.northconcepts.datapipeline.filter.FieldFilterRule
-
Returns the
FieldFilterthis rule was added to or null if it was not added to one directly. - getFieldIndex() - Method in class com.northconcepts.datapipeline.core.FieldLocation
-
Gets the zero-based field index (column position) of this field location.
- getFieldIndexes() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- getFieldListCandidates(List<String>, int) - Static method in class com.northconcepts.datapipeline.foundations.tools.DetectPrimaryKeysInDataset
-
Returns every combination of
keyLengthnames fromfieldNames, keeping their order; throws ifkeyLengthis less than 1. - getFieldMappings() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Returns the field mappings, applied in order to build the target record.
- getFieldName() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the field name associated with this exception.
- getFieldName() - Method in class com.northconcepts.datapipeline.core.FieldComparator
-
Returns the field path of the field used for comparisons.
- getFieldName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the record field name for this node, or its node name if no field name is set.
- getFieldName() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Returns the name of the entity field this index field refers to.
- getFieldName() - Method in class com.northconcepts.datapipeline.transform.MoveFieldAfter
- getFieldName() - Method in class com.northconcepts.datapipeline.transform.MoveFieldBefore
- getFieldName() - Method in class com.northconcepts.datapipeline.transform.MoveFieldToIndex
- getFieldNameHint() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetPattern
-
Returns the affix stripped of leading/trailing separators as a candidate field name (for example
item), ornullwhen both affixes are empty after trimming. - getFieldNameList() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a
FieldListcontaining the names of all fields in this record. - getFieldNamePrefix() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the name of the nearest named ancestor, skipping wildcards and JSON
object/arraycontainers, or null if there is none. - getFieldNames() - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Returns a copy of the field names that were set or read from the first row, or an empty array if there are none yet.
- getFieldNames() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a list of the field names in this record in order.
- getFieldNames() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Returns the names given to the fields in column order, overriding any read from the first row (null or empty if unset).
- getFieldNames() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the names of the fields declared in this entity, excluding inherited ones.
- getFieldNames() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
-
Returns the field name of each error in order, with null for errors not tied to a field.
- getFieldNamesForErrorMessage() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
-
Returns
FieldDef.getNameForErrorMessage()for the field of each error in order, with null for errors not tied to a field. - getFieldOrNull(String) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the first field with the given name or null if none are found.
- getFieldPath(int) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns the entry at the given index parsed as a
FieldPath; parsing also replaces quoted entries in this list with their unquoted form. - getFields() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- getFields() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageFields
- getFields() - Method in class com.northconcepts.datapipeline.core.FieldDeclarations
-
Returns the backing map of field names to declared types, not a copy.
- getFields() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a new collection of the fields in this record.
- getFields() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Returns the calculated fields, evaluated in order before the rules and available to them as variables.
- getFields() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Returns the calculated fields, evaluated in order before the tree is walked and available to it as variables.
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Returns the fields to read; null or empty if none were added.
- getFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- getFields() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the fields declared in this entity (excluding inherited ones) or null if none were added.
- getFields() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
-
Returns the field of each error in order, with null for errors not tied to a field.
- getFields() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryGrouping
- getFields() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySelection
- getFields() - Method in class com.northconcepts.datapipeline.jira.JiraIssue
- getFields() - Method in class com.northconcepts.datapipeline.jira.JiraSearch
- getFields() - Method in class com.northconcepts.datapipeline.security.DecryptingReader
-
Returns the fields to decrypt; when empty, every top-level field of each record is decrypted.
- getFields() - Method in class com.northconcepts.datapipeline.security.EncryptingReader
-
Returns the fields to encrypt; when empty, every top-level field of each record is encrypted.
- getFields() - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Returns the fields whose values form the lookup key.
- getFields() - Method in class com.northconcepts.datapipeline.transform.RemoveDuplicateFields
-
Returns the field names checked for duplicates; null or empty means all names.
- getFields() - Method in class com.northconcepts.datapipeline.transform.SelectFields
- getFields(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Returns the fields to read, first creating an empty list if
createis true and there is none. - getFields(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the fields declared in this entity, creating the list if it is null and
createis true. - getFields(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns this entity's own fields whose name matches the given name, ignoring case; empty if none match or the name is empty.
- getFieldsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- getFieldsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- getFieldsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getFieldsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getFieldSchema() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The field's schema for ORC and Parquet files.
- getFieldSeparator() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Returns the string used between each field value (defaults to comma).
- getFieldSeparator() - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Returns the string used between each field value (defaults to comma).
- getFieldSeparator() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Returns the string used between field values (defaults to comma).
- getFieldSeparator() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Returns the string written between field values (defaults to comma).
- getFieldSeparator() - Method in class com.northconcepts.datapipeline.transform.FlattenRecord
-
Returns the separator placed between parent names, child names and array indexes in flattened field names (default is "_").
- getFieldType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the
FieldTypecorresponding to this column's Java type. - getFieldType() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
-
Returns the field type for the described number: INT, LONG or BIG_INTEGER for whole numbers and DOUBLE or BIG_DECIMAL for fractions, depending on the digit count.
- getFieldType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the most frequent field type, skipping an all-null
UNDEFINEDwhen others exist, or null if none were seen. - getFieldType() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternMatch
-
Returns
FieldType. - getFieldType() - Method in class com.northconcepts.datapipeline.transform.SetField
-
Returns the type given to the field when the value is null.
- getFieldType(boolean) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternMatch
-
Returns
FieldType. - getFieldType(Column) - Method in enum class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset.FieldTypeSelectionMode
-
Gets the field type for the given column based on this selection mode.
- getFieldTypeCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of distinct field types seen.
- getFieldTypeForPrimitiveType(Type) - Method in class com.northconcepts.datapipeline.parquet.tools.GenerateSchemaDefFromParquet
-
Creates the field definition for a primitive Parquet column from its primitive and logical type; INT96 columns use
GenerateSchemaDefFromParquet.getInt96FieldType(). - getFieldTypes() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field types for all fields in this record.
- getFieldTypes() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of values seen for each field type, nulls included.
- getFieldTypes(FieldList) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field types for the fields matching the given
FieldList, or all fields if the list isnullor empty. - getFieldTypeSelectionMode() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Gets the field type selection mode.
- getFieldValue(FieldPath, T) - Method in class com.northconcepts.datapipeline.core.Record
-
Gets the value at the specified field path, returning a default value if the field is null or not found.
- getFieldValue(String, T) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the unconverted value at the given
FieldPathexpression or the default value if it is missing or null. - getFieldValueAsArray(String, ArrayValue) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value as array if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsBigDecimal(String, BigDecimal) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsBigInteger(String, BigInteger) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsBoolean(String, Boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsByte(String, Byte) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsBytes(String, byte[]) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsChar(String, Character) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsDate(String, Date) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsDatetime(String, Date) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsDouble(String, Double) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsFloat(String, Float) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsInstant(String, Instant) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsInteger(String, Integer) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsList(String, List<T>, Class<T>) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value as a
Listif the field exists and its value is not null, otherwise, it returns the default value (even if the list contains no values). - getFieldValueAsLocalDate(String, LocalDate) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsLocalDatetime(String, LocalDateTime) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsLocalTime(String, LocalTime) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsLong(String, Long) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsRecord(String, Record) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsShort(String, Short) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsString(String, String) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsTime(String, Time) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValueAsUUID(String, UUID) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field's value if the field exists and its value is not null, otherwise, it returns the default value.
- getFieldValues(long) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- getFile() - Method in class com.northconcepts.datapipeline.core.TextReader
-
Returns the source file or null if this reader was created from a
Reader. - getFile() - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
-
Returns the target file or null if this writer was created from a
Writer. - getFile() - Method in class com.northconcepts.datapipeline.core.TextWriter
-
Returns the target file or null if this writer was created from a
Writer. - getFile() - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
-
Returns the file last passed to
ExcelDocument.open(File)or null if the workbook was not opened from a file. - getFile() - Method in class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Returns the file being examined, or null when reading from a stream.
- getFile() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Returns the absolute file for the path; throws an exception if the path is empty.
- getFile() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The
java.io.Fileused to create the DataReader. - getFile() - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The
java.io.Fileused to create the DataReader. - getFile() - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
-
Returns the file the document was loaded from or null if it was loaded from a stream or not loaded yet.
- getFile() - Method in class com.northconcepts.datapipeline.security.FileCredentialsResolver
- getFileColumnNumber() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The beginning column number in the input file starting with 0.
- getFileColumnNumber() - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
Returns the column number in the input file starting with 0.
- getFileExtension() - Method in enum class com.northconcepts.datapipeline.foundations.file.FileType
-
Returns the same value as
FileType.getDefaultFileExtension(). - getFileId(String) - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Returns the first occurrence of the Google Drive File Id with the matching
fileName. - getFileLineNumber() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The line number in the input file starting with 0.
- getFileLineNumber() - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The line number in the input file starting with 0.
- getFileSink() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FileSinkPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- getFileSink() - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- getFileSize() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Returns the size in S3 in bytes, or -1 if the key is absent (other errors throw); a known size is kept until the bucket, path, or file system changes, a sink upload finishes, or
AmazonS3File.refreshFileSize()is called. - getFileSize() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
-
Returns the size of the file in bytes.
- getFileSize() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
-
Returns the size of the file in bytes.
- getFileSize() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Returns the length of the file in bytes, or 0 if it does not exist.
- getFileSize() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- getFileSize(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the size of an S3 object in bytes.
- getFileSource() - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FileSourcePipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- getFileSource() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- getFileTransferMode() - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Returns the file transfer mode applied at
FtpFileSystem.open()(defaults toFileTransferMode.STREAM). - getFileTransferType() - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Returns the file transfer type applied at
FtpFileSystem.open()(defaults toFileTransferType.BINARY). - getFileType() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- getFileType() - Method in class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Returns the detected type, from the name's extension if it matches one exactly, otherwise by sampling the content.
- getFileType() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
-
Returns the format of the file, or null if it is unknown.
- getFileType() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
-
Returns the format of the file, or null if it is unknown.
- getFileType() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Returns the file type, detecting it from the file's extension or content if it was not set.
- getFileType() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- getFillChar() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
-
Returns this column's fill character or null to use the reader's or writer's own (a space by default).
- getFillChar() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
-
Returns the character trimmed from values in columns without their own fill character (defaults to space).
- getFillChar() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
-
Returns the character used to pad values in columns without their own fill character (defaults to space).
- getFillChar() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Returns the character trimmed from values in columns without their own fill character (defaults to space).
- getFillChar() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Returns the character used to pad values in columns without their own fill character (defaults to space).
- getFilter() - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
-
Returns the filter applied to each directory listing (null accepts all); rejected directories are not recursed into.
- getFilter() - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Returns the filter limiting which records this operation applies to or null if it applies to all of them.
- getFilter() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Returns the metadata filter the reader applies when it opens the file (default is
NO_FILTER). - getFilter() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Returns the filter settings.
- getFilter() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- getFilter() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Deprecated.
- getFilter() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
-
Returns the filters selecting which boards are read (defaults to
BoardFilter.ALL); null or empty also means ALL. - getFilterCondition() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- getFilteredStreamRules() - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Returns the active rules on the streaming endpoint.
- getFinancialStatus() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getFinishedOn() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the time this job finished running.
- getFinishedOn() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the time this job finished running.
- getFinishedOn() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the time this job finished running.
- getFirstColumnIndex() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Returns the 0-based column that each record's first field is written to (defaults to 0).
- getFirstColumnIndex() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Returns the 0-based column each record's first field is written to (defaults to 0).
- getFirstColumnIndex() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getFirstColumnIndex() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- getFirstException() - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Returns the first exception thrown for any individual read attempt.
- getFirstException() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the first exception thrown for any individual read attempt.
- getFirstException() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the first exception thrown for any individual write attempt.
- getFirstMessage(Message[]) - Method in enum class com.northconcepts.datapipeline.email.EmailReadDirection
-
Returns the 0-based index of the first message to read from the array.
- getFirstName() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getFirstProperty(String, String) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageFooter
-
Returns the first value of the named property or
defaultValueif it has none. - getFirstProperty(String, String) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageHeader
-
Returns the first value of the named property or
defaultValueif it has none. - getFirstRowIndex() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Returns the 0-based row that the first record (or the header row) is written to (defaults to 0).
- getFirstRowIndex() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Returns the 0-based row the header or first record is written to (defaults to 0).
- getFirstRowIndex() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getFirstRowIndex() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- getFixedSizeInBytes() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns the number of bytes used to represent values of this type or zero (0) for non-fixed-byte-sized types.
- getFloatLiteral(float) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getFolderId(String) - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Returns the first occurrence of the Google Drive Folder Id with the matching
folderName. - getFolderName() - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Returns the name of the folder to read messages from (default is
INBOX). - getFollow() - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
-
Returns the IDs of the users the stream is filtered by.
- getFollowers(String, int, String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Returns the Followers of a given Twitter handle.
- getFollowing(String, int, String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Returns the Twitter users that the provided Twitter handle is following.
- getFontColor() - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Gets the font color.
- getFooter() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- getFooterTemplate() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Returns the template written after the records or null if there is none.
- getForeignEntity() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the foreign entity from the parent schema or null if this relationship has no schema or the entity is not found.
- getForeignEntityName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the name of the entity that holds the foreign key fields.
- getForeignEntityRelationships(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the relationships whose foreign entity is the given entity, which must belong to this schema.
- getForeignKeyColumnNames() - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Returns the foreign key column names.
- getForeignKeyColumnNames() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- getForeignKeyColumnNames() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- getForeignKeyFieldNames() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the names of the foreign entity's fields that reference the primary entity's key, in key order, or null if none were added.
- getForeignKeyFieldNames(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the foreign key field names, creating the list if it is null and
createis true. - getForeignKeyFields() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the foreign entity's fields named in
EntityRelationshipDef.getForeignKeyFieldNames(), skipping names it does not define; empty if the foreign entity cannot be found. - getForeignTableName() - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Returns the foreign table name.
- getForeignTableName() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Returns the name of the table that is altered to add the foreign key (the referencing table).
- getForeignTableName() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Returns the name of the table that is altered to add the foreign key (the referencing table).
- getForiegnKeyCatalogName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- getForiegnKeyColumnName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- getForiegnKeyName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns the name of the foreign key constraint, or null if the database does not report one.
- getForiegnKeySchemaName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- getForiegnKeyTableName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- getFormat() - Method in class com.northconcepts.datapipeline.core.StreamWriter
-
Returns how each record is printed (defaults to
StreamWriter.Format.RECORD). - getFormatter() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePattern
-
Returns the case-insensitive, non-lenient formatter built from the pattern, or null if no pattern is set.
- getFractionDigits() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- getFractionPart() - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
-
Returns the digits after the decimal point: empty if there is no point and
"0"if nothing follows it. - getFreezeColumns() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Returns the number of columns to freeze at the left side of the Excel sheet.
Supported ProviderTypes are: - getFreezeColumns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Gets the number of columns to freeze (make non-scrollable) in the Excel sheet.
- getFreezeRows() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Returns the number of rows to freeze at the top of the Excel sheet.
Supported ProviderTypes are: - getFreezeRows() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Gets the number of rows to freeze (make non-scrollable) in the Excel sheet.
- getFulfillmentStatus() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getFunction(Class, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- getFunctionArity(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- getGetterMethod() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the bean getter name for this column, e.g.
- getGmtoff() - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- getGreen() - Method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Gets the green component of this color.
- getGreen() - Method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Gets the green component of the color.
- getGroupByFields() - Method in class com.northconcepts.datapipeline.group.GroupByReader
- getGrouping() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Returns the GROUP BY fields (never
null). - getHandlesAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getHasValue() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConditionPart
-
Returns true if at least one parameter value was given.
- getHaving() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Returns the HAVING criteria (never
null). - getHeader() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- getHeaderTemplate() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Returns the template written before the records or null if there is none.
- getHeight() - Method in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
-
Returns the portrait page height in twips (1/1440 of an inch).
- getHex() - Method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Gets the color as a hexadecimal string (e.g., "#RRGGBB").
- getHex() - Method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Gets the color as a hexadecimal string (e.g., "#RRGGBB").
- getHistogram() - Method in class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Returns the count of each byte value (256 entries) in the sample, or null if the content has not been read.
- getHits() - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Returns the number of lookup requests where the results were already cached.
- getHost() - Method in class com.northconcepts.datapipeline.email.EmailReader
- getHref() - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- getHttpProxyHost() - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Returns the HTTP proxy host, applied when the client is created on the first API call.
- getHttpProxyHost() - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Returns the HTTP proxy host, applied when the stream is created (when a reader is opened).
- getHttpProxyPort() - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Returns the HTTP proxy port, applied when the client is created on the first API call.
- getHttpProxyPort() - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Returns the HTTP proxy port, applied when the stream is created (when a reader is opened).
- getId() - Method in class com.northconcepts.datapipeline.core.DataObject
-
The auto numbered ID of this instance.
- getId() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the unique (sequential) ID of this event bus (within this JVM/classloader).
- getId() - Method in enum class com.northconcepts.datapipeline.jms.JmsAcknowledgeMode
-
Returns the matching
javax.jms.Sessionacknowledge-mode constant. - getId() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the unique (sequential) ID of this job (within this JVM/classloader).
- getId() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getId() - Method in class com.northconcepts.datapipeline.mailchimp.list.Tag
- getId() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- getId() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getIds() - Method in class com.northconcepts.datapipeline.security.CredentialsResolverRegistry
-
Returns a read-only view of the registered ids.
- getIdsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- getIdsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItemCriteria
- getIdsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getIdsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getImageBytes() - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
-
Returns the total stream length in bytes of the images counted by
PdfDocumentStatistics.getImageCount(). - getImageCount() - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
-
Returns the number of images in the pages' resources; an image shared by several pages is counted once per page.
- getImportedKey(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the first entry of the named foreign key, ignoring case, or
null; a multi-column key has one entry per column. - getImportedKeyColumns(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns this table's columns in the named foreign key (ignoring case), in key sequence order.
- getImportedKeys() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns this table's foreign keys to other tables, one entry per key column.
- getImports() - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
- getIncludeDirectories() - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
-
Indicates if directories are returned as records too, not just files (default is false).
- getIncludeElapsedTime() - Method in class com.northconcepts.datapipeline.core.DebugReader
-
Indicates if each record's header also shows how long this reader has been open (default is false).
- getIncludeElapsedTime() - Method in class com.northconcepts.datapipeline.core.DebugWriter
-
Indicates if each record's header also shows how long this writer has been open (default is false).
- getIndentation() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Returns the text written once per indent level at the start of each line (defaults to two spaces).
- getIndentCount() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Returns the current indent level: how many times the indentation is written at the start of each line.
- getIndex() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns the position of this field within its record.
- getIndex() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
-
Returns this sequence's 0-based position.
- getIndex() - Method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Gets the Excel color palette index.
- getIndex() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Index of column in table (starting at 1).
- getIndex() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- getIndex() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetIterator
-
Returns the 0-based index of the next record to return.
- getIndex(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the index with the given name, ignoring case, or
nullif there is none. - getIndex(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the first of this entity's own indexes whose name matches, ignoring case, or null if none does.
- getIndexCount() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the number of indexes in this entity.
- getIndexDef() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Returns the index containing this field or null if it has not been added to one.
- getIndexes() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- getIndexes() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the indexes declared in this entity (excluding inherited ones) or null if none were added.
- getIndexes(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the indexes declared in this entity, creating the list if it is null and
createis true. - getIndexes(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns this entity's own indexes whose name matches the given name, ignoring case; empty if none match or the name is empty.
- getIndexField(String) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the
IndexFieldDefthat matches the specified name. - getIndexFieldCount() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the number of index fields in this index.
- getIndexFieldNames() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the names of all index fields in this index.
- getIndexFields() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the index fields or null if none were added.
- getIndexFields(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the index fields, creating the list if it is null and
createis true. - getIndexInEntityDef() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Returns the zero-based index of this field in
EntityDef. - getIndexInIndexDef() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Returns the zero-based index of this index field in
IndexDef. - getIndexName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- getIndexName() - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Returns the index name.
- getIndexName() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- getIndexName() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- getIndexNames() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the names of all indexes in this entity.
- getIndexQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Returns a qualified name that includes the name of this index field and the
IndexDefabove it separated by period. - getIndexQualifier() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Returns the index catalog (JDBC
INDEX_QUALIFIER), or null. - getInferredBooleanValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of string values equal to true, false, yes or no, ignoring case.
- getInferredFieldType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the most frequently occurring type in a column.
- getInferredNumericValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of string values recognized as numbers, excluding leading-zero whole numbers such as
007. - getInferredTemporalValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of string values that match at least one date/time pattern.
- getInferredTextualValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of string values not recognized as a boolean, number, date/time or UUID.
- getInferredTypeName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the capitalized name of
Column.getInferredFieldType(), such asInt, orStringwhen that is null. - getInferredUuidValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of string values recognized as UUIDs and not as a number or date/time.
- getInheritedFieldCount() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the number of fields in this entity and its super entities, counting overridden super fields too.
- getInheritedFields() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the fields in this entity and its super entities with overridden super fields removed.
- getInheritedFields(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the fields in this entity and its super entities, optionally removing overridden super fields.
- getInheritedFields(List<FieldDef>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the fields in this entity and its super entities, optionally removing overridden super fields.
- getInheritedIndexCount() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the number of indexes in this entity and its super entities.
- getInitialRetryDelay() - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Returns the amount of time to wait (in milliseconds) after the first error, before retrying (default 1 second).
- getInitialRetryDelay() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the amount of time to wait (in milliseconds) after the first error, before retrying (default 1 second).
- getInitialRetryDelay() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the amount of time to wait (in milliseconds) after the first error, before retrying (default 1 second).
- getInitialRetryDelay() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Returns the delay in milliseconds before the first retry of a rate-limited request (defaults to 1000).
- getInput() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- getInputStream() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- getInputStream() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
-
Opens a new stream to read the file's content; the caller must close it.
- getInputStream() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- getInputStream() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- getInsert() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Returns the insert strategy; each connection's writer uses its own clone.
- getInsert() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- getInsertSql() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Returns the SQL buffer holding the prefix followed by the rows of values not yet executed.
- getInsertSql() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
-
Returns the generated INSERT SQL or
nullbeforeGenericUpsert.prepare(JdbcUpsertWriter, Record)is called. - getInsertSql() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
-
Returns the INSERT part of the generated SQL or
nullbeforePostgreSqlUpsert.prepare(JdbcUpsertWriter, Record)is called. - getInsertSqlPrefix() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Returns the SQL that precedes the rows of values; the SQL buffer is truncated back to its length after each execution.
- getInsertStatement() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getInsertStatement() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
-
Returns the prepared INSERT statement or
nullbeforeGenericUpsert.prepare(JdbcUpsertWriter, Record)is called. - getInstanceCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the number of times this path occurred in the document.
- getInstanceName() - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Returns the name of the queue or topic.
- getInt96FieldType() - Method in class com.northconcepts.datapipeline.parquet.tools.GenerateSchemaDefFromParquet
-
Returns
FieldTypefor int96 data type of Parquet. - getInterests() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getInternalId() - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
The auto numbered ID of this instance.
- getInternalName() - Method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
The name of this instance (
- ). - getIntLiteral(int) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getInvalidRecordCount() - Method in class com.northconcepts.datapipeline.avro.AvroReader
-
Returns the total number of broken Avro records this reader encountered.
- getInventoryItemCriteria() - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryItemReader
-
Returns the criteria for the inventory items to read or null for none; it is modified in place when later pages are requested.
- getInventoryItemIdsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryLevelCriteria
- getInventoryItems(ShopifyInventoryItemCriteria, int, String) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- getInventoryItems(ShopifyInventoryItemCriteria, Integer, String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Returns a page of inventory items whose
nextfield holds the cursor of the following page, if any. - getInventoryLevelCriteria() - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryLevelReader
-
Returns the criteria for the inventory levels to read or null for none; it is modified in place when later pages are requested.
- getIpOpt() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getIpSignup() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getIsCatalogAtStart() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Indicates if the catalog appears at the start of a qualified table name; null until
JdbcConnection.loadCatalogAndSchemas()runs. - getIssueComments(String) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
- getIssueComments(String) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
-
Returns a record mapping each comment ID to a record with the comment's author display name, body, created and updated values.
- getIssuesRecord() - Method in class com.northconcepts.datapipeline.jira.JiraEpicReader
- getIssuesRecord() - Method in class com.northconcepts.datapipeline.jira.JiraIssueReader
- getIssuesRecord() - Method in class com.northconcepts.datapipeline.jira.JiraProjectReader
- getIssuesRecord() - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Fetches the next page as a record with an
isLastflag and the item array (namedvaluesunless changed byJiraReader.setRecordsFieldName(String)), or returns null to end the read. - getIssuesRecord() - Method in class com.northconcepts.datapipeline.jira.JiraSprintReader
- getIssueStatus(String...) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
-
Returns a record mapping each issue ID to its status name, or to Jira's error response if the issue is not found; returns null if
issueIdsis null. - getIssueStatus(String, String) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
-
Returns the issue as JSON, requesting only the given
fields(such asstatus). - getIssueTransitions(String) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
- getIssueTransitions(String) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
-
Returns the issue's transitions as a record whose field names are transition IDs and whose values are transition names.
- getIterator() - Method in class com.northconcepts.datapipeline.memory.CollectionReader
-
Gets the iterator used to read elements.
- getJavaCode() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Returns a Java program, a
DataPipelineDesktopclass whosemainmethod holds this pipeline's generated code. - getJavaCode() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
-
Returns a Java program, a
DataPipelineDesktopclass whosemainmethod holds the nested actions' generated code. - getJavaCode() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Returns the source of each class generated by the last
GenerateQueryDaoClasses.generate()call, or null before the first call. - getJavaType() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns the default Java representation for this instance.
- getJavaType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Returns the Java type for the column's values, chosen from the connection's type overrides or SQL-to-Java type mapper.
- getJavaType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- getJavaType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the Java type for the column's values, chosen from the connection's type overrides or SQL-to-Java type mapper.
- getJavaTypeOverride(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the Java type override for the database type name, ignoring case, or null if there is none.
- getJavaTypeOverrides() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- getJdbcConnectionFactory() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- getJdbcConnectionFactory() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- getJdbcType(Class<?>) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
The
Typesconstant (or a database specific value) assigned to the specified Java class type usingJdbcMultiUpsertWriter.setJdbcType(Class, int)or null if none was set. - getJdbcType(Class<?>) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
The
Typesconstant (or a database specific value) assigned to the specified Java class type usingJdbcMultiWriter.setJdbcType(Class, int)or null if none was set. - getJdbcType(Class<?>) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
The
Typesconstant (or a database specific value) assigned to the specified Java class type usingJdbcUpsertWriter.setJdbcType(Class, int)or null if none was set. - getJdbcType(Class<?>) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
The
Typesconstant (or a database specific value) assigned to the specified Java class type usingJdbcWriter.setJdbcType(Class, int)or null if none was set. - getJdbcType(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Returns the JDBC type set for the field with
JdbcPipelineOutput.setJdbcType(String, int)or null if there is none. - getJdbcType(String) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
The
Typesconstant (or a database specific value) assigned to the specified field usingJdbcUpsertWriter.setJdbcType(String, int)or null if none was set. - getJdbcType(String) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
The
Typesconstant (or a database specific value) assigned to the specified field usingJdbcWriter.setJdbcType(String, int)or null if none was set. - getJdbcWriter(int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Returns the writer for the connection at the 0-based index or
nullbeforeJdbcMultiUpsertWriter.open(). - getJdbcWriter(int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Returns the writer for the connection at the 0-based index or
nullbeforeJdbcMultiWriter.open(). - getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn0
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn1
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn2
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn3
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn4
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn5
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn6
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn7
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.Fn8
- getJFunctionCallable() - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.FnVarArgs
- getJiraClient() - Method in class com.northconcepts.datapipeline.jira.client.JiraClient.JiraStub
- getJndiFactoryName() - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Indicates the JNDI name to use when looking up the ConnectionFactory (defaults to "ConnectionFactory").
- getJob() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns the job loading this dataset's records or null before the first load and after
Dataset.cancelLoad(). - getJobCount() - Static method in class com.northconcepts.datapipeline.job.Job
-
Returns the current number of live jobs in the JVM/classloader.
- getJobExecutor() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- getJoins() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- getJql() - Method in class com.northconcepts.datapipeline.jira.JiraSearch
- getKey() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectSummary
- getKey() - Method in class com.northconcepts.datapipeline.buffer.RecordBuffer
- getKey() - Method in class com.northconcepts.datapipeline.jira.JiraIssue
- getKey() - Method in class com.northconcepts.datapipeline.memory.MapWriter
-
Returns the path of the field whose values become the map's keys.
- getKey() - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePair
- getKeyFieldNames() - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Returns the key fields listed in the
ON CONFLICTclause. - getKeyFieldNames() - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
-
Returns the key fields listed in the
ON CONFLICTclause. - getKeyFields() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Returns the fields that identify the existing row to update.
- getKeys() - Method in class com.northconcepts.datapipeline.security.Credentials
-
Returns a read-only view of the keys present in these credentials.
- getKeySequence() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns this column's 1-based position within the foreign key.
- getLabelIds() - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- getLanguage() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getLanguage() - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- getLargeCellHandler() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Returns how text values longer than
ExcelWriter.MAX_CELL_LENGTHcharacters are handled (defaults toLargeCellHandler.FAIL). - getLargeCellHandler() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Returns how text values longer than an Excel cell's 32,767 characters are handled (defaults to
LargeCellHandler.FAIL). - getLargestPoolSize() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the largest number of threads that have ever simultaneously been in the pool in this bus' executorService or -1 if unknown.
- getLastChanged() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getLastChildNodeElementDepth() - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Returns the element depth of the last child node, looking inside non-element children, or this node's own depth if it has none.
- getLastChildNodeElementDepth() - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
- getLastColumnIndex() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- getLastColumnIndex() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- getLastColumnIndex() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- getLastException() - Method in class com.northconcepts.datapipeline.retry.RetryContext
- getLastException() - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Returns the last exception thrown for any individual read attempt.
- getLastException() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the last exception thrown for any individual read attempt.
- getLastException() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the last exception thrown for any individual write attempt.
- getLastLineSeparator() - Method in class com.northconcepts.datapipeline.core.LineParser
- getLastModified() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectSummary
- getLastName() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getLastRecord() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Returns the most recent record seen by this endpoint while it is open or
null. - getLastRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaFilter
-
Returns the last record passed to
SchemaFilter.allow(Record)or null if none has been checked. - getLastRecord() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the most recent record seen by this job while it is running or
null. - getLastRow() - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Returns the 0-based index of the last row to read or -1 to read to the end (default is -1).
- getLastRow() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Returns the 0-based index of the last row to read or a negative value to read to the end of the sheet (defaults to -1).
- getLastRow() - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
- getLastRow() - Method in class com.northconcepts.datapipeline.sql.h2.Insert
-
Returns the last row.
- getLastRow() - Method in class com.northconcepts.datapipeline.sql.h2.Upsert
-
Returns the last row.
- getLastRow() - Method in class com.northconcepts.datapipeline.sql.mysql.Insert
- getLastRow() - Method in class com.northconcepts.datapipeline.sql.mysql.Upsert
- getLastRow() - Method in class com.northconcepts.datapipeline.sql.postgresql.Insert
- getLastRow() - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
- getLastRowIndex() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- getLastRowIndex() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- getLastRowIndex() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- getLastRowIndex() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getLastSequence() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
-
Returns the sequence before this one or null if this is the first.
- getLatitude() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
- getLatitude() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationReader
- getLatitude() - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- getLatitude() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getLength() - Method in class com.northconcepts.datapipeline.parquet.RandomAccessInputFile
- getLength() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns the column length.
- getLength() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Returns the length or precision written after the type, or null for none; ignored if the type does not support one.
- getLength() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Returns the length or precision written after the type, or null for none; ignored if the type does not support one.
- getLengthSum() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the total string length of the non-null values.
- getLevel() - Method in class com.northconcepts.datapipeline.core.Message
- getLimit() - Method in class com.northconcepts.datapipeline.core.LimitReader
-
Returns the maximum number of records to return after the offset or null for no limit.
- getLimit() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
- getLimitRemaining() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
- getLimitResetTime() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
-
Returns when the limit resets, in milliseconds since the epoch.
- getLimitResetTimeRemaining() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
-
Returns the milliseconds left until the limit resets, or 0 if the reset time has passed.
- getLine() - Method in class com.northconcepts.datapipeline.core.LineParser
-
Returns the 0-based number of the current line or -1 before the first line is read.
- getLine() - Method in exception class com.northconcepts.datapipeline.jsonata.ParseException
-
Deprecated.Use
ParseException.getLocation()instead - getLineCount() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Returns the number of lines ended by the
printlnmethods. - getLineNumber() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Returns the current 0-based line number, i.e.
- getLineNumber() - Method in class com.northconcepts.datapipeline.core.TextReader
-
Returns the underlying stream's current line number, which starts at 0 and increases with each line terminator read.
- getLineNumber() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Returns the 0-based index of the next sheet row to read.
- getLineNumber() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
-
Returns the 0-based index of the next row to read within the loaded sheet or range.
- getLineSeparatorAsCsvEscaped() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Returns the line separators as a comma-separated list of Java-escaped strings, as serialized.
- getLineSeparatorAsCsvEscaped(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Returns the line separators, Java-escaped and joined by the given separator, or an empty string if there are none.
- getLineSeparators() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Returns the strings used to separate records or
nullif none were explicitly assigned. - getLineSeparators() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Returns the strings that separate records (defaults to LF, CRLF and CR).
- getLineText() - Method in class com.northconcepts.datapipeline.core.LineParser
-
Returns the current line's text, without its separator, or null before the first line is read.
- getLinks() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getLinks() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- getList() - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns the backing list of field names, not a copy.
- getList() - Method in class com.northconcepts.datapipeline.eventbus.TypedListenerList
- getList() - Method in class com.northconcepts.datapipeline.trello.CommaSeparatedList
- getListener() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the listener notified as
JdbcConnection.loadTables(LoadTablesRequest)progresses; never null. - getListenerCount() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the total number of listeners subscribed to this bus.
- getListFilter() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardListsReader
-
Returns which of the board's lists are read (defaults to
ListFilter.OPEN). - getListId() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getListId() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- getListId() - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
- getListId() - Method in class com.northconcepts.datapipeline.trello.TrelloListCardsReader
- getListIdField() - Method in class com.northconcepts.datapipeline.trello.TrelloCardWriter
-
Returns the name of the record field holding the ID of the list to add the card to (defaults to
"listId"). - getListMember(String, String) - Method in interface com.northconcepts.datapipeline.mailchimp.MailChimpClient
-
Returns the member with the given
subscriber hashas raw JSON. - getListMemberObject(String, String) - Method in interface com.northconcepts.datapipeline.mailchimp.MailChimpClient
-
Returns the same member as
MailChimpClient.getListMember(String, String)mapped to aListMember. - getListMembers(String, ListMemberStatus, long, long) - Method in interface com.northconcepts.datapipeline.mailchimp.MailChimpClient
-
Returns up to
countlist members starting atoffsetas raw JSON; a nullstatussends no status filter. - getListMembersObject(String, ListMemberStatus, long, long) - Method in interface com.northconcepts.datapipeline.mailchimp.MailChimpClient
-
Returns the same page as
MailChimpClient.getListMembers(String, ListMemberStatus, long, long)mapped to aListMembers. - getLists() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
-
Returns which of each board's lists are requested (defaults to
BoardLists.NONE). - getLocation() - Method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
-
Gets the location/address of this hyperlink.
- getLocation() - Method in exception class com.northconcepts.datapipeline.jsonata.JException
-
Returns the error location (in characters)
- getLocation() - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Returns the current parser location.
- getLocation() - Method in exception class com.northconcepts.datapipeline.jsonata.ParseException
-
Returns the location at which the error occurred.
- getLocation() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getLocationIdsAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryLevelCriteria
- getLocationInventoryLevel(ShopifyInventoryLevelCriteria, int, String) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- getLocationInventoryLevel(ShopifyInventoryLevelCriteria, Integer, String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Returns a page of inventory levels whose
nextfield holds the cursor of the following page, if any. - getLocationPath() - Method in class com.northconcepts.datapipeline.xml.XmlField
- getLocationPath() - Method in class com.northconcepts.datapipeline.xml.XmlRecordBreak
- getLocations() - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- getLocations(int, String) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- getLocations(Integer, String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Returns a page of locations whose
nextfield holds the cursor of the following page, if any. - getLogWriter() - Method in class com.northconcepts.datapipeline.job.AbstractJob
- getLogWriter() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the writer that receives this job's statistics records or
nullif none was set. - getLongitude() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
- getLongitude() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationReader
- getLongitude() - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- getLongitude() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getLongLiteral(long) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getLookup() - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
- getMailStore() - Method in class com.northconcepts.datapipeline.email.EmailReader
- getMap() - Method in class com.northconcepts.datapipeline.memory.MapWriter
- getMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
-
Returns the replacement value and type for each field name.
- getMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
-
Returns the regular expression each field's whole value must match, keyed by field name.
- getMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
-
Returns the value and type to set for each field name.
- getMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- getMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- getMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
-
Returns the sort direction (
"ascending"or"descending") for each field name, in sort-key order. - getMapping() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
-
Returns the regular expression each field's whole value must match, keyed by field name.
- getMaxBufferSizeInBytes() - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Returns the estimated size in bytes of buffered records at which the background thread pauses reading (defaults to 512 KB).
- getMaxColumnStatsRecords() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
The number of records to use when calculating column stats or
nullfor all records (defaultnull). - getMaxColumnsToAnalyze() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Defines the first N columns to analyze for stats for column stats.
- getMaxEntries() - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Returns the maximum number of results to cache or
nullif there is no limit. - getMaxErrorCount() - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Returns the number of retries allowed across all read attempts (default max long - 1).
- getMaxErrorCount() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the number of retries allowed across all read attempts (default max long - 1).
- getMaxErrorCount() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the number of retries allowed across all write attempts (default max long - 1).
- getMaxId() - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
-
Searches for tweets with IDs less than the specified ID (i.e.
- getMaximum() - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
The optional largest number allowed in values of this field.
- getMaximum() - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
The optional largest date, time, or datetime allowed in values of this field.
- getMaximum(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Returns the current result of
AggregateReader.maximum(String)for the field; throws if that operation was not added. - getMaximumArrayElements() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the most elements in a non-null array value or -1 if there were none.
- getMaximumChildInstanceCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the largest instance count among the children, or -1 if there are none; the result is cached until
TreeNode.invalidateChildInstanceCountCache()is called. - getMaximumElements() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The maximum numbers of array elements allowed by this array field.
- getMaximumLength() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the longest string length of the non-null values or -1 if there were none.
- getMaximumLength() - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
-
The optional most number of bytes in values of this field.
- getMaximumLength() - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
The optional most number of characters in values of this field.
- getMaximumNameLength() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DateTimeNodeNameRule
-
Returns the longest name this rule will attempt to parse as a date/timestamp (default 40).
- getMaximumPoolSize() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the maximum allowed number of threads in this bus' executorService or -1 if unknown.
- getMaxInvalidRecords() - Method in class com.northconcepts.datapipeline.avro.AvroReader
-
Indicates the number of broken Avro records to skip before this reader should fail (default 1000).
- getMaxInvalidRecords() - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
-
Indicates the number of broken Avro records to skip before this reader should fail (default 1000).
- getMaxItems() - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Indicates the maximum number of items to return.
- getMaxPagedRecordCount() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Returns the number of records needed to fill every page up to and including the current one.
- getMaxRecords() - Method in class com.northconcepts.datapipeline.memory.TailProxyReader
- getMaxRecords() - Method in class com.northconcepts.datapipeline.memory.TailWriter
- getMaxRecordsAnalyzed() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates how many records should be analyzed and cached to generate the Parquet schema if no schema was explicitly set on this writer (default is 1000).
- getMaxRecordsToLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
The maximum records to load parameter (
maxRecordsToLoad) passed to the last call toDataset.load(Integer)orDataset.load(Integer, JobCallback). - getMaxResults() - Method in class com.northconcepts.datapipeline.instagram.InstagramMediaReader
- getMaxResults() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfReader
- getMaxResults() - Method in class com.northconcepts.datapipeline.jira.JiraSearch
-
Returns the number of issues requested per page (defaults to 50).
- getMaxResults() - Method in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
-
Indicates the maximum number of records that will be obtained by the endpoint.
- getMaxRetryCount() - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Returns the number of retries allowed for any individual read attempt (default 5).
- getMaxRetryCount() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the number of retries allowed for any individual read attempt (default 5).
- getMaxRetryCount() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the number of retries allowed for any individual write attempt (default 5).
- getMaxRetryCount() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Returns the maximum number of attempts, including the first, for a rate-limited request (defaults to 5).
- getMaxTime() - Method in class com.northconcepts.datapipeline.core.TimedReader
-
Returns the maximum reading time in milliseconds, measured from
TimedReader.open(). - getMaxWaitTimeMillis() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Returns the maximum milliseconds to wait for the sample records to load, and again for their column statistics (defaults to 10000).
- getMeasure() - Method in class com.northconcepts.datapipeline.meter.RecordMeter
-
Returns whether each record adds its estimated size in bytes or one to the count (defaults to BYTES).
- getMeasure() - Method in class com.northconcepts.datapipeline.throttle.ThrottledReader
-
Returns whether the limit counts records or their estimated size in bytes (defaults to BYTES).
- getMeasure() - Method in class com.northconcepts.datapipeline.throttle.ThrottledWriter
-
Returns whether the limit counts records or their estimated size in bytes (defaults to BYTES).
- getMemberId() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
-
Returns the ID of the member whose boards are read (defaults to
"me"). - getMemberRating() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getMembers() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- getMergeCondition() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- getMergeCondition() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- getMergeCondition() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- getMergeFields() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getMergeSql() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
-
Returns the generated MERGE SQL or
nullbeforeMergeUpsert.prepare(JdbcUpsertWriter, Record)is called. - getMergeSql() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
-
Returns the generated MERGE SQL or
nullbeforeOracleUpsert.prepare(JdbcUpsertWriter, Record)is called. - getMergeSql() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
-
Returns the generated MERGE SQL or
nullbeforeSybaseUpsert.prepare(JdbcUpsertWriter, Record)is called. - getMergeStatement() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
-
Returns the prepared MERGE statement or
nullbeforeMergeUpsert.prepare(JdbcUpsertWriter, Record)is called. - getMergeStatement() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
-
Returns the prepared MERGE statement or
nullbeforeOracleUpsert.prepare(JdbcUpsertWriter, Record)is called. - getMergeStatement() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
-
Returns the prepared MERGE statement or
nullbeforeSybaseUpsert.prepare(JdbcUpsertWriter, Record)is called. - getMessage() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageReader
-
Returns the parsed message, including its header and footer, or null before
BloombergMessageReader.open(). - getMessage() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the detail message string of this exception along with any prefixed text.
- getMessage() - Method in class com.northconcepts.datapipeline.core.Message
- getMessage() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- getMessage(int) - Method in class com.northconcepts.datapipeline.core.Messages
- getMessageCount() - Method in class com.northconcepts.datapipeline.core.Messages
- getMessages() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
-
Returns the message of each error in order (empty if there are none).
- getMessageWithProperties() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the detail message string of this exception along with any prefixed text and properties (name-value pairs).
- getMetadataFile() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Returns the JSON file holding the dataset's record, column and data file counts and its records per file.
- getMeter() - Method in interface com.northconcepts.datapipeline.meter.Metered
- getMeter() - Method in class com.northconcepts.datapipeline.meter.MeteredInputStream
- getMeter() - Method in class com.northconcepts.datapipeline.meter.MeteredOutputStream
- getMeter() - Method in class com.northconcepts.datapipeline.meter.MeteredReader
- getMeter() - Method in class com.northconcepts.datapipeline.meter.MeteredWriter
- getMeter() - Method in class com.northconcepts.datapipeline.throttle.Throttle
- getMethod() - Method in class com.northconcepts.datapipeline.eventbus.Event
-
Returns the listener method called on the publisher; typed listeners receive the event as a call to the same method.
- getMethod() - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- getMethodSuffix() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the
ResultSetandPreparedStatementaccessor suffix for the Java type, e.g. - getMillisecondsPastHour() - Method in class com.northconcepts.datapipeline.schedule.HourlyScheduler
-
Returns a copy of this schedule's offsets in ascending order.
- getMimeType() - Method in enum class com.northconcepts.datapipeline.foundations.file.FileType
- getMinimum() - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
The optional smallest number allowed in values of this field.
- getMinimum() - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
The optional smallest date, time, or datetime allowed in values of this field.
- getMinimum(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Returns the current result of
AggregateReader.minimum(String)for the field; throws if that operation was not added. - getMinimumArrayElements() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the fewest elements in a non-null array value or -1 if there were none.
- getMinimumChildInstanceCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the smallest instance count among the children, or -1 if there are none; the result is cached until
TreeNode.invalidateChildInstanceCountCache()is called. - getMinimumElements() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The minimum numbers of array elements allowed by this array field.
- getMinimumLength() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the shortest string length of the non-null values or -1 if there were none.
- getMinimumLength() - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
-
The optional least number of bytes in values of this field.
- getMinimumLength() - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
The optional least number of characters in values of this field.
- getMinimumSiblings() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.AffixSiblingSetRule
-
Returns the minimum number of pattern-sharing siblings required to derive a pattern (default 3).
- getMinimumSiblings() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
-
Returns the minimum number of structurally similar siblings required to derive a pattern (default 3).
- getMinimumSimilarity() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
-
Returns the minimum Jaccard overlap between sibling structural signatures (default 0.75).
- getMinimumSizeInBytes() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns the minimum number of bytes used to represent values of this type.
- getMinNumberOfArgs() - Method in class com.northconcepts.datapipeline.jsonata.utils.Signature
-
Returns the minimum # of arguments.
- getMinRecords() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Returns the number of records to sample before generating the entity (defaults to 1000).
- getMissedTweets() - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
-
Returns the total of the limited-tweet counts reported by track limitation notices.
- getMisses() - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Returns the number of lookup requests where the results were not already cached and the underlying lookup was used.
- getModifiedSchema() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Indicates the modified schema used to read the file.
- getName() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- getName() - Method in class com.northconcepts.datapipeline.amazons3.S3Bucket
- getName() - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.core.DataObject
-
The name of this instance (
- ). - getName() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's name.
- getName() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the name assigned to this bus or its default name if one was not assigned.
- getName() - Method in class com.northconcepts.datapipeline.filter.FieldExists
-
Returns the field name when this filter checks exactly one field, otherwise null.
- getName() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Returns the field name when this filter checks exactly one field, otherwise null.
- getName() - Method in class com.northconcepts.datapipeline.filter.FieldNotExists
-
Returns the field name when this filter checks exactly one field, otherwise null.
- getName() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- getName() - Method in class com.northconcepts.datapipeline.foundations.core.Property
- getName() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- getName() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- getName() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- getName() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- getName() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- getName() - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- getName() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
- getName() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
- getName() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
- getName() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- getName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- getName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- getName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Returns the column label: its
ASalias, or its name when there is none. - getName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- getName() - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcSink
- getName() - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcSource
- getName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- getName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DatasetPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FileSourcePipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FileSinkPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
-
Returns a display name for this input, such as the source's name followed by its format.
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineOutput
-
Returns a display name for this output, such as the destination's name followed by its format.
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- getName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
The human-readable text identifier for this entity.
- getName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getName() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The human-readable text identifier for this field.
- getName() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- getName() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
The human-readable text identifier for this schema.
- getName() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the name assigned to this job or its default name if one was not assigned.
- getName() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the name assigned to this job or its default name if one was not assigned.
- getName() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the name assigned to this job or its default name if one was not assigned.
- getName() - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.mailchimp.list.Tag
- getName() - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- getName() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- getName() - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- getName() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getName() - Method in class com.northconcepts.datapipeline.sql.h2.TableColumn
-
Returns the column name.
- getName() - Method in class com.northconcepts.datapipeline.sql.mysql.TableColumn
- getName() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Returns the name of the field this transformer applies to if only one field was specified, otherwise
nullif multiple fields. - getName() - Method in class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
- getName() - Method in class com.northconcepts.datapipeline.transform.SetCalculatedField
- getName() - Method in class com.northconcepts.datapipeline.transform.SetField
- getName() - Method in class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
- getName() - Method in class com.northconcepts.datapipeline.transform.SetSequenceNumberField
- getName() - Method in class com.northconcepts.datapipeline.transform.SetUuidField
- getName() - Method in class com.northconcepts.datapipeline.transform.SplitArrayField
- getName() - Method in class com.northconcepts.datapipeline.xml.builder.XmlAttribute
- getName() - Method in class com.northconcepts.datapipeline.xml.builder.XmlElement
- getName() - Method in class com.northconcepts.datapipeline.xml.XmlField
- getName(boolean) - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's name.
- getName(int) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
-
Returns the name of the attribute at the given 0-based index, in name order.
- getNameAsJavaClassName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the name as a camel-case Java class name, e.g.
- getNameAsJavaClassName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the name as a camel-case Java class name, e.g.
- getNameAsJavaIdentifier() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Returns the label as a camel-case Java identifier, e.g.
- getNameAsJavaIdentifier() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
-
Returns the name as a camel-case Java identifier, e.g.
- getNameAsJavaIdentifier() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the name as a camel-case Java identifier, e.g.
- getNameAsJavaIdentifier() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the name as a camel-case Java identifier, e.g.
- getNameField() - Method in class com.northconcepts.datapipeline.trello.TrelloCardWriter
-
Returns the name of the record field holding the card name (defaults to
"name"). - getNameForErrorMessage() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The fully-qualified name for use in error and validation messages using
FieldDef.getDisplayNameOrName()for each name segment. - getNamePath() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the slash-separated names from the top of the tree down to this node, such as
/orders/order/id, or null for the unnamed root. - getNamePattern() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the naming pattern this (wildcard) node was collapsed down from, or
nullwhen the node was not derived from a sibling-set pattern. - getNames() - Method in class com.northconcepts.datapipeline.filter.FieldExists
- getNames() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
- getNames() - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
-
Returns a new list of the attribute names in sorted order.
- getNames() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
- getNamesAsStrings() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
- getNestedAlias() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySource
-
Returns the alias written after this source in a FROM clause or
nullfor none. - getNestedEndpoint() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
- getNestedEndpoint() - Method in class com.northconcepts.datapipeline.core.DataReader
- getNestedEndpoint() - Method in class com.northconcepts.datapipeline.core.DataWriter
- getNestedEndpoint() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the
Endpointheld inside this one ornullif there isn't one. - getNestedFileSource() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- getNestedLookup() - Method in class com.northconcepts.datapipeline.transform.lookup.ProxyLookup
- getNestedPipelineInput() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
-
Returns the
PipelineInputheld inside this one ornullif there isn't one. - getNestedPipelineInput() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineInput
- getNestedPipelineOutput() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineOutput
-
Returns the
PipelineOutputheld inside this one ornullif there isn't one. - getNestedPipelineOutput() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineOutput
- getNestedReader() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Returns the
DataReaderheld inside this one ornullif there isn't one. - getNestedReader() - Method in class com.northconcepts.datapipeline.core.ProxyReader
- getNestedReader() - Method in class com.northconcepts.datapipeline.core.SortingReader
- getNestedReader0() - Method in class com.northconcepts.datapipeline.core.SortingReader
-
Returns the reader actually being proxied: the original until the first read, then one over the sorted records (
SortingReader.getNestedReader()always returns the original). - getNestedWriter() - Method in class com.northconcepts.datapipeline.core.DataWriter
-
Returns the
DataWriterheld inside this one ornullif there isn't one. - getNestedWriter() - Method in class com.northconcepts.datapipeline.core.ProxyWriter
- getNewIndex() - Method in class com.northconcepts.datapipeline.transform.MoveFieldToIndex
-
Returns the 0-based position the field is moved to.
- getNewLine() - Method in class com.northconcepts.datapipeline.core.LinedTextWriter
-
Returns the string written after each line (defaults to the platform line separator).
- getNewLine() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Returns the string written after each record (defaults to the system line separator).
- getNewLine() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Returns the string written after each record (defaults to the system line separator).
- getNewLine() - Method in class com.northconcepts.datapipeline.texttable.TextTableWriter
-
Returns the string used between each line (defaults to the platform's line separator).
- getNewLineEscaped() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Returns the line separator in Java-escaped form, as serialized.
- getNewName() - Method in class com.northconcepts.datapipeline.transform.FastRenameField
- getNewName() - Method in class com.northconcepts.datapipeline.transform.RenameField
- getNewValue() - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- getNextContinuationToken() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectListing
- getNextPageInfo() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Returns the
page_infocursor of the next page to request or null for the first page. - getNextPageToken() - Method in class com.northconcepts.datapipeline.jira.JiraSearch
-
Returns the token of the next page of results to request;
JiraIssueReaderupdates it after each page. - getNextTime(long) - Method in class com.northconcepts.datapipeline.schedule.HourlyScheduler
- getNextTime(long) - Method in class com.northconcepts.datapipeline.schedule.PeriodicScheduler
- getNextTime(long) - Method in interface com.northconcepts.datapipeline.schedule.Scheduler
-
Returns the next time in this schedule after the specified time.
- getNextToken() - Method in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
-
Returns the pagination token for the next request: empty before the first page and null once no pages remain.
- getNode(Node, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns the node (field, record, array or single value) this path leads to from
rootNode, creating missing parts ifcreateis true. - getNodeDepth() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns this node's distance from its root node.
- getNodeDepth() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns this node's distance from its root node.
- getNodeNameRules() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Returns the editable list of rules that classify node names as dynamic.
- getNodes() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Returns the child nodes, checked in order; evaluation enters the first one whose condition holds.
- getNodes() - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
- getNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- getNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Returns this node's children; a conditional node returns null when its condition is false in the given context.
- getNodeType() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the concrete
Node.NodeTypeof this node. - getNodeType() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns the concrete
Node.NodeTypeof this node. - getNodeType() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns the concrete
Node.NodeTypeof this node. - getNodeType() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the concrete
Node.NodeTypeof this node. - getNodeType() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the concrete
Node.NodeTypeof this node. - getNonNullCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of non-null values, blank ones included.
- getNonNullNonBlankCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- getNonPrettyLineSeparator() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Returns the text written between lines when pretty printing is off (defaults to a single space).
- getNonPrimaryKeyColumns() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the columns outside the primary key, ordered by their position in the table.
- getNonUnique() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Indicates if the index allows duplicate values (it is not a unique index).
- getNonUpdateFields() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Returns the list of fields that must not be updated if the recored already exists (default null).
- getNonUpdateFields() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Returns the list of fields that must not be updated if the recored already exists (default null).
- getNullCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- getNullsFirst() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
-
Indicates if nulls sort first (
NULLS FIRST) or last (NULLS LAST);null, the default, adds neither. - getNullValueFieldTypes() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of null values seen for each field type.
- getNullValuePolicy() - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Returns the object responsible for writing null values (defaults to ValuePolicy.EMPTY_STRING).
- getNullValuePolicy() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Returns how null values are written (defaults to
CSVWriter.ValuePolicy.EMPTY_STRING, an unquoted blank). - getNumber() - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
-
Parses the source text with the descriptor's field type and caches the result; returns null if there is no descriptor.
- getNumberDescriptor() - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
- getNumberDescriptor() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the sign and digit counts that fit every number recognized in string values or null if there were none.
- getNumberDetector() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Returns the detector a
Datasetbuilt on this pipeline uses to infer numeric values in text columns. - getNumberOfArgs() - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.JFunction
- getNumberOfArgs() - Method in class com.northconcepts.datapipeline.jsonata.utils.Signature
- getNumericSizeInBytes() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns the number of bytes used to represent values of this type or zero (0) for non-numeric types.
- getObjectSummaries() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectListing
-
Returns the objects in this page (never
null). - getObjectWrapper() - Method in class com.northconcepts.datapipeline.template.ArrayTemplateModel
- getObjectWrapper() - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePair
- getObjectWrapper() - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePairIterator
- getObjectWrapper() - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- getOffset() - Method in class com.northconcepts.datapipeline.core.LimitReader
-
Returns the number of leading records to skip or null to skip none.
- getOffset() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetReader
-
Returns the 0-based index of the first record to read.
- getOffset() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Returns the number of rows to skip or
nullif not set. - getOffset() - Method in exception class com.northconcepts.datapipeline.jsonata.ParseException
-
Deprecated.Use
ParseException.getLocation()instead - getOffsetConsumed() - Method in class com.northconcepts.datapipeline.core.LimitReader
-
Returns the number of records skipped so far to satisfy the offset.
- getOldFieldPath() - Method in class com.northconcepts.datapipeline.transform.RenameField
- getOldFieldPathAsString() - Method in class com.northconcepts.datapipeline.transform.RenameField
- getOldIndex() - Method in class com.northconcepts.datapipeline.transform.FastRenameField
-
Returns the 0-based position of the field to rename; when renaming by name it is null until the first record is transformed.
- getOldName() - Method in class com.northconcepts.datapipeline.transform.FastRenameField
-
Returns the name of the field to rename or null if it is identified by position.
- getOldName() - Method in class com.northconcepts.datapipeline.transform.RenameField
-
Deprecated.use
RenameField.getOldFieldPathAsString()instead. - getOldValue() - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- getOnDeleteAction() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getOnDeleteAction() - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Returns the ON DELETE action.
- getOnDeleteAction() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Returns the
ON DELETEaction, or null if the clause is omitted (the default). - getOnDeleteAction() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Returns the
ON DELETEaction, or null if the clause is omitted (the default). - getOnUpdateAction() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getOnUpdateAction() - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Returns the ON UPDATE action.
- getOnUpdateAction() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Returns the
ON UPDATEaction, or null if the clause is omitted (the default). - getOnUpdateAction() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Returns the
ON UPDATEaction, or null if the clause is omitted (the default). - getOpenedOn() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the time in milliseconds when this endpoint was opened or zero (0) if it hasn't yet been opened.
- getOpenedWindows() - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Returns the windows that are currently open and collecting records.
- getOpenElapsedTime() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the number of milliseconds this endpoint was (or has been) opened for or zero (0) if it hasn't yet been opened.
- getOpenElapsedTimeAsString() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the total time (as a human readable string) this endpoint was (or has been) opened for or "0 seconds" if it hasn't yet been opened.
- getOperation() - Method in class com.northconcepts.datapipeline.group.GroupOperationField
- getOperations() - Method in class com.northconcepts.datapipeline.group.GroupByReader
- getOrCreateColumn(String, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns the named column, creating it with the given 0-based field index if needed; called while collecting column stats.
- getOrCreateColumn(String, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getOrCreateColumn(String, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getOrCreateColumn(String, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- getOrCreateColumn(String, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getOrder() - Method in class com.northconcepts.datapipeline.core.SortingReader
-
Returns the comparator that defines the sort order; with no fields added, records are compared on all their fields.
- getOrder() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Returns the ORDER BY fields (never
null). - getOrderBy() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Returns the order in which events are requested (defaults to
"startTime"). - getOrderByField() - Method in class com.northconcepts.datapipeline.jira.JiraProjectReader
-
Indicates the returned issue sort order.
- getOrderCriteria() - Method in class com.northconcepts.datapipeline.shopify.ShopifyOrderReader
-
Returns the criteria for the orders to read or null for none; it is modified in place when later pages are requested.
- getOrdinalPosition() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
-
Returns the column's 1-based position within the index.
- getOriginalFieldIndex() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The index of a field set by the DataReader before any transformation or operation was performed.
- getOriginalFieldName() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The name of a field set by the DataReader before any transformation or operation was performed.
- getOutcome() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableResult
-
Returns the fields set by the fired rule's outcomes, or by the default outcomes if no rule fired; null if no rule fired and there are no default outcomes.
- getOutcome() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeResult
-
Returns the fields set by the outcomes of the visited nodes; never null.
- getOutcomeAsJson() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableResult
- getOutcomeAsJson() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeResult
- getOutcomes() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- getOutcomes() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Returns the outcomes set when evaluation visits this node.
- getOutput() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- getOutputStream() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- getOutputStream() - Method in class com.northconcepts.datapipeline.core.BinaryWriter
- getOutputStream() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
-
Opens a new stream to write the file's content; the caller must close it.
- getOutputStream() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- getOverwrite() - Method in class com.northconcepts.datapipeline.transform.CopyField
- getOverwrite() - Method in class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
- getOverwrite() - Method in class com.northconcepts.datapipeline.transform.SetCalculatedField
- getOverwrite() - Method in class com.northconcepts.datapipeline.transform.SetField
- getOverwrite() - Method in class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
- getOverwrite() - Method in class com.northconcepts.datapipeline.transform.SetSequenceNumberField
- getOverwrite() - Method in class com.northconcepts.datapipeline.transform.SetUuidField
- getPackage() - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
-
Returns the package declared in the generated source; classes in it are not imported by
JavaCodeBuilder.addImport(Class). - getPage() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
-
Returns the 0-based page number.
- getPage() - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
-
Returns the cursor of the next page to request.
- getPageCount() - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
- getPageImpl(long, int) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowerIDsReader
- getPageImpl(long, int) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowerListReader
- getPageImpl(long, int) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowingIDsReader
- getPageImpl(long, int) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowingListReader
- getPageImpl(long, int) - Method in class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
- getPageImpl(long, int) - Method in class com.northconcepts.datapipeline.twitter.TwitterListOwnershipReader
- getPageImpl(long, int) - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
-
Fetches the page at the given cursor, requesting
pageSizeelements. - getPageNumber() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Returns the current 0-based page number.
- getPageOffset() - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Indicates the first offset to start returning.
- getPageOffset() - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
-
Returns the offset of the next page to request (defaults to 0); it grows by the number of members in each page read.
- getPageOrientation() - Method in class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
-
Returns the page orientation for the Word document (default
MicrosoftWordWriter.PageOrientation.PORTRAIT). - getPageOrientation() - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
-
Returns the page orientation for the Word document (default
MicrosoftWordWriter.PageOrientation.PORTRAIT). - getPageOrientation() - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
-
Returns the page orientation for the PDF document (default
PdfWriter.PageOrientation.PORTRAIT). - getPageOrientation() - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
-
Returns the page orientation for the PDF document (default
PdfWriter.PageOrientation.PORTRAIT). - getPages() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Returns the number of pages the index uses, or the table uses for a
tableIndexStatisticentry. - getPageSize() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
- getPageSize() - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
-
Returns the number of members requested per page (defaults to 10).
- getPageSize() - Method in class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
-
Returns the page size for the Word document (default
MicrosoftWordWriter.PageSize.LETTER). - getPageSize() - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
-
Returns the page size for the Word document (default
MicrosoftWordWriter.PageSize.LETTER). - getPageSize() - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
-
Returns the page size for the PDF document (default
PdfWriter.PageSize.LETTER). - getPageSize() - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
-
Returns the page size for the PDF document (default
PdfWriter.PageSize.LETTER). - getPageSize() - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- getParameters() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Returns the parameters, in the order of the query's
?placeholders. - getParameters() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Returns the values bound, in order, to the query's
?placeholders or null to run it as a plain statement. - getParameterSqlTypes() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Returns the
Typescode of each parameter, in the same order, or null to bind them without a type. - getParameterValues() - Method in class com.northconcepts.datapipeline.jdbc.sql.SqlPart
-
Returns the values for this part's
?parameters in order, or an empty array if there are none. - getParent() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Returns the parent node, or null if this is the root.
- getParent() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the thread-local job that ran this one while this job is running.
- getParent() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the thread-local job that ran this one while this job is running.
- getParent() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the thread-local job that ran this one while this job is running.
- getParentField() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns the closest parent record's field that this node is the child of, otherwise null if one does not exist.
- getParentNode() - Method in class com.northconcepts.datapipeline.core.Field
- getParentNode() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns the parent node that this node belongs to, or
nullif this is a root node. - getParentNode() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns the parent node that this node belongs to, or
nullif this is a root node. - getParentNode() - Method in class com.northconcepts.datapipeline.json.builder.JsonFragment
- getParentRecord() - Method in class com.northconcepts.datapipeline.core.Field
- getParentRecord() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns the closest parent record that this node is the child of, otherwise null if one does not exist.
- getParquetSchema() - Method in class com.northconcepts.datapipeline.parquet.tools.GenerateSchemaDefFromParquet
-
Returns the Parquet schema used by the most recent
generateSchemaDefcall or null if there was none. - getParser() - Method in class com.northconcepts.datapipeline.csv.CSVReader
- getParts() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
- getParts() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
-
Returns the live list of child parts.
- getParts() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
- getPassword() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
-
Returns the password used to open the PDF or null for none; it is serialized as plain text.
- getPasswordEncoder() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the encoder used to store the password (defaults to
Encoder.HEX). - getPath() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Returns the key of this file's object within its bucket.
- getPath() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeResult
-
Returns the nodes entered because their conditions held, in order from the root; the root and default nodes are not included.
- getPath() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
- getPath() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
- getPath() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Returns the path of the local file; a relative path is resolved against the current working directory.
- getPath() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- getPath() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Returns the
Pathof the ORC file being read. - getPath() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Returns the
Pathof the ORC file being written. - getPath() - Method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
- getPattern() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
-
Returns the
SimpleDateFormatpattern used to format the values; if blank, each value's default string form is used. - getPattern() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
-
Returns the
DecimalFormatpattern used to format the values; if blank, each value's default string form is used. - getPattern() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
-
Returns the
SimpleDateFormatpattern used to parse the values. - getPattern() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
-
Returns the
DecimalFormatpattern used to parse the values; if blank, the type's standard parsing is used. - getPattern() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.RegexNodeNameRule
- getPattern() - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
The optional numeric pattern to use when parsing incoming values (from currency, percentage, etc.) during mapping.
- getPattern() - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
The optional date, time, or datetime pattern to use when parsing incoming values during mapping.
- getPattern() - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
The optional regular expression pattern to use when parsing incoming values during validation (not used during mapping).
- getPattern() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePattern
-
Returns the date-time pattern for case-insensitive parsing.
- getPattern() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternMatch
-
The pattern used for parsing.
- getPatterns() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
-
Returns the live set of patterns, in the order they are tried.
- getPausedOn() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the time this job was paused or
nullif this job is not currently paused. - getPausedOn() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the time this job was paused or
nullif this job is not currently paused. - getPausedOn() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the time this job was paused or
nullif this job is not currently paused. - getPeakBufferSizeInBytes() - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Returns the largest value
AsyncReader.getBufferSizeInBytes()has reached. - getPeakBufferSizeInBytes() - Method in class com.northconcepts.datapipeline.core.AsyncWriter
-
Returns the largest value
AsyncWriter.getBufferSizeInBytes()has reached. - getPeekUnitsPerSecond() - Method in class com.northconcepts.datapipeline.throttle.Throttle
-
Returns the highest rate (units per second) the meter reported when
Throttle.throttle()was called. - getPercentage() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
-
Returns the percentage of calls remaining, rounded down.
- getPeriod() - Method in class com.northconcepts.datapipeline.schedule.PeriodicScheduler
-
Returns the time between scheduled events in milliseconds.
- getPersonFields() - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
-
Returns the comma-separated person fields requested for each contact.
- getPhone() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getPipeline() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
-
Returns the pipeline this action belongs to, or null if it has not been added to one.
- getPipeline() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- getPipelineInput(Class<T>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
-
Searches for a nested
PipelineInputof the specified type within this pipeline input hierarchy. - getPipelineOutput(Class<T>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineOutput
-
Searches for a nested
PipelineOutputof the specified type within this pipeline output hierarchy. - getPlainTextPassword() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the password decoded with the
password encoder. - getPolicy() - Method in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
Returns the matching legacy
BigDecimalrounding constant, such asROUND_UP(8 for HALF_ODD, which has none). - getPoolSize() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the current number of threads in this bus' executorService pool or -1 if unknown.
- getPort() - Method in class com.northconcepts.datapipeline.email.EmailReader
- getPos() - Method in class com.northconcepts.datapipeline.parquet.RandomAccessSeekableInputStream
- getPosition() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The zero-based location of this field in the data (if applicable).
- getPrecision() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
-
Returns the total number of digits (whole plus fraction digits).
- getPrecision() - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
The optional numeric precision -- currently unused.
- getPrefix() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectListing
-
Returns the key prefix (folder) that was listed or
nullfor a bucket's root folder. - getPrefix() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetPattern
- getPreviousSource() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
-
Returns the source context of the previously mapped record, or null if there is none (such as for the first record).
- getPreviousTarget() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
-
Returns the target context of the previously mapped record, or null if there is none (such as for the first record).
- getPrimaryEntity() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the primary entity from the parent schema or null if this relationship has no schema or the entity is not found.
- getPrimaryEntityName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the name of the entity whose primary key the foreign key fields reference.
- getPrimaryEntityRelationships(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the relationships whose primary entity is the given entity, which must belong to this schema.
- getPrimaryKeyCatalogName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- getPrimaryKeyColumnName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- getPrimaryKeyColumnNames() - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Returns the primary key column names.
- getPrimaryKeyColumnNames() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- getPrimaryKeyColumnNames() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- getPrimaryKeyColumns() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the primary key columns in key sequence order.
- getPrimaryKeyColumns() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Returns the list of primary key columns.
- getPrimaryKeyColumns() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
-
Returns the columns marked as primary key, in column order; they form the table's
PRIMARY KEYclause. - getPrimaryKeyColumns() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
-
Returns the columns marked as primary key, in column order; they form the table's
PRIMARY KEYclause. - getPrimaryKeyFieldNames() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the names of this entity's own primary key fields (not inherited ones) ordered by their primary key position.
- getPrimaryKeyFields() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns this entity's own primary key fields (not inherited ones) ordered by their primary key position.
- getPrimaryKeyFields() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the primary entity's primary key fields in key order or null if the primary entity cannot be found.
- getPrimaryKeyName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns the name of the referenced primary key constraint, or null if the database does not report one.
- getPrimaryKeyName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the name of the primary key constraint (not a column), or
null. - getPrimaryKeyPosition() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Returns the zero-based position of this field in its entity's primary key or null if it is not part of the key.
- getPrimaryKeySchemaName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- getPrimaryKeySequence() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Starting at 1.
- getPrimaryKeyTableName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- getPrimaryKeyType() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Returns the strategy used to generate this primary key field's values or null if none is set.
- getPrimaryTableName() - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Returns the primary table name.
- getPrimaryTableName() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Returns the name of the table the foreign key references.
- getPrimaryTableName() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Returns the name of the table the foreign key references.
- getPrintWriter() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Returns the writer for progress messages and, when not writing files, the generated source (standard output if not set).
- getPrintWriter() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateRecordSerializers
-
Returns the writer the generated code is printed to (standard output if not set).
- getPrintWriter() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Returns the writer that receives the generated source when not writing files (standard output if not set).
- getPrintWriter() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Returns the writer that receives the generated source when not writing files (standard output if not set).
- getPriority() - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Returns the priority given to the background reading thread when this reader is opened (defaults to
Thread.NORM_PRIORITY). - getPriority() - Method in class com.northconcepts.datapipeline.core.AsyncWriter
-
Returns the priority given to the background writing thread when this writer is opened (defaults to
Thread.NORM_PRIORITY). - getProcessedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getProcessedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getProductCriteria() - Method in class com.northconcepts.datapipeline.shopify.ShopifyProductReader
-
Returns the criteria for the products to read or null for none; it is modified in place when later pages are requested.
- getProducts(ShopifyProductCriteria, int, String) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- getProducts(ShopifyProductCriteria, Integer, String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Returns a page of products whose
nextfield holds the cursor of the following page, if any. - getProductType() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getProjects(String, Integer, boolean) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
-
Deprecated.
- getProjectsPaginated(int, int, String, String, String) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
-
Returns a page of projects as JSON, starting at the 0-based
startAtoffset. - getProperties() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageFooter
- getProperties() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageHeader
- getProperties() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the values associated with this exception as a
Map. - getProperties() - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Returns the properties used to create the mail session; keys not set here fall back to the system properties.
- getProperties() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the extra properties passed to the JDBC driver by
JdbcConnection.createConnection(). - getProperties() - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Returns the JNDI environment used to look up the connection factory; it must not be empty when connecting.
- getPropertiesAsString() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the properties as
name=[value]lines sorted by name, or null if there are none. - getProperty(String) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageFooter
-
Returns all values of the named property or null if it is not present.
- getProperty(String) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageHeader
-
Returns all values of the named property or null if it is not present.
- getProperty(String) - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Returns a JNDI environment property or null if it is not set.
- getProtocol() - Method in enum class com.northconcepts.datapipeline.email.MailStore
- getProvider() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- getProvider() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
- getProvider() - Method in class com.northconcepts.datapipeline.twitter.TwitterWriter
- getProviderType() - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
- getProviderType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Returns the provider used to read the workbook (defaults to
ExcelDocument.ProviderType.POI_XSSF). - getProviderType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Returns the provider used to write the workbook (defaults to
ExcelDocument.ProviderType.POI_XSSF). - getProvince() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getProvinceCode() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- getPublishedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getPublishedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getPublishedStatus() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getPublisher(Class<T>) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns a proxy of the listener interface that publishes each call as an event on this bus, without a source or topic.
- getPublisher(Object, Class<T>) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns a proxy of the listener interface that publishes each call as an event on this bus, from the given source and without a topic.
- getPublisher(Object, Class<T>, Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns a proxy of the listener interface that publishes each call as an event on this bus, with the given source and topic; the bus's executor delivers the events to the listeners.
- getPublishersCreated() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the number of event publishers created by this bus.
- getQualifiedForiegnKeyTable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns the referencing (foreign key) table's name, prefixed with its schema and a dot when it has one.
- getQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the name prefixed with the schema and a dot when there is a schema; the catalog is not included.
- getQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the fully qualified name that includes the name of this entity and all names in its hierarchy separated by period.
- getQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the fully qualified name that includes the name of this entity relationship and all names in its hierarchy separated by period.
- getQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Returns the fully qualified name that includes the name of this field definition and all names in its hierarchy separated by period.
- getQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the fully qualified name that includes the name of this index and all names in its hierarchy separated by period.
- getQualifiedName() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Returns the fully qualified name that includes the name of this index field and all names in its hierarchy separated by period.
- getQualifiedPrimaryKeyTable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns the referenced (primary key) table's name, prefixed with its schema and a dot when it has one.
- getQueries() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- getQuery() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- getQuery() - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcSink
- getQuery() - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcSource
-
Returns the SQL that selects this source's rows.
- getQuery() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- getQuery() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Deprecated.Use
JdbcPipelineInput.getQueryString()instead. - getQuery() - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
-
Returns the search query used to list messages or null if none was set (the default).
- getQuery() - Method in class com.northconcepts.datapipeline.jira.JiraProjectReader
-
Indicates the case-insensitive search filter.
- getQuery() - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
-
Gets the JSON style query string.
Output format:
(e.g. - getQueryColumns(ResultSetMetaData, JdbcConnection) - Static method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Describes each result column, choosing its Java type from the connection's type overrides or SQL-to-Java type mapper.
- getQuerySources() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- getQueryString() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- getQueue() - Method in class com.northconcepts.datapipeline.core.PipedReader
-
Returns the queue shared with the connected
PipedWriter. - getQueue() - Method in class com.northconcepts.datapipeline.core.PipedWriter
-
Returns the queue shared with the connected
PipedReader. - getQueue() - Method in class com.northconcepts.datapipeline.multiplex.SplitReader
-
Returns the bounded queue the splitter's strategy fills with records for this reader.
- getQueueSize() - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
-
Retrieves the buffer size for downstream readers of this splitter (default is 100 records).
- getQuoteChar() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Returns the starting quote - same as calling getStartingQuote() (defaults to double quote - ").
- getQuoteChar() - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Returns the starting quote - same as calling getStartingQuote() (defaults to double quote - ").
- getRadix() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the radix of the size and decimals, typically 10 or 2.
- getRange() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getRange() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- getRange() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- getRateLimit() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Returns the cached rate limit, fetching it from the API only if none has been loaded.
- getRateLimit() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Returns the cached rate limit, fetching it from the API only if none has been loaded.
- getRateLimit(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Returns the rate limit, reloading it if none is cached or if
autoReloadis true and it has reset. - getRateLimit(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Returns the rate limit, reloading it if none is cached or if
autoReloadis true and it has reset. - getRateLimit(String, String) - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Calls the API for the current rate limit of the endpoint identified by resource family and key.
- getReader() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader.ReaderThread
- getReader() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the reader supplied to this job.
- getReader() - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Returns the
TransformingReaderthis transformer was added to or null if none. - getReader(Class<T>) - Method in class com.northconcepts.datapipeline.core.DataReader
-
Returns the first
DataReaderof the specified type held inside this one ornullif there isn't one. - getReader(Class<T>) - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the first reader of the supplied type from the read pipeline.
- getReaders() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the read pipeline — the chain of readers records pass through, starting with the root instance and ending with the reader passed to this job (and returned by
Job.getReader()). - getReadWriteLock() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
-
Returns the lock guarding this list, for holding it across several calls or while iterating.
- getReceiveTimeout() - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Returns the timeout interval for receiving messages or
nullif reads should not timeout (default tonull). - getRecentTweets(String, LocalDateTime, LocalDateTime, int, String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Returns filtered public Tweets posted over the last 7 days.
- getRecord() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the record associated with this exception.
- getRecord() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns the record this field belongs to.
- getRecord() - Method in class com.northconcepts.datapipeline.core.FieldLocation
-
Gets the record containing the field at this location.
- getRecord() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the
Recordassociated with this container. - getRecord() - Method in interface com.northconcepts.datapipeline.core.RecordContainer
-
Returns the
Recordassociated with this container. - getRecord() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
- getRecord() - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
- getRecord() - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePairIterator
- getRecord() - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- getRecord(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns the loaded record at the given 0-based index.
- getRecord(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getRecord(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getRecord(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- getRecord(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getRecordBreaks() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Returns the location paths of the JSON nodes read as records or null if none were added.
- getRecordBreaks() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Returns the location paths that delimit records or null if none were added.
- getRecordBreaks() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Returns the location paths of the elements read as records or null if none were added.
- getRecordBreaks(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Returns the record break paths, first creating an empty list if
createis true and there is none. - getRecordBreaks(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Returns the record break paths, first creating an empty list if
createis true and there is none. - getRecordBreaks(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Returns the record break paths, first creating an empty list if
createis true and there is none. - getRecordConverterFunction() - Method in class com.northconcepts.datapipeline.memory.CollectionReader
-
Gets the function used to convert elements to Records.
- getRecordCount() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- getRecordCount() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Returns this endpoint's record-count as a
long. - getRecordCount() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns the number of records in this list -- an alias for
RecordList.size(). - getRecordCount() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
-
The number of records written in this sequence while this sequence is current.
- getRecordCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns the number of records loaded into this dataset so far.
- getRecordCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getRecordCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getRecordCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- getRecordCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- getRecordCount() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert.UpsertStub
- getRecordCountAsBigInteger() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Returns this endpoint's record-count as a
BigInteger. - getRecordCountAsString() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Returns this endpoint's record-count as a
String. - getRecordList() - Method in class com.northconcepts.datapipeline.memory.MemoryReader
- getRecordList() - Method in class com.northconcepts.datapipeline.memory.MemoryWriter
- getRecordList(long, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Get a subset of the records cached in this dataset.
- getRecordList(long, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
- getRecordList(long, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- getRecordNumber() - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The sequential record number starting with 0.
- getRecordNumber() - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The beginning column number in the input file starting with 0.
- getRecords() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageData
- getRecords() - Method in class com.northconcepts.datapipeline.buffer.RecordBuffer
- getRecords() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- getRecords() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns a list of records.
- getRecordSchema() - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The schema for ORC and Parquet files.
- getRecordsFromResponse(Record) - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Returns the records in a response from
ShopifyApiReader.invokeRequest(), such as itsordersarray; null or empty ends reading. - getRecordsFromResponse(Record) - Method in class com.northconcepts.datapipeline.shopify.ShopifyCustomerReader
- getRecordsFromResponse(Record) - Method in class com.northconcepts.datapipeline.shopify.ShopifyEventReader
- getRecordsFromResponse(Record) - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryItemReader
- getRecordsFromResponse(Record) - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryLevelReader
- getRecordsFromResponse(Record) - Method in class com.northconcepts.datapipeline.shopify.ShopifyLocationReader
- getRecordsFromResponse(Record) - Method in class com.northconcepts.datapipeline.shopify.ShopifyOrderReader
- getRecordsFromResponse(Record) - Method in class com.northconcepts.datapipeline.shopify.ShopifyProductReader
- getRecordsPendingInsert() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getRecordsPerCacheFile() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- getRecordsPerCacheFile() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates how many records should be cached in memory to generate the Parquet schema if no schema was explicitly set on this writer (default is 10_000L).
- getRecordsPerFile() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Returns the number of records stored in each data file (defaults to 1000).
- getRecordsTransferred() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the number of records sent from the supplied reader to the supplied writer.
- getRecordTagName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Returns the name of the element written for each record (defaults to
record); it must not be blank. - getRecordTagName() - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Returns the name of the element written for each record (defaults to
record); it must not be null or empty. - getRecurseDirectories() - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
-
Indicates if sub-directories are read recursively (default is false).
- getRed() - Method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Gets the red component of this color.
- getRed() - Method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Gets the red component of the color.
- getReferencedEntityDef() - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
-
The entity in the parent schema to use when validating and mapping this nested field.
- getReferencedEntityDef(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
-
Returns the referenced entity from the parent schema; if it, the parent entity or the schema is missing, throws an exception when
throwExceptionis true and returns null otherwise. - getReferencedEntityName() - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
-
The name of the entity in the parent schema to use when validating and mapping this nested field.
- getRegion() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the AWS region set by
AmazonS3FileSystem.setRegion(String), ornullif it is resolved when connecting. - getRel() - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- getRemainingCallString() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
-
Returns the remaining percentage as text, such as
"75% API calls remaining". - getRemainingLineText() - Method in class com.northconcepts.datapipeline.core.LineParser
-
Returns the unconsumed rest of the current line, an empty string if it is fully consumed, or null before the first line is read.
- getRemarks() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- getRemarks() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- getRequests() - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Returns the number of lookup requests made on this cache (sum of
CachedLookup.getHits()andCachedLookup.getMisses()). - getRequiresShipping() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- getResetInterval() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
-
Returns the time left until the limit resets, truncated to whole seconds.
- getResetSchedule() - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
-
Returns the schedule for clearing all cached results or
nullif the cache is never cleared. - getResetTimeString() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
-
Returns
"Reset in "followed by thereset interval. - getResource() - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
-
Returns the resource name whose connections are read (defaults to
"people/me"). - getResteasyClient() - Method in class com.northconcepts.datapipeline.jira.client.JiraClient.JiraStub
- getResteasyClient() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyClient.ShopifyStub
- getRetryCount() - Method in class com.northconcepts.datapipeline.retry.RetryContext
-
Returns the 0-based index of the failed attempt (0 for the initial attempt, 1 for the first retry).
- getRetryDelay(int, long) - Method in interface com.northconcepts.datapipeline.retry.IRetryStrategy
-
Returns the amount of time to wait (in milliseconds) before retrying the operation.
- getRetryDelay(int, long) - Method in enum class com.northconcepts.datapipeline.retry.RetryStrategy
- getRetryDelayImpl(int, long) - Method in enum class com.northconcepts.datapipeline.retry.RetryStrategy
-
Returns the delay in milliseconds for the retries after the first (
retryCountis at least 1). - getRetryPredicate() - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Returns the predicate that determines whether to retry after a failure.
- getRetryStrategy() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Returns the strategy for the delay before retrying a rate-limited request (defaults to
RetryStrategy.EXPONENTIAL_BACKOFF). - getRgb() - Method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Gets the RGB value as a single integer (0xRRGGBB format).
- getRgb() - Method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Gets the RGB value as a single integer (0xRRGGBB format).
- getRootCause() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the root cause of this throwable or
thisif the cause is nonexistent or unknown. - getRootEndpoint() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
- getRootEndpoint() - Method in class com.northconcepts.datapipeline.core.DataReader
- getRootEndpoint() - Method in class com.northconcepts.datapipeline.core.DataWriter
- getRootEndpoint() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the deepest, nested
Endpointheld inside this one, otherwise this instance is returned if there aren't any nestedEndpoints. - getRootExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Returns the context holding the constants added with
DataMapping.setValue(String, Object); it is the parent of the context used to evaluate expressions. - getRootExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Returns the context holding the constants set with
DecisionTable.setValue(String, Object). - getRootExpressionContext() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Returns the context holding the constants set with
DecisionTree.setValue(String, Object). - getRootFieldName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Returns the name of the top-level field holding the records array or blank to write a bare array (defaults to
data). - getRootFieldName() - Method in class com.northconcepts.datapipeline.json.JsonRecordWriter
-
Returns the name of the top-level field holding the records array, or null/empty to write a bare array (default is
data). - getRootNode() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Returns the node where evaluation starts; its condition is not evaluated.
- getRootNode() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Returns the unnamed root node whose children are the document's top-level nodes.
- getRootPart() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
Returns the top-level part holding all conditions or
nullif there are none. - getRootPipelineInput() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
-
Returns the deepest, nested
PipelineInputheld inside this one, otherwise this instance is returned if there aren't any nestedPipelineInputs. - getRootPipelineOutput() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineOutput
-
Returns the deepest, nested
PipelineOutputheld inside this one, otherwise this instance is returned if there aren't any nestedPipelineOutputs. - getRootReader() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Returns the deepest, nested
DataReaderheld inside this one, otherwise this instance is returned if there aren't any nestedDataReaders. - getRootTagName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Returns the name of the element wrapping all records or blank for none (defaults to
document). - getRootTagName() - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Returns the name of the root element wrapping all records, or null/empty for none (defaults to
document). - getRootWriter() - Method in class com.northconcepts.datapipeline.core.DataWriter
-
Returns the deepest, nested
DataWriterheld inside this one, otherwise this instance is returned if there aren't any nestedDataWriters. - getRoundingMode() - Method in class com.northconcepts.datapipeline.group.operation.GroupAverage
-
Returns the rounding applied to the average (defaults to
RoundingMode.HALF_UP). - getRoundingMode() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the rounding algorithm used for all BigDecimal values (default is
RoundingMode.HALF_UP). - getRoundingMode() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates the rounding algorithm used for all BigDecimal values (default is
RoundingMode.HALF_UP). - getRoundingMode() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates the rounding algorithm used for all BigDecimal values (default is
RoundingMode.HALF_UP). - getRoundingMode() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates the rounding algorithm used for all BigDecimal values (default is
RoundingMode.HALF_UP). - getRoundPolicy() - Method in class com.northconcepts.datapipeline.transform.format.Rounder
- getRowBatchVersion() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Returns
RowBatchVersionto store ORC data. - getRowBatchVersion() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Returns
RowBatchVersionto store ORC data. - getRowIdentifierSequence() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the column's 1-based position in the table's best row identifier, or
nullif it is not part of it. - getRowIndex() - Method in class com.northconcepts.datapipeline.core.FieldLocation
-
Gets the zero-based row index of this field location.
- getRownum() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Returns the number of
DataMapping.map(ExpressionContext)calls so far, also available to expressions asrownum. - getRownum() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Returns the current row number, incremented for each evaluation and available to expressions as
rownum. - getRownum() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Returns the current row number, incremented for each evaluation and available to expressions as
rownum. - getRows() - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
- getRows() - Method in class com.northconcepts.datapipeline.sql.h2.Insert
-
Returns the list of rows.
- getRows() - Method in class com.northconcepts.datapipeline.sql.h2.Upsert
-
Returns the list of rows.
- getRows() - Method in class com.northconcepts.datapipeline.sql.mysql.Insert
- getRows() - Method in class com.northconcepts.datapipeline.sql.mysql.Upsert
- getRows() - Method in class com.northconcepts.datapipeline.sql.postgresql.Insert
- getRows() - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
- getRowsWritten() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getRule(int) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
- getRuleCount() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
- getRuleFired() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableResult
-
Returns the first rule whose conditions all held, or null if none did.
- getRules() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Returns the rules, evaluated in order until one fires.
- getRules() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.CollapseSiblingPatterns
-
Returns the editable list of rules, consulted in order; the first one to derive a pattern wins.
- getRunnable() - Method in class com.northconcepts.datapipeline.job.RunnableJobAdapter
- getRunningTime() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the number of milliseconds this job was (or has been) running for or zero (0) if it hasn't yet started running.
- getRunningTime() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the number of milliseconds this job was (or has been) running for or zero (0) if it hasn't yet started running.
- getRunningTime() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the number of milliseconds this job was (or has been) running for or zero (0) if it hasn't yet started running.
- getRunningTimeAsString() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the time this job was (or has been) running in long form as a human readable string (2 Years, 1 Second, 12 Millisecond) or
nullif it hasn't yet started running. - getRunningTimeAsString() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the time this job was (or has been) running in long form as a human readable string (2 Years, 1 Second, 12 Millisecond) or
nullif it hasn't yet started running. - getRunningTimeAsString() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the time this job was (or has been) running in long form as a human readable string (2 Years, 1 Second, 12 Millisecond) or
nullif it hasn't yet started running. - getRunningTimeAsString(boolean) - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the time this job was (or has been) running as a human readable string in long form (2 Years, 1 Second, 12 Millisecond) or short form (2y 1s 12ms) or
nullif it hasn't yet started running. - getRunningTimeAsString(boolean) - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the time this job was (or has been) running as a human readable string in long form (2 Years, 1 Second, 12 Millisecond) or short form (2y 1s 12ms) or
nullif it hasn't yet started running. - getRunningTimeAsString(boolean) - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the time this job was (or has been) running as a human readable string in long form (2 Years, 1 Second, 12 Millisecond) or short form (2y 1s 12ms) or
nullif it hasn't yet started running. - getRunThread() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the thread currently executing this job or
nullif the job is not running. - getRunThread() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the thread currently executing this job or
nullif the job is not running. - getRunThread() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the thread currently executing this job or
nullif the job is not running. - getSalesOrders(ShopifyOrder, int, String) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- getSalesOrders(ShopifyOrder, Integer, String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Returns a page of orders whose
nextfield holds the cursor of the following page, if any. - getSampleValue() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the first non-null value added to this column, as a string.
- getScale() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Returns the number of digits to the right of the decimal point (0 where not applicable).
- getScale() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
-
Returns the number of fraction digits.
- getScale() - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
The optional numeric scale -- currently unused.
- getScale() - Method in class com.northconcepts.datapipeline.group.operation.GroupAverage
-
Returns the number of decimal places in the average (defaults to 5).
- getScale() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns the column scale.
- getScale() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Returns the scale written after the length, or null for none; ignored unless the type supports it and a length is set.
- getScale() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Returns the scale written after the length, or null for none; ignored unless the type supports it and a length is set.
- getSchema() - Method in class com.northconcepts.datapipeline.avro.AvroReader
-
Returns the Avro schema of the data being read or null if the reader has not been opened.
- getSchema() - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- getSchema() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Indicates the schema used to read the file.
- getSchema() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Indicates the schema used to read the file.
- getSchema() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the schema used to write the file.
- getSchema() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Returns the schema used to write the file.
- getSchema() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates the schema used to read the file.
- getSchema() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Returns the schema used to write the file.
- getSchema() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Indicates the schema used to read the file.
- getSchema() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Returns the schema used to write the file.
- getSchemaDef() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
The parent schema this entity belongs to.
- getSchemaDef() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getSchemaDef() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The schema of the parent entity containing this field.
- getSchemaDef() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
The schema of the parent entity containing this field.
- getSchemaDef() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
The schema of the parent entity containing this field.
- getSchemaDef() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- getSchemaDef() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaPart
-
Returns the schema containing this part (itself for a
SchemaDef) or null if the part is not in a schema. - getSchemaDef() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Returns provided
CreateH2DdlFromSchemaDef.schemaDef. - getSchemaDef() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Returns provided
CreateMySqlDdlFromSchemaDef.schemaDef. - getSchemaDef() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Returns provided
CreatePostgreSqlDdlFromSchemaDef.schemaDef. - getSchemaDef(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Returns the schema of the entity containing this field; if either is missing, throws a
DataExceptionwhenthrowExceptionis true and returns null otherwise. - getSchemaDef(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the schema of the entity containing this index; if either is missing, throws a
DataExceptionwhenthrowExceptionis true and returns null otherwise. - getSchemaDef(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Returns the schema of the index's entity; if the index, entity or schema is missing, throws a
DataExceptionwhenthrowExceptionis true and returns null otherwise. - getSchemaName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- getSchemaName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcSchema
- getSchemaName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- getSchemaName() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaPart
-
Returns the name of the schema containing this part or null if it is not in a schema.
- getSchemaPart() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaProblem
- getSchemaPartContainer() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- getSchemaPartContainer() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getSchemaPartContainer() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- getSchemaPartContainer() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- getSchemaPartContainer() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- getSchemaPartContainer() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- getSchemaPartContainer() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaPart
-
Returns the schema part containing this one or null if there is none.
- getSchemaPartContainerName() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaPart
-
Returns the name of the
containing partor null if there is none. - getSchemaPartContainerType() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaPart
-
Returns the type of the
containing partor null if there is none. - getSchemaPartName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- getSchemaPartName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getSchemaPartName() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- getSchemaPartName() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- getSchemaPartName() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- getSchemaPartName() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- getSchemaPartName() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaPart
-
Returns the name identifying this part, such as an entity's name or an index field's field name.
- getSchemaPartType() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- getSchemaPartType() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getSchemaPartType() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- getSchemaPartType() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- getSchemaPartType() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- getSchemaPartType() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- getSchemaPartType() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaPart
-
Returns the kind of part this is, such as
SchemaPartType.ENTITY. - getSchemaPattern() - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Returns the schema name pattern (
%and_wildcards); null (the default) does not filter by schema. - getSchemaProblems() - Method in interface com.northconcepts.datapipeline.foundations.schema.SchemaProblemsSupplier
-
Returns the problems found in this element without checking its children.
- getSchemaProblems(boolean) - Method in interface com.northconcepts.datapipeline.foundations.schema.SchemaProblemsSupplier
-
Returns a new list with this element's problems, plus those of its children when
includeChildrenis true. - getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in interface com.northconcepts.datapipeline.foundations.schema.SchemaProblemsSupplier
-
Adds this element's problems to the list, plus those of its children when
includeChildrenis true; the default adds none. - getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- getSchemaProblems(List<SchemaProblem>, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- getSchemas() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the database's schemas, as filled by
JdbcConnection.loadCatalogAndSchemas(). - getSearchTerm() - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Returns the criteria selecting which messages are read or null to read every message in the folder.
- getSegmentRule() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetPattern
-
Returns the rule that the middle segment of a matching name must satisfy.
- getSegmentRules() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.AffixSiblingSetRule
-
Returns the editable list of rules, tried in order, that classify the varying middle segment of sibling names.
- getSelection() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Returns the SELECT column list (never
null). - getSelects() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- getSelfTime() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the total time in milliseconds this endpoint spent reading (inside
DataReader.read()) or writing (insideDataWriter.write(Record)) minus the elapsed time from nested endpoints if the captureElapsedTime flag is set (Endpoint.setCaptureElapsedTime(boolean)was called with true). - getSelfTimeAsString() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Returns the total time (as a human readable string) this endpoint spent reading (inside
DataReader.read()) or writing (insideDataWriter.write(Record)) minus the elapsed time from nested endpoints if the captureElapsedTime flag is set (Endpoint.setCaptureElapsedTime(boolean)was called with true). - getSeparator() - Method in class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.RenamePolicy
- getSequence() - Method in class com.northconcepts.datapipeline.eventbus.Event
-
Returns the 1-based order in which this event was published on its bus or 0 if it has not been published.
- getSequenceCount() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
-
Deprecated.use
SequenceWriter.getSequencesStarted()instead The number of sequences created by this writer (alias forSequenceWriter.getSequencesStarted()). - getSequencesFinished() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
-
Returns the number of sequences that have ended, including the last one once this writer is closed.
- getSequencesStarted() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
-
Returns the number of sequences (nested writers) created so far.
- getSequenceWriter() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
- getSession() - Method in class com.northconcepts.datapipeline.jms.JmsConnection
-
Returns the JMS session or null before
JmsConnection.open()is called. - getSessionProperty(Class<T>) - Method in class com.northconcepts.datapipeline.core.Node
-
Returns the session property value associated with the given type.
- getSessionProperty(Class<T>) - Method in interface com.northconcepts.datapipeline.core.Session
-
Returns the session property value associated with the given type.
- getSessionProperty(Class<T>) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- getSessionProperty(Class<T>, String) - Method in class com.northconcepts.datapipeline.core.Node
-
Returns the session property value associated with the given type and name combination.
- getSessionProperty(Class<T>, String) - Method in interface com.northconcepts.datapipeline.core.Session
-
Returns the session property value associated with the given type and name combination.
- getSessionProperty(Class<T>, String) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- getSessionProperty(String) - Method in class com.northconcepts.datapipeline.core.Node
-
Returns the session property value associated with the given name.
- getSessionProperty(String) - Method in interface com.northconcepts.datapipeline.core.Session
-
Returns the session property value associated with the given name.
- getSessionProperty(String) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- getSetterMethod() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the bean setter name for this column, e.g.
- getSettings() - Method in class com.northconcepts.datapipeline.jms.JmsReader
- getSettings() - Method in class com.northconcepts.datapipeline.jms.JmsWriter
- getSheet() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- getSheetIndex() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Returns the 0-based index of the sheet to read when no sheet name is set (defaults to 0).
- getSheetIndex() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Returns the 0-based index of the sheet to write when no sheet name is set, or the position of a newly created sheet (default is -1, the end).
- getSheetIndex() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Returns the 0-based index of the sheet to read when no sheet name is set (defaults to 0).
- getSheetIndex() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Returns the 0-based index of the sheet to write (defaults to -1, a new sheet at the end).
- getSheetIndex() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getSheetIndex() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- getSheetIndex() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- getSheetName() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Returns the name of the sheet to read; when set, it is used instead of the sheet index (default is null).
- getSheetName() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Returns the name of the sheet to write, reusing an existing sheet by that name or creating it (default is null).
- getSheetName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Returns the name of the sheet to read; when blank, the sheet at
ExcelPipelineInput.getSheetIndex()is read (defaults to null). - getSheetName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Returns the name of the sheet to write or blank to use a generated name (defaults to null).
- getSheetName() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getSheetName() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- getSheetName() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- getSheetNames() - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
-
Returns the workbook's sheet names in order, or null with the
ExcelDocument.ProviderType.POI_XSSFBprovider. - getSheetNames() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- getSheetNames() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- getSheetNames() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- getSheetNames() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Titles of every sheet in position order; loaded by
GoogleSheetDocument.open(String). - getShippingAddress() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getShortLiteral(short) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- getShutdownTimeout() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the time in milliseconds this bus will wait for events to complete before forcibly shutting down (defaults to 30 seconds).
- getShutdownTimeoutAsString() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns time as human readable string this bus will wait for events to complete before forcibly shutting down (defaults to 30 seconds).
- getSimpleName() - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns the name (or number/index) of the last segment in this path as a string.
- getSince() - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
-
Returns the date sent to Trello as the
sinceparameter, or null if none (the default). - getSinceId() - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
-
Searches for tweets with IDs greater than the specified ID (i.e.
- getSinceId() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Returns the
sinceIdsearch criteria. - getSingleValue(FieldPath, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the
SingleValueat the specifiedFieldPath, optionally creating intermediate fields. - getSingleValue(Record, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns the
SingleValueat this path (a field's value or an array element), handlingcreateandthrowExceptionlikeFieldPath.getField(Record, boolean, boolean). - getSink() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Returns the readers created by
DeMux.createReader(), which receive the source's records. - getSize() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectSummary
-
Returns the object's size in bytes, or 0 if the listing did not report one.
- getSize() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Returns the column's maximum width in characters (the JDBC display size).
- getSize() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the column size: the precision for numbers, the length in characters for text and in bytes for binary data.
- getSizeInBytes() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the estimated size of this value node in bytes, including object overhead.
- getSizeInBytes() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- getSizeInBytes() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns the estimated size of this field in bytes, including object overhead and value size.
- getSizeInBytes() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the estimated size of this value node in bytes, including object overhead.
- getSizeInBytes() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns the estimated memory used by this list in bytes, counting the first record's field names once for all records.
- getSizeInBytes() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the estimated size of this value node in bytes, including object overhead.
- getSizeInBytes() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns the estimated size of this value node in bytes, including object overhead.
- getSizeInBytes(ValueNode<?>) - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns the estimated size in bytes of the given value as this type, summing the elements of an array value.
- getSizeInBytesImpl(Object) - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns the estimated size in bytes of a single non-array value for
FieldType.getSizeInBytes(ValueNode); defaults toFieldType.getMinimumSizeInBytes(). - getSizeInBytesOfFieldNames() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the estimated total size of all field names in bytes, including object overhead.
- getSizeOfNameInBytes() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns the estimated size of this field's name in bytes, including object overhead.
- getSku() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- getSnapshot() - Method in class com.northconcepts.datapipeline.memory.TailProxyReader
-
Returns a new list of the most recent records (the same instances, not copies); safe to call while records flow.
- getSnapshot() - Method in class com.northconcepts.datapipeline.memory.TailWriter
-
Returns a new list of the most recent records (the same instances, not copies); safe to call while records flow.
- getSortDirection() - Method in class com.northconcepts.datapipeline.jira.JiraProjectReader
-
Returns the direction applied to the order-by field (defaults to
JiraProjectReader.SortDirection.DEFAULT). - getSource() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
- getSource() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
- getSource() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the source record, which a
DataMappingonly sets when it has a source entity. - getSource() - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
- getSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction.FieldMapping
- getSource() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction.FieldMapping
- getSource() - Method in class com.northconcepts.datapipeline.json.builder.JsonExpression
- getSource() - Method in class com.northconcepts.datapipeline.json.builder.JsonLogicalExpression
- getSource() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
- getSource() - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
-
Returns the package line, the sorted imports and the code body; closes the source writer, so call it once all code is written.
- getSource() - Method in class com.northconcepts.datapipeline.xml.builder.XmlExpression
- getSource() - Method in class com.northconcepts.datapipeline.xml.builder.XmlLogicalExpression
- getSourceAsJson() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- getSourceEntity() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
The schema entity used to convert and validate incoming data before this mapping is performed (default
null). - getSourceEntity() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Returns the schema entity used to convert and validate records read from the input, before any processing, or null if none.
- getSourceEntityResult() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the result of validating the source record against the mapping's source entity, or null if it was not validated.
- getSourceExpression() - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- getSourceExpressionAsString() - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- getSourceFieldName() - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Returns the field this operation reads as a string or null if it reads none (as when counting records).
- getSourceFieldName() - Method in class com.northconcepts.datapipeline.transform.CopyField
- getSourceFieldPath() - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Returns the field this operation reads or null if it reads none (as when counting records).
- getSourceString() - Method in interface com.northconcepts.datapipeline.expression.ASTNode
-
Returns the source code for this node and its descendants in the syntax tree.
- getSourceString() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Returns the code written so far; only supported by writers created with the no-argument constructor.
- getSourceType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- getSourceType() - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcSource
- getSourceType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- getSourceWriter() - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
-
Returns the writer for the code body, which
JavaCodeBuilder.getSource()places after the package and import lines. - getSpreadsheetId() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getSpreadsheetUrl() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getSprints(int, int, int, String) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
-
Returns a page of the board's sprints as JSON; a null
stateomits the state filter. - getSprintState() - Method in class com.northconcepts.datapipeline.jira.JiraSprintReader
-
Indicates the state to filter sprints on (default is ACTIVE).
- getSqlFragment() - Method in enum class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria.CriteriaType
- getSqlFragment() - Method in class com.northconcepts.datapipeline.jdbc.sql.SqlPart
-
Returns this part's SQL, formatted as set by
SqlPart.setPretty(boolean), with trailing whitespace removed. - getSqlFragment() - Method in enum class com.northconcepts.datapipeline.sql.h2.ForeignKeyAction
-
Returns the SQL fragment representation of this action.
- getSqlFragment() - Method in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
-
Returns the SQL fragment representation of this column type.
- getSqlFragment() - Method in enum class com.northconcepts.datapipeline.sql.mysql.ForeignKeyAction
-
Returns the action as written in SQL, with spaces for underscores (e.g.
- getSqlFragment() - Method in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
-
Returns the type as written in SQL: the lowercase name with spaces for underscores (e.g.
- getSqlFragment() - Method in enum class com.northconcepts.datapipeline.sql.postgresql.ForeignKeyAction
-
Returns the action as written in SQL, with spaces for underscores (e.g.
- getSqlFragment() - Method in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
-
Returns the type as written in SQL: the lowercase name with spaces for underscores (e.g.
- getSqlFragment(List<Object>) - Method in interface com.northconcepts.datapipeline.jdbc.sql.merge.IMergeUsing
-
Returns the USING clause, ending with a space, for the values added with
Merge.addValue(Object). - getSqlOrderBy(String) - Static method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns an ORDER BY clause (with a leading space) for the column, descending if its name starts with
-, or an empty string if it is empty; the name is not quoted or escaped. - getSqlToJavaTypeMapper() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the strategy that picks each column's Java type from its SQL type (defaults to
JdbcValueReader.OPINIONATED). - getSqlType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Returns the column's
java.sql.Typescode. - getSqlType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
-
Returns the
java.sql.Typescode used to bind the example value, or null to let the driver infer it. - getSqlTypeIndex() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
SQL type from
Types - getSqlTypeName() - Method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Returns the SQL type used for this type's values in generated SQL, or null for
EXPRESSION. - getSqlValueLiteral(Field) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Returns the field's value as a SQL literal (
nullfor null fields), delegating to the literal method for its type. - getSqlValueLiteral(Field) - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Returns the SQL literal written for a field's value:
null, a quoted string, a number,TRUE/FALSE, a JDBC escape such as{d '...'}for dates and times, a JSON string for records, orX'...'for blobs. - getSqlValueLiteral(Field) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
-
Returns the SQL literal written for a field's value:
null, a quoted string, a number,TRUE/FALSE, a JDBC escape such as{d '...'}for dates and times, a JSON string for records, orX'...'for blobs. - getSqlValueLiteral(Field) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
-
Returns the SQL literal written for a field's value:
null, a quoted string, a number,TRUE/FALSE, a JDBC escape such as{d '...'}for dates and times,'...'::jsonbfor records, or a hexbyteastring for blobs. - getStacktrace() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
-
Returns the stack trace of the exception behind this error (set for mapping failures) or null if there was none.
- getStackTrace() - Method in class com.northconcepts.datapipeline.core.Message
-
Returns the exception, or the
Throwablecaptured at creation, whose stack trace belongs to this message; null if none. - getStart() - Method in class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
- getStart() - Method in class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
- getStart() - Method in class com.northconcepts.datapipeline.transform.SetSequenceNumberField
- getStartDate() - Method in class com.northconcepts.datapipeline.twitter2.TwitterSearchReader
-
Indicates the oldest UTC timestamp search criteria.
- getStartDate() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Indicates the oldest UTC timestamp search criteria.
- getStarted() - Method in class com.northconcepts.datapipeline.meter.Meter
-
Returns the time (milliseconds since the epoch) the meter was created or last reset.
- getStartedOn() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the time this job instance started running.
- getStartedOn() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the time this job instance started running.
- getStartedOn() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the time this job instance started running.
- getStartingColumn() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Returns the 0-based index of the first column read; earlier columns are skipped (defaults to 0).
- getStartingColumn() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Returns the 0-based index of the first column to read (defaults to 0).
- getStartingColumn() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- getStartingOffset() - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
-
Returns the cursor of the first page requested (defaults to
TwitterPageableReader.FIRST_PAGE). - getStartingQuote() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Returns the string used to mark the beginning of text values that may contain commas and other special characters (defaults to double quote - ").
- getStartingQuote() - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Returns the string used to mark the beginning of text values that may contain commas and other special characters (defaults to double quote - ").
- getStartingQuote() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Returns the string that starts a quoted value (defaults to a double quote).
- getStartingQuote() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Returns the string that starts a quoted value (defaults to a double quote).
- getStartingRecordCount() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
-
Returns the writer's total record count when this sequence started.
- getStartingRow() - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Returns the 0-based index of the first row to read; earlier rows are skipped when the reader is opened (default is 0).
- getStartingRow() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Returns the 0-based index of the first row to read (defaults to 0).
- getStartTime() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
-
Returns when this sequence started, in milliseconds since the epoch.
- getState() - Method in class com.northconcepts.datapipeline.core.Endpoint
- getState() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the current lifecycle state of this record.
- getState() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the current state of this bus.
- getStatement() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConditionPart
- getStats() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getStatsFile() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Returns the file holding the serialized column stats.
- getStatsTableName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Gets the name of the statistics table in the database.
- getStatus() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getStatus() - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
-
Returns the status used to filter the requested members or null (the default) to send no status filter.
- getStatus() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getStatusAsCsv() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getStatusIfNew() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getStep() - Method in class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
- getStep() - Method in class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
- getStep() - Method in class com.northconcepts.datapipeline.transform.SetSequenceNumberField
- getStrategy() - Method in class com.northconcepts.datapipeline.core.SequenceWriter
- getStrategy() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
- getStrategy() - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
- getStrategy() - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Returns the retry strategy (default
RetryStrategy.EXPONENTIAL_BACKOFF). - getStrategy() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Returns the retry strategy (default
RetryStrategy.EXPONENTIAL_BACKOFF). - getStrategy() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Returns the retry strategy (default
RetryStrategy.EXPONENTIAL_BACKOFF). - getString(CSVWriter, Record, int, Field, String) - Method in interface com.northconcepts.datapipeline.csv.CSVWriter.IValuePolicy
-
Returns the text written as-is (without quoting or escaping) in place of the null or empty value of the field at the given 0-based index.
- getStringLiteral(String) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Returns the value in single quotes with embedded single quotes doubled; also used for UUID, CHAR and any field type without its own literal method.
- getStructuralSignature(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
-
Returns the node's structural signature: the names of its element and attribute children, looking through JSON
object/arraycontainer nodes to the entries inside them. - getStyleFormats() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Deprecated.use
ExcelPipelineOutput.getDataFormats()instead - getStyleFormats(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Deprecated.use
ExcelPipelineOutput.getDataFormats(boolean)instead - getSubscriberHash() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
-
Returns the subscriber hash of this member's email address; see
ListMember.getSubscriberHash(String). - getSubscriberHash(String) - Static method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
-
Returns the MD5 hash (upper-case hex) of the lower-cased email address or the address itself if it is null or blank.
- getSuffix() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetPattern
- getSum(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Returns the current result of
AggregateReader.sum(String)for the field; throws if that operation was not added. - getSuperEntity() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the parent entity this entity inherits from (a superclass in object-oriented programming).
- getSuperEntityName() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the name of the parent entity this entity inherits from (a superclass in object-oriented programming).
- getSupportsCatalogsInDataManipulation() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Indicates if the database accepts catalog names in data manipulation statements; null until
JdbcConnection.loadCatalogAndSchemas()runs. - getSupportsCatalogsInPrivilegeDefinitions() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Indicates if the database accepts catalog names in privilege definition statements; null until
JdbcConnection.loadCatalogAndSchemas()runs. - getSupportsCatalogsInTableDefinitions() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Indicates if the database accepts catalog names in table definition statements; null until
JdbcConnection.loadCatalogAndSchemas()runs. - getSymmetricAlgorithm() - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
-
Returns the algorithm of the symmetric key that encrypted the fields (default is
AES). - getSymmetricAlgorithm() - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Returns the algorithm of the symmetric key that encrypts the fields (default is
AES). - getSymmetricAlgorithm() - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
-
Returns the
Cipheralgorithm used to decrypt, such asAES; required to open the reader. - getSymmetricAlgorithm() - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
-
Returns the
Cipheralgorithm used to encrypt, such asAES; required to open the reader. - getSymmetricKey() - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Returns the symmetric key that encrypts the fields; if none is set, one is generated when the reader opens.
- getSymmetricKey() - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
-
Returns the secret key used to decrypt; required to open the reader.
- getSymmetricKey() - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
-
Returns the secret key used to encrypt; required to open the reader.
- getSymmetricKeyBitLength() - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Returns the size in bits of the symmetric key generated when none is set (default is 128); it must be at least
AsymmetricEncryptingReader.MINIMUM_SYMMETRIC_LENGTH. - getSystemEventBus() - Static method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the shared JVM-wide bus used for lifecycle events; a JVM shutdown hook shuts it down.
- getSystemRegistry() - Static method in class com.northconcepts.datapipeline.security.CredentialsResolverRegistry
-
Returns the shared JVM-wide registry.
- getTable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns the table this key was added to, or null.
- getTable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Returns the table this index was added to, or null.
- getTable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns the table this column was added to, or
null. - getTable() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Deprecated.Use
JdbcPipelineOutput.getTableName()instead. - getTable() - Method in class com.northconcepts.datapipeline.jdbc.sql.delete.Delete
- getTable() - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
- getTable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Join
- getTable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySource
-
Returns the first table in the list of tables.
- getTable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Returns the first table in the list of tables.
- getTable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- getTable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- getTable() - Method in class com.northconcepts.datapipeline.jdbc.sql.update.Update
- getTable() - Method in class com.northconcepts.datapipeline.sql.h2.Insert
-
Returns the table name.
- getTable() - Method in class com.northconcepts.datapipeline.sql.h2.Upsert
-
Returns the table name.
- getTable() - Method in class com.northconcepts.datapipeline.sql.mysql.Insert
- getTable() - Method in class com.northconcepts.datapipeline.sql.mysql.Upsert
- getTable() - Method in class com.northconcepts.datapipeline.sql.postgresql.Insert
- getTable() - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
- getTable(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the first table with the given name, ignoring case and schema, or null if none matches.
- getTable(String, String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the table with the given schema and name, ignoring case, or null; a null schema matches only tables without one.
- getTable(String, String, String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns the table with the given catalog, schema and name, ignoring case, or null; a null or empty catalog never matches.
- getTableCount() - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
-
Returns the number of tables extracted from the document (0 before it is opened or after it is closed).
- getTableIndex() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
-
Returns the 0-based index, counted across the whole document, of the table to read (default is 0).
- getTableIndex() - Method in class com.northconcepts.datapipeline.pdf.PdfReader
-
Returns the 0-based index, counted across the whole document, of the table to read (default is 0).
- getTableName() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- getTableName() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- getTableName() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- getTableName() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- getTableName() - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Returns the table name.
- getTableName() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Returns the table name.
- getTableName() - Method in class com.northconcepts.datapipeline.sql.h2.DropTableConstraint
-
Returns the table name.
- getTableName() - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Returns the table name.
- getTableName() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- getTableName() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
- getTableName() - Method in class com.northconcepts.datapipeline.sql.mysql.DropTableConstraint
- getTableName() - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- getTableName() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- getTableName() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
- getTableName() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- getTableName() - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- getTableNamePattern() - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Returns the table name pattern (
%and_wildcards); defaults to%for all tables. - getTableNames() - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
-
Returns the table names.
- getTableNames() - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
- getTableNames() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
- getTables() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- getTables() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySource
-
Returns the tables this source reads from, including those of nested sources but not joined tables.
- getTables() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- getTables() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- getTables() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- getTablesSorted() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns a list of of tables sorted alphabetically.
- getTablesSortedTopologically() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Returns a list of of tables sorted alphabetically, but with dependencies first.
- getTagName() - Method in class com.northconcepts.datapipeline.instagram.InstagramTagMediaReader
- getTagName() - Method in class com.northconcepts.datapipeline.instagram.InstagramTagReader
- getTags() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
The set of labels used to organize, filter, and classify this entity.
- getTags() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
The set of labels used to organize, filter, and classify this entityRelationShip.
- getTags() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The set of labels used to organize, filter, and classify this field.
- getTags() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
The set of labels used to organize, filter, and classify this schema.
- getTags() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getTagsCount() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getTarget() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Returns all of the mapped and sorted data.
- getTarget() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
- getTarget() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the mapped record, or null if a condition or the source entity validation failed.
- getTarget() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction.FieldMapping
- getTarget() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction.FieldMapping
- getTarget() - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
- getTarget() - Method in class com.northconcepts.datapipeline.jira.client.JiraClient.JiraStub
- getTarget() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyClient.ShopifyStub
- getTargetAsJson() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- getTargetEntity() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
The schema entity used to convert and validate outgoing data after this mapping is performed (default
null). - getTargetEntity() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Returns the schema entity used to convert and validate records after processing, before they are written, or null if none.
- getTargetEntityResult() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Returns the result of validating the target record against the mapping's target entity, or null if it was not validated.
- getTargetFieldName() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- getTargetFieldName() - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Returns the summary record field this operation writes to as a string; defaults to the source field.
- getTargetFieldName() - Method in class com.northconcepts.datapipeline.transform.CopyField
- getTargetFieldPath() - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Returns the summary record field this operation writes to; defaults to the source field.
- getTargetPage() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Returns the mapped records on the current page (
DataMappingEditor.PAGE_SIZEper page), or an empty list before a mapping is applied. - getTargets() - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
-
Returns the readers created by
SplitWriter.createReader(), which receive the records written to this splitter. - getTargetSchema() - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- getTargetValidationEntity() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Deprecated.
- getTargetValidationResult() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Deprecated.
- getTask() - Method in class com.northconcepts.datapipeline.core.AsyncTaskReader
- getTaskCount() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the approximate total number of tasks that have ever been scheduled for execution by this bus' executorService or -1 if unknown.
- getTemporalAccessor() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternMatch
-
Deprecated.use
DateTimePatternMatch.getValue()instead. - getTemporalFieldTypeCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of distinct temporal field types matched.
- getTemporalFieldTypes() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of string values that matched a pattern of each temporal field type.
- getTemporalPatternCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of distinct date/time patterns matched.
- getTemporalPatterns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of string values that matched each date/time pattern.
- getText() - Method in class com.northconcepts.datapipeline.xml.builder.XmlText
- getTextBytes() - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
-
Returns the total size in bytes of the text extracted from all pages, encoded with the platform default charset.
- getThread() - Method in class com.northconcepts.datapipeline.core.Message
-
Returns the name of the thread that created this message.
- getThread() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Returns the thread running the feeder or
nullif it is not running. - getThreads() - Method in class com.northconcepts.datapipeline.core.AsyncTaskReader
- getThrottle() - Method in interface com.northconcepts.datapipeline.throttle.Throttled
- getThrottle() - Method in class com.northconcepts.datapipeline.throttle.ThrottledInputStream
- getThrottle() - Method in class com.northconcepts.datapipeline.throttle.ThrottledOutputStream
- getThrottle() - Method in class com.northconcepts.datapipeline.throttle.ThrottledReader
- getThrottle() - Method in class com.northconcepts.datapipeline.throttle.ThrottledWriter
- getTimeLiteral(Time) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Returns the value as a JDBC time escape,
{t 'HH:mm:ss.SSS'}. - getTimeMax() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- getTimeMin() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- getTimestamp() - Method in class com.northconcepts.datapipeline.core.Message
-
Returns the time this message was created.
- getTimestampOpt() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getTimestampOptObject() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
-
Returns
ListMember.getTimestampOpt()parsed as an ISO-8601OffsetDateTimeor null if it is blank. - getTimestampSignup() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getTimeToLiveMilliseconds() - Method in class com.northconcepts.datapipeline.security.CachingCredentialsResolver
-
Returns the maximum time cached credentials are reused before being re-fetched, in milliseconds (zero for no time-to-live); they are re-fetched sooner once they report expiry within
CachingCredentialsResolver.getExpirySkewMilliseconds(). - getTimezone() - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- getTitle() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getToken() - Method in class com.northconcepts.datapipeline.instagram.InstagramMediaReader
-
Returns the jInstagram token built from the access token and client secret.
- getToken() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfReader
-
Returns the jInstagram token built from the access token and client secret.
- getTopic() - Method in class com.northconcepts.datapipeline.eventbus.Event
-
Returns the topic the publisher was created with or
nullif it has none. - getTopic() - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
- getTopicFieldName() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Returns the field name used to add the delivery topic to each record or
nullif the topic should not be added to records (defaults tonull). - getTopics() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Returns the topics to read records for; empty or
nullmeans all topics. - getTotal() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
-
Returns the total number of rows across all pages.
- getTotalFailedRecordCount() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
-
Returns total failed record count during mapping.
- getTotalItems() - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Returns the number of items fetched so far, or -1 before the first page is fetched.
- getTotalItems() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- getTotalPages() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
-
Returns the number of pages needed for the total rows at this page size, rounded up.
- getTotalRecordCount() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
-
The number of records written to all sequences, including the current.
- getTrack() - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
-
Returns the keywords the stream is filtered by.
- getTracked() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- getTransformers() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Returns the editable list of passes that
TreeDetectionStrategy.apply(Tree)runs, in order. - getTransition() - Method in class com.northconcepts.datapipeline.jira.JiraIssue
-
Returns the transition to perform as a record holding its
id, or null if none was set. - getTransport() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getTwitter() - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
- getTwitterStream() - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Returns the stream, creating it on first use with the configured credentials and proxy.
- getType() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns
ArrayValue.defaultTypeif there are no elements, theFieldTypematching all elements if they are the same orFieldType.UNDEFINEDif elements contain multiple types. - getType() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns the
FieldTypeof this field's value. - getType() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the
FieldTypeof this value node. - getType() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the
FieldTypeof this value node. - getType() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns the
FieldTypeof this value node. - getType() - Method in class com.northconcepts.datapipeline.eventbus.TypedListenerList
- getType() - Method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
-
Gets the type of this hyperlink.
- getType() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
-
Returns the type the field's value is converted to, or null to keep the mapped value as is.
- getType() - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- getType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Returns the index type as a
DatabaseMetaDatacode:tableIndexStatistic,tableIndexClustered,tableIndexHashedortableIndexOther. - getType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns the table type reported by the database, such as
TABLEorVIEW. - getType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
-
Returns the kind of value (date-time, date or time) the strings are parsed into, or null if not set.
- getType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
-
Returns the number type the values are parsed into, or null if not set.
- getType() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.TypeValue
- getType() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The data type of this field.
- getType() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
Returns the clause this criteria renders as, WHERE (the default) or HAVING.
- getType() - Method in class com.northconcepts.datapipeline.jms.JmsSettings
- getType() - Method in class com.northconcepts.datapipeline.json.builder.JsonArray
- getType() - Method in class com.northconcepts.datapipeline.json.builder.JsonField
- getType() - Method in class com.northconcepts.datapipeline.json.builder.JsonFragment
- getType() - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Returns the kind of JSON this node represents, which determines the child nodes it accepts.
- getType() - Method in class com.northconcepts.datapipeline.json.builder.JsonObject
- getType() - Method in class com.northconcepts.datapipeline.json.builder.JsonPrimitive
- getType() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns the column type.
- getType() - Method in class com.northconcepts.datapipeline.sql.h2.TableColumn
-
Returns the column type.
- getType() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- getType() - Method in class com.northconcepts.datapipeline.sql.mysql.TableColumn
- getType() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- getTypedListenerCount() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the number of type-specific listeners subscribed to this bus.
- getTypedListenerList(Class<T>) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the listeners registered for the given listener interface or
nullif none has been added for it. - getTypeImpl(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
- getTypes() - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Returns the table types to load, such as
TABLEorVIEW; null (the default) loads all types. - getUndoneActionCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- getUndoneActions() - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
-
Returns a read-only view of the actions removed by
Pipeline.undoLastAction()that can still be redone. - getUniqueEmailId() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getUniqueImages() - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
-
Returns the number of distinct images, identified by their page resource name and file suffix.
- getUniqueRecordCount() - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Returns the number of unique records that have been read.
- getUniqueValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of distinct values seen, which are tracked only when the dataset collects unique values.
- getUniqueValues() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns how often each distinct value occurred, with null keyed as
"null". - getUniqueValuesByCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the entries of
Column.getUniqueValues()sorted by count, most frequent first. - getUnitsPerSecond() - Method in class com.northconcepts.datapipeline.meter.Meter
-
Returns units per second.
- getUnitsPerSecond() - Method in class com.northconcepts.datapipeline.throttle.Throttle
-
Returns the maximum average rate, in the meter's units per second, that
Throttle.throttle()enforces. - getUnitsPerSecondAsString() - Method in class com.northconcepts.datapipeline.meter.Meter
-
Returns the rate as a human readable string scaled by powers of 1000, such as
12.5 kilo-units/s. - getUnitsPerSecondAsString() - Method in class com.northconcepts.datapipeline.meter.RecordMeter
- getUnitsPerSecondAsString(String) - Method in class com.northconcepts.datapipeline.meter.Meter
-
Returns the rate as a human readable string using the given unit name (
unitsif null), such as12.5 kilo-bytes/s. - getUntilId() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Returns the
untilIdsearch criteria. - getUntypedEventListenerCount() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the number of non-type-specific listeners subscribed to this bus.
- getUntypedListenerCount() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Deprecated.Use
EventBus.getUntypedEventListenerCount()instead. - getUpdatedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- getUpdatedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getUpdatedAtMax() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getUpdatedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- getUpdatedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryLevelCriteria
- getUpdatedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- getUpdatedAtMin() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getUpdatedMin() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- getUpdatedOn() - Method in class com.northconcepts.datapipeline.buffer.RecordBuffer
-
Returns the time (milliseconds since the epoch) the last record was added or 0 if none were.
- getUpdateRule() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns what happens to the foreign key when the referenced primary key is updated, as a
DatabaseMetaDatacode such asimportedKeyCascade. - getUpdateSql() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
-
Returns the generated UPDATE SQL or
nullbeforeGenericUpsert.prepare(JdbcUpsertWriter, Record)is called. - getUpdateStatement() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
-
Returns the prepared UPDATE statement or
nullbeforeGenericUpsert.prepare(JdbcUpsertWriter, Record)is called. - getUpsert() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Returns the upsert strategy; each connection's writer uses its own clone.
- getUpsert() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- getUpsert() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert.UpsertStub
- getUpsertSql() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
-
Returns the generated
INSERT ... ON CONFLICTSQL ornullbeforePostgreSqlUpsert.prepare(JdbcUpsertWriter, Record)is called. - getUpsertStatement() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
-
Returns the prepared upsert statement or
nullbeforePostgreSqlUpsert.prepare(JdbcUpsertWriter, Record)is called. - getUrl() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- getUrlPath() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- getUrlPath() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
- getUrlPath() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
- getUrlPath() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Returns the path as a
file://URL, with forward slashes and a leading slash added. - getUrlPath() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- GetUrlQueryParam - Class in com.northconcepts.datapipeline.transform.net
-
Retrieves all query parameter values in a URL for the given name and stores them in the target field.
- GetUrlQueryParam(String, String, String) - Constructor for class com.northconcepts.datapipeline.transform.net.GetUrlQueryParam
-
Creates a transformer that adds each value of the named query parameter (name matched ignoring case, value not URL-decoded) in the URL field to the target field.
- getUseColumnLabel() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Indicates if column labels (or aliases) are used for field names instead of the underlying, real column names (defaults to
false). - getUser() - Method in class com.northconcepts.datapipeline.email.EmailReader
- getUserMessage() - Method in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
-
Returns the short error message for this code.
- getUsername() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- getUsername() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
- getUserName() - Method in class com.northconcepts.datapipeline.instagram.InstagramUserMediaReader
- getUserScreenNameField() - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
- getUserScreenNameField() - Method in class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
- getUserTimelineMentions(String, LocalDateTime, LocalDateTime, String, String, int, String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Returns Tweets mentioning a specific Twitter user.
- getUserTimelineTweets(String, LocalDateTime, LocalDateTime, String, String, int, String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Returns Tweets, Retweets, replies, and Quote Tweets published by a specific Twitter account.
- getUsing() - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
-
Returns the strategy that renders the USING clause or
nullif none is set. - getUuid() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns the universally unique identifier (UUID) for this job.
- getUuid() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns the universally unique identifier (UUID) for this job.
- getUuid() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns the universally unique identifier (UUID) for this job.
- getUuid() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the universally unique identifier (UUID) for this job.
- getValidation() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
-
Returns the entity validation rule that failed (see
EntityDef.addValidation(Filter)) or null for other errors. - getValidationResult() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaTransformer
-
Returns the result for the most recent record; the same instance is cleared and reused for every record.
- getValidations() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
The list of arbitrary validations associated with this entity.
- getValidations(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the validation rules, creating the list if it is null and
createis true. - getValidationsSource() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
The list of
toString()results from all filters. - getValue() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the underlying value held by this node.
- getValue() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns the raw value held by this field, or
nullif the field has no value or is null. - getValue() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the underlying value held by this node.
- getValue() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the underlying value held by this node.
- getValue() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns the underlying value held by this node.
- getValue() - Method in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferMode
-
Returns the Apache Commons Net constant for this mode, as passed to
FTPClient.setFileTransferMode. - getValue() - Method in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferType
-
Returns the Apache Commons Net constant for this type, as passed to
FTPClient.setFileType. - getValue() - Method in class com.northconcepts.datapipeline.filter.rule.Contains
-
Returns the text that field values must contain.
- getValue() - Method in class com.northconcepts.datapipeline.foundations.core.Property
- getValue() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternMatch
-
The parsed value.
- getValue() - Method in class com.northconcepts.datapipeline.group.GroupOperationField
-
Returns the result written to the group's summary record.
- getValue() - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertValue
- getValue() - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.MergeValue
- getValue() - Method in class com.northconcepts.datapipeline.jdbc.sql.update.UpdateValue
- getValue() - Method in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
-
Returns the field name sent to Jira in the
orderByparameter. - getValue() - Method in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.SortDirection
-
Returns the prefix added to the
orderByvalue:+,-or empty. - getValue() - Method in enum class com.northconcepts.datapipeline.jira.JiraSprintReader.SprintState
-
Returns the value sent as the
statefilter, or null forALL. - getValue() - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- getValue() - Method in class com.northconcepts.datapipeline.memory.MapWriter
-
Returns the path of the field whose values become the map's values.
- getValue() - Method in interface com.northconcepts.datapipeline.pdf.PdfWriter.IPageSize
-
Returns the CSS
@pagesize value, such asA4or10in 15in. - getValue() - Method in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageOrientation
-
Returns the CSS
@pageorientation keyword (portraitorlandscape). - getValue() - Method in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- getValue() - Method in class com.northconcepts.datapipeline.sql.h2.InsertValue
-
Returns the value.
- getValue() - Method in class com.northconcepts.datapipeline.sql.mysql.InsertValue
- getValue() - Method in class com.northconcepts.datapipeline.sql.postgresql.InsertValue
- getValue() - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePair
- getValue() - Method in class com.northconcepts.datapipeline.transform.SetField
- getValue() - Method in class com.northconcepts.datapipeline.xml.builder.XmlAttribute
- getValue(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the value at the specified index (for zero or positive indexes) or from the end of the list (for negative indexes by adding index to the size of the list).
- getValue(int) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
-
Returns the value of the attribute at the given 0-based index, in name order.
- getValue(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the value node at the specified
FieldPath. - getValue(FieldPath, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the value node at the specified
FieldPath, optionally creating intermediate fields. - getValue(FieldPath, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the value node at the specified
FieldPath, optionally creating intermediate fields. - getValue(ValueNode<?>, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns the plain value of the node that
FieldPath.getValueNode(ValueNode, boolean, boolean)finds, or null if there is none. - getValue(String) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
-
Returns the named attribute's value, or
nullif it is missing. - getValue(String, T) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
-
Returns the named attribute's value, or
defaultValueif it is missing or null. - getValueAsArray() - Method in class com.northconcepts.datapipeline.core.Field
-
Retrieve the field's value as an
ArrayValue. - getValueAsArray(boolean) - Method in class com.northconcepts.datapipeline.core.Field
-
Retrieve the field's value as an
ArrayValue. - getValueAsArray(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index cast to an
ArrayValue. - getValueAsBigDecimal() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
BigDecimal. - getValueAsBigDecimal() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
BigDecimal. - getValueAsBigDecimal(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
BigDecimal. - getValueAsBigInteger() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
BigInteger. - getValueAsBigInteger() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
BigInteger. - getValueAsBigInteger(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
BigInteger. - getValueAsBoolean() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
boolean. - getValueAsBoolean() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
boolean. - getValueAsBoolean(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
boolean. - getValueAsByte() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
byte. - getValueAsByte() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
byte. - getValueAsByte(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
byte. - getValueAsBytes() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
byte[]. - getValueAsBytes() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
byte[]. - getValueAsBytes(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
byte[]. - getValueAsChar() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
char. - getValueAsChar() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
char. - getValueAsChar(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
char. - getValueAsDate() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
Date. - getValueAsDate() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
Date. - getValueAsDate(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
Date. - getValueAsDatetime() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
Date(datetime). - getValueAsDatetime() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
Date(datetime). - getValueAsDatetime(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
Date(datetime). - getValueAsDouble() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
double. - getValueAsDouble() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
double. - getValueAsDouble(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
double. - getValueAsFloat() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
float. - getValueAsFloat() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
float. - getValueAsFloat(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
float. - getValueAsInstant() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as an
Instant. - getValueAsInstant() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as an
Instant. - getValueAsInstant(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as an
Instant. - getValueAsInteger() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as an
int. - getValueAsInteger() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as an
int. - getValueAsInteger(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as an
int. - getValueAsList(boolean, Class<T>) - Method in class com.northconcepts.datapipeline.core.Field
-
Retrieve the field's value as a
List. - getValueAsList(int, Class<T>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the array element value at the specified index as a
Listwith each element coerced to the specified type. - getValueAsLocalDate() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
LocalDate. - getValueAsLocalDate() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
LocalDate. - getValueAsLocalDate(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
LocalDate. - getValueAsLocalDateTime() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
LocalDateTime. - getValueAsLocalDateTime() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
LocalDateTimeusing the system default time zone. - getValueAsLocalDateTime(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
LocalDateTime. - getValueAsLocalTime() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
LocalTime. - getValueAsLocalTime() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
LocalTime. - getValueAsLocalTime(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
LocalTime. - getValueAsLong() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
long. - getValueAsLong() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
long. - getValueAsLong(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
long. - getValueAsRecord() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value cast to a
Record. - getValueAsRecord(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index cast to a
Record. - getValueAsShort() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
short. - getValueAsShort() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
short. - getValueAsShort(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
short. - getValueAsSingleValue() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value cast to a
SingleValue. - getValueAsSingleValue(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index cast to a
SingleValue. - getValueAsString() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a string representation of the value held by this node.
- getValueAsString() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
String. - getValueAsString() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a string representation of the value held by this node.
- getValueAsString() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns a string representation of the value held by this node.
- getValueAsString() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns a string representation of the value held by this node.
- getValueAsString(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the string representation of the element at the specified index.
- getValueAsTime() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
Time. - getValueAsTime() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
Time. - getValueAsTime(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
Time. - getValueAsUuid() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns this field's value as a
UUID. - getValueAsUuid() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns the value as a
UUID. - getValueAsUuid(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the element at the specified index as a
UUID. - getValueCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns the number of values seen, including nulls; array elements are counted individually.
- getValueImpl(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingExpressionContext
- getValueInputOption() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getValueNode() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns the
ValueNodebacking this field's value, ornullif no value has been set. - getValueNode(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the value node at the specified index (for zero or positive indexes) or from the end of the list (for negative indexes by adding index to the size of the list).
- getValueNode(ValueNode<?>, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns the value (record, array or single value) at this path below the given record or array, handling
createandthrowExceptionlikeFieldPath.getField(Record, boolean, boolean). - getValueOnException() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Returns the value a field receives when transforming it throws, or null if none was set.
- getValueReader() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Returns the strategy that maps column types and reads values (defaults to
JdbcValueReader.OPINIONATED). - getValueRenderOption() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- getValues() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a list of values.
- getValues() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns all the field values in this record as a
List. - getValues() - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- getValues() - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
-
Returns the live list of values to match; changes to it affect this rule.
- getValues() - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.InsertRow
- getValues() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConditionPart
- getValues() - Method in class com.northconcepts.datapipeline.sql.h2.InsertRow
-
Returns the list of insert values for this row.
- getValues() - Method in class com.northconcepts.datapipeline.sql.mysql.InsertRow
- getValues() - Method in class com.northconcepts.datapipeline.sql.postgresql.InsertRow
- getValues() - Method in class com.northconcepts.datapipeline.xml.XmlField
-
Returns the values recorded for this field, each paired with the sequence number of the node it came from.
- getValues(FieldList) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the field values in this record as a
Listfor the fields matching the supplied FieldList. - getValues(Class<T>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a list of values with each element coerced to the supplied type.
- getValuesAsArray() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns all the field values in this record as an
ArrayValue. - getValuesAsArray() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns a multi-dimensional, ArrayValue of ArrayValues of all the values in this list.
- getValuesAsArray(FieldPath, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns an ArrayValue of all the values matching the fieldPath in this list.
- getValuesAsArray(String, boolean, boolean) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns an ArrayValue of all the values matching the fieldPath in this list.
- getValuesAsString() - Method in class com.northconcepts.datapipeline.core.CompositeValue
-
Returns the values as a bracketed, comma-separated list, such as
[a, 1, null]. - getValueStream() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a stream of values.
- getValueStream(Class<T>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a stream of values with each element coerced to the supplied type.
- getVariable() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
-
Returns the variable that
?stands for in the expression. - getVariable() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- getVariable() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- getVariable() - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
-
Returns the name of the expression-context variable that receives the expression's result.
- getVendor() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- getVerb() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- getViewId() - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- getVip() - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- getWhere() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Returns the WHERE criteria (never
null). - getWholeDigits() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- getWholePart() - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
-
Returns the digits before the decimal point, without the minus sign; empty if there are none.
- getWidth() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- getWidth() - Method in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
-
Returns the portrait page width in twips (1/1440 of an inch).
- getWindowsClosed() - Method in class com.northconcepts.datapipeline.group.GroupByReader
- getWindowsCreated() - Method in class com.northconcepts.datapipeline.group.GroupByReader
- getWorkbook() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- getWriter() - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
- getWriter() - Method in class com.northconcepts.datapipeline.core.TextWriter
- getWriter() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the writer supplied to this job.
- getWriter() - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Returns the
TransformingWriterthis transformer was added to or null if none. - getWriter(Class<T>) - Method in class com.northconcepts.datapipeline.core.DataWriter
-
Returns the first
DataWriterof the specified type held inside this one ornullif there isn't one. - getWriter(Class<T>) - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the first writer of the supplied type from the write pipeline.
- getWriters() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns the write pipeline — the chain of writers records pass through, starting with the writer passed to this job and returned by
Job.getWriter()and ending with the root instance. - getWriteStrategy() - Method in class com.northconcepts.datapipeline.core.MultiWriter
-
Returns how records are distributed among the target writers (defaults to
MultiWriter.REPLICATE_CLONE). - getXmlNodeReader() - Method in class com.northconcepts.datapipeline.xml.XmlReader
- getXpathExpression() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- getZip() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- GmailFolders - Interface in com.northconcepts.datapipeline.email
-
Names of the standard Gmail folders, for use with
EmailReader.setFolderName(String). - GmailMessageReader - Class in com.northconcepts.datapipeline.google.gmail
-
Reads Gmail messages, optionally selected by a search query, one record per message with its addresses, headers, flags, content parts and Gmail metadata such as label and thread IDs.
- GmailMessageReader(Credential) - Constructor for class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
-
Creates a reader with its own HTTP transport, which is shut down on close.
- GmailMessageReader(Credential, HttpTransport) - Constructor for class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
-
Creates a reader that uses the caller's transport, which is not shut down on close.
- GOLD - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- GOOGLE_FOLDER_TYPE - Static variable in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
The Google Drive MIME type identifying an entry as a folder rather than a file.
- GoogleAnalyticsReportReader - Class in com.northconcepts.datapipeline.google.analytics
-
Reads a Google Analytics (Reporting API v4) report for a view, one record per report row holding its dimension values followed by its metric values for each date range.
- GoogleAnalyticsReportReader(GoogleCredential, HttpTransport, String) - Constructor for class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
-
Creates a reader for the given view that uses the caller's transport, which is not shut down on close.
- GoogleAnalyticsReportReader(GoogleCredential, String) - Constructor for class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
-
Creates a reader for the given view with its own HTTP transport, which is shut down on close.
- GoogleApiReader - Class in com.northconcepts.datapipeline.google
-
Base class for readers that call Google APIs, holding the OAuth credential, HTTP transport and application name used to build the API client.
- GoogleApiReader(Credential) - Constructor for class com.northconcepts.datapipeline.google.GoogleApiReader
-
Creates a reader with its own trusted HTTP transport, which is shut down when the reader is closed.
- GoogleApiReader(Credential, HttpTransport) - Constructor for class com.northconcepts.datapipeline.google.GoogleApiReader
-
Creates a reader that uses the given transport; the caller remains responsible for shutting it down.
- GoogleCalendarReader - Class in com.northconcepts.datapipeline.google.calendar
-
Reads the events of a Google Calendar, one record per event with its details, attendees, attachments, conference data and calendar properties.
- GoogleCalendarReader(Credential, HttpTransport) - Constructor for class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Creates a reader that uses the caller's transport, which is not shut down on close.
- GoogleContactsReader - Class in com.northconcepts.datapipeline.google.contacts
-
Reads a Google account's contacts through the People API, one record per person with their names, email addresses, phone numbers, addresses and other details.
- GoogleContactsReader(Credential, HttpTransport) - Constructor for class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
-
Creates a reader that uses the caller's transport, which is not shut down on close.
- GoogleDriveFileSystem - Class in com.northconcepts.datapipeline.googledrive
-
A
FileSystemthat reads and writes files stored in Google Drive. - GoogleDriveFileSystem(String) - Constructor for class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Enables access to Google Drive with an OAuth access token supplied through a
CredentialsResolver(seeGoogleDriveFileSystem.setCredentialsResolver(CredentialsResolver)) — no client secrets, credentials folder, or interactive authorization required. - GoogleDriveFileSystem(String, String, InputStream, File) - Constructor for class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Enables access to Google Drive.
- GoogleSheetDocument - Class in com.northconcepts.datapipeline.google.sheets
-
A Google Sheets spreadsheet shared by
GoogleSheetReaderandGoogleSheetWriter. - GoogleSheetDocument(Credential) - Constructor for class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Creates a trusted transport that
GoogleSheetDocument.close()shuts down. - GoogleSheetDocument(Credential, HttpTransport) - Constructor for class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
The transport stays owned by the caller and is not shut down by
GoogleSheetDocument.close(). - GoogleSheetReader - Class in com.northconcepts.datapipeline.google.sheets
-
Reads records from one sheet, or one range, of a Google Sheets spreadsheet opened as a
GoogleSheetDocument; the sheet is the one the range names, else the named sheet, else the sheet at the index. - GoogleSheetReader(GoogleSheetDocument) - Constructor for class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
-
Creates a reader for the given document, which must be opened by the caller and is not closed by this reader unless
GoogleSheetReader.setAutoCloseDocument(boolean)is enabled. - GoogleSheetWriter - Class in com.northconcepts.datapipeline.google.sheets
-
Writes records to one sheet of a Google Sheets spreadsheet opened as a
GoogleSheetDocument, creating the sheet when its name is new and clearing the target block first. - GoogleSheetWriter(GoogleSheetDocument) - Constructor for class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Creates a writer for the given document, which must be opened by the caller and is not closed by this writer unless
GoogleSheetWriter.setAutoCloseDocument(boolean)is enabled. - GREEN - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- GREY_25_PERCENT - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- GREY_40_PERCENT - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- GREY_50_PERCENT - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- GREY_80_PERCENT - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- group - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- GroupAverage - Class in com.northconcepts.datapipeline.group.operation
-
A
GroupOperationthat averages the source field in each group as aBigDecimal; unlessexcludeNullsis set, null values count as zero. - GroupAverage(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupAverage
- GroupAverage(FieldPath, FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupAverage
- GroupAverage(FieldPath, FieldPath, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupAverage
- GroupAverage(String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupAverage
- GroupAverage(String, String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupAverage
- GroupAverage(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupAverage
- groupBy(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- GROUPBY - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
- GroupByField(String, String, AggregateGroupFieldsAction.OperatorType, boolean) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.GroupByField
-
Creates a field whose target name defaults to the source name when blank.
- GroupByReader - Class in com.northconcepts.datapipeline.group
-
A proxy that divides records into groups and applies summary operations to each group; similar to "group by" in SQL, but applied to streaming data.
- GroupByReader(DataReader, int, FieldList) - Constructor for class com.northconcepts.datapipeline.group.GroupByReader
-
Creates a reader that groups records by the given fields; the source is read on a background thread that buffers up to
queueSizerecords. - GroupByReader(DataReader, int, String...) - Constructor for class com.northconcepts.datapipeline.group.GroupByReader
-
Creates a reader that groups records by the given fields; the source is read on a background thread that buffers up to
queueSizerecords. - GroupByReader(DataReader, FieldList) - Constructor for class com.northconcepts.datapipeline.group.GroupByReader
-
Creates a reader that groups records by the given fields; the source is read on a background thread that buffers up to 100 records.
- GroupByReader(DataReader, String...) - Constructor for class com.northconcepts.datapipeline.group.GroupByReader
-
Creates a reader that groups records by the given fields; the source is read on a background thread that buffers up to 100 records.
- GroupCollect - Class in com.northconcepts.datapipeline.group.operation
-
Collects the individual values into an array.
- GroupCollect(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Creates a GroupCollect operation for the specified source field path.
- GroupCollect(FieldPath, FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Creates a GroupCollect operation with source and target field paths.
- GroupCollect(FieldPath, FieldPath, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Creates a GroupCollect operation with source and target field paths and null exclusion option.
- GroupCollect(String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Creates a GroupCollect operation for the specified source field.
- GroupCollect(String, String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Creates a GroupCollect operation with source and target field names.
- GroupCollect(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Creates a GroupCollect operation with source and target field names and null exclusion option.
- GroupCount - Class in com.northconcepts.datapipeline.group.operation
-
A
GroupOperationthat counts the records in each group. - GroupCount(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupCount
- GroupCount(String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupCount
- GroupFirst - Class in com.northconcepts.datapipeline.group.operation
-
A
GroupOperationthat returns the first value of the source field in each group (the first non-null value whenexcludeNullsis set). - GroupFirst(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupFirst
- GroupFirst(FieldPath, FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupFirst
- GroupFirst(FieldPath, FieldPath, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupFirst
- GroupFirst(String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupFirst
- GroupFirst(String, String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupFirst
- GroupFirst(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupFirst
- GroupLast - Class in com.northconcepts.datapipeline.group.operation
-
A
GroupOperationthat returns the last value of the source field in each group (the last non-null value whenexcludeNullsis set). - GroupLast(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupLast
- GroupLast(FieldPath, FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupLast
- GroupLast(FieldPath, FieldPath, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupLast
- GroupLast(String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupLast
- GroupLast(String, String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupLast
- GroupLast(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupLast
- GroupMaximum - Class in com.northconcepts.datapipeline.group.operation
-
A
GroupOperationthat returns the largest non-null value of the source field in each group. - GroupMaximum(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMaximum
- GroupMaximum(FieldPath, FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMaximum
- GroupMaximum(FieldPath, FieldPath, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMaximum
- GroupMaximum(String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMaximum
- GroupMaximum(String, String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMaximum
- GroupMaximum(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMaximum
- GroupMinimum - Class in com.northconcepts.datapipeline.group.operation
-
A
GroupOperationthat returns the smallest value of the source field in each group; unlessexcludeNullsis set, a null value discards the minimum found so far. - GroupMinimum(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMinimum
- GroupMinimum(FieldPath, FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMinimum
- GroupMinimum(FieldPath, FieldPath, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMinimum
- GroupMinimum(String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMinimum
- GroupMinimum(String, String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMinimum
- GroupMinimum(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupMinimum
- GroupOperation<T> - Class in com.northconcepts.datapipeline.group
-
See
FieldPathfor supported field name expressions. - GroupOperation(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.GroupOperation
- GroupOperation(FieldPath, FieldPath) - Constructor for class com.northconcepts.datapipeline.group.GroupOperation
- GroupOperation(FieldPath, FieldPath, boolean) - Constructor for class com.northconcepts.datapipeline.group.GroupOperation
- GroupOperation(String) - Constructor for class com.northconcepts.datapipeline.group.GroupOperation
- GroupOperation(String, String) - Constructor for class com.northconcepts.datapipeline.group.GroupOperation
- GroupOperation(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.group.GroupOperation
- GroupOperationField<T> - Class in com.northconcepts.datapipeline.group
-
Accumulates one
GroupOperation's result for a single group within aWindow. - GroupOperationField(GroupOperation<T>) - Constructor for class com.northconcepts.datapipeline.group.GroupOperationField
- GroupSum - Class in com.northconcepts.datapipeline.group.operation
-
A
GroupOperationthat totals the non-null values of the source field in each group as aBigDecimal. - GroupSum(FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupSum
- GroupSum(FieldPath, FieldPath) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupSum
- GroupSum(FieldPath, FieldPath, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupSum
- GroupSum(String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupSum
- GroupSum(String, String) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupSum
- GroupSum(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.group.operation.GroupSum
H
- H2InsertWriter - Class in com.northconcepts.datapipeline.sql.h2
-
Generates H2 insert statement from records.
- H2InsertWriter(String, File) - Constructor for class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Constructs an H2InsertWriter for the specified table and file.
- H2InsertWriter(String, File, boolean) - Constructor for class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Constructs an H2InsertWriter for the specified table, file, and append mode.
- H2InsertWriter(String, Writer) - Constructor for class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Constructs an H2InsertWriter for the specified table and writer.
- H2SqlPart - Class in com.northconcepts.datapipeline.sql.h2
-
Base class for H2 SQL components.
- H2SqlPart() - Constructor for class com.northconcepts.datapipeline.sql.h2.H2SqlPart
- HALF_DOWN - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
If discarded fraction is > 0.5, then behaves as
UP, otherwise, behaves asDOWN - HALF_EVEN - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
If the digit to the left of the discarded fraction is odd, behaves as
HALF_UP, otherwise, behaves asHALF_DOWN - HALF_ODD - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
If the digit to the left of the discarded fraction is odd, behaves as
HALF_DOWN, otherwise, behaves asHALF_UP. - HALF_UP - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
If discarded fraction is ≥ 0.5, then behaves as
UP, otherwise, behaves asDOWN - handleCancel() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Clears the thread's interrupted flag and throws
InterruptedExceptionif this job or its parent was cancelled. - handleDuplicateFields(Record, Map<String, List<Field>>) - Method in interface com.northconcepts.datapipeline.transform.RemoveDuplicateFields.IDuplicateFieldsPolicy
-
Resolves the duplicates in
record;duplicateFieldsMapmaps each duplicated name to its fields (two or more) in record order. - handleDuplicateFields(Record, Map<String, List<Field>>) - Method in class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.RenamePolicy
- handleError(JException) - Method in class com.northconcepts.datapipeline.jsonata.Parser
- handleException(Event<?>, Object, Throwable) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Counts a listener's exception and publishes it to the exception listeners, unless an exception listener threw it.
- handleLargeValueImpl(Field, String) - Method in enum class com.northconcepts.datapipeline.excel.LargeCellHandler
-
Returns the replacement for a value over
ExcelWriter.MAX_CELL_LENGTHcharacters, or throws to reject it. - handlePause() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Blocks while this job is paused, calling
AbstractJob.onPause()before andAbstractJob.onResume()after the wait. - handleUnknownType(Object) - Method in class com.northconcepts.datapipeline.template.TemplateObjectWrapper
- hasArrayFields() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns
trueif any field in this record contains anArrayValue. - hasCallback() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns true if a callback other than the default
JobCallback.NULLwas assigned. - hasCascadingFields - Variable in class com.northconcepts.datapipeline.xml.XmlReader
- hasChildNodes() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns
trueif this node contains any sub nodes. - hasChildNodes() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this node contains any sub nodes. - hasChildNodes() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif this node contains any sub nodes. - hasChildNodes() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns
trueif this node contains any sub nodes. - hasChildNodes() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns
trueif this node contains any sub nodes. - hasChildNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlConditionalNode
- hasChildNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlDetailMarker
- hasChildNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Returns true if this node has children to write in the given context; a conditional node also requires its condition.
- hasChildNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
- hasChildRecords() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns
trueif this node contains any descendant, record nodes. - hasChildRecords() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this node contains any descendant, record nodes. - hasChildRecords() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif this node contains any descendant, record nodes. - hasChildRecords() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns
trueif this node contains any descendant, record nodes. - hasChildRecords() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns
trueif this node contains any descendant, record nodes. - hasCompositePrimaryKeys() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns true if more than one of this entity's own fields is part of its primary key.
- hasExceptions() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- hashCode() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a hash code based on the internal element list.
- hashCode() - Method in class com.northconcepts.datapipeline.core.CompositeValue
- hashCode() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns a hash code based on this field's value.
- hashCode() - Method in class com.northconcepts.datapipeline.core.FieldDeclarations
- hashCode() - Method in class com.northconcepts.datapipeline.core.FieldList
- hashCode() - Method in class com.northconcepts.datapipeline.core.FieldLocation
- hashCode() - Method in class com.northconcepts.datapipeline.core.FieldPath
- hashCode() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a hash code based on all fields in this record.
- hashCode() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns a hash code based on the underlying value.
- hashCode() - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- hashCode() - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
- hashCode() - Method in class com.northconcepts.datapipeline.excel.ExcelColor
- hashCode() - Method in class com.northconcepts.datapipeline.excel.ExcelFont
- hashCode() - Method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
- hashCode() - Method in class com.northconcepts.datapipeline.filter.FieldCount
- hashCode() - Method in class com.northconcepts.datapipeline.filter.FieldExists
- hashCode() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
- hashCode() - Method in class com.northconcepts.datapipeline.filter.FieldNotExists
- hashCode() - Method in class com.northconcepts.datapipeline.filter.FilterExpression
- hashCode() - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaFilter
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- hashCode() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePattern
- hashCode() - Method in class com.northconcepts.datapipeline.jsonata.Location
- hashCode(FieldList) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a hash code based on the fields matching the given
FieldList, or all fields ifnull. - hasMoreMessages(int, Message[]) - Method in enum class com.northconcepts.datapipeline.email.EmailReadDirection
-
Returns true if the given index has not yet moved past the last message to read in this direction.
- hasNext() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
- hasNext() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetIterator
- hasNext() - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePairIterator
- hasNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- hasNodes(ExpressionContext) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Returns true if this node has children to write in the given context; a conditional node also requires its condition.
- hasPrevious() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
- hasSourceValidationErrors() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- hasTargetValidationErrors() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- hasValidationErrors() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- hasValue() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns
trueif this container has had any value added, includingnull. - hasValue() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field has been set to a value, includingnull. - hasValue() - Method in interface com.northconcepts.datapipeline.core.ValueNodeContainer
-
Returns
trueif this container has had any value added, includingnull. - hasValueOnException() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Returns true if
FieldTransformer.setValueOnException(Object)was called, even with null. - having(boolean, String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Adds a condition and its parameter values to the HAVING clause with AND (if
andConjunctionis true) or OR. - having(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Replaces all HAVING conditions with the given part.
- having(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
ANDs a condition, such as
"SUM(total) > ?", and its parameter values with the existing HAVING conditions. - HAVING - Enum constant in enum class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria.CriteriaType
- HdfsFileSystem - Class in com.northconcepts.datapipeline.filesystem.hdfs
-
Class for accessing the Hadoop Distributed File System.
- HdfsFileSystem(String) - Constructor for class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Enables access to Hadoop Distributed File System with the user name supplied through a
CredentialsResolver(seeHdfsFileSystem.setCredentialsResolver(CredentialsResolver)).
URI Example: "hdfs://localhost:9000" - HdfsFileSystem(String, String) - Constructor for class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Enables access to Hadoop Distributed File System.
URI Example: "hdfs://localhost:9000" - HeaderFilter() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyClient.HeaderFilter
- Helper() - Constructor for class com.northconcepts.datapipeline.job.JobCallback.Helper
- HEX - Static variable in interface com.northconcepts.datapipeline.foundations.core.Encoder
- HexEncoder() - Constructor for class com.northconcepts.datapipeline.foundations.core.Encoder.HexEncoder
- HIGH - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaProblem.Severity
- hofFuncArgs(Object, Object, Object, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Helper function to build the arguments to be supplied to the function arg of the HOFs map, filter, each, sift and single
- HOUR - Static variable in class com.northconcepts.datapipeline.schedule.HourlyScheduler
- hourlyScheduleInMinutes(int...) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers at fixed minutes past each hour (for example: 0, 15, 30, and 45 minutes past each hour).
- hourlyScheduleInMinutes(int...) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes windows at fixed minutes past each hour (for example: 0, 15, 30, and 45 minutes past each hour).
- hourlyScheduleInMinutes(String, int...) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers at fixed minutes past each hour for the specified datetime field (for example: 0, 15, 30, and 45 minutes past each hour).
- hourlyScheduleInMinutes(String, int...) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes windows at fixed minutes past each hour for the specified datetime field (for example: 0, 15, 30, and 45 minutes past each hour).
- HourlyScheduler - Class in com.northconcepts.datapipeline.schedule
-
Represents a schedule of fixed minutes past each hour (for example: 0, 15, 30, and 45 minutes past each hour).
- HourlyScheduler(long...) - Constructor for class com.northconcepts.datapipeline.schedule.HourlyScheduler
-
Creates a schedule at the given offsets in milliseconds past each hour (at least one is required); sorts the given array in place and keeps it.
- hoursToDate() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of hours since the epoch to dates (midnight in the default time zone); other values are left unchanged.
- hoursToDateTime() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of hours since the epoch to date-times; other values are left unchanged.
- html - Enum constant in enum class com.northconcepts.datapipeline.mailchimp.list.EmailType
- HTML - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- hyperlink() - Static method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Returns a new ExcelCellStyle that is underlined with a blue font color.
- hyperlink() - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that applies the standard hyperlink style to the cell.
- hyperlink(ExcelCellStyle) - Static method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Decorates the supplied style making it underlined with a blue font color.
I
- IApiLimitPolicy - Interface in com.northconcepts.datapipeline.twitter
-
Indicates the action to take when the Twitter API call limits are reached.
- id - Variable in class com.northconcepts.datapipeline.core.DataObject
- IDENTITY - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.PrimaryKeyType
- IEntityExpansionPolicy - Interface in com.northconcepts.datapipeline.twitter
-
Indicates how multi-valued values should be returned.
- IFieldMapping - Interface in com.northconcepts.datapipeline.foundations.datamapping
-
A mapping that sets one field of a
DataMapping's target record. - IInsert - Interface in com.northconcepts.datapipeline.jdbc.insert
-
The strategy used to write records to a database.
- IJob - Interface in com.northconcepts.datapipeline.job
-
A unit of work that can be run synchronously or asynchronously, paused, resumed, cancelled and monitored.
- IMAP - Enum constant in enum class com.northconcepts.datapipeline.email.MailStore
- IMAP_OVER_SSL - Enum constant in enum class com.northconcepts.datapipeline.email.MailStore
- IMergeUsing - Interface in com.northconcepts.datapipeline.jdbc.sql.merge
-
Renders the USING clause of a
Mergestatement. - importedKeysLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- INBOX - Static variable in interface com.northconcepts.datapipeline.email.GmailFolders
- incBlankCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- incEventsDelivered() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Counts one more delivery to a listener and returns the new
EventBus.getEventsDelivered()total. - incInstanceCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- IncludeFields - Class in com.northconcepts.datapipeline.transform
-
Deprecated.use
SelectFields - IncludeFields(String...) - Constructor for class com.northconcepts.datapipeline.transform.IncludeFields
-
Deprecated.
- IncludeFields(Collection<String>) - Constructor for class com.northconcepts.datapipeline.transform.IncludeFields
-
Deprecated.
- incNullCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- incorrectPrimaryKeyPosition(String, int, int) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- increment() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert.UpsertStub
- incrementRecordCount() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Increases this endpoint's record-count by 1.
- indent() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Increases the indent level by one for the lines that follow.
- index - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- index(int) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Appends a 0-based index segment that selects an array element or a record's field by position; negative indexes count back from the end.
- INDEX - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
- INDEX_FIELD - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
- IndexDef - Class in com.northconcepts.datapipeline.foundations.schema
-
The metadata model for an entity's index.
- IndexDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.IndexDef
- IndexDef(String, String...) - Constructor for class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Creates an index on the named entity fields, each in ascending order.
- IndexDefDiff - Class in com.northconcepts.datapipeline.foundations.schema.diff
-
The differences between two versions of an
IndexDef, with child diffs for its properties and index fields. - IndexDefDiff() - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.IndexDefDiff
- IndexDefDiff(DiffType, String, IndexDef, IndexDef) - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.IndexDefDiff
- indexDoesNotHaveFields(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- indexesLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- IndexFieldDef - Class in com.northconcepts.datapipeline.foundations.schema
-
The metadata model for a field in an entity's index.
- IndexFieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- IndexFieldDef(String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Creates an ascending index field for the named entity field.
- IndexFieldDef(String, boolean) - Constructor for class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- IndexFieldDefDiff - Class in com.northconcepts.datapipeline.foundations.schema.diff
-
The property differences between two versions of an
IndexFieldDef. - IndexFieldDefDiff() - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.IndexFieldDefDiff
- IndexFieldDefDiff(DiffType, String, IndexFieldDef, IndexFieldDef) - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.IndexFieldDefDiff
- indexFieldHasNoIndex(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- indexFieldHasNoSchema(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- indexHasNoEntity(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- indexHasNoSchema(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- indexOf(String) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- indexOfEntity(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the zero-based position of the
EntityDefwith the specified name or -1 if it is not found. - indexOfEntityRelationship(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Returns the zero-based position of the
EntityRelationshipDefwith the specified name or -1 if it is not found. - indexOfField(Field) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the 0-based index of this exact field instance (compared by identity) or -1 if it is not in this record.
- indexOfField(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the zero-based position of the field with the specified name (ignoring case) among this entity's own fields or -1 if it is not found.
- indexOfField(String) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the zero-based position of the
IndexDefwith the specified name or -1 if it is not found. - indexOfField(String, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Returns the index of the first field with the given name, or
-1if not found. - indexOfField(String, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the zero-based position of the field with the specified name (ignoring case) among this entity's own fields or -1 if it is not found and
throwExceptionOnFailureis false, otherwise aDataExceptionis thrown. - indexOfField(String, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns the zero-based position of the
IndexFieldDefwith the specified name or -1 if it is not found andthrowExceptionOnFailureis false, otherwise aDataExceptionis thrown. - indexOfForeignKeyFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Returns the zero-based position of the given foreign key field name, ignoring case, or -1 if it is not found.
- indexOfIndex(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the zero-based position of the
IndexDefwith the specified name or -1 if it is not found. - indexOfIndex(String, boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Returns the zero-based position of the
IndexDefwith the specified name or -1 if it is not found andthrowExceptionOnFailureis false, otherwise aDataExceptionis thrown. - indexOfNode(Node) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the index of the specified node in this array using identity comparison, or
-1if not found. - indexOfValue(Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the index of the first element whose underlying value equals the specified value, or
-1if not found. - indexOutOfBound(long, long) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- INDIGO - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- INET - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- INFERRED - Enum constant in enum class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset.FieldTypeSelectionMode
-
Uses the inferred field type based on the most frequently inferred type from column values.
- INFO - Enum constant in enum class com.northconcepts.datapipeline.core.Message.Level
- init() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- init() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- initCipher() - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
- initCipher() - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
- initCipher() - Method in class com.northconcepts.datapipeline.security.DecryptingReader
-
Initializes or resets
DecryptingReader.cipherfor decryption; called when the reader opens and again after a field fails to decrypt. - initCipher() - Method in class com.northconcepts.datapipeline.security.EncryptingReader
-
Initializes or resets
EncryptingReader.cipherfor encryption; called when the reader opens and again after a field fails to encrypt. - initCipher() - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
- initCipher() - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
- initStyles() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Initializes default cell style formats for different field types.
- initStyles() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- initStyles() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- initStyles() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- innerJoin(String, String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- InnerJoin - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Generates an INNER JOIN clause.
- InnerJoin(String, String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.InnerJoin
- INodeVisitor - Interface in com.northconcepts.datapipeline.core
-
Receives callbacks while
NodeVisitor.visit(Node, INodeVisitor)walks a tree of records, fields, arrays and values depth-first. - input - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- InputStreamFactory - Interface in com.northconcepts.datapipeline.io
-
Opens input streams on demand; name an implementation (with a public no-argument constructor) in the
datapipeline.license.factorysystem property to load the license from it. - insert(int, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Inserts
textat the 0-basedindex, or appends it if the value is not longer thanindex. - Insert - Class in com.northconcepts.datapipeline.jdbc.sql.insert
-
Builds an
INSERT INTO table (columns) VALUES (?, ...), ...statement with one or more rows; the column list comes from the first row. - Insert - Class in com.northconcepts.datapipeline.sql.h2
-
Generates an
INSERT INTOstatement for H2. - Insert - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates an
INSERT INTOstatement for MySQL. - Insert - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates an
INSERT INTOstatement for PostgreSQL. - Insert(String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
- Insert(String) - Constructor for class com.northconcepts.datapipeline.sql.h2.Insert
-
Constructs an Insert for the specified table.
- Insert(String) - Constructor for class com.northconcepts.datapipeline.sql.mysql.Insert
- Insert(String) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.Insert
- InsertRow - Class in com.northconcepts.datapipeline.jdbc.sql.insert
-
One row of an
Insert, rendered as a parenthesized list of?placeholders. - InsertRow - Class in com.northconcepts.datapipeline.sql.h2
-
Represents a row of values for H2 insert statements.
- InsertRow - Class in com.northconcepts.datapipeline.sql.mysql
- InsertRow - Class in com.northconcepts.datapipeline.sql.postgresql
- InsertRow() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.insert.InsertRow
- InsertRow() - Constructor for class com.northconcepts.datapipeline.sql.h2.InsertRow
- InsertRow() - Constructor for class com.northconcepts.datapipeline.sql.mysql.InsertRow
- InsertRow() - Constructor for class com.northconcepts.datapipeline.sql.postgresql.InsertRow
- InsertValue - Class in com.northconcepts.datapipeline.jdbc.sql.insert
-
A column and its parameter value in an
InsertRow. - InsertValue - Class in com.northconcepts.datapipeline.sql.h2
-
Represents a column-value pair for H2 insert statements.
- InsertValue - Class in com.northconcepts.datapipeline.sql.mysql
-
A column name and value pair in an
InsertRow. - InsertValue - Class in com.northconcepts.datapipeline.sql.postgresql
-
A column name and value pair in an
InsertRow. - InsertValue(String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.insert.InsertValue
-
Creates a column with a null parameter value.
- InsertValue(String) - Constructor for class com.northconcepts.datapipeline.sql.h2.InsertValue
-
Constructs an insert value with the specified column name and null value.
- InsertValue(String) - Constructor for class com.northconcepts.datapipeline.sql.mysql.InsertValue
-
Creates an entry for the column with a null value (written as
null). - InsertValue(String) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.InsertValue
-
Creates an entry for the column with a null value (written as
null). - InsertValue(String, Object) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.insert.InsertValue
- InsertValue(String, Object) - Constructor for class com.northconcepts.datapipeline.sql.h2.InsertValue
-
Constructs an insert value with the specified column name and value.
- InsertValue(String, Object) - Constructor for class com.northconcepts.datapipeline.sql.mysql.InsertValue
- InsertValue(String, Object) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.InsertValue
- InstagramLocationMediaReader - Class in com.northconcepts.datapipeline.instagram
-
Search Instagram for media given a specific location (latitude, longitude).
- InstagramLocationMediaReader(String, String, double, double, int) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
-
Get at most maximum number(maxResults) of recently searched media by location (latitude, longitude).
- InstagramLocationReader - Class in com.northconcepts.datapipeline.instagram
-
Search for a location by geographic coordinate in Instagram.
- InstagramLocationReader(String, String, double, double) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramLocationReader
-
Search Instagram for a location by geographic coordinate.
- InstagramMediaReader - Class in com.northconcepts.datapipeline.instagram
-
Base class for all InstagramXXXMediaReader.
- InstagramMediaReader(String, String, int) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramMediaReader
-
Creates a reader for at most
maxResultsmedia; a non-positive limit is stored as 0 (no media). - InstagramSelfFollowedByReader - Class in com.northconcepts.datapipeline.instagram
-
Get the list of users this user is followed by.
- InstagramSelfFollowedByReader(String, String, int) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramSelfFollowedByReader
-
Get at most maximum number(maxResults) of users this user is followed by.
- InstagramSelfFollowsReader - Class in com.northconcepts.datapipeline.instagram
-
Get the list of users this user follows.
- InstagramSelfFollowsReader(String, String, int) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramSelfFollowsReader
-
Get at most maximum number(maxResults) of users this user follows.
- InstagramSelfMediaReader - Class in com.northconcepts.datapipeline.instagram
-
Get your most recent media published.
- InstagramSelfMediaReader(String, String, int) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramSelfMediaReader
-
Get at most maximum number(maxResults) of your recent media.
- InstagramSelfReader - Class in com.northconcepts.datapipeline.instagram
-
Base class for all InstagramSelfXXXReader.
- InstagramSelfReader(String, String, int) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramSelfReader
-
Creates a reader for at most
maxResultsusers; a non-positive limit is stored as 0 (no users). - InstagramTagMediaReader - Class in com.northconcepts.datapipeline.instagram
-
Search Instagram for media given a specific tag.
- InstagramTagMediaReader(String, String, String, int) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramTagMediaReader
-
Get at most maximum number(maxResults) of recently tagged media.
- InstagramTagReader - Class in com.northconcepts.datapipeline.instagram
-
Search for matching tags in Instagram by name - results are ordered first as an exact match, then by popularity.
- InstagramTagReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramTagReader
- InstagramUserMediaReader - Class in com.northconcepts.datapipeline.instagram
-
Get the most recent media published by a user.
- InstagramUserMediaReader(String, String, String, int) - Constructor for class com.northconcepts.datapipeline.instagram.InstagramUserMediaReader
-
Creates a reader for at most
maxResultsrecent media of the given user; the username must not be empty. - INT - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- INT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- INT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- INT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- INT2 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- INT4 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- INT8 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- int96ToTimestamp(byte[]) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Converts a 12-byte Parquet INT96 timestamp to a
Datein the system default time zone. - INTEGER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- INTEGER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
- INTEGER - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- INTEGER - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- INTEGER - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- INTEGER - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- IntegrationProxyReader - Class in com.northconcepts.datapipeline.internal.lang
-
Base class for proxy readers in the license-gated integration modules;
IntegrationProxyReader.open()leaves the reader unopened unless the product edition and license allow integrations. - IntegrationProxyReader(DataReader) - Constructor for class com.northconcepts.datapipeline.internal.lang.IntegrationProxyReader
- IntegrationProxyWriter - Class in com.northconcepts.datapipeline.internal.lang
-
Base class for proxy writers in the license-gated integration modules;
IntegrationProxyWriter.open()leaves the writer unopened unless the product edition and license allow integrations. - IntegrationProxyWriter(DataWriter) - Constructor for class com.northconcepts.datapipeline.internal.lang.IntegrationProxyWriter
- IntegrationReader - Class in com.northconcepts.datapipeline.internal.lang
-
Base class for readers in the license-gated integration modules;
IntegrationReader.open()leaves the reader unopened unless the product edition and license allow integrations. - IntegrationReader() - Constructor for class com.northconcepts.datapipeline.internal.lang.IntegrationReader
- IntegrationWriter - Class in com.northconcepts.datapipeline.internal.lang
-
Base class for writers in the license-gated integration modules;
IntegrationWriter.open()leaves the writer unopened unless the product edition and license allow integrations. - IntegrationWriter() - Constructor for class com.northconcepts.datapipeline.internal.lang.IntegrationWriter
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.core.DebugReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.core.DebugWriter
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.core.ProxyReader
-
Overridden by subclasses to transform, drop, or observe a record on its way through this proxy.
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.core.ProxyWriter
-
Overridden by subclasses to transform, drop, or observe a record on its way through this proxy.
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.core.TeeReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.filter.FilteringReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableWriter
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeWriter
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.memory.TailProxyReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.meter.MeteredWriter
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.security.DecryptingReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.security.EncryptingReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.throttle.ThrottledWriter
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
- interceptRecord(Record) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
- interceptValue(Field, String) - Method in enum class com.northconcepts.datapipeline.excel.LargeCellHandler
-
Returns the value unchanged if it is null or fits in a cell, otherwise the result of this strategy.
- INTERNAL_ERROR - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- internalId - Variable in class com.northconcepts.datapipeline.foundations.core.FoundationObject
- internalName - Variable in class com.northconcepts.datapipeline.foundations.core.FoundationObject
- intervalToMilliseconds() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts intervals to their millisecond part as a long, ignoring any months and years.
- intervalToMonths() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts intervals to their month part as an int (a year counts as 12 months), ignoring days and smaller units.
- intervalToSeconds() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts intervals to the whole seconds in their millisecond part as a long, ignoring any months and years.
- intervalToYears() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts intervals to the whole years in their month part as an int, ignoring days and smaller units.
- INVALID_MEDIA_ID - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- INVALID_OR_EXPIRED_TOKEN - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- invalidateChildInstanceCountCache() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Resets the lazily cached
TreeNode.getMinimumChildInstanceCount()andTreeNode.getMaximumChildInstanceCount()values so they are recomputed on next access. - invalidEntityInRelationship(String, String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- invalidIdentifier(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- invalidOffsetOrCount(long, long, long) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- invalidOneToManyRelationship(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- invalidStartOfIdentifier(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- invoke(Object, Method, Object[]) - Method in class com.northconcepts.datapipeline.eventbus.EventSourceInvocationHandler
- invokeRequest() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Fetches the page for the
ShopifyApiReader.getNextPageInfo()cursor (up toShopifyApiReader.getBatchSize()records); must not return null. - invokeRequest() - Method in class com.northconcepts.datapipeline.shopify.ShopifyCustomerReader
- invokeRequest() - Method in class com.northconcepts.datapipeline.shopify.ShopifyEventReader
- invokeRequest() - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryItemReader
- invokeRequest() - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryLevelReader
- invokeRequest() - Method in class com.northconcepts.datapipeline.shopify.ShopifyLocationReader
- invokeRequest() - Method in class com.northconcepts.datapipeline.shopify.ShopifyOrderReader
- invokeRequest() - Method in class com.northconcepts.datapipeline.shopify.ShopifyProductReader
- IParser - Interface in com.northconcepts.datapipeline.core
-
Character-level parser with lookahead, used by the text readers to peek at, match and consume their input.
- IRetryStrategy - Interface in com.northconcepts.datapipeline.retry
-
Strategy for computing how long to wait before each retry of a failed read, write or operation.
- isAddMissingOptionalFields() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Indicates if data mapping should add optional fields in this entity that are not present in the data (doesn't apply during validation).
- isAddTextToParent() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if each child element's text is also added to its parent's text (defaults to false); this uses more memory.
- isAddTextToParent() - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Return true if each child node's text should be concatenated to its parent during parsing (defaults to false).
- isAddTextToParent() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Return true if each child node's text should be concatenated to its parent during parsing (defaults to false).
- isAddUserToRecord() - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
-
Indicates if the followed user's details are added to each written record (default is false).
- isAddUserToRecord() - Method in class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
-
Indicates if the unfollowed user's details are added to each written record (default is false).
- isAlive() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns true if this bus has not been shutdown.
- isAll() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
-
Indicates if the queries are combined with
UNION ALLinstead ofUNION(default is false). - isAllowBlank() - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
Indicates if empty strings are allowed as values for this field.
- isAllowDuplicateFieldNames() - Method in class com.northconcepts.datapipeline.transform.RenameField
-
Indicates if a field may be renamed to the name of another field in its record instead of throwing (default is false).
- isAllowExtraFieldsInMapping() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Indicates if data mapping should fail when the data contains fields not present in this entity (doesn't apply during validation).
- isAllowExtraFieldsInValidation() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Indicates if data validation should fail when the data contains fields not present in this entity (doesn't apply during mapping ).
- isAllowMultiLineText() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Indicates if line separators are allowed inside quoted fields.
- isAllowMultiLineText() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if line separators are allowed inside quoted fields (defaults to false).
- isAllowNoConditions() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Indicates if the rule may have no conditions, in which case it always fires; otherwise validation fails (default false).
- isAllowNoOutcomes() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Indicates if the rule may have no outcomes; otherwise validation fails (default false).
- isAllowNoResults() - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Indicates if no exception should be thrown if no results are found (default false, exceptions are thrown).
- isAllowQuoteInField() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Indicates if unescaped quotes are allowed in fields (default to false).
- isAllowQuoteInField() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if unescaped quotes are allowed in fields (defaults to false).
- isAlwaysIncludeEmail() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Indicates the
alwaysIncludeEmailvalue of the events request (default is true). - isAlwaysShowFooter() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Indicates if the footer should be written, even if no records were written (defaults to true).
- isAlwaysShowHeader() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Indicates if the header should be written, even if no records are written (defaults to true).
- isAncestorOf(Node) - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif the supplied node is a descendant of this one. - isAppend() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- isAppend() - Method in class com.northconcepts.datapipeline.core.TextWriter
-
Indicates if writing should start at the end of the file (if it exists).
- isAppend() - Method in class com.northconcepts.datapipeline.file.FileWriter
-
Indicates if writing should start at the end of the file (if it exists).
- isAppend() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
-
Indicates if
FileSink.getOutputStream()appends to an existing file instead of replacing it. - isAppend() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- isApplicable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConditionPart
- isApplicable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.ConjunctivePart
- isApplicable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.NotPart
- isApplicable() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
-
Returns true if this part renders any SQL; parts that do not, such as an empty
AndPart, are skipped. - isApproximateNumber() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns
trueif values of this type are numbers that do not contain exact quantities (DOUBLE and FLOAT). - isApproximateNumber() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif values of this type are numbers that do not contain exact quantities (DOUBLE, FLOAT, or REAL). - isArbitrarySizeInBytes() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns
trueif values of this type can vary in length/size, otherwisefalsefor fixed-length types. - isArray() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns
trueif this value node is anArrayValue. - isArray() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field's value is anArrayValue. - isArray() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns
trueif this value node is anArrayValue. - isArray() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this value node is anArrayValue. - isArray() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns true if at least one array value was seen.
- isArray() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Indicates if either
FieldDef.getMinimumElements()orFieldDef.getMaximumElements()are not null. - isArrayOfNumbers(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- isArrayOfStrings(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- isAscending() - Method in class com.northconcepts.datapipeline.core.FieldComparator
-
Indicates if fields are compared in ascending order (default is true).
- isAscending() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
-
Indicates if the column is sorted ascending; false for descending or when the database reports no sort order.
- isAscending() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Indicates if this field is sorted in ascending order in the index (defaults to true).
- isAscending() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
-
Indicates if the field sorts in ascending order; otherwise
DESCis added (default is false). - isAttribute() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if this node is an XML attribute, whose name starts with
@. - isAutoCloseConnection() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Returns whether the database connection will be automatically closed when this dataset is closed.
- isAutoCloseConnection() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Indicates if the database connection is closed when the reader is closed (defaults to false).
- isAutoCloseConnection() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Indicates if the database connection is closed when the writer is closed (defaults to false).
- isAutoCloseConnection() - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
-
Indicates if the MongoDB client should be closed when this reader closes (defaults to false).
- isAutoCloseConnection() - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
-
Indicates if the MongoDB client should be closed when this writer closes (defaults to false).
- isAutoCloseConnection() - Method in class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
-
Indicates if the database connection in this lookup should be closed when the lookup is closed by the
LookupTransformervia aTransformingReaderorTransformingWriter. - isAutoCloseDocument() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Indicates if the ExcelDocument should be closed when this endpoint is closed.
- isAutoCloseDocument() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if the Excel document is closed when the reader is closed (defaults to false).
- isAutoCloseDocument() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
-
Indicates if the GoogleSheetDocument should be closed when this endpoint is closed.
- isAutoCloseDocument() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Indicates if the GoogleSheetDocument should be closed when this endpoint is closed.
- isAutoCloseDocument() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
-
Indicates if the PDF document is closed when the reader closes (default is false).
- isAutoCloseDocument() - Method in class com.northconcepts.datapipeline.pdf.PdfReader
-
Indicates if the PdfDocument should be closed when this endpoint is closed.
- isAutoCloseLogWriter() - Method in class com.northconcepts.datapipeline.job.AbstractJob
- isAutoCloseLogWriter() - Method in class com.northconcepts.datapipeline.job.Job
- isAutoCloseReader() - Method in class com.northconcepts.datapipeline.file.FileReader
-
Indicates if the underlying input stream should be closed when this stream closes (defaults to true).
- isAutoCloseReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Indicates if the file's stream is closed when the reader is closed (defaults to true).
- isAutoCloseReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Indicates if the file's stream is closed when the reader is closed (defaults to true).
- isAutoCloseReader() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if the file's stream is closed when the reader is closed (defaults to true).
- isAutoCloseReader() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
- isAutoCloseReader() - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
- isAutoCloseReader() - Method in class com.northconcepts.datapipeline.xml.SimpleXmlReader
-
Indicates if the
Readerpassed to the constructor is closed when this reader closes (default is true); a file opened by this reader is always closed. - isAutoCloseReader() - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Indicates if the
Readerpassed to the constructor is closed when this reader closes (default is true); a file opened by this reader is always closed. - isAutoCloseReader() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if the
Readerpassed to the constructor is closed when this reader closes (default is true); a file opened by this reader is always closed. - isAutoCloseWriter() - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
-
Indicates if the underlying java.io.BufferedWriter should be closed when this stream closes (defaults to true).
- isAutoCloseWriter() - Method in class com.northconcepts.datapipeline.core.TextWriter
-
Indicates if the underlying java.io.BufferedWriter should be closed when this stream closes (defaults to true).
- isAutoCloseWriter() - Method in class com.northconcepts.datapipeline.file.FileReader
-
Deprecated.use
FileReader.isAutoCloseReader()instead. Indicates if the underlying input stream should be closed when this stream closes (defaults to true). - isAutoCloseWriter() - Method in class com.northconcepts.datapipeline.file.FileWriter
-
Indicates if the underlying output stream should be closed when this stream closes (defaults to true).
- isAutoCloseWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Indicates if the file's stream is closed when the writer is closed (defaults to true).
- isAutoCloseWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Indicates if the file's stream is closed when the writer is closed (defaults to true).
- isAutoCloseWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Indicates if the file's stream is closed when the writer is closed (defaults to true).
- isAutoCloseWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if the file's stream is closed when the writer is closed (defaults to true).
- isAutofilterColumns() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Indicates if drop-down filters are added to the first written row (usually the header) on close (default is false).
- isAutoFilterColumns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Indicates if drop-down filters are added to the first written row, usually the header (defaults to false).
- isAutofitColumns() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Indicates if the columns should be expanded to fit the widest value (default is false).
- isAutofitColumns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Indicates if columns are widened to fit their widest value (defaults to false).
- isAutoIncrement() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- isAutoIncrement() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- isAutoIncrement() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns whether the column has auto-increment enabled.
- isAutoIncrement() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Indicates if
AUTO_INCREMENTis written; only applies to types whoseTableColumnType.isAutoIncrementSupported()is true. - isAutoIncrementSupported() - Method in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
-
Indicates if this column type supports auto-increment.
- isAutoIncrementSupported() - Method in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
-
Indicates if
AUTO_INCREMENTmay be written for this type; true only for the integer typesSMALLINTtoBIGINT. - isAutoMapping() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Indicates if incoming source fields should be mapped automatically without the need for explicit
FieldMappings (defaultfalse). - isBatchMode() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Indicates if updates are batched, i.e.
- isBatchMode() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Indicates if updates are batched, i.e.
- isBatchMode() - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
-
Returns true if the batch size is greater than 1, so records are inserted in batches.
- isBatchMode() - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Returns whether batch mode is enabled.
- isBatchMode() - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
-
Indicates if inserts are batched, i.e.
- isBatchMode() - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
-
Indicates if inserts are batched, i.e.
- isBatchSupported() - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Returns true if
IInsert.addBatch()andIInsert.executeBatch()are supported; otherwiseJdbcWriter.setBatchSize(int)rejects batch sizes above 1. - isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- isBatchSupported() - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Returns true if
IUpsert.addBatch()andIUpsert.executeBatch()are supported; otherwiseJdbcUpsertWriter.setBatchSize(int)rejects batch sizes above 1. - isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- isBatchSupported() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- isBinary() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns true if values of this type are byte arrays (BLOB).
- isBinary() - Method in class com.northconcepts.datapipeline.foundations.file.FileDetector
-
Indicates if the sample contains control characters (other than tab, CR and LF) or DEL; false until the content is read.
- isBinary() - Method in enum class com.northconcepts.datapipeline.foundations.file.FileType
- isBinarySqlType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif the SQL type is BLOB, BINARY, VARBINARY or LONGVARBINARY. - isBold() - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Returns whether bold formatting is enabled.
- isBoolean() - Method in enum class com.northconcepts.datapipeline.core.FieldType
- isBoolean() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns true if at least one string value was true, false, yes or no.
- isBoolean(String) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns true if the string is true, false, yes or no, ignoring case.
- isBooleanSqlType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif the SQL type is BIT or BOOLEAN. - isCacheFieldIndexes() - Method in class com.northconcepts.datapipeline.core.SortingReader
- isCancelled() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns
trueif this job was cancelled. - isCancelled() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns
trueif this job was cancelled. - isCancelled() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns
trueif this job was cancelled. - isCancelled(Throwable) - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns
trueif this exception is due to this job being cancelled. - isCandidateKey(RecordList, String...) - Static method in class com.northconcepts.datapipeline.foundations.tools.DetectPrimaryKeysInDataset
-
Returns true if no two records have the same values for the given fields.
- isCaptureElapsedTime() - Static method in class com.northconcepts.datapipeline.core.Endpoint
-
Indicates if all endpoints (readers and writers) should record their processing time.
- isCascade() - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
-
Returns whether CASCADE is enabled.
- isCascade() - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
- isCascade() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
- isCascade() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- isCascadeFieldValue() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if this field's value spans several records and should be repeated (cascaded) in each of them.
- isCascadeValues() - Method in class com.northconcepts.datapipeline.xml.XmlField
-
Indicates if this field's last value carries over to later records until a new match replaces it (default is false).
- isCaseSensitive() - Method in class com.northconcepts.datapipeline.filter.rule.Contains
- isCausedBy(Class<? extends Throwable>) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns
trueif this exception was caused by (or one of its nested exceptions was caused by) the specified exception. - isCauseInterruptedException() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns
trueif the nested exception indicates that a thread was interrupted. - isCellStyleSupported() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- isCellStyleSupported() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- isCellStyleSupported() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- isCheckIfConstraintExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
-
Indicates if
IF EXISTSclause should be added to theALTER TABLE...DROP CONSTRAINTstatement before the constraint name (default true). - isCheckIfDropTableExists() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default is true). - isCheckIfDropTableExists() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default is true). - isCheckIfDropTableExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default is true). - isCheckIfExists() - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default true). - isCheckIfExists() - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default true). - isCheckIfExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default true). - isCheckIfForeignTableExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Indicates if
IF EXISTSclause should be included in theALTER TABLE...ADD CONSTRAINTstatement (default true). - isCheckIfForeignTableExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if
IF EXISTSclause should be included in theALTER TABLEstatement (default is true). - isCheckIfIndexNotExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE INDEXstatement (default is true). - isCheckIfNotExists() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default true). - isCheckIfNotExists() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default true). - isCheckIfNotExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE INDEXstatement (default true). - isCheckIfNotExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default true). - isCheckIfTableExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
-
Indicates if the
IF EXISTSclause should be added to theALTER TABLEstatement before the table name (default true). - isCheckIfTableNotExists() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default is true). - isCheckIfTableNotExists() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default is true). - isCheckIfTableNotExists() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default is true). - isChildNode() - Method in class com.northconcepts.datapipeline.core.Node
-
Indicates if this record has a parent record (i.e.
- isCloneRecord() - Method in class com.northconcepts.datapipeline.core.TeeReader
-
Indicates if a copy of the original record should be sent to the writer (default false), otherwise the original record is sent to the writer.
- isCloseBeforeAddingRecord() - Method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Returns
trueif the window should be closed before adding the record orfalseif (the default). - isClosed() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Indicates if this endpoint has finished transferring data.
- isClosed() - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
- isCollectUniqueValues() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if unique values in the dataset should be collected (default
false). - isColumnStatsLoaded() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Return
trueif all the column stats have been loaded. - isCommitBatch() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Indicates if commit is called after every batch instead of only after the last one (defaults to false).
- isCommitBatch() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Indicates if this writer should call commit on each connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).
- isCommitBatch() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Indicates if this writer should call commit on each connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).
- isCommitBatch() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Returns true if this reader calls commit on the connection after every batch is sent.
- isCommitBatch() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Indicates if this writer should call commit on the connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).
- isCompressed() - Method in class com.northconcepts.datapipeline.file.FileReader
-
Indicates if the data is compressed and should be decompressed as it is being read.
- isCompressed() - Method in class com.northconcepts.datapipeline.file.FileWriter
-
Indicates if the data should be compressed as it is being written (default false).
- isContinueOnException() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Indicates if exceptions thrown by operations are ignored so the remaining operations still run; the last one is kept in
BasicFieldTransformer.getException()(default is false). - isCurrency() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- isDataFormatSupported() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- isDataFormatSupported() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- isDataFormatSupported() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- isDataLoaded() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Return
trueif all the records have been loaded and all the column stats have been loaded. - isDataLoading() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Return
trueif the records or column stats are currently being loaded. - isDebug() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Indicates if this file's
AmazonS3FileSystemlogs multipart upload progress at debug level. - isDebug() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Indicates if multipart uploads log each part and their completion or abort at debug level (default is false).
- isDebug() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
-
Indicates if buffer activity (buffers opened and closed, records added) is logged at debug level (default is false).
- isDebug() - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Indicates if debug mode is turned on for the mail session when the reader opens (default is false).
- isDebug() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Indicates if the bus should emit debug log messages when events are published or delivered and during the shutdown process.
- isDebug() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Indicates if the reader logs each parsed node to help find record break paths; not serialized (defaults to false).
- isDebug() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Indicates if the reader logs each parsed node to help find field and record break paths; not serialized (defaults to false).
- isDebug() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if the reader logs each parsed node to help find record break paths; not serialized (defaults to false).
- isDebug() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
-
Indicates if failing patterns should be logged (default false).
- isDebug() - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Indicates if window activity is logged at debug level (defaults to false).
- isDebug() - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Indicates if the generated SQL should be logged (default false).
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Indicates if the generated SQL should be logged (default false).
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Indicates if the generated SQL should be logged (default false).
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Indicates if the generated SQL should be logged (default false).
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Indicates if the generated SQL should be logged (default false).
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
-
Indicates if the generated SQL should be logged (default false).
- isDebug() - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Indicates if the generated SQL should be logged (default false).
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
-
Indicates if the generated SQL should be logged (default false).
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- isDebug() - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- isDebug() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Indicates if each JSON token read is logged at debug level (default is false).
- isDebug() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if debugging is enabled to print log statements.
- isDebug() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Indicates if debugging is enabled to print log statements.
- isDebug() - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Indicates if each node read is logged at debug level (default is false).
- isDebug() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if each node read is logged at debug level (default is false).
- isDefaulAdjustToUTC() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Deprecated.
- isDefaultAdjustedToUTC() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates if all datetime fields should be marked as AdjustedToUTC.
- isDefaultAdjustedToUTC() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates if all datetime fields should be marked as AdjustedToUTC.
- isDeleted() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns
trueif this record has been marked for deletion. - isDeleteDatabaseFileOnClose() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
-
Indicates if the MVStore file is deleted when this dataset is closed (defaults to false).
- isDeleteFilesOnClose() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Indicates if this dataset's files are deleted when it is closed (defaults to false).
- isDependentOn(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns
trueif this table is either directly or indirectly dependent on the supplied table. - isDetectBigNumberValues() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if big decimals and big integers should be analyzed to determine their precision and scale (default
true). - isDetectBooleanValues() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if boolean values should be looked for in strings and undefined types (default
true). - isDetectNumericValues() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if numeric values should be looked for in strings and undefined types (default
true). - isDetectTemporalValues() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if date/time patterns should be looked for in strings and undefined types (default
true). - isDetectUuidValues() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if UUID values should be looked for in strings and undefined types (default
true). - isDigit(int) - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Indicates if the character is an ASCII digit (0-9).
- isDirectlyDependentOn(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Returns
trueif this table is directly dependent on the supplied table (i.e they have a direct public-foreign key relationship). - isDistinct() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySelection
-
Indicates if
SELECT DISTINCTis generated (default is false). - isDistinctValues() - Method in class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Returns whether only distinct values are collected.
- isDropTable() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if drop table statement should be included in the output DDL for each entity in the
CreateH2DdlFromSchemaDef.schemaDef(default true). - isDropTable() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if drop table statement should be included in the output DDL for each entity in the
CreateMySqlDdlFromSchemaDef.schemaDef(default true). - isDropTable() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if drop table statement should be included in the output DDL for each entity in the
CreatePostgreSqlDdlFromSchemaDef.schemaDef(default true). - isDropTablesOnClose() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Returns whether the database tables will be dropped when this dataset is closed.
- isDynamicName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DateTimeNodeNameRule
- isDynamicName(String) - Method in interface com.northconcepts.datapipeline.foundations.pipeline.tree.detect.NodeNameRule
-
Returns true if the name is dynamic data, such as an identifier or date, rather than a fixed structural name.
- isDynamicName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.RegexNodeNameRule
- isDynamicName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StandardNodeNameRule
- isEmpty() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns
trueif this array contains no elements -- equivalent toArrayValue.size()== 0. - isEmpty() - Method in class com.northconcepts.datapipeline.core.FieldList
- isEmpty() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns true if this record has no fields or all field values are null.
- isEmpty() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns true if this list contains no records.
- isEmpty() - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- isEmpty() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds an
IsEmptyrule to this filter. - isEmpty() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
- isEmpty() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryGrouping
- isEmpty() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
- isEmpty() - Method in class com.northconcepts.datapipeline.jsonata.JsonObject
- isEmpty() - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- IsEmpty - Class in com.northconcepts.datapipeline.filter.rule
-
Field filter rule that returns true if a field value is empty.
- IsEmpty() - Constructor for class com.northconcepts.datapipeline.filter.rule.IsEmpty
-
Creates a new IsEmpty filter rule.
- isEmptyDefaultValue() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif the default value is an empty string or the string "''". - isEnabled() - Static method in class com.northconcepts.datapipeline.core.Messages
-
Indicates if messages are collected, for all threads; when false,
Messages.getCurrent()returns a container that discards them (defaults to true). - isEscapePatterns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
-
Indicates if backslashes and double quotes in the patterns are escaped in the generated Java code (defaults to false); filtering is unaffected.
- isEscapePatterns() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
-
Indicates if backslashes and double quotes in the patterns are escaped in the generated Java code (defaults to false).
- isEvaluateExpressions() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Indicates if cell formulas/expressions should be evaluated and the result set as the field's value (default true), otherwise, the cell's formula will be set as the field's value and no evaluation will take place.
- isEvaluateExpressions() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- isEvaluateExpressions() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- isEvaluateExpressions() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- isEvaluateExpressions() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if formulas are evaluated and their results read instead of the formula text (defaults to true).
- isExactNumber() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns
trueif values of this type are numbers that contain exact quantities (INT, LONG, BYTE, SHORT, BIG_INTEGER, and BIG_DECIMAL). - isExactNumber() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif values of this type are numbers that contain exact quantities (BIGINT, DECIMAL, INTEGER, NUMERIC, SMALLINT, TINYINT, SMALLINT). - isExceptionOnFailure() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Indicates if a transformer that throws or returns false stops processing with an exception (default is true unless a discard writer is set).
- isExceptionOnFailure() - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Indicates if a transformer that throws or returns false stops processing with an exception (default is true unless a discard writer is set).
- isExceptionOnFailure() - Method in class com.northconcepts.datapipeline.validate.ValidatingReader
-
Indicates if a record failing validation throws an exception instead of being discarded with a warning (defaults to true unless a discard writer is set).
- isExcludeCatalogAnnotation() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if the catalog is left out of the generated
@Tableannotation (default false). - isExcludeNulls() - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Indicates if
nullgroups should be excluded from results (defaults to false). - isExcludeSchemaAnnotation() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if the schema is left out of the generated
@Tableannotation (default false). - isExhausted() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Returns
trueif this stream has already returned anullindicating that no further reads are possible. - isExpired() - Method in class com.northconcepts.datapipeline.security.Credentials
-
Indicates if these credentials have already expired; always returns
falsewhen no expiry is known. - isExpired(long) - Method in class com.northconcepts.datapipeline.security.Credentials
-
Indicates if these credentials have expired or will expire within the next
skewMilliseconds. - isFailed() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns
trueif this job has completed unsuccessfully. - isFailed() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns
trueif this job has completed unsuccessfully. - isFailed() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns
trueif this job has completed unsuccessfully. - isFailOnException() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
-
Indicates if a source reader failure stops all reading and is rethrown by
DataReader.read()(default is true) instead of only being kept forAsyncMultiReader.getException(). - isFailOnLimitationNotice() - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
-
Indicates if track limitation notices fail the reader rather than only being counted (default is false).
- isField() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if this node's values are read into a record field.
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Indicates if the first row holds the field names instead of data (default is false).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.core.AbstractWriter
-
Indicates if a header row of field names is written before the first record (default is true).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.core.TextWriter
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if the first row holds the field names (defaults to false).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if the first row read holds the field names (defaults to false).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Indicates if the first row holds the field names (defaults to false).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Indicates if a header row of field names is written first (defaults to true).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Indicates if a header row of field names is written first (defaults to true).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Indicates if a header row of field names is written first (defaults to true).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
-
Returns whether field names are written as the first row (default true).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
-
Returns whether field names are written as the first row (default true).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
-
Indicates if the table's first row holds the field names instead of data (default is false).
- isFieldNamesInFirstRow() - Method in class com.northconcepts.datapipeline.pdf.PdfReader
-
Indicates if the table's first row holds the field names instead of data (default is false).
- isFieldType(FieldType) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field to be of the given
FieldType. - IsFieldType - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields of the givenFieldType. - IsFieldType(FieldType) - Constructor for class com.northconcepts.datapipeline.filter.rule.IsFieldType
- isFinished() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader.ReaderThread
- isFinished() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns
trueif this job has finished running. - isFinished() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns
trueif this job has finished running. - isFinished() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns
trueif this job has finished running. - isFinished() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
- isFixedSizeInBytes() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns
trueif values of this type are fixed in length/size, otherwisefalsefor types that can vary in length. - isFlattenArrayValues() - Method in class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Returns whether array values should be flattened during collection.
- isFlushOnWrite() - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
-
Indicates if the underlying java.io.BufferedWriter should be flushed after each record is written.
- isFlushOnWrite() - Method in class com.northconcepts.datapipeline.core.TextWriter
-
Indicates if the underlying java.io.BufferedWriter should be flushed after each record is written.
- isFlushOnWrite() - Method in class com.northconcepts.datapipeline.file.FileWriter
-
Indicates if the underlying java.io.BufferedWriter should be flushed after each record is written.
- isFlushOnWrite() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Indicates if the output is flushed after each record (defaults to false).
- isFlushOnWrite() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Indicates if the output is flushed after each record (defaults to false).
- isFlushOnWrite() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Indicates if the output is flushed after each record (defaults to false).
- isFlushOnWrite() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if the output is flushed after each record (defaults to false).
- isForceQuote() - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Returns true if all values will be quoted, even if they are not null or empty strings.
- isForceQuote() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Indicates if every non-empty value is quoted, not only those that need it (defaults to false).
- isForiegnKeyTable(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns
trueif the given table is the referencing (foreign key) table, comparing catalog, schema and name exactly. - isFreezePaneSupported() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- isFreezePaneSupported() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- isFreezePaneSupported() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- isFunction(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- isGenerated() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Indicates if the column is a generated (computed) column.
- isGenerateIndexes() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreateH2DdlFromSchemaDef.schemaDef(default is true). - isGenerateIndexes() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreateMySqlDdlFromSchemaDef.schemaDef(default is true). - isGenerateIndexes() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreatePostgreSqlDdlFromSchemaDef.schemaDef(default is true). - isGenerateRelationships() - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if DDL should be generated for relationships in the
CreateH2DdlFromSchemaDef.schemaDef(default is true). - isGenerateRelationships() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if DDL should be generated for relationships in the
CreateMySqlDdlFromSchemaDef.schemaDef(default is true). - isGenerateRelationships() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if DDL should be generated for relationships in the
CreatePostgreSqlDdlFromSchemaDef.schemaDef(default is true). - isHeaderRow() - Method in class com.northconcepts.datapipeline.core.AbstractWriter
-
Returns
trueif the current record being written is the header row. - isHyperlinkSupported() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- isHyperlinkSupported() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- isHyperlinkSupported() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- isIgnoreEmptyText() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- isIgnoreEmptyText() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
- isIgnoreNamespaces() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if namespaces on elements and attributes are removed (defaults to true);
falseis not supported. - isIgnoreNamespaces() - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Indicates if namespaces on elements and attributes are ignored when matching expressions (default to true).
- isIgnoreNamespaces() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if namespaces on elements and attributes are to be removed (default to true).
- isIgnoreOnError() - Method in class com.northconcepts.datapipeline.jdbc.insert.MySqlPreparedStatementInsert
-
Indicates if
INSERT IGNOREis generated instead of a plainINSERT(default is false). - isIncludeInOutcome() - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
-
Indicates if this field's definition (variable and expression, not its value) is listed under
fieldsin the decision outcome (default is false). - isIncludeSpamAndTrash() - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- isIncludeTemplateMasterFormDef() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Indicates if each generated entity includes a TemplateMaster
FORM_DEFdescribing its columns (default false). - isIncludeTemplateMasterFormDef() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if each generated entity includes a TemplateMaster
FORM_DEFdescribing its columns (default false). - isInferStringTypes() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if string and undefined types should be analyzed to determine if they represent a numeric, boolean, or date/time value (default
true). - isInsert() - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.MergeValue
-
Indicates if the column is rendered as its bare name (INSERT clause) rather than
column=?(UPDATE SET clause). - isInsertFirst() - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
-
Indicates if an insert should be attempted before and update (the default) or false if the update should be attempted first.
- isInstanceOfJavaType(Class<?>) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to be an instance of the given type or a subtype; null values fail.
- IsInstanceOfJavaType - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields whose value is an instance of the given Java type or a subtype; null values are rejected. - IsInstanceOfJavaType(Class<?>) - Constructor for class com.northconcepts.datapipeline.filter.rule.IsInstanceOfJavaType
- isIntegerNumber() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns
trueif values of this type are numbers that cannot contain fractions (byte, short, int, etc.). - isIntegerNumber() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif columns of this type are numbers that cannot contain fractions (byte, short, int, etc.). - isItalic() - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Returns whether italic formatting is enabled.
- isJavaType(Class<?>) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to be null or exactly of the given class (subclasses fail).
- IsJavaType - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields whose value is exactly of the given class (not a subclass); null values are also allowed. - IsJavaType(Class<?>) - Constructor for class com.northconcepts.datapipeline.filter.rule.IsJavaType
- isJsonArray() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if this node held array values or is a JSON
arraycontainer node. - isJsonObject() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if this node is a JSON
objectcontainer node. - isKeepPolling() - Method in class com.northconcepts.datapipeline.kafka.KafkaReader
-
Indicates if the reader keeps polling while no messages arrive instead of ending after an empty poll (default is true).
- isLambda(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- isLastFieldConsumesRemaining() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
-
Indicates if the last field in each record will contain the rest of each line (default is false).
- isLastFieldConsumesRemaining() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Indicates if the last field takes the rest of each line regardless of its width (defaults to false).
- isLeadingZeroWholeNumber() - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
-
Returns
truewhen this match is a non-negative whole number whose digits start with'0'and span more than one digit (e.g. - isLengthSupported() - Method in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
-
Indicates if this column type supports length specification.
- isLengthSupported() - Method in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
-
Indicates if a length or precision may follow this type in a column definition.
- isLengthSupported() - Method in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
-
Indicates if a length or precision may follow this type in a column definition.
- isLenient() - Method in class com.northconcepts.datapipeline.transform.SelectFields
-
Indicates if fields missing from a record are skipped instead of causing an exception (default is false).
- isLenientPattern() - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
Indicates if values are parsed leniently with the pattern (defaults to true).
- isLetter(int) - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Indicates if the character is an ASCII letter (a-z or A-Z).
- isLimitToAllowedValues() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Indicates if values not it
FieldDef.getAllowedValues()are allowed. - isLineageSupported() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Indicates if this reader can capture record and field lineage (false unless overridden by a reader that supports it).
- isLineageSupported() - Method in class com.northconcepts.datapipeline.core.ParsingReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.csv.CSVReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
-
Indicates if this input can save data lineage on the records it reads (false unless a subclass overrides it).
- isLineageSupported() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- isLineageSupported() - Method in class com.northconcepts.datapipeline.xml.SimpleXmlReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.xml.XmlReader
- isLineageSupported() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
- isLoadColumns() - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Indicates if each table's columns, primary key and row identifiers are loaded too, which also runs a
SELECTreturning no rows on each table (default is true). - isLoadExportedKeys() - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Indicates if the foreign keys referencing each table (exported keys) are loaded (default is true).
- isLoadImportedKeys() - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Indicates if each table's foreign keys to other tables (imported keys) are loaded (default is true).
- isLoadIndexes() - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Indicates if each table's indexes are loaded (default is true).
- isLocal() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- isLocal() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSink
-
Indicates if the file is on the local file system.
- isLocal() - Method in interface com.northconcepts.datapipeline.foundations.file.FileSource
-
Indicates if the file is on the local file system.
- isLocal() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
- isLocal() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- isLookupById() - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Indicates if users are looked up by ID (the default); the source field must then hold
Longvalues. - isLookupByScreenName() - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Indicates if users are looked up by the screen name in the source field instead of by ID (default is false).
- isMakeIdentifiersSingular() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
- isMakeIdentifiersSingular() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Indicates if entity class names are made singular, such as
Customerfor acustomerstable (default false). - isMakeIdentifiersSingular() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if entity class names are made singular, such as
Customerfor acustomerstable (default false). - isMakeOptionalFieldsRequired() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if top-level optional columns with no nulls and equal min/max statistics may be read as required (default is false).
- isMakeOptionalFieldsRequired() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Used whether to check for
optionalcolumns that can be maderequiredusingduringinvalid reference
ColumnChunkMetaData#getStatistics()ParquetDataReader.open(). - isMakeRequiredFieldsOptional() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if top-level required columns whose statistics report nulls are read as optional (default is false).
- isMakeRequiredFieldsOptional() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
When true, check for
requiredcolumns that can be madeoptionalusing.invalid reference
ColumnChunkMetaData#getStatistics() - isMapTextRecordsToFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if text-only elements become simple values instead of nested records with a
$textfield (defaults to true). - isMapTextRecordsToFields() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if elements holding only text (or nothing) become plain field values (or null) instead of nested records (default is true).
- isMarker() - Method in class com.northconcepts.datapipeline.json.builder.JsonDetailMarker
- isMarker() - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Returns true for the
JsonDetailMarkerthat marks where each record is written. - isMarker(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlDetailMarker
- isMarker(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Returns true for the
XmlDetailMarkerthat marks where each record is written. - isMethodBacklisted(String) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Returns true if the specified method starts with any of the blacklisted prefixes and does not start with a whitelisted prefix.
- isMultithreaded() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Indicates if each processing stage runs in its own thread using an
AsyncReader(defaults to true). - isMuteUser() - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
-
Indicates if each followed user is also muted (default is false).
- isMuteUser() - Method in class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
-
Indicates if each unfollowed user is also muted (default is false).
- isNegative() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- isNewLine(int) - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Indicates if the character is a carriage return or line feed.
- isNotAlive() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Returns true if this bus has been shutdown or is in the process of shutting down.
- isNotArray() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field's value is not anArrayValue. - isNotArray() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this value node is not anArrayValue. - isNotEmpty() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns
trueif this array contains elements -- equivalent toArrayValue.size()> 0. - isNotEmpty() - Method in class com.northconcepts.datapipeline.core.FieldList
- isNotEmpty() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns true if this record has at least one non-null field value.
- isNotEmpty() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns true if this list contains at least one record.
- isNotEmpty() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds an
IsNotEmptyrule to this filter. - isNotEmpty() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
- isNotEmpty() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryGrouping
- isNotEmpty() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
- IsNotEmpty - Class in com.northconcepts.datapipeline.filter.rule
-
Field filter rule that returns true if a field value is not empty.
- IsNotEmpty() - Constructor for class com.northconcepts.datapipeline.filter.rule.IsNotEmpty
-
Creates a new IsNotEmpty filter rule.
- isNotFieldType(FieldType) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field not to be of the given
FieldType. - isNotFinished() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader.ReaderThread
- isNotInstanceOfJavaType(Class<?>) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to be null or not an instance of the given type.
- isNotJavaType(Class<?>) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to be non-null and not exactly of the given class.
- isNotNull() - Method in class com.northconcepts.datapipeline.core.Field
- isNotNull() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif this node does not contain a null value. - isNotNull() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this node does not contain a null value. - IsNotNull - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields with non-null values. - IsNotNull() - Constructor for class com.northconcepts.datapipeline.filter.rule.IsNotNull
- IsNotNull() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to be non-null.
- isNotRecord() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field's value is not aRecord. - isNotRecord() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this value node is not aRecord. - isNotSingleValue() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field's value is not aSingleValue. - isNotSingleValue() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this value node is not aSingleValue. - isNotValid() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
- isNull() - Method in class com.northconcepts.datapipeline.core.CompositeValue
-
Returns true if every value is null, including when there are no values.
- isNull() - Method in class com.northconcepts.datapipeline.core.Field
- isNull() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif this node contains a null value. - isNull() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this node contains a null value. - isNull() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to be null.
- IsNull - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields with null values. - IsNull() - Constructor for class com.northconcepts.datapipeline.filter.rule.IsNull
- isNullable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Indicates if the column is known to allow nulls (false when the driver reports no nulls or unknown).
- isNullable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Indicates if the column is known to allow nulls (false when the database reports no nulls or unknown).
- isNullable() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns whether the column is nullable.
- isNullable() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Indicates if the column accepts nulls;
NOT NULLis written when false (default true). - isNullable() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Indicates if the column accepts nulls;
NOT NULLis written when false (default true). - isNullDefaultValue() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif the default value isnullor the string "NULL". - isNumber(String) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns true if Commons Lang
NumberUtils.isParsableaccepts the string. - isNumeric() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns true if values of this type are numbers (BYTE, SHORT, INT, LONG, FLOAT, DOUBLE, BIG_INTEGER and BIG_DECIMAL).
- isNumeric() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns true if at least one string value was recognized as a number.
- isNumeric(CharSequence) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- isNumeric(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- isNumericSqlType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif the SQL type is BIGINT, DECIMAL, DOUBLE, FLOAT, INTEGER, NUMERIC, REAL, SMALLINT or TINYINT. - isOpen() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Indicates if this endpoint is ready for reading or writing.
- isOpen() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- isOptimizeTreeStructure() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Indicates if dynamic names should collapse tree nodes together while the tree is being built (default false).
- isOverwrite() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableReader
-
Indicates if outcome fields replace existing non-null fields with the same name instead of being added under a numbered name (default false).
- isOverwrite() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableWriter
-
Indicates if outcome fields replace existing non-null fields with the same name instead of being added under a numbered name (default false).
- isOverwrite() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeReader
-
Indicates if outcome fields replace existing non-null fields with the same name instead of being added under a numbered name (default false).
- isOverwrite() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeWriter
-
Indicates if outcome fields replace existing non-null fields with the same name instead of being added under a numbered name (default false).
- isOverwrite() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction.FieldMapping
-
Indicates if an existing target field is replaced; otherwise it is left unchanged.
- isOverwrite() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Overwrites the file if true, otherwise, throws an exception if the file already exists.
- isOverwrite() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Overwrites the file if true, otherwise, throws an exception if the file already exists.
- isOverwriteFields() - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Returns true if the duplicate field action is
Node.DuplicateNodeAction.OVERWRITE. - isParallelCall - Variable in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- isParseFieldNamesAsFieldPath() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
-
Indicates if each added source and target field name in the mappings should be treated as a
FieldPathexpression and parsed (when true, the default) or as a literal and used as a name, exactly as-is without parsing (when false). - isParseFieldNamesAsFieldPath() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
-
Indicates if each added field name in the mappings should be treated as a
FieldPathexpression and parsed (when true, the default) or as a literal and used as a name, exactly as-is without parsing (when false). - isParseFieldNamesAsFieldPath() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
-
Indicates if each source field name in the mappings should be treated as a
FieldPathexpression and parsed (when true, the default) or as a literal and used as a name, exactly as-is without parsing (when false). - isPaused() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns
trueif this job is currently paused. - isPaused() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns
trueif this job is currently paused. - isPaused() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns
trueif this job is currently paused. - isPollingRequired() - Method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Indicates if the
BufferStrategy.shouldClose(RecordBuffer, BufferedReader, Record)method should be called every second for open buffers -- even if no new data is present -- to release any data that may have been collected (passing in anullrecord). - isPollingRequired() - Method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
- isPollingRequired() - Method in class com.northconcepts.datapipeline.group.CreateWindowStrategy
- isPretty() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Indicates if line breaks and indentation are added to the output (defaults to false).
- isPretty() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if line breaks and indentation are added to the output (defaults to false).
- isPretty() - Method in class com.northconcepts.datapipeline.jdbc.sql.SqlPart
-
Indicates if
SqlPart.getSqlFragment()adds line breaks and indentation instead of using one line (default is false). - isPretty() - Method in class com.northconcepts.datapipeline.json.JsonRecordWriter
-
Indicates if line breaks and indentations should be added to output (default false).
- isPretty() - Method in class com.northconcepts.datapipeline.json.SimpleJsonWriter
-
Indicates if line breaks and indentations should be added to output (default false).
- isPretty() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Indicates if output is split into indented lines instead of joined by the non-pretty separator (default is true).
- isPretty() - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Returns whether pretty formatting is enabled.
- isPretty() - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
-
Indicates if line breaks and indentations should be added to the output insert statements (default false).
- isPretty() - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
-
Indicates if line breaks and indentations should be added to the output insert statements (default false).
- isPretty() - Method in class com.northconcepts.datapipeline.xml.SimpleXmlWriter
-
Indicates if line breaks and indentations should be added to output (default false).
- isPretty() - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Indicates if line breaks and indentations should be added to output (default false).
- isPretty() - Method in class com.northconcepts.datapipeline.xml.XmlWriter
-
Indicates if line breaks and indentations should be added to output (default false).
- isPrimaryKey() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- isPrimaryKey() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Returns
trueifprimaryKeyPositionis not null. - isPrimaryKey() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns whether the column is a primary key.
- isPrimaryKey() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Indicates if
CreateTablelists the column in the table'sPRIMARY KEYclause. - isPrimaryKey() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Indicates if
CreateTablelists the column in the table'sPRIMARY KEYclause. - isPrimaryKeyIndex() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Returns true if this index has exactly the entity's primary key fields, in key order and all ascending.
- isPrimaryKeyTable(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Returns
trueif the given table is the referenced (primary key) table, comparing catalog, schema and name exactly. - isPseudo() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Indicates if the column is a pseudo column, like an Oracle ROWID, reported as part of the best row identifier.
- isPublishLifecycleEvents() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Indicates if the bus should publish its own EventBusLifecycleListener and ShutdownListener events (defaults to
true). - isQuantity() - Method in interface com.northconcepts.datapipeline.expression.ASTNode
-
Trueif this node represents a literal of variable,falseif it represents an expression. - isRateLimitExceeded() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- isRateLimitExceeded() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
- isReadMetadata() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Returns whether Excel metadata (such as hyperlinks and cell styles) should be read.
- isReadOnly() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- isRealNumber() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns
trueif values of this type are numbers that can contain fractions. - isRealNumber() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif columns of this type are numbers that can contain fractions. - isRecord() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field's value is aRecord. - isRecord() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns
trueif this value node is aRecord. - isRecord() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns
trueif this value node is aRecord. - isRecord() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this value node is aRecord. - isRecordBreak() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if each instance of this node starts a new record.
- isRecordBreak(JsonXmlNode) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Returns true if the node matches any location path added with
JsonRecordReader.addRecordBreak(String). - isRecordBreak(XmlNode) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Returns true if the node matches any location path added with
XmlReader.addRecordBreak(String). - isRecordBreak(XmlNode) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Returns true if the node matches any location path added with
XmlRecordReader.addRecordBreak(String). - isRecordCountBigInteger() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Indicates if this endpoint's record-count is too big (over 1000000000000000000L or 1.0e+18) for a
longand should be retrieved as aBigIntegerusingDataEndpoint.getRecordCountAsBigInteger(). - isRecordsLoaded() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Return
trueif all the records have been loaded. - isRecordStackTraceInMessage() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Indicates if the warning added when a transformer returns false includes a stack trace (default is true).
- isRecordStackTraceInMessage() - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Indicates if the warning added when a transformer returns false includes a stack trace (default is true).
- isRecordStackTraceInMessage() - Method in class com.northconcepts.datapipeline.validate.ValidatingReader
-
Indicates if the warning recorded for each discarded record captures a stack trace (defaults to true).
- isRemoteVerification() - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Indicates if data connections must be with the same host as the control connection, applied at
FtpFileSystem.open()(defaults to true). - isRemoveDocumentId() - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
-
Indicates if the document "_id" property should be removed from the resulting records (defaults to true).
- isRemoveFieldsWithoutColumnMetadata() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if schema fields with no column metadata in any row group are dropped from the schema used for reading (default is false).
- isRemoveFieldsWithoutColumnMetadata() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
When true, remove fields in the schema does not have a corresponding
ColumnChunkMetaDatain the file. - isRemoveFieldsWithoutValues() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if top-level columns that have no values in a row group are dropped from the schema used for reading (default is false).
- isRemoveFieldsWithoutValues() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
When true, remove fields in the schema whose value count is invalid input: '<'= 0 See
ParquetDataReader.getFieldsWithoutColumnMetadata()for details. - isRemoveUnsupportedChars() - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Returns whether unsupported characters are removed from field names.
- isRemoveUnsupportedChars() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Indicates if characters other than letters, digits, '_' and '-' are removed from field names (default is true).
- isRemoveUnsupportedChars() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates if characters other than letters, digits, '_' and '-' are removed from field names (default is true).
- isRemoveUnsupportedChars() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates if unsupported characters should be removed from field names (default is true).
- isRenameRequired() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction.FieldMapping
-
Returns true if the target is not blank and differs, case-sensitively, from the source.
- isRequired() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Indicates if this field can be null or missing.
- isRestrict() - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
-
Returns whether RESTRICT is enabled.
- isRestrict() - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
-
Returns the inverse of
DropTable.isCascade(); noRESTRICTkeyword is ever written. - isRestrict() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
-
Returns the inverse of
DropTable.isCascade(); noRESTRICTkeyword is ever written. - isRestrict() - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
-
Returns the inverse of
DropTableConstraint.isCascade(); noRESTRICTkeyword is ever written. - isReturnOrphans() - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Indicates if records failing the lookup should be returned — instead of being deleted (default is
false). - isRotating() - Method in class com.northconcepts.datapipeline.security.CachingCredentialsResolver
- isRotating() - Method in interface com.northconcepts.datapipeline.security.CredentialsResolver
-
Indicates if this resolver can return different credentials over time.
- isRotating() - Method in class com.northconcepts.datapipeline.security.FileCredentialsResolver
- isRotating() - Method in class com.northconcepts.datapipeline.security.SuppliedCredentialsResolver
- isRotating() - Method in class com.northconcepts.datapipeline.security.SystemPropertyCredentialsResolver
- isRowIdentifier() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif the column is part of the table's best row identifier (the columns that uniquely identify a row). - isRunning() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Returns
trueif this job is currently running. - isRunning() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Returns
trueif this job is currently running. - isRunning() - Method in class com.northconcepts.datapipeline.job.Job
-
Returns
trueif this job is currently running. - isRunning() - Method in class com.northconcepts.datapipeline.meter.Meter
-
Indicates if the timer is still running (not stopped since the meter was created or last reset).
- isSanitizeInput() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if generated setters clean text values with the Jsoup basic whitelist to remove unsafe HTML (default false).
- isSaveLineage() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Indicates if record and field lineage is captured for each record read (default is false).
- isSaveLineage() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
-
Indicates if data lineage (where each record and field came from) is saved on the records read (defaults to false).
- isSaveLineage() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- isScaleSupported() - Method in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
-
Indicates if this column type supports scale specification.
- isScaleSupported() - Method in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
-
Indicates if a scale may follow the length or precision of this type in a column definition.
- isScaleSupported() - Method in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
-
Indicates if a scale may follow the length or precision of this type in a column definition.
- isSearchable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Indicates if the column can be used in a WHERE clause.
- isSendSkippedToDiscardWriter() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
-
Indicates if records skipped by a failed mapping condition are also written to the discard writer (default false).
- isSendSkippedToDiscardWriter() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
-
Indicates if records skipped by a failed mapping condition are also written to the discard writer (default false).
- isSendSkippedToDiscardWriter() - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
-
Indicates if records skipped because a mapping condition failed are also sent to the discard writer (defaults to false).
- isSequence(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- isSigned() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- isSigned() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- isSigned() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
-
Indicates if the number needs a sign; same as
NumberDescriptor.isNegative(). - isSingleEvent() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Indicates the
singleEventsvalue of the events request (default is true). - isSingleValue() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field's value is aSingleValue. - isSingleValue() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns
trueif this value node is aSingleValue. - isSingleValue() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this value node is aSingleValue. - isSkip() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
-
Indicates if
FixedWidthReaderdiscards this column instead of creating a field for it (default is false). - isSkipEmptyRows() - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Indicates that rows with only null values should not be returned by the reader (default is false).
- isSkipEmptyRows() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if rows with only null values are skipped (defaults to false).
- isSkipEmptyRows() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if rows whose values are all null or empty are skipped (defaults to false).
- isSkipEmptyRows() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Indicates if rows with only null values are skipped (defaults to false).
- isStopOnWriterEOF() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Indicates if this reader should stop reading from the event bus when any event bus writer on the same topic finishes (default to true).
- isStrictArrays() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Indicates if arrays should be strictly handled as arrays (default/true) or if an array with one value can be treated and a non-array and vice-versa (false).
- isStrictTypeMapping() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Indicates if database types should be mapped to java type based only on
java.sql.Typesas defined by Sun/Oracle (defaults to false). - ISSUE_COUNT - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
- isTabular() - Method in class com.northconcepts.datapipeline.core.FieldList
-
Indicates if all the fields match against a flat record (i.e.
- isTabular() - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Indicates if this path matches against a flat record (i.e.
- isTemporal() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns true if values of this type are dates or times (DATETIME, DATE and TIME).
- isTemporal() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns true if at least one string value matched a date/time pattern.
- isTemporalSqlType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif the SQL type is DATE, TIME, TIMESTAMP, TIME_WITH_TIMEZONE or TIMESTAMP_WITH_TIMEZONE. - isTerminateWithSemicolon() - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
-
Indicates if the MERGE statement ends with a semicolon (default is false);
MergeUpsert.prepare(JdbcUpsertWriter, Record)turns this on when the database product name is Microsoft SQL Server or ASE. - isTerminateWithSemicolon() - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
-
Indicates if the MERGE statement ends with a semicolon (default is false).
- isTerminateWithSemicolon() - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
-
Indicates if the MERGE statement ends with a semicolon (default is false).
- isTextSqlType() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Returns
trueif the SQL type is CHAR, VARCHAR, LONGVARCHAR, their national (N) variants, CLOB or NCLOB. - isTextual() - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns true if values of this type are text (STRING and CHAR).
- isTextual() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns true if at least one string value was not recognized as another type.
- isThrowExceptionOnMissingField() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Indicates if a record missing a checked field causes an exception (the default) instead of being discarded.
- isThrowExceptionOnMissingField() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Indicates if an exception should be thrown if the source field is missing (default to true).
- isTimeExpired() - Method in class com.northconcepts.datapipeline.core.TimedReader
-
Returns
trueif reading stopped due to the time expiring. - isTransacted() - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Indicates if the JMS session is created as transacted (default is false).
- isTrim() - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
Indicates if leading and trailing whitespace characters should be removed (default is false).
- isTrimFields() - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Indicates if space and tab characters at the beginning and ending of non-quoted-values should be removed.
- isTrimFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if whitespace around unquoted values is removed (defaults to true).
- isTrue(ExpressionContext) - Method in class com.northconcepts.datapipeline.json.builder.JsonLogicalExpression
- isTrue(ExpressionContext) - Method in class com.northconcepts.datapipeline.xml.builder.XmlLogicalExpression
- isTruncated() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectListing
-
Indicates if more results (objects or common prefixes) remain; pass this listing to
AmazonS3FileSystem.nextBatch(S3ObjectListing)to get the next page. - isTruncateFields() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
-
Indicates if values longer than their column are cut to fit instead of failing the write (default is true).
- isTruncateFields() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Indicates if values longer than their column are cut to fit instead of failing the write (defaults to true).
- isUnderline() - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Returns whether underline formatting is enabled.
- isUnique() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- isUnique() - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Returns whether this is a unique index.
- isUnique() - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Returns whether the column has a unique constraint.
- isUnique() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- isUnique() - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- isUnique() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- isUnique() - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- isUseBigDecimal() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
-
Indicates if JSON decimal numbers are read as
BigDecimalinstead of double (defaults to false). - isUseBigDecimal() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Indicates if JSON decimal numbers are read as
BigDecimalinstead of double (defaults to false). - isUseBigDecimal() - Method in class com.northconcepts.datapipeline.json.JsonReader
-
Indicates if decimal numbers are read as BigDecimal instead of Double (default is false).
- isUseBigDecimal() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Indicates if decimal numbers are read as BigDecimal instead of Double (default is false).
- isUseBigDecimal() - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
-
Indicates if decimal numbers are read as BigDecimal instead of Double (default is false).
- isUseBigInteger() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
-
Returns whether to use
BigIntegerfor large integer values in JSON. - isUseBigInteger() - Method in class com.northconcepts.datapipeline.json.JsonReader
-
Returns whether BigInteger should be used for reading large numeric values.
- isUseBigInteger() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Returns whether BigInteger should be used for reading large numeric values.
- isUseBigInteger() - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
-
Returns whether BigInteger should be used for reading large numeric values.
- isUseCatalog() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Indicates if each table's catalog is passed to the column, key and index metadata lookups instead of null (default is false).
- isUseColumnLabel() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Indicates if column labels (aliases) are used as field names instead of the column names (defaults to false).
- isUseDatabaseIdentifiersAsDisplayNames() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Returns whether to use database identifiers as display names in generated form definitions.
- isUseInferredType() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Deprecated.
- isUseSheetColumnCount() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Indicates whether to use the entire worksheet (or just the current row) when determining each record's field count (default is false).
- isUseSheetColumnCount() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if every record gets a field for each column in the sheet, not just its own row's cells (defaults to false).
- isUseStrongListenerReference() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Indicates if the event bus uses strong references (default) or soft references for holding listeners added to the bus.
- isUseTemplateObjectWrapper() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Indicates if values are wrapped with a
TemplateObjectWrapperbefore templates see them; fixed by the constructor. - isUseTimestampInstant() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates if
Instants should be used to store datetime values. - isUseTimestampInstant() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates if
Instants should be used to store datetime values. - isUTC() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates if datetime values are adjusted to UTC.
- isUTC() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates if datetime values are adjusted to UTC.
- isUuid() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Returns true if at least one string value was recognized as a UUID.
- isValid() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
- isValidateInput() - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
-
Checks whether input validation is active
- isValueNode() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns
trueif this node is a ValueNode (Record, ArrayValue, or SingleValue). - isValueNode() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Returns
trueif this node is a ValueNode (Record, ArrayValue, or SingleValue). - isValueNode(Object) - Static method in class com.northconcepts.datapipeline.jsonata.ValueNodeMapper
- isValueNotSet() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field has never had a value assigned. - isValueSet() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns
trueif this field has had a value assigned (including anullvalue). - isWildcard() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if this node is named
*, standing in for siblings with dynamic names. - isWildcardPathSegment(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Indicates if any
NodeNameRuleclassifies the supplied name as dynamic. - isWrapText() - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Returns whether text wrapping is enabled for the cell.
- isWritable() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- isWriteFieldsAsAttributes() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if null and single-value fields are written as attributes instead of child elements (defaults to true).
- isWriteFieldsAsAttributes() - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Indicates if null and single-valued fields are written as attributes of their element instead of child elements (default is true).
- isWriteMetadata() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Returns whether Excel metadata (such as hyperlinks and cell styles) should be written.
- isWriteToFile() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Indicates if generated classes are written as files under the base folder instead of printed to the print writer (default true).
- isWriteToFile() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Indicates if generated classes are written as files under the base folder instead of printed to the print writer (default true).
- isWriteToFile() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if generated classes are written as files under the base folder instead of printed to the print writer (default true).
- isWriteUuidAsString() - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Indicates whether UUID values are written as strings or bytes.
- isWriteUuidAsString() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Indicates whether UUID values are written as strings or bytes.
- isWriteUuidAsString() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates whether UUID values are written as strings or bytes.
- isWriteUuidAsString() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates whether UUID values are written as strings or bytes.
- isWriteXmlDeclaration() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if an XML declaration is written first (defaults to false).
- isWriteXmlDeclaration() - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Indicates if the output starts with an XML declaration (default is false).
- italic() - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that makes text italic.
- iterator() - Method in class com.northconcepts.datapipeline.core.ArrayValue
- iterator() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- iterator() - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns an iterator over the fields in this list.
- iterator() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns an iterator over the fields in this record.
- iterator() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns an iterator over the records in this list.
- iterator() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- ITwitterConverter - Interface in com.northconcepts.datapipeline.twitter
-
Copies Twitter tweets, users and user lists into records;
TwitterConverteris the default implementation. - IUpsert - Interface in com.northconcepts.datapipeline.jdbc.upsert
-
The strategy used to upsert records to a database.
J
- JAN_1_1970 - Static variable in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- JAN_1_1970 - Static variable in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- JAVA_ARRAY_SIZE - Static variable in class com.northconcepts.datapipeline.core.Field
- JAVA_OBJECT_SIZE - Static variable in class com.northconcepts.datapipeline.core.Field
- JavaBeanReader - Class in com.northconcepts.datapipeline.javabean
-
Obtains records from an object using bean introspection and reflection.
- JavaBeanReader(String, Object) - Constructor for class com.northconcepts.datapipeline.javabean.JavaBeanReader
-
Creates a reader over the given object graph, using
nameas the root element name in location paths. - JavaCodeBuilder - Class in com.northconcepts.datapipeline.sourcecode
-
A simple model containing generated Java code, imports, and variable names.
- JavaCodeBuilder() - Constructor for class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
- JavaCodeGenerator - Interface in com.northconcepts.datapipeline.sourcecode
-
Interface for classes capable of participating in Java code generation.
- JdbcConnection - Class in com.northconcepts.datapipeline.foundations.jdbc
-
Describes a database (driver, URL, credentials and driver properties), creates JDBC connections to it and loads its table, schema and query metadata.
- JdbcConnection() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- JdbcConnectionFactory - Interface in com.northconcepts.datapipeline.jdbc
-
A consistent interface for creating JDBC connections.
- JdbcConnectionListener - Interface in com.northconcepts.datapipeline.foundations.jdbc
-
Callbacks fired while
JdbcConnection.loadTables(LoadTablesRequest)runs: atable...method after each table's step and a plural one once the step is done for all tables. - JdbcDataset - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Caches the dataset's records on database.
- JdbcDataset.DatabaseProvider - Enum Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Enumeration of supported database providers for JDBC datasets.
- JdbcExportedKey - Class in com.northconcepts.datapipeline.foundations.jdbc
-
One column of a foreign key that references the owning table's primary key, as reported by JDBC
getExportedKeys. - JdbcExportedKey() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcExportedKey
- JdbcFieldIndex - Class in com.northconcepts.datapipeline.foundations.jdbc
-
One column of a
JdbcIndex: its name, position in the index and sort direction. - JdbcFieldIndex() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
- JdbcFieldIndex(String, int, boolean) - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
- JdbcImportedKey - Class in com.northconcepts.datapipeline.foundations.jdbc
-
One column of a foreign key: the referencing (foreign key) column and the primary key column it points to, as reported by JDBC
getImportedKeys; a multi-column key has one entry per column. - JdbcImportedKey() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- JdbcIndex - Class in com.northconcepts.datapipeline.foundations.jdbc
-
Metadata for a table index and its columns, as reported by JDBC
DatabaseMetaData.getIndexInfo. - JdbcIndex() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- JdbcLookup - Class in com.northconcepts.datapipeline.transform.lookup
-
A
Lookupthat runs a SQL query for each lookup, binding the key values to its parameters in order. - JdbcLookup(JdbcConnectionFactory, String) - Constructor for class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
-
Creates a new instance with the
autoCloseConnectionproperty set totrue. - JdbcLookup(JdbcConnectionFactory, String, int...) - Constructor for class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
-
Creates a new instance with the
autoCloseConnectionproperty set totrue. - JdbcLookup(Connection, String) - Constructor for class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
-
Creates a new instance with the
autoCloseConnectionproperty set tofalse. - JdbcLookup(Connection, String, int...) - Constructor for class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
-
Creates a new instance with the
autoCloseConnectionproperty set tofalse. - JdbcMultiUpsertWriter - Class in com.northconcepts.datapipeline.jdbc
-
Writes records to a database table using the upsert idiom (attempt to insert, but update if duplicate key exists).
- JdbcMultiUpsertWriter(JdbcConnectionFactory, int, int, String, IUpsert, String...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Creates a writer that obtains its connections from the factory when opened; at least one key field is required.
- JdbcMultiUpsertWriter(JdbcConnectionFactory, int, int, String, String...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Creates a writer using
GenericUpsertthat obtains its connections from the factory when opened. - JdbcMultiUpsertWriter(DataSource, int, int, String, IUpsert, String...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Creates a writer that obtains its connections from the data source when opened; at least one key field is required.
- JdbcMultiUpsertWriter(DataSource, int, int, String, String...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Creates a writer using
GenericUpsertthat obtains its connections from the data source when opened. - JdbcMultiWriter - Class in com.northconcepts.datapipeline.jdbc
-
Writes records to a database table using 1 or more connections; each connection writing asynchronously using a separate thread.
- JdbcMultiWriter(JdbcConnectionFactory, int, int, String) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Creates a writer using
PreparedStatementInsertthat obtains its connections from the factory when opened. - JdbcMultiWriter(JdbcConnectionFactory, int, int, String, IInsert) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Creates a writer that obtains its connections from the factory when opened.
- JdbcMultiWriter(DataSource, int, int, String) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Creates a writer using
PreparedStatementInsertthat obtains its connections from the data source when opened. - JdbcMultiWriter(DataSource, int, int, String, IInsert) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Creates a writer that obtains its connections from the data source when opened.
- JdbcPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Reads a pipeline's source data from a database query using a
JdbcReader. - JdbcPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- JdbcPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline.output
-
Writes a pipeline's records to a database table using a
JdbcWriter. - JdbcPipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- JdbcQuery - Class in com.northconcepts.datapipeline.foundations.jdbc
-
A named SQL query with its parameters and result columns;
JdbcConnection.loadQueries()fills in the columns by running it. - JdbcQuery() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- JdbcQuery(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- JdbcQuery.Cardinality - Enum Class in com.northconcepts.datapipeline.foundations.jdbc
-
Whether a query returns many rows or a single row; generated DAO code reads only the first row for
ONE. - JdbcQueryColumn - Class in com.northconcepts.datapipeline.foundations.jdbc
-
Metadata for one result column of a
JdbcQuery, read from JDBCResultSetMetaDatabyJdbcConnection.loadQueries(). - JdbcQueryColumn() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- JdbcQueryParameter - Class in com.northconcepts.datapipeline.foundations.jdbc
-
A
?parameter of aJdbcQuery: its name, Java and SQL types, and an expression giving the example value bound whenJdbcConnection.loadQueries()runs the query. - JdbcQueryParameter() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- JdbcQueryParameter(String, Class<?>, Integer, String) - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- JdbcReader - Class in com.northconcepts.datapipeline.jdbc
-
Obtains records from a database query.
- JdbcReader(JdbcConnectionFactory, String) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Creates a new instance with the
autoCloseConnectionproperty set totrue. - JdbcReader(JdbcConnectionFactory, String, Object...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Creates a new instance with the
autoCloseConnectionproperty set totrue. - JdbcReader(JdbcConnectionFactory, String, Object[], int[]) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Creates a new instance with the
autoCloseConnectionproperty set totrue. - JdbcReader(Connection, String) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Creates a new instance with the
autoCloseConnectionproperty set tofalse. - JdbcReader(Connection, String, Object...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Creates a new instance with the
autoCloseConnectionproperty set tofalse. - JdbcReader(Connection, String, Object[], int[]) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Creates a new instance with the
autoCloseConnectionproperty set tofalse. - JdbcResultPage<T> - Class in com.northconcepts.datapipeline.foundations.jdbc
-
One page of query results: its rows plus the page number, page size and total row count.
- JdbcResultPage(int, int, List<T>, long) - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
-
Creates a page holding
content, the rows of the 0-basedpage, out oftotalrows overall. - JdbcSchema - Class in com.northconcepts.datapipeline.foundations.jdbc
-
A database schema and the catalog it belongs to, as loaded by
JdbcConnection.loadCatalogAndSchemas(). - JdbcSchema() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcSchema
- JdbcSink - Interface in com.northconcepts.datapipeline.foundations.jdbc
-
A named database destination, such as a
JdbcTable. - JdbcSource - Interface in com.northconcepts.datapipeline.foundations.jdbc
-
A named table or query whose rows can be read with the SQL from
JdbcSource.getQuery(). - JdbcSourceType - Enum Class in com.northconcepts.datapipeline.foundations.jdbc
-
Whether a
JdbcSourceis a table or a query. - JdbcTable - Class in com.northconcepts.datapipeline.foundations.jdbc
-
Metadata for a database table or view (name, schema, type, columns, keys and indexes), as loaded by
JdbcConnection.loadTables(LoadTablesRequest). - JdbcTable() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- JdbcTableColumn - Class in com.northconcepts.datapipeline.foundations.jdbc
-
Metadata for a column of a
JdbcTable, read from JDBCDatabaseMetaDatabyJdbcConnection.loadTables(LoadTablesRequest). - JdbcTableColumn() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- JdbcUpsertWriter - Class in com.northconcepts.datapipeline.jdbc
-
Writes records to a database table using the upsert idiom (attempt to insert, but update if duplicate key exists).
- JdbcUpsertWriter(JdbcConnectionFactory, String, IUpsert, String...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Creates a new instance with the
autoCloseConnectionproperty set totrue, using a connection obtained from the factory immediately; at least one key field is required. - JdbcUpsertWriter(JdbcConnectionFactory, String, String...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- JdbcUpsertWriter(Connection, String, IUpsert, String...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Creates a new instance with the
autoCloseConnectionproperty set tofalse; at least one key field is required. - JdbcUpsertWriter(Connection, String, String...) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- JdbcValueReader - Interface in com.northconcepts.datapipeline.jdbc
-
The interface used to read column values from a JDBC ResultSet.
- JdbcWriter - Class in com.northconcepts.datapipeline.jdbc
-
Writes records to a database table.
- JdbcWriter(JdbcConnectionFactory, String) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Creates a new instance with the
autoCloseConnectionproperty set totrue. - JdbcWriter(JdbcConnectionFactory, String, IInsert) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Creates a new instance with the
autoCloseConnectionproperty set totrue. - JdbcWriter(Connection, String) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Creates a new instance with the
autoCloseConnectionproperty set tofalse. - JdbcWriter(Connection, String, IInsert) - Constructor for class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Creates a new instance with the
autoCloseConnectionproperty set tofalse. - JException - Exception Class in com.northconcepts.datapipeline.jsonata
- JException(String) - Constructor for exception class com.northconcepts.datapipeline.jsonata.JException
- JException(String, int) - Constructor for exception class com.northconcepts.datapipeline.jsonata.JException
- JException(String, int, Object) - Constructor for exception class com.northconcepts.datapipeline.jsonata.JException
- JException(String, int, Object, Object) - Constructor for exception class com.northconcepts.datapipeline.jsonata.JException
- JException(Throwable, String, int, Object, Object) - Constructor for exception class com.northconcepts.datapipeline.jsonata.JException
- JFunction(Jsonata.JFunctionCallable, String) - Constructor for class com.northconcepts.datapipeline.jsonata.Jsonata.JFunction
- JFunction(String, String, Class, Object, String) - Constructor for class com.northconcepts.datapipeline.jsonata.Jsonata.JFunction
- JiraClient - Interface in com.northconcepts.datapipeline.jira.client
-
RESTEasy client proxy for the Jira REST endpoints used by the Jira readers and
JiraService; methods return the raw JSON response. - JiraClient.JiraStub - Class in com.northconcepts.datapipeline.jira.client
-
Holds a RESTEasy client and the
JiraClientproxy created byJiraClient.Proxy.get(String, String, String); callJiraClient.JiraStub.close()to release the client. - JiraClient.Proxy - Class in com.northconcepts.datapipeline.jira.client
-
Creates Jira clients that authenticate with a username and API key.
- JiraEpicReader - Class in com.northconcepts.datapipeline.jira
-
Reads Jira epics from a board based on the API user's permission.
- JiraEpicReader(String, String, String, int) - Constructor for class com.northconcepts.datapipeline.jira.JiraEpicReader
-
Creates a reader for the epics of the given board;
domainis the Jira site's base URL. - JiraIssue - Class in com.northconcepts.datapipeline.jira
-
The request body for creating, updating or transitioning a Jira issue: its key, its
fieldsrecord and an optional transition. - JiraIssue() - Constructor for class com.northconcepts.datapipeline.jira.JiraIssue
- JiraIssueReader - Class in com.northconcepts.datapipeline.jira
-
Reads Jira issues using JQL.
- JiraIssueReader(String, String, String, JiraSearch) - Constructor for class com.northconcepts.datapipeline.jira.JiraIssueReader
-
Creates a reader for the issues matching the search;
domainis the Jira site's base URL. - JiraProjectReader - Class in com.northconcepts.datapipeline.jira
-
Reads Jira projects from based on the API user's permission.
- JiraProjectReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.jira.JiraProjectReader
-
Creates a reader for the projects of the Jira site at the
domainbase URL. - JiraProjectReader.OrderByField - Enum Class in com.northconcepts.datapipeline.jira
-
The fields a
JiraProjectReadercan order projects by. - JiraProjectReader.SortDirection - Enum Class in com.northconcepts.datapipeline.jira
-
The direction a
JiraProjectReadersorts projects in;DEFAULTadds no direction prefix. - JiraReader - Class in com.northconcepts.datapipeline.jira
-
Base class for readers that page through a Jira REST resource, returning each item of every page as a record.
- JiraReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.jira.JiraReader
-
Creates a reader for the Jira site at the
domainbase URL, authenticating with the username and API key. - JiraSearch - Class in com.northconcepts.datapipeline.jira
-
A Jira issue search request: the JQL query, page size, fields to return and the token of the next page.
- JiraSearch() - Constructor for class com.northconcepts.datapipeline.jira.JiraSearch
- JiraService - Class in com.northconcepts.datapipeline.jira.client
-
Creates, updates, searches, transitions, comments on and deletes Jira issues through
JiraClient, returning JSON responses as records. - JiraService(String, String, String) - Constructor for class com.northconcepts.datapipeline.jira.client.JiraService
-
Creates a service for the Jira site at the
domainbase URL; callJiraService.close()when done. - JiraSprintReader - Class in com.northconcepts.datapipeline.jira
-
Reads Jira sprints from a board based on the API user's permission.
- JiraSprintReader(String, String, String, int) - Constructor for class com.northconcepts.datapipeline.jira.JiraSprintReader
-
Creates a reader for the sprints of the given board;
domainis the Jira site's base URL. - JiraSprintReader.SprintState - Enum Class in com.northconcepts.datapipeline.jira
-
The sprint states a
JiraSprintReadercan filter on;ALLsends no state filter. - JIS_B4 - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
- JIS_B4 - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- JIS_B5 - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
- JIS_B5 - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- JList() - Constructor for class com.northconcepts.datapipeline.jsonata.Utils.JList
- JList(int) - Constructor for class com.northconcepts.datapipeline.jsonata.Utils.JList
- JList(Collection<? extends E>) - Constructor for class com.northconcepts.datapipeline.jsonata.Utils.JList
- JmsAcknowledgeMode - Enum Class in com.northconcepts.datapipeline.jms
-
The JMS session acknowledge modes for
JmsSettings; inCLIENTmode,JmsReaderacknowledges each message once it has been converted to a record. - JmsConnection - Class in com.northconcepts.datapipeline.jms
-
A connection to Java Message Service (JMS) provider.
- JmsConnection(JmsSettings) - Constructor for class com.northconcepts.datapipeline.jms.JmsConnection
- JmsDestinationType - Enum Class in com.northconcepts.datapipeline.jms
-
Constants for the type of messaging to use.
- JmsReader - Class in com.northconcepts.datapipeline.jms
-
Read
Recordsfrom a Java Message Service (JMS) provider. - JmsReader(JmsSettings) - Constructor for class com.northconcepts.datapipeline.jms.JmsReader
-
Connects to a Java Message Service server.
Apache ActiveMQ Example:
Properties props = new Properties();
props.setProperty(Context.INITIAL_CONTEXT_FACTORY,"org.apache.activemq.jndi.ActiveMQInitialContextFactory");
props.setProperty(Context.PROVIDER_URL,"tcp://localhost:61616");
DataReader reader = new JmsReader(props, JmsDestinationType.QUEUE, "queueName");
- JmsSettings - Class in com.northconcepts.datapipeline.jms
- JmsSettings(String, JmsDestinationType) - Constructor for class com.northconcepts.datapipeline.jms.JmsSettings
- JmsSettings(String, JmsDestinationType, Properties) - Constructor for class com.northconcepts.datapipeline.jms.JmsSettings
- JmsWriter - Class in com.northconcepts.datapipeline.jms
-
Write
Recordsto a Java Message Service (JMS) provider. - JmsWriter(JmsSettings) - Constructor for class com.northconcepts.datapipeline.jms.JmsWriter
-
Connects to a Java Message Service server.
Apache ActiveMQ Example:
Properties props = new Properties();
props.setProperty(Context.INITIAL_CONTEXT_FACTORY,"org.apache.activemq.jndi.ActiveMQInitialContextFactory");
props.setProperty(Context.PROVIDER_URL,"tcp://localhost:61616");
DataWriter writer = new JmsWriter(props, JmsDestinationType.TOPIC, "topicName");
- Job - Class in com.northconcepts.datapipeline.job
-
Used to run, manage, and track pipelines.
- Job(DataReader, DataWriter) - Constructor for class com.northconcepts.datapipeline.job.Job
- JobCallback<R,
W> - Interface in com.northconcepts.datapipeline.job -
Receives the progress and outcome of a
Job; the defaultonFailurerethrows the exception. - JobCallback.Helper - Class in com.northconcepts.datapipeline.job
-
Factory for default callbacks such as
JobCallback.NULL. - JobLifecycleListener - Interface in com.northconcepts.datapipeline.job
-
Receives start, pause, resume and finish notifications for jobs; register with
Job.addJobLifecycleListener(JobLifecycleListener). - jobs - Static variable in class com.northconcepts.datapipeline.job.AbstractJob
- JobTemplate - Interface in com.northconcepts.datapipeline.job
-
JobTemplate is the base type for classes that transfer records from DataReaders to DataWriters.
- JobTemplateImpl - Class in com.northconcepts.datapipeline.job
-
The default
JobTemplate, which runs each transfer as aJob. - JobTemplateImpl() - Constructor for class com.northconcepts.datapipeline.job.JobTemplateImpl
- join() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Waits for the feeder process to finish reading records from the source reader and sending them to downstream readers.
- join(long) - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Waits at most millis milliseconds for the feeder process to finish reading records from the source reader and sending them to downstream readers.
- join(long, int) - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Waits at most millis milliseconds plus nanos nanoseconds for the feeder process to finish reading records from the source reader and sending them to downstream readers.
- join(Record, RecordList, List<?>) - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Merges the first lookup result into the record, after passing an empty result to
LookupTransformer.noResults(Record, List)or a multi-record one toLookupTransformer.tooManyResults(Record, List, RecordList). - join(CharSequence) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidationPath
-
Returns the current thread's path elements from first to last, separated by the delimiter (empty if there are none).
- join(List<String>, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Join an array of strings
- Join - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Base class for the JOIN clauses of a
Select, each joining a table on a condition. - Join(String, String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.Join
- JPEG - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- Json - Class in com.northconcepts.datapipeline.jsonata
-
Vanilla JSON parser Uses classes JsonParser + JsonHandler from: https://github.com/ralfstx/minimal-json
- Json() - Constructor for class com.northconcepts.datapipeline.jsonata.Json
- JSON - Enum constant in enum class com.northconcepts.datapipeline.core.StreamWriter.Format
- JSON - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- JSON - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- JSON - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- JSON - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- JSON_FACTORY - Static variable in class com.northconcepts.datapipeline.google.GoogleApiReader
- JSON_FACTORY - Static variable in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- JSON_LINES - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- Json._JsonHandler - Class in com.northconcepts.datapipeline.jsonata
- JsonArray - Class in com.northconcepts.datapipeline.json.builder
-
A JSON array in a
JsonTemplate; elements are added withJsonArray.object(),JsonArray.array()andJsonArray.value(String). - JsonArray - Class in com.northconcepts.datapipeline.jsonata
-
A lightweight
Listadapter over a DataPipelineArrayValue. - JsonArray() - Constructor for class com.northconcepts.datapipeline.json.builder.JsonArray
- jsonata(String) - Static method in class com.northconcepts.datapipeline.jsonata.Jsonata
-
JSONata
- Jsonata - Class in com.northconcepts.datapipeline.jsonata
- Jsonata.EntryCallback - Interface in com.northconcepts.datapipeline.jsonata
- Jsonata.ExitCallback - Interface in com.northconcepts.datapipeline.jsonata
- Jsonata.Fn0<R> - Interface in com.northconcepts.datapipeline.jsonata
- Jsonata.Fn1<A,
R> - Interface in com.northconcepts.datapipeline.jsonata - Jsonata.Fn2<A,
B, - Interface in com.northconcepts.datapipeline.jsonataR> - Jsonata.Fn3<A,
B, - Interface in com.northconcepts.datapipeline.jsonataC, R> - Jsonata.Fn4<A,
B, - Interface in com.northconcepts.datapipeline.jsonataC, D, R> - Jsonata.Fn5<A,
B, - Interface in com.northconcepts.datapipeline.jsonataC, D, E, R> - Jsonata.Fn6<A,
B, - Interface in com.northconcepts.datapipeline.jsonataC, D, E, F, R> - Jsonata.Fn7<A,
B, - Interface in com.northconcepts.datapipeline.jsonataC, D, E, F, G, R> - Jsonata.Fn8<A,
B, - Interface in com.northconcepts.datapipeline.jsonataC, D, E, F, G, H, R> - Jsonata.FnVarArgs<R> - Interface in com.northconcepts.datapipeline.jsonata
- Jsonata.Frame - Class in com.northconcepts.datapipeline.jsonata
- Jsonata.JFunction - Class in com.northconcepts.datapipeline.jsonata
-
JFunction definition class
- Jsonata.JFunctionCallable - Interface in com.northconcepts.datapipeline.jsonata
-
JFunction callable Lambda interface
- Jsonata.JFunctionSignatureValidation - Interface in com.northconcepts.datapipeline.jsonata
- Jsonata.JLambda - Interface in com.northconcepts.datapipeline.jsonata
- JSONB - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- JsonConditionalNode - Class in com.northconcepts.datapipeline.json.builder
-
A fragment of a
JsonTemplatewhose nodes are written only when its logical expression is true; created bywhen(String). - JsonConditionalNode(JsonNode, String) - Constructor for class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- JsonDetailMarker - Class in com.northconcepts.datapipeline.json.builder
-
Marks where records go in a
JsonTemplate; the nodes added to it are written once for each record. - JsonDetailMarker(JsonNode) - Constructor for class com.northconcepts.datapipeline.json.builder.JsonDetailMarker
- JsonExpression - Class in com.northconcepts.datapipeline.json.builder
-
An expression for a field name or value in a
JsonTemplate, parsed once and evaluated on each write. - JsonExpression(String) - Constructor for class com.northconcepts.datapipeline.json.builder.JsonExpression
- JsonField - Class in com.northconcepts.datapipeline.json.builder
-
A field of a JSON object in a
JsonTemplate: an expression for its name plus aJsonValue. - JsonField(String, JsonValue) - Constructor for class com.northconcepts.datapipeline.json.builder.JsonField
-
Creates a field named by evaluating
nameExpression; quote a fixed name, as in'id'. - JsonFragment - Class in com.northconcepts.datapipeline.json.builder
-
Base class for template nodes that write only their children, not JSON of their own, and take their type from the parent node.
- JsonFragment(JsonNode) - Constructor for class com.northconcepts.datapipeline.json.builder.JsonFragment
- JsonHandler<A,
O> - Class in com.northconcepts.datapipeline.jsonata -
A handler for parser events.
- JsonHandler() - Constructor for class com.northconcepts.datapipeline.jsonata.JsonHandler
- JsonLinesWriter - Class in com.northconcepts.datapipeline.json
-
Writes records in JSON Lines format: each record as a JSON object on its own line.
- JsonLinesWriter(File) - Constructor for class com.northconcepts.datapipeline.json.JsonLinesWriter
- JsonLinesWriter(Writer) - Constructor for class com.northconcepts.datapipeline.json.JsonLinesWriter
- JsonLogicalExpression - Class in com.northconcepts.datapipeline.json.builder
-
A boolean expression that decides whether a
JsonConditionalNode's nodes are written. - JsonLogicalExpression(String) - Constructor for class com.northconcepts.datapipeline.json.builder.JsonLogicalExpression
- JsonNode - Class in com.northconcepts.datapipeline.json.builder
-
Base class for the nodes of a
JsonTemplate; each writes its opening and closing JSON to a Jackson generator. - JsonNode() - Constructor for class com.northconcepts.datapipeline.json.builder.JsonNode
- JsonNodeType - Enum Class in com.northconcepts.datapipeline.json.builder
-
The kinds of nodes in a
JsonTemplate: scalar values, arrays, objects and object fields. - JsonNodeWriter - Class in com.northconcepts.datapipeline.json.builder
-
Walks a
JsonTemplate's node tree depth-first, writing one node to a Jackson generator per step. - JsonObject - Class in com.northconcepts.datapipeline.json.builder
-
A JSON object in a
JsonTemplate; fields are added withJsonObject.field(String, String),JsonObject.object(String)andJsonObject.array(String). - JsonObject - Class in com.northconcepts.datapipeline.jsonata
- JsonObject() - Constructor for class com.northconcepts.datapipeline.json.builder.JsonObject
- JsonParser - Class in com.northconcepts.datapipeline.jsonata
-
A streaming parser for JSON text.
- JsonParser(JsonHandler<?, ?>) - Constructor for class com.northconcepts.datapipeline.jsonata.JsonParser
-
Creates a new JsonParser with the given handler.
- JsonPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Reads a pipeline's source data from a JSON
FileSourceusing aJsonReader, which selects fields and record breaks by location path. - JsonPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- JsonPrimitive - Class in com.northconcepts.datapipeline.json.builder
-
A scalar value in a
JsonTemplatecomputed from an expression; dates, times and datetimes are written asyyyy-MM-dd,HH:mm:ss.SSSandyyyy-MM-dd'T'HH:mm:ss.SSS'Z'strings. - JsonPrimitive(String) - Constructor for class com.northconcepts.datapipeline.json.builder.JsonPrimitive
- JsonReader - Class in com.northconcepts.datapipeline.json
-
Obtains records from a JSON stream using
XmlReaderlocation paths, where JSON objects and arrays appear asobjectandarrayelements (for example//array/object/name). - JsonReader(File) - Constructor for class com.northconcepts.datapipeline.json.JsonReader
- JsonReader(Reader) - Constructor for class com.northconcepts.datapipeline.json.JsonReader
- JsonRecordPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Reads a pipeline's source data from a JSON
FileSourceusing aJsonRecordReader, which turns each node matching a record break into one nested record. - JsonRecordPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- JsonRecordPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline.output
-
Writes a pipeline's records to a JSON
FileSinkusing aJsonRecordWriter, one object per record. - JsonRecordPipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- JsonRecordReader - Class in com.northconcepts.datapipeline.json
-
Obtains records from a JSON stream, turning each object, array or field matched by a record break into one record that keeps nested objects and arrays as nested records and arrays.
- JsonRecordReader(JsonParser) - Constructor for class com.northconcepts.datapipeline.json.JsonRecordReader
- JsonRecordReader(File) - Constructor for class com.northconcepts.datapipeline.json.JsonRecordReader
- JsonRecordReader(Reader) - Constructor for class com.northconcepts.datapipeline.json.JsonRecordReader
- JsonRecordWriter - Class in com.northconcepts.datapipeline.json
-
Writes JSON using the structure of each record's natural representation.
- JsonRecordWriter(File) - Constructor for class com.northconcepts.datapipeline.json.JsonRecordWriter
- JsonRecordWriter(Writer) - Constructor for class com.northconcepts.datapipeline.json.JsonRecordWriter
- JsonSerializable - Interface in com.northconcepts.datapipeline.core
-
The interface implemented by classes to participate in serialization to and from JSON.
- JsonTemplate - Class in com.northconcepts.datapipeline.json.builder
-
Describes the JSON a
JsonWriterproduces: nodes before theJsonFragment.detail()marker form the header, the marker's nodes are written once per record and the remaining nodes form the footer. - JsonTemplate() - Constructor for class com.northconcepts.datapipeline.json.builder.JsonTemplate
- JsonValue - Class in com.northconcepts.datapipeline.json.builder
-
Base class for the objects, arrays and scalar values of a
JsonTemplate. - JsonValue() - Constructor for class com.northconcepts.datapipeline.json.builder.JsonValue
- JsonWriter - Class in com.northconcepts.datapipeline.json
-
Writes records as JSON using a
JsonTemplatethat defines the header, each record's detail and the footer. - JsonWriter(JsonTemplate, File) - Constructor for class com.northconcepts.datapipeline.json.JsonWriter
- JsonWriter(JsonTemplate, Writer) - Constructor for class com.northconcepts.datapipeline.json.JsonWriter
- JXL - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Read/Write .xls files using JExcel/JXL.
K
- K - Static variable in class com.northconcepts.datapipeline.meter.Meter
- KafkaReader - Class in com.northconcepts.datapipeline.kafka
-
Read
Recordsfrom an Apache Kafka distributed messaging system. - KafkaReader(Properties, String, long) - Constructor for class com.northconcepts.datapipeline.kafka.KafkaReader
-
Creates a reader for the topic that waits up to
pollTimeoutmilliseconds for each poll. - KafkaWriter - Class in com.northconcepts.datapipeline.kafka
-
Write
Recordsto an Apache Kafka distributed messaging system. - KafkaWriter(Properties, String) - Constructor for class com.northconcepts.datapipeline.kafka.KafkaWriter
-
Creates a writer that sends each record to the topic without a key; opening it puts the key/value serializers into the given properties.
- keepSingleton - Variable in class com.northconcepts.datapipeline.jsonata.Utils.JList
- keepSingletonArray - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- KEY - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
- keys() - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- keys(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Return keys for an object
- keySet() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns the set of all session property keys.
- keySet() - Method in interface com.northconcepts.datapipeline.core.Session
-
Returns the set of all session property keys.
- keySet() - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- keyValuePairIterator() - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
L
- label - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- LANDSCAPE - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageOrientation
- LANDSCAPE - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageOrientation
- LargeCellHandler - Enum Class in com.northconcepts.datapipeline.excel
-
Strategy for text values longer than
ExcelWriter.MAX_CELL_LENGTHcharacters, the most an Excel cell can hold. - last(FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the last value of the field in each group, written to the same field path.
- last(FieldPath, FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the last non-null value of the source field in each group, written to the target field.
- last(FieldPath, FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- last(String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the last value of the field in each group, written to a field of the same name.
- last(String, String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the last non-null value of the source field in each group, written to the target field.
- last(String, String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- LAST - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
- LAST_ISSUE_UPDATED_TIME - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
- lastIndexOf(Object) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- lastRecord - Variable in class com.northconcepts.datapipeline.core.DataEndpoint
- lastRow - Variable in class com.northconcepts.datapipeline.core.AbstractReader
- LatexPipelineOutput - Class in com.northconcepts.datapipeline.latex.output
-
A pipeline output that writes records as a table in a LaTeX document to a
FileSinkusing aLatexWriter. - LatexPipelineOutput() - Constructor for class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- LatexWriter - Class in com.northconcepts.datapipeline.latex
-
Writes records to a standalone LaTeX document containing a table.
- LatexWriter(File) - Constructor for class com.northconcepts.datapipeline.latex.LatexWriter
- LatexWriter(Writer) - Constructor for class com.northconcepts.datapipeline.latex.LatexWriter
- LAVENDER - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- LEDGER - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
- LEDGER - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- left(int) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Keeps the first
lengthcharacters of each value; shorter values are unchanged. - LEFT - Enum constant in enum class com.northconcepts.datapipeline.fixedwidth.FixedWidthAlign
- leftJoin(String, String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- LeftJoin - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Generates a LEFT JOIN clause.
- LeftJoin(String, String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.LeftJoin
- leftPad(String, int, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- LEGAL - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
- LEGAL - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- LEMON_CHIFFON - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- length(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
length of a string
- LETTER - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
- LETTER - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
- lettersToDecimal(String, char) - Static method in class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
- level - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- lhsObject - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- LIGHT_BLUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- LIGHT_CORNFLOWER_BLUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- LIGHT_GREEN - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- LIGHT_ORANGE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- LIGHT_TURQUOISE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- LIGHT_TURQUOISE1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- LIGHT_YELLOW - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- lighten(double) - Method in class com.northconcepts.datapipeline.excel.ExcelColor
-
Lightens a color.
- LIME - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- limit(int) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Limits the result to
countrows and clears any offset; a negative count removes the limit. - limit(Integer, Integer) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Sets the rows to skip (
OFFSET) and the maximum to return (LIMIT); a null or negative value omits that clause. - limitedRecords(long) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes the buffer after the specified amount of records have been collected.
- limitedRecords(long) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes the window after the specified amount of records has been collected.
- limitedTime(long) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes windows after they've been open for the specified time.
- limitedTime(String, long) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers after the specified datetime field has increased by a set amount of time since it was first seen.
- limitedTime(String, long) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes windows after the specified datetime field has increased by a set amount of time since it was first seen.
- limitedTimeFromLastUpdate(long) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers after the specified time has elapsed since the last record was added.
- limitedTimeFromLastUpdateOrLimitedRecords(long, long) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers after the specified time has elapsed since the last record was added or the specified amount of records have been collected.
- limitedTimeFromOpen(long) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers after they've been open for the specified time.
- limitedTimeFromOpenOrLimitedRecords(long, long) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers after they've been open for the specified time or the specified amount of records have been collected.
- limitOpened(int) - Static method in class com.northconcepts.datapipeline.group.CreateWindowStrategy
-
Opens a new window if there are less currently open than the specified number.
- LimitReader - Class in com.northconcepts.datapipeline.core
-
A proxy that can skip a number of upstream records, limit the number of records sent downstream, or both.
- LimitReader(DataReader) - Constructor for class com.northconcepts.datapipeline.core.LimitReader
-
Creates a reader with no offset or limit; set at least one before
LimitReader.open(). - LimitReader(DataReader, long) - Constructor for class com.northconcepts.datapipeline.core.LimitReader
-
Creates a reader that returns at most
limitrecords without skipping any. - LimitReader(DataReader, Integer, Integer) - Constructor for class com.northconcepts.datapipeline.core.LimitReader
-
Creates a reader that skips
offsetrecords and then returns at mostlimit; either may be null, but not both. - LimitReader(DataReader, Long, Long) - Constructor for class com.northconcepts.datapipeline.core.LimitReader
-
Creates a reader that skips
offsetrecords and then returns at mostlimit; either may be null, but not both. - line - Variable in class com.northconcepts.datapipeline.jsonata.Location
-
The line number, starting at 1.
- LINE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- LINEAR_BACKOFF - Enum constant in enum class com.northconcepts.datapipeline.retry.RetryStrategy
- LinedTextWriter - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for writing records to a text stream.
- LinedTextWriter(File) - Constructor for class com.northconcepts.datapipeline.core.LinedTextWriter
-
Creates a writer that overwrites the file, which this constructor opens immediately rather than in
open(). - LinedTextWriter(File, boolean) - Constructor for class com.northconcepts.datapipeline.core.LinedTextWriter
- LinedTextWriter(Writer) - Constructor for class com.northconcepts.datapipeline.core.LinedTextWriter
- lineNumber - Variable in class com.northconcepts.datapipeline.core.ParsingReader
- LineParser - Class in com.northconcepts.datapipeline.core
-
An
IParserthat reads its input one line at a time; lookahead and matching only see the current line untilLineParser.cacheNextLine()moves to the next one. - LineParser(Reader, char[][]) - Constructor for class com.northconcepts.datapipeline.core.LineParser
-
Creates a parser that ends lines at the given separators, checked in array order, or like
BufferedReader.readLine()if they are null. - LineParser(String, char[][]) - Constructor for class com.northconcepts.datapipeline.core.LineParser
-
Creates a parser that ends lines at the given separators, checked in array order, or like
BufferedReader.readLine()if they are null. - LINESTRING - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- LINESTRING - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- Link - Class in com.northconcepts.datapipeline.mailchimp.list
- Link() - Constructor for class com.northconcepts.datapipeline.mailchimp.list.Link
- listBuckets() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the buckets owned by the authenticated user.
- listen(TwitterStream) - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- listen(TwitterStream) - Method in class com.northconcepts.datapipeline.twitter.TwitterSampleStreamReader
- listEntries() - Method in class com.northconcepts.datapipeline.filesystem.zip.ZipFileSystem
-
Returns an iterator over the zip file's entries, which must be used before
close(). - listEntries(ZipEntryFilter) - Method in class com.northconcepts.datapipeline.filesystem.zip.ZipFileSystem
-
Returns an iterator over the zip file's entries that the filter accepts, which must be used before
close(). - ListFilter - Enum Class in com.northconcepts.datapipeline.trello
-
Selects which lists
TrelloBoardListsReaderreads;toString()gives the lowercase value sent to Trello. - listFolder(String) - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Returns an list of all DropBox files and folders belonging to the
folderName. - listFolder(String) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Returns the contents of the folder.
- listFolder(String) - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Returns the contents of the folder.
- listFolder(String) - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Returns the contents of the folder.
- listFolder(String) - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Returns a
Listof all Google Drive files and folders under the specified folder. - listFolder(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the objects under the specified folder, including nested keys.
- ListMember - Class in com.northconcepts.datapipeline.mailchimp.list
-
A member of a MailChimp list, as read from or sent to the API's list member endpoints.
- ListMember() - Constructor for class com.northconcepts.datapipeline.mailchimp.list.ListMember
- ListMembers - Class in com.northconcepts.datapipeline.mailchimp.list
-
A page of members returned by the MailChimp list members endpoint.
- ListMembers() - Constructor for class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- ListMemberStatus - Enum Class in com.northconcepts.datapipeline.mailchimp.list
-
Statuses of a MailChimp
ListMember, also used to filter the members requested from a list. - listRootFolder() - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Returns a
Listof all DropBox files and folders in the root folder. - listRootFolder() - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Returns the contents of the root folder.
- listRootFolder() - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Returns a
Listof all HDFS files and folders under the root folder. - listRootFolder() - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Returns the contents of the root folder.
- listRootFolder() - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Returns a
Listof all Google Drive files and folders. - listRootFolder(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the objects in the specified bucket, including nested keys.
- load() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Starts the asynchronous loading of records from the pipeline into this dataset.
- load(Integer) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Starts the asynchronous loading of records from the pipeline into this dataset.
- load(Integer, JobCallback<DataReader, DataWriter>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Starts the asynchronous loading of records from the pipeline into this dataset.
- load(Integer, JobCallback<DataReader, DataWriter>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- load(Integer, JobCallback<DataReader, DataWriter>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- loadCatalogAndSchemas() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Replaces the catalog names and schemas with those reported by the database and records its catalog support flags.
- loadJson(File) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads a JSON file and detects its record breaks and fields using
standard(false). - loadJson(File, boolean) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads a JSON file using
TreeDetectionStrategy.standard(boolean), which merges dynamically named nodes into wildcard nodes whenoptimizeTreeStructureis true. - loadJson(File, TreeDetectionStrategy) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads a JSON file and detects its record breaks and fields using the given strategy, or
standard(false)if null. - loadJson(Reader) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads a JSON document and detects its record breaks and fields using
standard(false). - loadJson(Reader, boolean) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads a JSON document using
TreeDetectionStrategy.standard(boolean), which merges dynamically named nodes into wildcard nodes whenoptimizeTreeStructureis true. - loadJson(Reader, TreeDetectionStrategy) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads a JSON document and detects its record breaks and fields using the given strategy, or
standard(false)if null. - loadQueries() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Runs each query with its parameters' example values and replaces its columns with those of the result.
- loadTables() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Loads the tables matching name pattern
%in any catalog and schema, with their columns, keys and indexes, replacing those loaded before. - loadTables(LoadTablesRequest) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Loads the tables and details selected by the request, replacing those loaded before and notifying the
listenerat each step. - loadTables(String, String, String, String...) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Loads the tables matching the given
DatabaseMetaData.getTablesarguments, with their columns, keys and indexes, replacing those loaded before. - loadTablesFailed(JdbcConnection, LoadTablesRequest, DataException) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
-
Called with the wrapped exception just before it is thrown to the caller.
- loadTablesFinished(JdbcConnection, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- LoadTablesRequest - Class in com.northconcepts.datapipeline.foundations.jdbc
-
The options for
JdbcConnection.loadTables(LoadTablesRequest): which tables to load and which of their details (columns, keys, indexes) to load with them. - LoadTablesRequest() - Constructor for class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
- loadTablesStarted(JdbcConnection, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- loadXml(File) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads an XML file and detects its record breaks and fields using
standard(false). - loadXml(File, boolean) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads an XML file using
TreeDetectionStrategy.standard(boolean), which merges dynamically named nodes into wildcard nodes whenoptimizeTreeStructureis true. - loadXml(File, TreeDetectionStrategy) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads an XML file and detects its record breaks and fields using the given strategy, or
standard(false)if null. - loadXml(Reader) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads an XML document and detects its record breaks and fields using
standard(false). - loadXml(Reader, boolean) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads an XML document using
TreeDetectionStrategy.standard(boolean), which merges dynamically named nodes into wildcard nodes whenoptimizeTreeStructureis true. - loadXml(Reader, TreeDetectionStrategy) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Loads an XML document and detects its record breaks and fields using the given strategy, or
standard(false)if null. - LocalFile - Class in com.northconcepts.datapipeline.foundations.file
-
Base class for the
FileSourceandFileSinkimplementations backed by a file on the local file system. - LocalFile() - Constructor for class com.northconcepts.datapipeline.foundations.file.LocalFile
- LocalFileDataset - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Caches the dataset's records on disk as binary data.
- LocalFileDataset(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Opens a dataset saved in
rootFolderwithfileNamePrefix. - LocalFileDataset(String, String, AbstractPipeline) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Creates a dataset that, when loaded, saves the pipeline's records to files in
rootFolderwhose names start withfileNamePrefix. - LocalFileSink - Class in com.northconcepts.datapipeline.foundations.file
-
A
FileSinkthat writes a file on the local file system, replacing or appending to its content. - LocalFileSink() - Constructor for class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- LocalFileSource - Class in com.northconcepts.datapipeline.foundations.file
-
A
FileSourcethat reads a file on the local file system. - LocalFileSource() - Constructor for class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- Location - Class in com.northconcepts.datapipeline.jsonata
-
An immutable object that represents a location in the parsed text.
- Location - Class in com.northconcepts.datapipeline.mailchimp.list
-
Location details of a MailChimp
ListMember. - Location() - Constructor for class com.northconcepts.datapipeline.mailchimp.list.Location
- lock - Variable in class com.northconcepts.datapipeline.core.AsyncReader
- log - Static variable in class com.northconcepts.datapipeline.core.DataObject
- log - Static variable in class com.northconcepts.datapipeline.core.RecordList
- log - Static variable in class com.northconcepts.datapipeline.eventbus.EventBus
- log - Static variable in class com.northconcepts.datapipeline.foundations.core.FoundationObject
- log - Static variable in class com.northconcepts.datapipeline.multiplex.DeMux
- log - Static variable in class com.northconcepts.datapipeline.multiplex.SplitWriter
- log() - Static method in class com.northconcepts.datapipeline.core.Functions
-
Logs all aliased functions know to the expression language to the debug level.
- log() - Method in class com.northconcepts.datapipeline.diagnostic.Diagnostic
-
Prints the collected properties to standard output.
- log() - Method in class com.northconcepts.datapipeline.job.AbstractJob
- log() - Method in class com.northconcepts.datapipeline.job.Job
-
Requests that this job's statistics be written to the log writer after the next record is transferred.
- logExceptions() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Prints each field mapping exception and its stack trace to standard error.
- logExceptions(PrintStream) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- logValidationErrors() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Prints the field name and message of each validation error to standard error.
- logValidationErrors(PrintStream) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
- LONG - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- LONG - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- LONG - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
- LONG - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- LONGBLOB - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- LONGBLOB - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- LONGTEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- LONGTEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- lookup(Integer) - Static method in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
-
Returns the constant with the given error code, or null if
valueis null or unknown. - lookup(Object, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Return value from an object for a given key
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.excel.ExcelReader.FailedExpressionStrategy
-
Looks up a FailedExpressionStrategy by name (case-insensitive).
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.excel.LargeCellHandler
-
Returns the handler whose name matches the given one case-insensitively, or null if it is empty or unknown.
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.foundations.difference.DiffType
-
Returns the constant whose name matches the string ignoring case, or
nullif none does or the string is empty. - lookup(String) - Static method in enum class com.northconcepts.datapipeline.foundations.file.FileType
-
Returns the type whose constant name matches, ignoring case, or null if none does.
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
-
Returns the operator whose name matches the value, ignoring case, or null if none does.
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
-
Returns the type whose name matches the value, ignoring case, or null if none does.
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
-
Returns the type whose name matches the value, ignoring case, or null if none does.
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
-
Returns the type whose name matches the value, ignoring case, or null if none does.
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Returns the type whose name matches the value, ignoring case, or null if none does.
- lookup(String) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.PrimaryKeyType
-
Returns the type with the given name, ignoring case, or null if the name is empty or matches no type.
- lookup(String) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- Lookup - Class in com.northconcepts.datapipeline.transform.lookup
-
Searches for data in another source to merge with each record passing through this lookup's transformer -- the streaming version of a join.
- Lookup() - Constructor for class com.northconcepts.datapipeline.transform.lookup.Lookup
- lookupByAction(String) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
-
Returns the action with the given name, ignoring case, or null for a null or empty name; unknown names throw a
DataException. - lookupByCardinality(String) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.RelationshipCardinality
-
Returns the cardinality with the given name, ignoring case, or null for a null or empty name; unknown names throw a
DataException. - lookupByFileExtension(String) - Static method in enum class com.northconcepts.datapipeline.foundations.file.FileType
-
Returns the first type whose default extension (without a dot) matches, ignoring case, or null if none does.
- lookupByMimeType(String) - Static method in enum class com.northconcepts.datapipeline.foundations.file.FileType
-
Returns the first type with the given MIME type, ignoring case, or null if none matches.
- lookupByType(String) - Static method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns the constant whose name matches
type, ignoring case, or null iftypeis null or blank; throws if none matches. - LookupTransformer - Class in com.northconcepts.datapipeline.transform.lookup
-
A
Transformerthat merges into each record the fields of the record aLookupreturns for the values of the key fields. - LookupTransformer(FieldList, Lookup) - Constructor for class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Creates a transformer that looks up the values of
fieldsand resolves clashes with existing field names usingNode.DuplicateNodeAction.APPEND. - LookupTransformer(FieldList, Lookup, boolean) - Constructor for class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Deprecated.
- LookupTransformer(FieldList, Lookup, Node.DuplicateNodeAction) - Constructor for class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Creates a transformer that looks up the values of
fieldsand resolves clashes with existing field names usingduplicateFieldAction. - LOW - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaProblem.Severity
- lowercase(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Lowercase a string
- lowerCase() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts values to lower case using the default locale.
- lowerCaseFirstChar() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts the first character of each value to lower case, leaving the rest unchanged.
- LSEG - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
M
- M - Static variable in class com.northconcepts.datapipeline.meter.Meter
- MACADDR - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- MACADDR8 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- MAIL_SENT - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- MailChimpClient - Interface in com.northconcepts.datapipeline.mailchimp
-
Client for the MailChimp API 3.0 list member endpoints; create one with
MailChimpClient.Proxy.get(String). - MailChimpClient.Proxy - Class in com.northconcepts.datapipeline.mailchimp
-
Creates
MailChimpClientproxies that authenticate with an API key. - MailChimpListMemberReader - Class in com.northconcepts.datapipeline.mailchimp
-
Reads the list of subscribed, unsubscribed, and cleaned members from a MailChimp list.
- MailChimpListMemberReader(String, String) - Constructor for class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
- MailStore - Enum Class in com.northconcepts.datapipeline.email
-
The mail protocols an
EmailReadercan connect with, each with its standard port. - main(String[]) - Static method in class com.northconcepts.datapipeline.diagnostic.Diagnostic
-
Collects the diagnostic properties and prints them to standard output; the arguments are ignored.
- main(String[]) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidationPath
- main(String[]) - Static method in class com.northconcepts.datapipeline.foundations.tools.GenerateEqualsAndHashCodeMethods
-
Prints the methods for a hard-coded list of classes; the command-line arguments are ignored.
- main(String[]) - Static method in class com.northconcepts.datapipeline.foundations.tools.GenerateRecordSerializers
-
Prints the serialization methods for the fully qualified class names given as arguments.
- main(String...) - Static method in class com.northconcepts.datapipeline.foundations.tools.GenerateSchemaFromRecord
-
Prints, as XML, the schema generated from the JSON file passed as the only argument.
- main(String[]) - Static method in class com.northconcepts.datapipeline.jsonata.Json
- main(String[]) - Static method in class com.northconcepts.datapipeline.jsonata.utils.Signature
- MAKE_ARRAY - Enum constant in enum class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.DuplicateFieldsPolicy
- MakeFieldNamesUnique - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Final naming pass: reassigns field names that still collide after the tree structure was transformed, keeping every field name unique.
- MakeFieldNamesUnique() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.MakeFieldNamesUnique
- makeOptionalFieldsRequired(List<ColumnPath>, MessageType) - Static method in class com.northconcepts.datapipeline.parquet.ParquetUtil
-
Returns the schema as text with the given columns changed from optional to required.
- makeRequiredFieldsOptional(List<ColumnPath>, MessageType) - Static method in class com.northconcepts.datapipeline.parquet.ParquetUtil
-
Returns the schema as text with the given columns changed from required to optional.
- MANY - Enum constant in enum class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery.Cardinality
- map(DataReader, BiFunction<ProxyReader, Record, Record>) - Static method in class com.northconcepts.datapipeline.core.ProxyReader
-
Wraps the reader in a proxy that passes itself and each record to the mapper; a null result drops the record.
- map(DataReader, Function<Record, Record>) - Static method in class com.northconcepts.datapipeline.core.ProxyReader
-
Wraps the reader in a proxy that passes each record through the mapper; a null result drops the record.
- map(DataWriter, BiFunction<ProxyWriter, Record, Record>) - Static method in class com.northconcepts.datapipeline.core.ProxyWriter
-
Wraps the writer in a proxy that passes itself and each record to the mapper before writing; a null result drops the record.
- map(DataWriter, Function<Record, Record>) - Static method in class com.northconcepts.datapipeline.core.ProxyWriter
-
Wraps the writer in a proxy that passes each record through the mapper before writing it; a null result drops the record.
- map(ExpressionContext) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Maps the record in the given context; exceptions thrown by individual field mappings are collected in the returned result instead of being thrown.
- map(String, String) - Method in class com.northconcepts.datapipeline.security.EnvironmentCredentialsResolver
-
Maps a logical credential key (see
Credentials) to an environment variable name. - map(String, String) - Method in class com.northconcepts.datapipeline.security.SystemPropertyCredentialsResolver
-
Maps a logical credential key (see
Credentials) to a system property name. - map(List, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Create a map from an array of arguments
- mapAndValidateRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Maps the record in place with
EntityDef.mapRecord(Record)and then validates it; if mapping fails, validation runs on a copy without the fields that failed to map. - mapAndValidateRecord(Record, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Maps and validates the record like
EntityDef.mapAndValidateRecord(Record), adding errors to the given result (or a new one if null) and returning it. - mapField(ExpressionContext, DataMappingResult) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- mapField(ExpressionContext, DataMappingResult) - Method in interface com.northconcepts.datapipeline.foundations.datamapping.IFieldMapping
-
Sets this mapping's field in the target record held by
result; called byDataMappingfor each record. - mapFieldImpl(ExpressionContext, DataMappingResult) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
-
Computes the target field's value in the mapping context; called only when there is no condition or it is true.
- mapFieldImpl(ExpressionContext, DataMappingResult) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- mapof() - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- mapof(K, V) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- mapof(K, V, K, V) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- mapof(K, V, K, V, K, V) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- mapof(K, V, K, V, K, V, K, V) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- mapof(K, V, K, V, K, V, K, V, K, V) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- mapping - Variable in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- mapRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Converts the record's values in place to the types of this entity's fields, including inherited ones, and applies default values; mapping errors are returned instead of thrown.
- mapRecord(Record, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Maps the record like
EntityDef.mapRecord(Record), adding errors to the given result (or a new one if null) and returning it. - mapValue(Object) - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Attempts to convert an object or string to the Java type that best represents this field type.
- mapValue(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Converts a value to this field's type, using the default value expression when the value is null.
- mapValueImpl(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Converts a single (non-array) value to this field's type; subclasses override it to parse or adjust values first.
- mapValueImpl(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- mapValueImpl(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- mapValueImpl(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- mapValueImpl(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- MapWriter - Class in com.northconcepts.datapipeline.memory
-
Copies the values in specific key-value fields to an in-memory
Map. - MapWriter(FieldPath, FieldPath, Map<?, ?>) - Constructor for class com.northconcepts.datapipeline.memory.MapWriter
-
Creates a writer that puts each record's
valuefield into the map under itskeyfield, replacing any earlier entry with the same key. - MapWriter(String, String, Map<?, ?>) - Constructor for class com.northconcepts.datapipeline.memory.MapWriter
-
Creates a writer that puts each record's value field into the map under its key field, replacing any earlier entry with the same key.
- MAROON - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- match(char) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes the next character, throwing a
DataExceptionif it is not the expected one. - match(char) - Method in class com.northconcepts.datapipeline.core.LineParser
- match(char) - Method in class com.northconcepts.datapipeline.core.Parser
- match(char) - Method in class com.northconcepts.datapipeline.core.StringParser
- match(char[]) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes the expected string, throwing a
DataExceptionat the first character that differs. - match(char[]) - Method in class com.northconcepts.datapipeline.core.LineParser
- match(char[]) - Method in class com.northconcepts.datapipeline.core.Parser
- match(char[]) - Method in class com.northconcepts.datapipeline.core.StringParser
- match(char[], String) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes the expected string, throwing a
DataExceptionprefixed withfailureMessageat the first character that differs. - match(char[], String) - Method in class com.northconcepts.datapipeline.core.LineParser
- match(char[], String) - Method in class com.northconcepts.datapipeline.core.Parser
- match(char[], String) - Method in class com.northconcepts.datapipeline.core.StringParser
- match(char, String) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes the next character, throwing a
DataExceptionprefixed withfailureMessageif it is not the expected one. - match(char, String) - Method in class com.northconcepts.datapipeline.core.LineParser
- match(char, String) - Method in class com.northconcepts.datapipeline.core.Parser
- match(char, String) - Method in class com.northconcepts.datapipeline.core.StringParser
- match(int) - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes the given character and appends it to
ParsingReader.valueBuffer, throwing if the next character differs. - match(CharSequence) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes the expected string, throwing a
DataExceptionat the first character that differs. - match(CharSequence) - Method in class com.northconcepts.datapipeline.core.LineParser
- match(CharSequence) - Method in class com.northconcepts.datapipeline.core.Parser
- match(CharSequence) - Method in class com.northconcepts.datapipeline.core.StringParser
- match(CharSequence, String) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes the expected string, throwing a
DataExceptionprefixed withfailureMessageat the first character that differs. - match(CharSequence, String) - Method in class com.northconcepts.datapipeline.core.LineParser
- match(CharSequence, String) - Method in class com.northconcepts.datapipeline.core.Parser
- match(CharSequence, String) - Method in class com.northconcepts.datapipeline.core.StringParser
- match(String) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDetector
-
Returns a NumberMatch or null if the string cannot be converted to a simple whole or fractional number.
- match(String, Pattern, Integer) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Match a string with a regex returning an array of object containing details of each match
- matchAll(String) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
-
Returns all the patterns in this detector that successfully parsed the supplied value.
- matchCHARACTER() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes one ASCII letter and appends it to
ParsingReader.valueBuffer, throwing if the next character is not a letter. - matchDIGIT() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes one digit (0-9) and appends it to
ParsingReader.valueBuffer, throwing if the next character is not a digit. - matchDIGITS() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes one or more digits and appends them to
ParsingReader.valueBuffer. - matchDOUBLE() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes a decimal number such as
1,234.56or.5and appends it, without the commas, toParsingReader.valueBuffer. - matches(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetPattern
-
Indicates if the supplied name fits this pattern: it carries the prefix and suffix around a non-empty middle segment that the segment rule classifies as dynamic.
- matchFirst(String) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
-
Returns the first pattern in this detector that successfully parsed the supplied value.
- matchINTEGER() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes an integer that may contain grouping commas and appends its digits to
ParsingReader.valueBuffer. - matchLINE() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes the rest of the current line, appending it to
ParsingReader.valueBuffer, followed by its line break if there is one. - matchNEWLINE() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes one line break (LF, CR or CR LF), increments the line number and starts a new parser column count; throws if there is no line break.
- matchNEWLINES() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Consumes one or more consecutive line breaks (LF, CR or CR LF), counting each in
ParsingReader.getLineNumber(). - matchUntil(char) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes and returns the text before the terminating character, then consumes the terminator; throws a
DataExceptionif the input ends first. - matchUntil(char) - Method in class com.northconcepts.datapipeline.core.LineParser
- matchUntil(char) - Method in class com.northconcepts.datapipeline.core.Parser
- matchUntil(char) - Method in class com.northconcepts.datapipeline.core.StringParser
- matchUntil(char, String) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes and returns the text before the terminating character, then consumes the terminator; throws a
DataExceptionprefixed withfailureMessageif the input ends first. - matchUntil(char, String) - Method in class com.northconcepts.datapipeline.core.LineParser
- matchUntil(char, String) - Method in class com.northconcepts.datapipeline.core.Parser
- matchUntil(char, String) - Method in class com.northconcepts.datapipeline.core.StringParser
- matchUntilEof() - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes and returns all remaining characters (of the current line for
LineParser). - matchUntilEof() - Method in class com.northconcepts.datapipeline.core.LineParser
- matchUntilEof() - Method in class com.northconcepts.datapipeline.core.Parser
- matchUntilEof() - Method in class com.northconcepts.datapipeline.core.StringParser
- max(FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the largest non-null value of the field in each group, written to the same field path.
- max(FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the largest value of the field in each group, written to the same field path.
- max(FieldPath, FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the largest non-null value of the source field in each group, written to the target field.
- max(FieldPath, FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- max(String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the largest non-null value of the field in each group, written to a field of the same name.
- max(String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the largest value of the field in each group, written to a field of the same name.
- max(String, String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the largest non-null value of the source field in each group, written to the target field.
- max(String, String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- max(List<Number>) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Max function
- MAX_BATCH_SIZE - Static variable in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- MAX_BATCH_SIZE - Static variable in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
- MAX_CELL_LENGTH - Static variable in class com.northconcepts.datapipeline.excel.ExcelWriter
- MAX_CELL_LENGTH_INDEX - Static variable in class com.northconcepts.datapipeline.excel.ExcelWriter
- MAX_DISPLAY_STRING - Static variable in class com.northconcepts.datapipeline.core.Field
- MAX_ENV_VALUE_LENGTH - Static variable in class com.northconcepts.datapipeline.diagnostic.Diagnostic
- MAX_QUEUE_SIZE - Static variable in class com.northconcepts.datapipeline.multiplex.DeMux
- MAX_WAIT_TIME - Static variable in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
- maximum(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Adds an operation tracking the field's largest non-null value.
- MAXIMUM - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
- MEDIA_ID_NOT_FOUND - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- MEDIUM - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaProblem.Severity
- MEDIUMBLOB - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- MEDIUMBLOB - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- MEDIUMINT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- MEDIUMINT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- MEDIUMTEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- MEDIUMTEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- MEMBERS - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardFilter
- MemoryDataset - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Caches the dataset's records in RAM.
- MemoryDataset(AbstractPipeline) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
-
Creates a dataset that keeps the given pipeline's records in memory once
Dataset.load()is called. - MemoryReader - Class in com.northconcepts.datapipeline.memory
-
Obtains records from an in-memory
RecordList. - MemoryReader() - Constructor for class com.northconcepts.datapipeline.memory.MemoryReader
-
Creates a reader over a new, empty list; add records with
MemoryReader.add(Record). - MemoryReader(RecordList) - Constructor for class com.northconcepts.datapipeline.memory.MemoryReader
-
Creates a reader that returns copies of the records in the given list, starting over each time it is opened.
- MemoryWriter - Class in com.northconcepts.datapipeline.memory
-
Writes records to an in-memory
RecordList. - MemoryWriter() - Constructor for class com.northconcepts.datapipeline.memory.MemoryWriter
- MemoryWriter(RecordList) - Constructor for class com.northconcepts.datapipeline.memory.MemoryWriter
- merge(TreeNode, TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeTransformer
-
Folds the source node into the target (adding its instance count, combining the record-break, field and cascade flags and merging its children), then removes the source from its parent.
- merge(List) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Merges an array of objects into a single object.
- Merge - Class in com.northconcepts.datapipeline.jdbc.sql.merge
-
Builds a MERGE statement that updates the target row when the ON condition matches and inserts one otherwise; the target table is aliased
target. - Merge(String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
- mergeChildren(TreeNode, TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeTransformer
-
Merges each child of the source into the target's child of the same name, or moves it under the target and rewrites the XPath expressions in its subtree to the target's path.
- MergeUpsert - Class in com.northconcepts.datapipeline.jdbc.upsert
-
A batch-able upsert strategy that relies on the SQL Merge statement.
- MergeUpsert() - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- MergeUsing - Enum Class in com.northconcepts.datapipeline.jdbc.sql.merge
-
The standard
IMergeUsingclauses, which supply the source row as parameters:USING (VALUES (?, ...)) source(...)orUSING (SELECT ?, ...) source(...). - MergeValue - Class in com.northconcepts.datapipeline.jdbc.sql.merge
-
A column in the INSERT or UPDATE SET clause of a
Merge, with its parameter value. - MergeValue(String, boolean) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.merge.MergeValue
-
Creates a column with a null parameter value.
- MergeValue(String, Object, boolean) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.merge.MergeValue
-
Creates a column rendered as its bare name if
insertis true (INSERT clause) or ascolumn=?otherwise. - mergeWildcardSiblings(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.OptimizeTreeStructure
-
Merges every other child of the parent into its first wildcard child, if it has one.
- Message - Class in com.northconcepts.datapipeline.core
-
A diagnostic message with a severity level, an optional exception or stack trace, and the time and thread it was created on; collected by
Messages. - Message(Message.Level, String) - Constructor for class com.northconcepts.datapipeline.core.Message
-
Creates a message without an exception or stack trace.
- Message(Message.Level, String, boolean) - Constructor for class com.northconcepts.datapipeline.core.Message
-
Creates a message without an exception, optionally capturing the caller's current stack trace.
- Message(Message.Level, String, Throwable) - Constructor for class com.northconcepts.datapipeline.core.Message
- Message(Message.Level, Throwable) - Constructor for class com.northconcepts.datapipeline.core.Message
-
Creates a message that uses the exception's message as its text.
- Message.Level - Enum Class in com.northconcepts.datapipeline.core
-
The severity of a
Message. - Messages - Class in com.northconcepts.datapipeline.core
-
Thread-local container for messages and exceptions originating in asynchronous operations.
- Messages() - Constructor for class com.northconcepts.datapipeline.core.Messages
- Meter - Class in com.northconcepts.datapipeline.meter
-
Counts units (such as bytes or records) and reports their average rate per second since the meter was created or last reset.
- Meter() - Constructor for class com.northconcepts.datapipeline.meter.Meter
- Metered - Interface in com.northconcepts.datapipeline.meter
-
Implemented by streams, readers and writers that measure the data passing through them with a
Meter. - MeteredInputStream - Class in com.northconcepts.datapipeline.meter
-
An input stream that counts the bytes read or skipped in a
Meter;MeteredInputStream.reset()also resets the meter. - MeteredInputStream(InputStream) - Constructor for class com.northconcepts.datapipeline.meter.MeteredInputStream
- MeteredOutputStream - Class in com.northconcepts.datapipeline.meter
-
An output stream that counts the bytes written in a
Meter. - MeteredOutputStream(OutputStream) - Constructor for class com.northconcepts.datapipeline.meter.MeteredOutputStream
- MeteredReader - Class in com.northconcepts.datapipeline.meter
-
A proxy that measures the rate (bytes/second) at which data is read.
- MeteredReader(DataReader) - Constructor for class com.northconcepts.datapipeline.meter.MeteredReader
- MeteredWriter - Class in com.northconcepts.datapipeline.meter
-
A proxy that measures the rate (bytes/second) at which data is written.
- MeteredWriter(DataWriter) - Constructor for class com.northconcepts.datapipeline.meter.MeteredWriter
- MicrosoftWordPipelineOutput - Class in com.northconcepts.datapipeline.microsoft.word.output
-
A pipeline output that writes records as a table in a Microsoft Word document to a
FileSinkusing aMicrosoftWordWriter. - MicrosoftWordPipelineOutput() - Constructor for class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- MicrosoftWordWriter - Class in com.northconcepts.datapipeline.microsoft.word
-
Writes records to a Microsoft Word (OOXML
.docx) document stream containing a single table. - MicrosoftWordWriter(File) - Constructor for class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
- MicrosoftWordWriter(OutputStream) - Constructor for class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
- MicrosoftWordWriter.PageOrientation - Enum Class in com.northconcepts.datapipeline.microsoft.word
-
The page orientations available to a Word document.
- MicrosoftWordWriter.PageSize - Enum Class in com.northconcepts.datapipeline.microsoft.word
-
The page sizes available to a Word document, with their portrait dimensions in twips (1/1440 of an inch).
- millis() - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- millisecondsToDate() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of milliseconds since the epoch to dates (midnight in the default time zone); other values are left unchanged.
- millisecondsToDateTime() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of milliseconds since the epoch to date-times; other values are left unchanged.
- min(FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the smallest non-null value of the field in each group, written to the same field path.
- min(FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- min(FieldPath, FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the smallest non-null value of the source field in each group, written to the target field.
- min(FieldPath, FieldPath, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- min(String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the smallest non-null value of the field in each group, written to a field of the same name.
- min(String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- min(String, String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the smallest non-null value of the source field in each group, written to the target field.
- min(String, String, boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
- min(List<Number>) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Min function
- MIN_BATCH_SIZE - Static variable in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- MIN_DATA_SIZE - Static variable in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
- minimum(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Adds an operation tracking the field's smallest value, which becomes null once a null value is read.
- MINIMUM - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
- MINIMUM_BUFFER_SIZE - Static variable in class com.northconcepts.datapipeline.core.AsyncReader
- MINIMUM_PART_SIZE - Static variable in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
- MINIMUM_SYMMETRIC_LENGTH - Static variable in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
- minimumNotLessThanMaximum(Number, Number, String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- MINUTE - Static variable in class com.northconcepts.datapipeline.schedule.HourlyScheduler
- minutesToDate() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of minutes since the epoch to dates (midnight in the default time zone); other values are left unchanged.
- minutesToDateTime() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of minutes since the epoch to date-times; other values are left unchanged.
- missingPrimaryKeyInPrimaryEntity(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- MODIFIED - Enum constant in enum class com.northconcepts.datapipeline.core.Record.State
-
Record has been modified since it was read.
- MONEY - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- MongoReader - Class in com.northconcepts.datapipeline.mongodb
-
Reads documents from a MongoDB database collection.
- MongoReader(String, String) - Constructor for class com.northconcepts.datapipeline.mongodb.MongoReader
-
Connects to the MongoDB server in localhost on the default port 27017.
- MongoReader(MongoClient, String, String) - Constructor for class com.northconcepts.datapipeline.mongodb.MongoReader
-
Connects to the MongoDB server as specified in MongoClient.
- MongoTypeConverter - Class in com.northconcepts.datapipeline.mongodb
-
Converts DataPipeline records and values to and from MongoDB BSON documents and values.
- MongoWriter - Class in com.northconcepts.datapipeline.mongodb
-
Writes records to a MongoDB database collection.
- MongoWriter(String, String) - Constructor for class com.northconcepts.datapipeline.mongodb.MongoWriter
-
Connects to the MongoDB server in localhost on the default port 27017.
- MongoWriter(MongoClient, String, String) - Constructor for class com.northconcepts.datapipeline.mongodb.MongoWriter
-
Connects to the MongoDB server as specified in MongoClient.
- move(int, int) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- move(int, int) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Moves the index field at the
oldIndexto thenewIndex, shifting any existing elements at or afternewIndexto the right. - moveField(int, int) - Method in class com.northconcepts.datapipeline.core.Record
-
Moves a field from one position to another within this record.
- moveField(int, int) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Moves the field at the
oldIndexto thenewIndex, shifting any existing elements at or afternewIndexto the right. - moveField(int, int) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Moves the index field at the
oldIndexto thenewIndex, shifting any existing elements at or afternewIndexto the right. - moveField(String, int) - Method in class com.northconcepts.datapipeline.core.Record
-
Moves the field with the specified name to a new position within this record.
- moveField(String, int) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Moves the field with the given name to the
newIndex, shifting any existing elements at or afternewIndexto the right. - moveField(String, int) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Moves the index field with the given name to the
newIndex, shifting any existing elements at or afternewIndexto the right. - moveFieldAfter(FieldPath, FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Moves the field at the specified path to the position immediately after another field path.
- moveFieldAfter(String, String) - Method in class com.northconcepts.datapipeline.core.Record
-
Moves the named field to the position immediately after another named field.
- moveFieldAfter(String, String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Moves the field with the given
fieldNameafter to the field with the specifiedafterFieldName, shifting any existing elements afterafterFieldNameto the right. - moveFieldAfter(String, String) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Moves the index field with the given
fieldNameafter to the index field with the specifiedafterFieldName, shifting any existing elements afterafterFieldNameto the right. - MoveFieldAfter - Class in com.northconcepts.datapipeline.transform
-
See
FieldPathfor supported field name expressions. - MoveFieldAfter(String, String) - Constructor for class com.northconcepts.datapipeline.transform.MoveFieldAfter
- moveFieldBefore(FieldPath, FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Moves the field at the specified path to the position immediately before another field path.
- moveFieldBefore(String, String) - Method in class com.northconcepts.datapipeline.core.Record
-
Moves the named field to the position immediately before another named field.
- moveFieldBefore(String, String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Moves the field with the given
fieldNamebefore to the field with the specifiedbeforeFieldName, shifting elements at or afterbeforeFieldNameto the right. - moveFieldBefore(String, String) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Moves the index field with the given
fieldNamebefore to the index field with the specifiedbeforeFieldName, shifting elements at or afterbeforeFieldNameto the right. - MoveFieldBefore - Class in com.northconcepts.datapipeline.transform
-
See
FieldPathfor supported field name expressions. - MoveFieldBefore(String, String) - Constructor for class com.northconcepts.datapipeline.transform.MoveFieldBefore
- MoveFieldToIndex - Class in com.northconcepts.datapipeline.transform
-
A transformer used to move a named field to a new position.
- MoveFieldToIndex(String, int) - Constructor for class com.northconcepts.datapipeline.transform.MoveFieldToIndex
-
Creates a transformer that moves the named top-level field to the given 0-based position.
- moveIndex(int, int) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Moves the index at the
oldIndexto thenewIndex, shifting any existing elements at or afternewIndexto the right. - moveIndex(String, int) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Moves the index with the given name to the
newIndex, shifting any existing elements at or afternewIndexto the right. - moveIndexAfter(String, String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Moves the index with the given
indexNameafter to the index with the specifiedafterIndexName, shifting any existing elements afterafterIndexNameto the right. - moveIndexBefore(String, String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Moves the index with the given
indexNamebefore to the index with the specifiedbeforeIndexName, shifting elements at or afterbeforeIndexNameto the right. - msg(String, int, Object, Object) - Static method in exception class com.northconcepts.datapipeline.jsonata.JException
-
Generate error message from given error code Codes are defined in Jsonata.errorCodes Fallback: if error code does not exist, return a generic message
- msg(String, int, Object, Object, boolean) - Static method in exception class com.northconcepts.datapipeline.jsonata.JException
-
Generate error message from given error code Codes are defined in Jsonata.errorCodes Fallback: if error code does not exist, return a generic message
- MULTILINESTRING - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- MULTILINESTRING - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- MULTIPOINT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- MULTIPOINT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- MULTIPOLYGON - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- MULTIPOLYGON - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- MultiRowPreparedStatementInsert - Class in com.northconcepts.datapipeline.jdbc.insert
-
Sample Generated SQL:
INSERT INTO tableName (col1, col2, col3) VALUES
(?, ?, ?),
(?, ?, ?),
(?, ?, ?),... - MultiRowPreparedStatementInsert() - Constructor for class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- MultiRowStatementInsert - Class in com.northconcepts.datapipeline.jdbc.insert
-
Sample Generated SQL:
INSERT INTO tableName (col1, col2, col3) VALUES
(val1, val2, val3),
(val1, val2, val3),
(val1, val2, val3),.. - MultiRowStatementInsert() - Constructor for class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- MultiWriter - Class in com.northconcepts.datapipeline.core
-
Writes records to multiple
DataWriter. - MultiWriter() - Constructor for class com.northconcepts.datapipeline.core.MultiWriter
-
Creates a writer with no targets that uses the
MultiWriter.REPLICATE_CLONEstrategy. - MultiWriter(DataWriter...) - Constructor for class com.northconcepts.datapipeline.core.MultiWriter
-
Creates a writer for the given targets that uses the
MultiWriter.REPLICATE_CLONEstrategy. - MultiWriter(MultiWriter.WriteStrategy) - Constructor for class com.northconcepts.datapipeline.core.MultiWriter
- MultiWriter.AvailableCapacityWriteStrategy - Class in com.northconcepts.datapipeline.core
-
Writes each record to a single writer by choosing the one with the highest available capacity (
DataWriter.available()If all writers have identical capacities, this strategy behaves likeMultiWriter.RoundRobinWriteStrategyand writes to each writer in turn. - MultiWriter.ReplicateCloneWriteStrategy - Class in com.northconcepts.datapipeline.core
-
Writes a clone (to prevent side effects) of each record to all writers.
- MultiWriter.ReplicateWriteStrategy - Class in com.northconcepts.datapipeline.core
-
Writes each record to all writers.
- MultiWriter.RoundRobinWriteStrategy - Class in com.northconcepts.datapipeline.core
-
Divides records evenly between all writers by cycling through the list and writing each record to a single writer in turn.
- MultiWriter.WriteStrategy - Class in com.northconcepts.datapipeline.core
-
Strategy for distributing each record among a
MultiWriter's target writers. - mute(String) - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
- MvStoreDataset - Class in com.northconcepts.datapipeline.foundations.pipeline.dataset
-
Caches the dataset's records on disk using MVStore.
- MvStoreDataset(File) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
-
Opens the dataset saved in the given MVStore file, with its records and column stats already loaded.
- MvStoreDataset(File, AbstractPipeline) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
-
Creates a dataset that, when loaded, stores the pipeline's records in the given MVStore file.
- MySqlInsertWriter - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates MySQL insert statement from records.
- MySqlInsertWriter(String, File) - Constructor for class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- MySqlInsertWriter(String, File, boolean) - Constructor for class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- MySqlInsertWriter(String, Writer) - Constructor for class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- MySqlPart - Class in com.northconcepts.datapipeline.sql.mysql
-
Base class for the MySQL statement builders; identifiers are quoted with backticks.
- MySqlPart() - Constructor for class com.northconcepts.datapipeline.sql.mysql.MySqlPart
- MySqlPreparedStatementInsert - Class in com.northconcepts.datapipeline.jdbc.insert
-
Sample Generated SQL:
INSERT IGNORE INTO tableName (col1, col2, col3) VALUES (?, ?, ?) - MySqlPreparedStatementInsert() - Constructor for class com.northconcepts.datapipeline.jdbc.insert.MySqlPreparedStatementInsert
- MySqlUpsert - Class in com.northconcepts.datapipeline.jdbc.upsert
-
A batch-able upsert strategy where when a row to be inserted would cause a duplicate value in a UNIQUE index or PRIMARY KEY, an UPDATE of the old row occurs.
- MySqlUpsert() - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- MySqlUpsertWriter - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates MySQL upsert statement from records.
- MySqlUpsertWriter(String, File) - Constructor for class com.northconcepts.datapipeline.sql.mysql.MySqlUpsertWriter
- MySqlUpsertWriter(String, File, boolean) - Constructor for class com.northconcepts.datapipeline.sql.mysql.MySqlUpsertWriter
- MySqlUpsertWriter(String, Writer) - Constructor for class com.northconcepts.datapipeline.sql.mysql.MySqlUpsertWriter
N
- name - Variable in class com.northconcepts.datapipeline.core.DataObject
- name - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- name(String) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Appends a new field name segment to this field path.
- NAME - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
- NAME_COMPARATOR - Static variable in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- NAME_COMPARATOR - Static variable in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- NAME_COMPARATOR - Static variable in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- negativeNumber() - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations where the field value is a negative number.
- negativeValue(String, Number) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- never() - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Never closes open windows.
- NEW - Enum constant in enum class com.northconcepts.datapipeline.core.DataEndpoint.State
- NEW - Enum constant in enum class com.northconcepts.datapipeline.core.Record.State
-
Record was just created.
- newField(JsonXmlNode, JsonToken, String, JsonLocation) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Creates the node for a JSON field name; a scalar value is later stored on it by
JsonRecordReader.newValue(JsonXmlNode, JsonToken, Object). - newInputStream(File) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Opens one of this dataset's files for reading.
- newInstanceFromJson(InputStream) - Static method in interface com.northconcepts.datapipeline.core.JsonSerializable
-
Creates an object from UTF-8 JSON that names its class in the
RecordSerializable.SERIALIZED_CLASS_NAMEfield. - newInstanceFromRecord(Record) - Static method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Instantiates the class named in the record's
RecordSerializable.SERIALIZED_CLASS_NAMEfield (via its no-arg constructor) and loads it from the record; returns null for a null record. - newInstanceFromRecord(Record) - Static method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Creates a field definition from its record form, picking the subclass by the
typefield; returns null if the type is missing or has no matching subclass. - newInstanceFromRecord(Record, Class<? super T>) - Static method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Instantiates the class named in the record's
RecordSerializable.SERIALIZED_CLASS_NAMEfield and loads it from the record; the class must be assignable totypewhen it is not null. - newInstanceFromType(String) - Static method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Creates the field definition subclass for the given
FieldTypename (ignoring case) or returns null if the name is empty or the type has no matching subclass. - newInstanceFromXml(InputStream) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Parses the XML and instantiates the class named in the root element's
XmlSerializable.XML_SERIALIZED_CLASS_NAMEattribute, loading it from that element. - newInstanceFromXml(Element) - Static method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Creates a field definition from a
fieldelement, picking the subclass by itstypeattribute; returns null if the type is missing or has no matching subclass. - newInstanceFromXml(Element, Class<? super T>) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Instantiates the class named in the element's
XmlSerializable.XML_SERIALIZED_CLASS_NAMEattribute, which must be assignable totype, and loads it from the element; returns null for a null element. - newJavaCodeBuilder() - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses.TableConfig
-
Returns a new code builder for the table's class in the target package.
- newJsonSystemOutWriter() - Static method in class com.northconcepts.datapipeline.core.StreamWriter
-
Creates a new instance of StreamWriter writing JSON to System.out.
- newLine(boolean) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Writes a raw line break if pretty printing is on or
forceis true; the line count and indentation state are unchanged. - newNode(JsonXmlNode, JsonToken, String, JsonLocation) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Creates the node for the start of a JSON object or array (named
objectorarray). - newOutputStream(File) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Creates one of this dataset's files for writing, replacing any existing content.
- newProvider() - Method in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Creates the provider implementing this type; each
ExcelDocumentcalls it once when constructed. - newStream() - Method in class com.northconcepts.datapipeline.parquet.RandomAccessInputFile
- newSystemErrWriter() - Static method in class com.northconcepts.datapipeline.core.StreamWriter
-
Creates a new instance of StreamWriter writing to System.err.
- newSystemOutWriter() - Static method in class com.northconcepts.datapipeline.core.StreamWriter
-
Creates a new instance of StreamWriter writing to System.out.
- newSystemOutWriterWithSessionProperties() - Static method in class com.northconcepts.datapipeline.core.StreamWriter
-
Creates a new instance of StreamWriter writing to System.out with all session properties.
- newValue(JsonXmlNode, JsonToken, Object) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Stores a scalar value on the current field node, or in a new child node when inside an array, and returns that node.
- newWorkbook() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- newWorkbook() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- newWorkbook() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- newXmlSystemOutWriter() - Static method in class com.northconcepts.datapipeline.core.StreamWriter
-
Creates a new instance of StreamWriter writing XML to System.out.
- next() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetIterator
- next() - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePairIterator
- nextBatch(S3ObjectListing) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns the next set of paged objects.
- nextLine() - Method in class com.northconcepts.datapipeline.core.LineParser
-
Moves to the next line, throwing a
DataExceptionif the input has ended. - nextLine(String) - Method in class com.northconcepts.datapipeline.core.LineParser
-
Moves to the next line, throwing a
DataExceptionprefixed withfailureMessageif the input has ended. - nextMessage(int) - Method in enum class com.northconcepts.datapipeline.email.EmailReadDirection
-
Returns the index of the message to read after the one at the given index.
- nextNode() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Advances to the next JSON token and updates the current node; returns false at the end of the input.
- nextNode(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonNodeWriter
-
Writes the next node depth-first, first closing any finished parents, and returns it or null when none remain.
- nextRecord() - Method in class com.northconcepts.datapipeline.buffer.RecordBuffer
-
Returns the next collected record or null when none remain; only allowed after the buffer is closed.
- nextRecord() - Method in class com.northconcepts.datapipeline.group.Window
-
Returns the next group's summary record or null after the last one; only allowed after this window is closed.
- nextRow() - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
-
Begins a new, empty row for subsequent
addcalls. - nextRow() - Method in class com.northconcepts.datapipeline.sql.h2.Insert
-
Starts a new row for inserting.
- nextRow() - Method in class com.northconcepts.datapipeline.sql.h2.Upsert
-
Starts a new row for upserting.
- nextRow() - Method in class com.northconcepts.datapipeline.sql.mysql.Insert
-
Starts a new row for subsequent
Insert.add(String, Object)calls; the first row already exists after construction. - nextRow() - Method in class com.northconcepts.datapipeline.sql.mysql.Upsert
-
Starts a new row for subsequent
Upsert.add(String, Object)calls; the first row already exists after construction. - nextRow() - Method in class com.northconcepts.datapipeline.sql.postgresql.Insert
-
Starts a new row for subsequent
Insert.add(String, Object)calls; the first row already exists after construction. - nextRow() - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
-
Starts a new row for subsequent
Upsert.add(String, Object)calls; the first row already exists after construction. - nextRow(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
-
Begins a new row for subsequent
addcalls, pre-filled with the previous row's columns and values ifcopyLastRowValuesis true. - Ngrams - Class in com.northconcepts.datapipeline.transform
-
Extracts each run/sequence of N words from the source field and stores them in a target field as an array.
- Ngrams(String, String, int) - Constructor for class com.northconcepts.datapipeline.transform.Ngrams
-
Creates a transformer that stores each run of
ngramCountwords as one space-separated string, finding words with the default locale's rules. - Ngrams(String, String, int, Locale) - Constructor for class com.northconcepts.datapipeline.transform.Ngrams
-
Creates a transformer that stores each run of
ngramCountwords as one space-separated string, finding words with the given locale's rules (the default locale if null). - NO_ACTION - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
- NO_ACTION - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.ForeignKeyAction
- NO_ACTION - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.ForeignKeyAction
- NO_ACTION - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.ForeignKeyAction
- NO_BACKOFF - Enum constant in enum class com.northconcepts.datapipeline.retry.RetryStrategy
- NO_STATUS_FOUND_WITH_THAT_ID - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- noDataMappingTargetFields(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- Node - Class in com.northconcepts.datapipeline.core
-
Node is the base class for all persistent data in Data Pipeline.
- Node() - Constructor for class com.northconcepts.datapipeline.core.Node
- Node.DuplicateNodeAction - Enum Class in com.northconcepts.datapipeline.core
-
DuplicateNodeAction lists all actions that can be taken automatically when a target field already exists during a record copy or lookup.
- Node.NodeType - Enum Class in com.northconcepts.datapipeline.core
-
NodeType lists all concrete data node types used in Data Pipeline.
- NodeNameRule - Interface in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Classifies a single XML element or JSON field name as dynamic data (an identifier, date, or other generated value) rather than a fixed structural name.
- NodeVisitor - Class in com.northconcepts.datapipeline.core
-
Base
INodeVisitorwhose callbacks do nothing; override only the ones you need and walk a tree withNodeVisitor.visit(Node, INodeVisitor). - NodeVisitor() - Constructor for class com.northconcepts.datapipeline.core.NodeVisitor
- noEntityInRelationship(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- noFieldSet(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- NONE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelHyperlinkType
-
No hyperlink.
- NONE - Enum constant in enum class com.northconcepts.datapipeline.foundations.difference.DiffType
- NONE - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardLists
- NONE - Enum constant in enum class com.northconcepts.datapipeline.trello.CardFilter
- NONE - Enum constant in enum class com.northconcepts.datapipeline.trello.ListFilter
- nonPrimaryKeyForeignKeyInOneToOneRelationship(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- noResults(Record, List<?>) - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Called when the lookup finds no records; returns
nullif that is allowed, otherwise throws. - normalizeFieldName(String) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Trims the name, replaces hyphens, spaces and forward or back slashes with underscores and drops a leading
@; returns null for null. - noSourceEntity(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- not(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
returns the Boolean NOT of the arg
- notContains(String, boolean) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to be null or, as a string, not contain the given text.
- NotFilter - Class in com.northconcepts.datapipeline.eventbus.filter
-
Matches only when none of a set of filters match -- !(filter A || filter B || filter C).
- NotFilter(EventFilter...) - Constructor for class com.northconcepts.datapipeline.eventbus.filter.NotFilter
- NotPart - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Negates another criteria part, rendering it as
not (...). - NotPart(QueryCriteriaPart) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.NotPart
- NotRule - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat inverts another rule, allowing the fields it rejects. - NotRule(FieldFilterRule) - Constructor for class com.northconcepts.datapipeline.filter.rule.NotRule
- now(String, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- NULL - Static variable in interface com.northconcepts.datapipeline.eventbus.EventFilter
- NULL - Static variable in interface com.northconcepts.datapipeline.foundations.core.Encoder
- NULL - Static variable in interface com.northconcepts.datapipeline.job.JobCallback
- NULL - Static variable in interface com.northconcepts.datapipeline.job.JobLifecycleListener
- NULL_VALUE - Static variable in class com.northconcepts.datapipeline.jsonata.Jsonata
- nullCallback() - Static method in class com.northconcepts.datapipeline.job.JobCallback.Helper
-
Returns a new callback that ignores progress and success and rethrows failures.
- NullEncoder() - Constructor for class com.northconcepts.datapipeline.foundations.core.Encoder.NullEncoder
- NullFilter - Class in com.northconcepts.datapipeline.eventbus.filter
-
Matches every event; used when a listener is added without a filter.
- NullFilter() - Constructor for class com.northconcepts.datapipeline.eventbus.filter.NullFilter
- nullParent(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- NullPipeline - Class in com.northconcepts.datapipeline.foundations.pipeline
-
A pipeline with no processing whose input defaults to a
NullReader(no records) and output to aNullWriter. - NullPipeline() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.NullPipeline
- NullReader - Class in com.northconcepts.datapipeline.core
-
A data source that produces no records.
- NullReader() - Constructor for class com.northconcepts.datapipeline.core.NullReader
- nullToAll(FieldLocationPredicate) - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns the given predicate if not null, otherwise returns a predicate that matches all locations.
- nullToExpression(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the result of the given expression, evaluated against the current record.
- nullToValue(boolean) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given boolean.
- nullToValue(byte) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given byte.
- nullToValue(byte[]) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given bytes.
- nullToValue(char) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given character.
- nullToValue(double) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given double.
- nullToValue(float) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given float.
- nullToValue(int) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given int.
- nullToValue(long) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given long.
- nullToValue(short) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given short.
- nullToValue(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given string.
- nullToValue(BigDecimal) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given big decimal.
- nullToValue(BigInteger) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given big integer.
- nullToValue(Date) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given date.
- nullToValue(Time) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given time.
- nullToValue(Instant) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given instant.
- nullToValue(LocalDate) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given local date.
- nullToValue(LocalDateTime) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given local date-time.
- nullToValue(LocalTime) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given local time.
- nullToValue(Date) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces null values with the given date-time.
- nullValue() - Static method in class com.northconcepts.datapipeline.core.ValueNode
- nullValue(FieldType) - Static method in class com.northconcepts.datapipeline.core.ValueNode
- NullWriter - Class in com.northconcepts.datapipeline.core
-
Discards records.
- NullWriter() - Constructor for class com.northconcepts.datapipeline.core.NullWriter
- number(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Cast argument to number
- NumberDescriptor - Class in com.northconcepts.datapipeline.foundations.number
- NumberDescriptor() - Constructor for class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- NumberDetector - Class in com.northconcepts.datapipeline.foundations.number
-
A utility for parsing simple numeric values from string.
- NumberDetector() - Constructor for class com.northconcepts.datapipeline.foundations.number.NumberDetector
- NumberMatch - Class in com.northconcepts.datapipeline.foundations.number
-
The result of
NumberDetector.match(String): the matched text split into whole and fraction parts, plus aNumberDescriptorfor it. - NumberMatch() - Constructor for class com.northconcepts.datapipeline.foundations.number.NumberMatch
- numberToBigDecimal() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- numberToBigInteger() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numeric values to big integers, truncating any fraction.
- numberToBoolean() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts the field's value to
trueif non-zero, otherwisefalse. - numberToDate(long) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to dates by multiplying them by
multiplierto get milliseconds since the epoch and clearing the time of day in the default time zone; other values are left unchanged. - numberToDate(String, long) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Adds an operation named
operationNamethat converts numbers to dates by multiplying them bymultiplierto get milliseconds since the epoch and clearing the time of day in the default time zone; other values are left unchanged. - numberToDateTime(long) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to date-times by multiplying them by
multiplierto get milliseconds since the epoch; other values are left unchanged. - numberToDateTime(String, long) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Adds an operation named
operationNamethat converts numbers to date-times by multiplying them bymultiplierto get milliseconds since the epoch; other values are left unchanged. - numberToDays() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to intervals of that many days; other values are left unchanged.
- numberToDouble() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- numberToHours() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to intervals of that many hours; other values are left unchanged.
- numberToInt() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numeric values to ints, truncating any fraction.
- numberToInterval(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to intervals of that many
unitNameunits (millisecond, second, minute, hour, day, week, month or year; singular or plural, any case); other values are left unchanged. - numberToInterval(String, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Adds an operation named
operationNamethat converts numbers to intervals of that manyunitNameunits; other values are left unchanged. - numberToLong() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numeric values to longs, truncating any fraction.
- numberToMillisecond() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to intervals of that many milliseconds; other values are left unchanged.
- numberToMinutes() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to intervals of that many minutes; other values are left unchanged.
- numberToMonths() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to intervals of that many months; other values are left unchanged.
- numberTooLarge(String, Number, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- numberTooSmall(String, Number, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- numberToSeconds() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to intervals of that many seconds; other values are left unchanged.
- numberToString(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Formats numeric values with a
DecimalFormatof the given pattern, converting them to double first. - numberToString(DecimalFormat) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Formats numeric values with the given
DecimalFormat, converting them to double first. - numberToWords(long, boolean) - Static method in class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
- numberToYears() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers to intervals of that many years; other values are left unchanged.
- NUMERIC - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- NumericFieldDef - Class in com.northconcepts.datapipeline.foundations.schema
-
A
FieldDeffor numeric values with optional range, precision and scale limits and a parsing pattern for mapping. - NumericFieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
Creates a field of type
FieldType.LONG. - NumericFieldDef(String, FieldType) - Constructor for class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
Creates a field with the given name and type; non-numeric types are rejected.
O
- object() - Method in class com.northconcepts.datapipeline.json.builder.JsonArray
- object() - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- object() - Method in class com.northconcepts.datapipeline.json.builder.JsonDetailMarker
- object() - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Adds an anonymous object element and returns it; only arrays (and the template root) accept one.
- object() - Method in class com.northconcepts.datapipeline.json.builder.JsonTemplate
- object(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- object(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonDetailMarker
- object(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Adds an object-valued field and returns the new object; only valid on object nodes.
- object(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonObject
- OBJECT - Enum constant in enum class com.northconcepts.datapipeline.json.builder.JsonNodeType
- oddFieldIndex() - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations with odd field indexes (columns).
- oddRowIndex() - Static method in interface com.northconcepts.datapipeline.core.FieldLocationPredicate
-
Returns a predicate that matches field locations with odd row indexes.
- of(String...) - Static method in class com.northconcepts.datapipeline.security.Credentials
-
Creates credentials from alternating key-value pairs:
Credentials.of(Credentials.USERNAME, "scott", Credentials.PASSWORD, "tiger"). - of(Function<Record, Boolean>) - Static method in class com.northconcepts.datapipeline.transform.Transformer
-
Creates a Transformer from a Java Function.
- of(Predicate<Record>) - Static method in class com.northconcepts.datapipeline.filter.Filter
-
Creates a Filter from a Java Predicate.
- offset - Variable in class com.northconcepts.datapipeline.jsonata.Location
-
The absolute character index, starting at 0.
- OFX - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- OLIVE_GREEN - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- onBytesMessage(BytesMessage) - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Converts a bytes message to a record whose
messagefield holds the body bytes. - OnConflict - Class in com.northconcepts.datapipeline.jdbc.sql.conflict
-
Builds the
UPDATE SET column=?, ...action that followsON CONFLICT (...) DOin an upsert statement. - OnConflict() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.conflict.OnConflict
- onDuplicate(Record) - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Called for each duplicate record.
- ONE - Enum constant in enum class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery.Cardinality
- ONE_TO_MANY - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.RelationshipCardinality
- ONE_TO_ONE - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.RelationshipCardinality
- onEvent(Event<?>) - Method in interface com.northconcepts.datapipeline.eventbus.UntypedEventListener
- onException(Event<?>, Throwable, Object) - Method in interface com.northconcepts.datapipeline.eventbus.ExceptionListener
-
Called with the event being delivered, the exception (unwrapped from reflection) and the listener that threw it.
- onFailure() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Called on the run thread after
AbstractJob.runImpl()throws; seeAbstractJob.getException(). - onFailure(Record, DataException, DataMappingResult) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
-
Handles a record whose mapping threw exceptions or failed validation: writes it to the discard writer and returns null to skip it, or throws
exceptionif there is no discard writer. - onFailure(Record, DataException, DataMappingResult) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
-
Handles a record whose mapping threw exceptions or failed validation: writes it to the discard writer and returns null to skip it, or throws
exceptionif there is no discard writer. - onFailure(Record, Transformer, DataException, String, Messages) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Handles a failed transformation (
exceptionisnullif it returned false): sends the record to the discard writer if there is one, otherwise throws or, when exceptionOnFailure is off, adds warnings tomessages. - onFailure(Record, Transformer, DataException, String, Messages) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Handles a failed transformation (
exceptionisnullif it returned false): sends the record to the discard writer if there is one, otherwise throws or, when exceptionOnFailure is off, adds warnings tomessages. - onFailure(Record, Throwable) - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Called after each failed read attempt; writes the failing record (when known) to the discard writer, if set, and throws once
RetryingReader.getMaxErrorCount()is exceeded. - onFailure(Record, Throwable) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Called after each failed write attempt; writes the record to the discard writer, if set, and throws once
RetryingWriter.getMaxErrorCount()is exceeded. - onFailure(Throwable) - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Called after each failed attempt; throws once the exception count exceeds
RetryingOperation.getMaxErrorCount(). - onFailure(R, W, Record, Throwable) - Method in class com.northconcepts.datapipeline.job.AbstractJobCallback
- onFailure(R, W, Record, Throwable) - Method in interface com.northconcepts.datapipeline.job.JobCallback
-
Called after a failed or cancelled transfer closes the reader and writer, with the record in progress or
null; the default rethrows the exception, makingJob.run()throw it. - onFinish() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Called on the run thread after
AbstractJob.onSuccess()orAbstractJob.onFailure(), even if they throw. - onFinish() - Method in class com.northconcepts.datapipeline.job.Job
-
Called when this job finishes.
- onFinish(Job) - Method in interface com.northconcepts.datapipeline.job.JobLifecycleListener
-
Called after the job ends, whether it succeeded, failed or was cancelled.
- onLimitExceeded(TwitterRateLimit) - Method in interface com.northconcepts.datapipeline.twitter.IApiLimitPolicy
-
Called when the API call limit is reached; returns true to retry or false to stop reading (it may also throw).
- onMapMessage(MapMessage) - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Converts a map message to a record with one field per map entry.
- onMessage(Message) - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Converts a received message to a record by message type, adds the JMS header fields and acknowledges it in
CLIENTmode; returns null if the message is null. - onObjectMessage(ObjectMessage) - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Converts an object message to a record whose
messagefield holds the object. - onPause() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Called on the run thread when it pauses in
AbstractJob.handlePause(). - onPause() - Method in class com.northconcepts.datapipeline.job.Job
-
Called when this job is paused.
- onPause(Job) - Method in interface com.northconcepts.datapipeline.job.JobLifecycleListener
-
Called after the job's run thread pauses between records, not when
Job.pause()is requested. - onProgress(R, W, Record) - Method in class com.northconcepts.datapipeline.job.AbstractJobCallback
- onProgress(R, W, Record) - Method in interface com.northconcepts.datapipeline.job.JobCallback
-
Called on the job's thread after each record is written.
- onRateLimitExceeded() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Marks the rate limit as exceeded and returns the API limit policy's answer: true to retry, false to stop reading.
- onRateLimitExceeded() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Marks the rate limit as exceeded and returns the API limit policy's answer: true to retry, false to stop reading.
- onRecord(Record) - Method in interface com.northconcepts.datapipeline.eventbus.RecordListener
-
Called with each published record or with
nullwhen a publishingEventBusWritercloses. - onResume() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Called on the run thread when it resumes in
AbstractJob.handlePause(). - onResume(Job) - Method in interface com.northconcepts.datapipeline.job.JobLifecycleListener
- onShuttingDown(EventBus) - Method in interface com.northconcepts.datapipeline.eventbus.EventBusLifecycleListener
-
Called asynchronously, on the system event bus, when an event bus begins shutting down.
- onShuttingDown(EventBus) - Method in interface com.northconcepts.datapipeline.eventbus.ShutdownListener
- onStart() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Called on the run thread when this job starts, before
AbstractJob.runImpl(). - onStart() - Method in class com.northconcepts.datapipeline.job.Job
-
Called when this job starts.
- onStart(Job) - Method in interface com.northconcepts.datapipeline.job.JobLifecycleListener
- onStartUp(EventBus) - Method in interface com.northconcepts.datapipeline.eventbus.EventBusLifecycleListener
-
Called asynchronously, on the system event bus, after a new event bus is created.
- onStreamMessage(StreamMessage) - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Converts a stream message to a record whose
messagefield holds only the first value read from the stream. - onSuccess() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Called on the run thread after
AbstractJob.runImpl()completes without throwing. - onSuccess(R, W) - Method in class com.northconcepts.datapipeline.job.AbstractJobCallback
- onSuccess(R, W) - Method in interface com.northconcepts.datapipeline.job.JobCallback
-
Called after all records were transferred and the reader and writer closed.
- onTextMessage(TextMessage) - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Converts a text message to a record whose
messagefield holds the text. - onTheadFinished(AsyncMultiReader.ReaderThread) - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
-
Called by each
AsyncMultiReader.ReaderThreadas it ends; signals the end of input once all have finished, or at the first failure whenAsyncMultiReader.isFailOnException()is true. - onUnique(Record) - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Called for each unique record.
- onUserFound(Long, String, Record) - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Called for each user found.
- onUserNotFound(Long, String, Record) - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Called for each user not found.
- open() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Opens a connection to the Amazon S3 file system.
- open() - Method in class com.northconcepts.datapipeline.avro.AvroReader
- open() - Method in class com.northconcepts.datapipeline.avro.AvroWriter
- open() - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageReader
- open() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
- open() - Method in class com.northconcepts.datapipeline.buffer.RecordBuffer
- open() - Method in class com.northconcepts.datapipeline.core.AbstractReader
- open() - Method in class com.northconcepts.datapipeline.core.AbstractWriter
- open() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
- open() - Method in class com.northconcepts.datapipeline.core.AsyncReader
- open() - Method in class com.northconcepts.datapipeline.core.AsyncTaskReader
- open() - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- open() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Makes this endpoint ready for reading or writing.
- open() - Method in class com.northconcepts.datapipeline.core.DataEndpointGroup
- open() - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Makes this endpoint ready for reading or writing.
- open() - Method in class com.northconcepts.datapipeline.core.LimitReader
- open() - Method in class com.northconcepts.datapipeline.core.MultiWriter
- open() - Method in class com.northconcepts.datapipeline.core.ParsingReader
- open() - Method in class com.northconcepts.datapipeline.core.ProxyReader
- open() - Method in class com.northconcepts.datapipeline.core.ProxyWriter
- open() - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
- open() - Method in class com.northconcepts.datapipeline.core.SequenceReader
- open() - Method in class com.northconcepts.datapipeline.core.SortingReader
- open() - Method in class com.northconcepts.datapipeline.core.StreamWriter
- open() - Method in class com.northconcepts.datapipeline.core.TeeReader
- open() - Method in class com.northconcepts.datapipeline.core.TextReader
- open() - Method in class com.northconcepts.datapipeline.core.TimedReader
- open() - Method in class com.northconcepts.datapipeline.email.EmailReader
- open() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
- open() - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
- open() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- open() - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
- open() - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
- open() - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Opens a connection to the DropBox file system.
- open() - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Opens a connection to an FTP server.
- open() - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Opens a connection to the Hadoop Distributed File System.
- open() - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Opens a connection to an SFTP server.
- open() - Method in class com.northconcepts.datapipeline.filesystem.zip.ZipFileSystem
- open() - Method in class com.northconcepts.datapipeline.filter.Filter
-
Called by
FilteringReaderwhenFilteringReader.open()is called (before reading starts). - open() - Method in class com.northconcepts.datapipeline.filter.FilteringReader
- open() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- open() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
- open() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
- open() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset.ColumnsDataReader
- open() - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- open() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- open() - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
- open() - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- open() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- open() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- open() - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- open() - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Opens a connection to the Google Drive file system.
- open() - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.
- open() - Method in class com.northconcepts.datapipeline.group.GroupByReader
- open() - Method in class com.northconcepts.datapipeline.group.Window
- open() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
- open() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationReader
- open() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfFollowedByReader
- open() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfFollowsReader
- open() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfMediaReader
- open() - Method in class com.northconcepts.datapipeline.instagram.InstagramTagMediaReader
- open() - Method in class com.northconcepts.datapipeline.instagram.InstagramTagReader
- open() - Method in class com.northconcepts.datapipeline.instagram.InstagramUserMediaReader
- open() - Method in class com.northconcepts.datapipeline.internal.lang.IntegrationProxyReader
- open() - Method in class com.northconcepts.datapipeline.internal.lang.IntegrationProxyWriter
- open() - Method in class com.northconcepts.datapipeline.internal.lang.IntegrationReader
- open() - Method in class com.northconcepts.datapipeline.internal.lang.IntegrationWriter
- open() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
- open() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
- open() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
- open() - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- open() - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- open() - Method in class com.northconcepts.datapipeline.jira.JiraIssueReader
- open() - Method in class com.northconcepts.datapipeline.jira.JiraReader
- open() - Method in class com.northconcepts.datapipeline.jms.JmsConnection
-
Connects using the connection factory looked up through JNDI with the settings' properties and creates the session and destination; call
JmsConnection.start()afterwards to begin receiving messages. - open() - Method in class com.northconcepts.datapipeline.jms.JmsReader
- open() - Method in class com.northconcepts.datapipeline.jms.JmsWriter
- open() - Method in class com.northconcepts.datapipeline.job.DataReaderIterator
- open() - Method in class com.northconcepts.datapipeline.json.JsonRecordWriter
- open() - Method in class com.northconcepts.datapipeline.json.JsonWriter
- open() - Method in class com.northconcepts.datapipeline.json.SimpleJsonWriter
- open() - Method in class com.northconcepts.datapipeline.kafka.KafkaReader
- open() - Method in class com.northconcepts.datapipeline.kafka.KafkaWriter
- open() - Method in class com.northconcepts.datapipeline.latex.LatexWriter
- open() - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
- open() - Method in class com.northconcepts.datapipeline.memory.MemoryReader
- open() - Method in class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
- open() - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
- open() - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
- open() - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
- open() - Method in class com.northconcepts.datapipeline.openfinancialexchange.OpenFinancialExchangeReader
- open() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
- open() - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
- open() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
- open() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
- open() - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
-
Deprecated.use open(File file) or open(InputStream inputStream)
- open() - Method in class com.northconcepts.datapipeline.pdf.PdfReader
- open() - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
- open() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
- open() - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
- open() - Method in class com.northconcepts.datapipeline.rtf.RtfWriter
- open() - Method in class com.northconcepts.datapipeline.security.DecryptingReader
- open() - Method in class com.northconcepts.datapipeline.security.EncryptingReader
- open() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
- open() - Method in class com.northconcepts.datapipeline.template.TemplateWriter
- open() - Method in class com.northconcepts.datapipeline.transform.FastRenameField
- open() - Method in class com.northconcepts.datapipeline.transform.lookup.Lookup
-
Called when the
LookupTransformerusing this lookup is opened; override to acquire resources. - open() - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
- open() - Method in class com.northconcepts.datapipeline.transform.lookup.ProxyLookup
- open() - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Called by
TransformingReaderorTransformingWriterwhen theiropen()method is called (before reading or writing starts). - open() - Method in class com.northconcepts.datapipeline.transform.TransformingReader
- open() - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
- open() - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
- open() - Method in class com.northconcepts.datapipeline.trello.TrelloApiWriter
- open() - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- open() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- open() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
- open() - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
- open() - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
- open() - Method in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
- open() - Method in class com.northconcepts.datapipeline.xml.SimpleXmlWriter
- open() - Method in class com.northconcepts.datapipeline.xml.XmlReader
- open() - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
- open() - Method in class com.northconcepts.datapipeline.xml.XmlWriter
- open(JmsSettings, Session) - Method in enum class com.northconcepts.datapipeline.jms.JmsDestinationType
-
Opens the type of message channel.
- open(File) - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
- open(File) - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
-
Loads the PDF file and extracts its tables.
- open(File, String) - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
-
Loads the PDF file using the password (null for none) and extracts its tables.
- open(InputStream) - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
-
Loads the workbook from the given stream; not supported by the
ExcelDocument.ProviderType.POI_XSSF_SAXandExcelDocument.ProviderType.POI_XSSFBproviders, which needExcelDocument.open(File). - open(InputStream) - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
-
Loads the PDF from the stream and extracts its tables.
- open(InputStream, String) - Method in class com.northconcepts.datapipeline.pdf.PdfDocument
-
Loads the PDF from the stream using the password (null for none) and extracts its tables.
- open(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Connects to the spreadsheet, given as a bare id or a full docs.google.com URL, and loads its sheet list.
- open(String, String) - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Does nothing; the stream is created when a reader is opened.
- OPEN - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.OrderStatus
- OPEN - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardFilter
- OPEN - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardLists
- OPEN - Enum constant in enum class com.northconcepts.datapipeline.trello.CardFilter
- OPEN - Enum constant in enum class com.northconcepts.datapipeline.trello.ListFilter
- openDataset(JdbcDataset.DatabaseProvider, JdbcConnectionFactory, String) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Loads an existing persistent dataset stored in a database determined by the provided
JdbcDataset.DatabaseProvider. - openDataset(File) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
-
Loads an existing dataset from the specified
databaseFile. - openDataset(String, String) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Loads an existing dataset from the specified
rootFolderinvalid input: '&'fileNamePrefix. - OPENED - Enum constant in enum class com.northconcepts.datapipeline.core.DataEndpoint.State
- OpenFinancialExchangePipelineInput - Class in com.northconcepts.datapipeline.openfinancialexchange.pipeline.input
-
A pipeline input that reads Open Financial Exchange (OFX) data from a
FileSourceusing anOpenFinancialExchangeReader. - OpenFinancialExchangePipelineInput() - Constructor for class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- OpenFinancialExchangeReader - Class in com.northconcepts.datapipeline.openfinancialexchange
-
Read an OFX / QFX (Quicken) / QBO (QuickBooks) file as a single nested
Recordthat mirrors the document's aggregate hierarchy, using the OFX tag names (BANKMSGSRSV1,STMTTRN,TRNAMT, ...) as field names. - OpenFinancialExchangeReader(File) - Constructor for class com.northconcepts.datapipeline.openfinancialexchange.OpenFinancialExchangeReader
-
Read an OFX/QFX/QBO file.
- OpenFinancialExchangeReader(InputStream) - Constructor for class com.northconcepts.datapipeline.openfinancialexchange.OpenFinancialExchangeReader
-
Read a stream of OFX/QFX/QBO data.
- openWorkbook(File) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- openWorkbook(File) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- openWorkbook(File) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- openWorkbook(InputStream) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- openWorkbook(InputStream) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- openWorkbook(InputStream) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- Operation(String) - Constructor for class com.northconcepts.datapipeline.transform.BasicFieldTransformer.Operation
-
Creates an operation whose name is used in its string form and in exception details.
- OPINIONATED - Static variable in interface com.northconcepts.datapipeline.jdbc.JdbcValueReader
-
Maps database types to java types based only on
java.sql.Types, column display size, and scale. - OptimizeTreeStructure - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Cleans up a loaded
Treeby merging non-wildcard siblings into an existing wildcard node, adding a synthetic value field under childless wildcard nodes, and marking JSON array elements as record breaks. - OptimizeTreeStructure() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.OptimizeTreeStructure
- or(boolean, QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ORs the part with the existing conditions (first if
firstis true) and returns the rootOrPart. - or(boolean, String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ORs a condition with its parameter values (first if
firstis true) and returns the rootOrPart. - or(BufferStrategy...) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers if any of the supplied strategies request it.
- or(FieldFilterRule...) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring at least one of the given rules to pass.
- or(CloseWindowStrategy...) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes windows if any of the supplied strategies request it.
- or(CreateWindowStrategy...) - Static method in class com.northconcepts.datapipeline.group.CreateWindowStrategy
-
Opens a new window if any of the supplied strategies request it.
- or(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ORs the part after the existing conditions and returns the root
OrPart. - or(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
ORs a condition, such as
"id = ?", with its parameter values and returns the rootOrPart. - OracleMultiRowInsertAllStatementInsert - Class in com.northconcepts.datapipeline.jdbc.insert
-
Sample Generated SQL:
OracleMultiRowInsertAllStatementInsertINSERT ALL
INTO tableName (col1, col2, col3) VALUES ('val1', 'val2', 'val3')
INTO tableName (col1, col2, col3) VALUES ('val1', 'val2', 'val3')
INTO tableName (col1, col2, col3) VALUES ('val1', 'val2', 'val3')
...
SELECT 1 FROM dual - OracleMultiRowInsertAllStatementInsert() - Constructor for class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowInsertAllStatementInsert
- OracleMultiRowSelectUnionAllStatementInsert - Class in com.northconcepts.datapipeline.jdbc.insert
-
Sample Generated SQL:
INSERT INTO tableName (col1, col2, col3)
SELECT 'val1', 'val2', 'val3' FROM dual UNION ALL
SELECT 'val1', 'val2', 'val3' FROM dual UNION ALL
...
SELECT 'val1', 'val2', 'val3' FROM dual - OracleMultiRowSelectUnionAllStatementInsert() - Constructor for class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowSelectUnionAllStatementInsert
- OracleMultiRowStatementInsert - Class in com.northconcepts.datapipeline.jdbc.insert
-
Base class for the Oracle-specific multi-row insert strategies, which write the values into the SQL as literals.
- OracleMultiRowStatementInsert() - Constructor for class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowStatementInsert
- OracleUpsert - Class in com.northconcepts.datapipeline.jdbc.upsert
-
A batch-able upsert strategy that relies on the SQL Merge statement.
- OracleUpsert() - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- ORANGE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- ORC - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- OrcDataReader - Class in com.northconcepts.datapipeline.orc
-
Read records from Apache ORC columnar files.
- OrcDataReader(File) - Constructor for class com.northconcepts.datapipeline.orc.OrcDataReader
-
Reads ORC data from a file.
- OrcDataReader(Path) - Constructor for class com.northconcepts.datapipeline.orc.OrcDataReader
-
Read ORC data from a
Path. - OrcDataWriter - Class in com.northconcepts.datapipeline.orc
-
Writes records to Apache ORC columnar files.
- OrcDataWriter(File) - Constructor for class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Write ORC data to a file.
- OrcDataWriter(Path) - Constructor for class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Write ORC data to a path like S3, Hadoop etc.
- ORCHID - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- OrcPipelineInput - Class in com.northconcepts.datapipeline.orc.input
-
A pipeline input that reads the Apache ORC file at a
FileSource's path using anOrcDataReader. - OrcPipelineInput() - Constructor for class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- OrcPipelineOutput - Class in com.northconcepts.datapipeline.orc.output
-
A pipeline output that writes an Apache ORC file to a
FileSink's path using anOrcDataWriter. - OrcPipelineOutput() - Constructor for class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- ORDER - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- orderBy(FieldList) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Appends the fields to the ORDER BY clause in ascending order.
- orderBy(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Appends the fields to the ORDER BY clause in ascending order.
- orderBy(String, boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- orderBy(String, boolean, Boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Appends a field to the ORDER BY clause, adding
NULLS FIRSTorNULLS LASTunlessnullsFirstis null. - OrderStatus - Enum Class in com.northconcepts.datapipeline.shopify.client
-
Order statuses for
ShopifyOrder.setStatus(OrderStatus);OrderStatus.toString()returns the lower-case name. - OrFilter - Class in com.northconcepts.datapipeline.eventbus.filter
-
Matches any one of a set of filers -- filer A || filer B || filer C.
- OrFilter(EventFilter...) - Constructor for class com.northconcepts.datapipeline.eventbus.filter.OrFilter
- ORGANIZATION - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardFilter
- ORIGINAL - Static variable in interface com.northconcepts.datapipeline.jdbc.JdbcValueReader
- ORIGINAL_FIELD_INDEX - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The index of a field set by the DataReader before any transformation or operation was performed.
- ORIGINAL_FIELD_NAME - Static variable in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The name of a field set by the DataReader before any transformation or operation was performed.
- OrPart - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
A
ConjunctivePartthat joins its parts with OR. - OrPart() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.OrPart
- OrRule - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows a field when any of its rules does; with no rules it rejects every field. - OrRule() - Constructor for class com.northconcepts.datapipeline.filter.rule.OrRule
- OrRule(FieldFilterRule...) - Constructor for class com.northconcepts.datapipeline.filter.rule.OrRule
- OrSequenceStrategy(SequenceWriter.ISequenceStrategy...) - Constructor for class com.northconcepts.datapipeline.core.SequenceWriter.OrSequenceStrategy
- outdent() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Decreases the indent level by one; throws
IllegalStateExceptionif it is already zero. - outerWrapper - Variable in class com.northconcepts.datapipeline.jsonata.Utils.JList
- OVER_CAPACITY - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- OVER_SPAM_REPORT_LIMIT - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- OVERWRITE - Enum constant in enum class com.northconcepts.datapipeline.core.Node.DuplicateNodeAction
-
Replaces the target field with the source field.
- OWNER - Enum constant in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
P
- P - Static variable in class com.northconcepts.datapipeline.meter.Meter
- pad(String, Number, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Pad a string to a minimum width by adding characters to the start or end
- padLeft(int, char) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Pads values on the left with
padCharup tolengthcharacters; longer values are unchanged and null values are padded as empty strings. - padRight(int, char) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Pads values on the right with
padCharup tolengthcharacters; longer values are unchanged and null values are padded as empty strings. - page(int, int) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Limits the result to the given 0-based page of
pageSizerows. - PAGE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- PAGE_DOES_NOT_EXIST - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- PAGE_SIZE - Static variable in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingEditor
- PAID - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
- PALE_BLUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- parallelStream() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a parallel Stream of the elements in this array.
- parallelStream() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- parallelStream() - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns a parallel Stream of the fields in this list.
- parallelStream() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a parallel Stream of the fields in this record.
- parallelStream() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns a parallel Stream of the records in this list.
- parent - Variable in class com.northconcepts.datapipeline.xml.builder.XmlNode
- PARQUET - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- ParquetDataReader - Class in com.northconcepts.datapipeline.parquet
-
Read records from Apache Parquet columnar files.
- ParquetDataReader(InputFile) - Constructor for class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Reads parquet data from an
InputFile. - ParquetDataWriter - Class in com.northconcepts.datapipeline.parquet
-
Writes records to Apache Parquet columnar files.
- ParquetDataWriter(File) - Constructor for class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Write parquet data to a file.
- ParquetDataWriter(OutputFile) - Constructor for class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Write parquet data to an
OutputFile. - ParquetOutputFile - Class in com.northconcepts.datapipeline.parquet.file
-
A Parquetthat writes to a Hadoop
invalid reference
OutputFile, with checksum writing turned off on checksum file systems.invalid reference
Path - ParquetPipelineInput - Class in com.northconcepts.datapipeline.parquet.input
-
A pipeline input that reads the Apache Parquet file at a
FileSource's path using aParquetDataReader. - ParquetPipelineInput() - Constructor for class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- ParquetPipelineOutput - Class in com.northconcepts.datapipeline.parquet.output
-
A pipeline output that writes an Apache Parquet file to a
FileSink's path using aParquetDataWriter. - ParquetPipelineOutput() - Constructor for class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- ParquetUtil - Class in com.northconcepts.datapipeline.parquet
-
Utility methods to read Parquet schemas and to rewrite schema fields identified by column path.
- ParquetUtil() - Constructor for class com.northconcepts.datapipeline.parquet.ParquetUtil
- parse(Reader) - Static method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
-
Parses a message from
START-OF-FILEon, turning each pipe-delimited data line into a record and skipping blank and#comment lines; the reader is closed after a successful parse. - parse(Reader) - Method in class com.northconcepts.datapipeline.jsonata.JsonParser
-
Reads the entire input from the given reader and parses it as JSON.
- parse(Reader, int) - Method in class com.northconcepts.datapipeline.jsonata.JsonParser
-
Reads the entire input from the given reader and parses it as JSON.
- parse(String) - Static method in class com.northconcepts.datapipeline.core.FieldPath
-
Converts a field path expression into a FieldPath object.
- parse(String) - Method in class com.northconcepts.datapipeline.jsonata.JsonParser
-
Parses the given input string.
- parse(String) - Method in class com.northconcepts.datapipeline.jsonata.Parser
- parse(String, boolean) - Static method in class com.northconcepts.datapipeline.core.FieldPath
-
Parses the expression as
FieldPath.parse(String)does, except that a null or blank expression returns null, or throws iffailOnEmptyis true. - parse(String, String, String, Boolean) - Static method in class com.northconcepts.datapipeline.csv.CSVReader
-
Utility method to quickly parse lines of CSV text.
- parse(String, String, String, Boolean, Boolean) - Static method in class com.northconcepts.datapipeline.csv.CSVReader
-
Utility method to quickly parse lines of CSV text.
- parseDateTime(String, String) - Static method in class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
- ParseException - Exception Class in com.northconcepts.datapipeline.expression
-
Thrown when expression-language text cannot be parsed.
- ParseException - Exception Class in com.northconcepts.datapipeline.jsonata
-
An unchecked exception to indicate that an input does not qualify as valid JSON.
- ParseException() - Constructor for exception class com.northconcepts.datapipeline.expression.ParseException
- ParseException(String) - Constructor for exception class com.northconcepts.datapipeline.expression.ParseException
- ParseException(String, Throwable) - Constructor for exception class com.northconcepts.datapipeline.expression.ParseException
- ParseException(Throwable) - Constructor for exception class com.northconcepts.datapipeline.expression.ParseException
- parseExpression(String) - Static method in class com.northconcepts.datapipeline.expression.ExpressionHelper
-
Parses the given expression into a syntax tree; throws a
ParseExceptionif it is null, blank or invalid. - parseInteger(String, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
parse a string containing an integer as specified by the picture string
- parseJson(Reader) - Static method in class com.northconcepts.datapipeline.jsonata.Json
-
Parses the given JSON
- parseJson(String) - Static method in class com.northconcepts.datapipeline.jsonata.Json
-
Parses the given JSON string
- parseLine(String, String, String, Boolean) - Static method in class com.northconcepts.datapipeline.csv.CSVReader
-
Utility method to quickly parse a line of CSV text.
- parseLine(String, String, String, Boolean, Boolean) - Static method in class com.northconcepts.datapipeline.csv.CSVReader
-
Utility method to quickly parse a line of CSV text.
- parseLogicalExpression(String) - Static method in class com.northconcepts.datapipeline.expression.ExpressionHelper
-
Parses a logical (true/false) expression, such as
x > 23, into a syntax tree; throws aParseExceptionif it is null, blank, invalid or not logical. - parseNumber(String) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
-
Parses the string into the Java number class of
NumberDescriptor.getFieldType(), e.g. - parser - Variable in class com.northconcepts.datapipeline.core.ParsingReader
- Parser - Class in com.northconcepts.datapipeline.core
- Parser - Class in com.northconcepts.datapipeline.jsonata
- Parser() - Constructor for class com.northconcepts.datapipeline.jsonata.Parser
- Parser(Reader) - Constructor for class com.northconcepts.datapipeline.core.Parser
- Parser(String) - Constructor for class com.northconcepts.datapipeline.core.Parser
- Parser.Symbol - Class in com.northconcepts.datapipeline.jsonata
- ParsingReader - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for obtaining records from a text stream using a parser.
- ParsingReader(File) - Constructor for class com.northconcepts.datapipeline.core.ParsingReader
-
Creates a reader for the file using the default charset; the file is opened by this constructor rather than by
open(). - ParsingReader(File, String) - Constructor for class com.northconcepts.datapipeline.core.ParsingReader
- ParsingReader(Reader) - Constructor for class com.northconcepts.datapipeline.core.ParsingReader
- PARTIAL - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FulfillmentStatus
- PARTIALLY_PAID - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
- PARTIALLY_REFUNDED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
- PASSIVE_LOCAL - Enum constant in enum class com.northconcepts.datapipeline.filesystem.ftp.DataConnectionMode
-
Data transfer mode where the client connects to the server's data port and that the server is in passive mode.
- PASSWORD - Static variable in class com.northconcepts.datapipeline.security.Credentials
- path - Variable in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- PATH - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- pathof(String) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
- patternFormat - Variable in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- patternFormat - Variable in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- PatternMatch - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields whose whole value, as a string, matches any of its regular expressions; null values are rejected. - PatternMatch() - Constructor for class com.northconcepts.datapipeline.filter.rule.PatternMatch
- PatternMatch(String...) - Constructor for class com.northconcepts.datapipeline.filter.rule.PatternMatch
- PatternMatch(String, int) - Constructor for class com.northconcepts.datapipeline.filter.rule.PatternMatch
-
Creates a rule for a regular expression compiled with the given
Patternflags, such asPattern.CASE_INSENSITIVE. - patternMatches(String...) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's whole value to match one of the given regular expressions; null values fail.
- patternNotMatches(String...) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to be null or not wholly match any of the given regular expressions.
- pause() - Method in class com.northconcepts.datapipeline.job.AbstractJob
- pause() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Asks this job to pause at its next pause check (between records for a
Job) untilIJob.resume()is called. - pause() - Method in class com.northconcepts.datapipeline.job.Job
- PDF - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- PdfDocument - Class in com.northconcepts.datapipeline.pdf
-
A PDF file or stream whose tables are extracted from every page when it is opened, for reading with a
PdfReader. - PdfDocument() - Constructor for class com.northconcepts.datapipeline.pdf.PdfDocument
-
Creates an unopened document; load it with one of the
openmethods. - PdfDocument(File) - Constructor for class com.northconcepts.datapipeline.pdf.PdfDocument
-
Deprecated.use open(File file)
- PdfDocument(File, String) - Constructor for class com.northconcepts.datapipeline.pdf.PdfDocument
-
Deprecated.use open(File file, String password)
- PdfDocumentStatistics - Class in com.northconcepts.datapipeline.pdf
-
Page, image and text statistics of a
PdfDocument. - PdfDocumentStatistics() - Constructor for class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
- PdfPipelineInput - Class in com.northconcepts.datapipeline.pdf.input
-
A pipeline input that reads a table from a PDF in a
FileSourceusing aPdfReader. - PdfPipelineInput() - Constructor for class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- PdfPipelineOutput - Class in com.northconcepts.datapipeline.pdf.output
- PdfPipelineOutput() - Constructor for class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- PdfReader - Class in com.northconcepts.datapipeline.pdf
-
Obtains records from the rows of one table extracted from a
PdfDocument, with one field per cell. - PdfReader(PdfDocument) - Constructor for class com.northconcepts.datapipeline.pdf.PdfReader
-
Creates a reader for a document that must already be opened when this reader opens.
- PdfWriter - Class in com.northconcepts.datapipeline.pdf
-
Writes records to a PDF document stream.
- PdfWriter(File) - Constructor for class com.northconcepts.datapipeline.pdf.PdfWriter
-
Creates a writer for the file, which is created or truncated immediately; the PDF is rendered when the writer closes.
- PdfWriter(OutputStream) - Constructor for class com.northconcepts.datapipeline.pdf.PdfWriter
-
Creates a writer for the stream; the PDF is rendered to it, and the stream closed, when the writer closes.
- PdfWriter.IPageSize - Interface in com.northconcepts.datapipeline.pdf
-
A PDF page size, expressed as a CSS
@pagesize value. - PdfWriter.PageOrientation - Enum Class in com.northconcepts.datapipeline.pdf
-
The page orientations, each mapped to its CSS
@pageorientation keyword. - PdfWriter.PageSize - Enum Class in com.northconcepts.datapipeline.pdf
-
Common page sizes, each mapped to its CSS
@pagesize keyword. - peek(int) - Method in class com.northconcepts.datapipeline.core.DataReader
-
Looks ahead to return the next record at the specified index without reading it or
nullif one does not exist. - peek(int) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Returns the character at the given 0-based offset ahead without consuming it, or
IParser.EOFpast the end of the input. - peek(int) - Method in class com.northconcepts.datapipeline.core.LineParser
- peek(int) - Method in class com.northconcepts.datapipeline.core.Parser
- peek(int) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekCHARACTER() - Method in class com.northconcepts.datapipeline.core.ParsingReader
-
Indicates if the next character is an ASCII letter, without consuming it.
- peekSequence(int, int) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Returns up to
lengthcharacters starting at the given lookahead offset without consuming them; fewer if the input ends first. - peekSequence(int, int) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekSequence(int, int) - Method in class com.northconcepts.datapipeline.core.Parser
- peekSequence(int, int) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekString(char[]) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Indicates if the upcoming characters match the given string, without consuming them.
- peekString(char[]) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekString(char[]) - Method in class com.northconcepts.datapipeline.core.Parser
- peekString(char[]) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekString(CharSequence) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Indicates if the upcoming characters match the given string, without consuming them.
- peekString(CharSequence) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekString(CharSequence) - Method in class com.northconcepts.datapipeline.core.Parser
- peekString(CharSequence) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekStringArray(char[][]) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Returns the index of the first string that matches the upcoming characters or -1 if none do, without consuming them.
- peekStringArray(char[][]) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekStringArray(char[][]) - Method in class com.northconcepts.datapipeline.core.Parser
- peekStringArray(char[][]) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekStringArray(char[][], int) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Returns the index of the first string that matches the characters at the given lookahead offset or -1 if none do.
- peekStringArray(char[][], int) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekStringArray(char[][], int) - Method in class com.northconcepts.datapipeline.core.Parser
- peekStringArray(char[][], int) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekStringArray(CharSequence...) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Returns the index of the first string that matches the upcoming characters or -1 if none do, without consuming them.
- peekStringArray(CharSequence...) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekStringArray(CharSequence...) - Method in class com.northconcepts.datapipeline.core.Parser
- peekStringArray(CharSequence...) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekStringArray(CharSequence[], int) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Returns the index of the first string that matches the characters at the given lookahead offset or -1 if none do.
- peekStringArray(CharSequence[], int) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekStringArray(CharSequence[], int) - Method in class com.northconcepts.datapipeline.core.Parser
- peekStringArray(CharSequence[], int) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekStringOffset(char[], int) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Indicates if the characters starting at the given lookahead offset match the given string, without consuming them.
- peekStringOffset(char[], int) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekStringOffset(char[], int) - Method in class com.northconcepts.datapipeline.core.Parser
- peekStringOffset(char[], int) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekStringOffset(CharSequence, int) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Indicates if the characters starting at the given lookahead offset match the given string, without consuming them.
- peekStringOffset(CharSequence, int) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekStringOffset(CharSequence, int) - Method in class com.northconcepts.datapipeline.core.Parser
- peekStringOffset(CharSequence, int) - Method in class com.northconcepts.datapipeline.core.StringParser
- peekWhitespaceLength(int) - Method in interface com.northconcepts.datapipeline.core.IParser
-
Returns the number of consecutive whitespace characters starting at the given 0-based lookahead offset.
- peekWhitespaceLength(int) - Method in class com.northconcepts.datapipeline.core.LineParser
- peekWhitespaceLength(int) - Method in class com.northconcepts.datapipeline.core.Parser
- peekWhitespaceLength(int) - Method in class com.northconcepts.datapipeline.core.StringParser
- pending - Enum constant in enum class com.northconcepts.datapipeline.mailchimp.list.ListMemberStatus
- PENDING - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
- PeriodicScheduler - Class in com.northconcepts.datapipeline.schedule
-
Represents a fixed, cyclical schedule (for example: every 30 minutes starting now).
- PeriodicScheduler(long) - Constructor for class com.northconcepts.datapipeline.schedule.PeriodicScheduler
-
Creates a schedule that repeats every
periodmilliseconds. - PG_LSN - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- PG_SNAPSHOT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- PINK - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- PINK1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- PipedReader - Class in com.northconcepts.datapipeline.core
-
Reads the records written to a connected
PipedWriter, usually on another thread; reads block until a record arrives and the stream ends when the writer is closed. - PipedReader() - Constructor for class com.northconcepts.datapipeline.core.PipedReader
-
Creates a reader with an unbounded queue.
- PipedReader(int) - Constructor for class com.northconcepts.datapipeline.core.PipedReader
-
Creates a reader whose queue holds at most
queueCapacityrecords; the writer blocks while it is full. - PipedWriter - Class in com.northconcepts.datapipeline.core
-
Writes records to a connected
PipedReader, blocking while its queue is full; closing this writer ends the reader's stream. - PipedWriter(PipedReader) - Constructor for class com.northconcepts.datapipeline.core.PipedWriter
- Pipeline - Class in com.northconcepts.datapipeline.foundations.pipeline
-
A declarative pipeline that applies an ordered list of
PipelineActions to its input records, with undo and redo of the most recent actions. - Pipeline() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- PipelineAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action
-
Base class for the steps of a declarative
Pipeline; each action wraps the reader produced by the previous step. - PipelineAction(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
-
Creates an action with the identifier returned by
PipelineAction.getCode()and the name returned byPipelineAction.getDisplayText(). - PipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline
-
Base class for the sources a pipeline reads its records from, such as CSV, Excel, fixed-width, JSON or XML files, JDBC queries and datasets.
- PipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
- PipelineObject - Class in com.northconcepts.datapipeline.foundations.pipeline
-
Base class for pipelines and their parts (inputs, outputs and actions), which can be serialized and can generate Java code.
- PipelineObject() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.PipelineObject
- PipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline
-
Base class for the destinations a pipeline writes its records to, such as CSV, Excel, fixed-width, JSON or XML files and JDBC tables.
- PipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.PipelineOutput
- placeBackTicks(String) - Static method in class com.northconcepts.datapipeline.sql.h2.H2SqlPart
-
Wraps an identifier in backticks for H2 SQL.
- placeBackTicks(String) - Static method in class com.northconcepts.datapipeline.sql.mysql.MySqlPart
-
Returns the given identifier wrapped in backticks, without escaping any backticks inside it.
- PLACED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- PLUM - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- PNG - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- POI - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Read/Write .xls files (Excel 2003) using Apache POI.
- POI_SXSSF - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Writes .xlsx files (Excel 2007+) using Apache POI's streaming API (SXSSF) and temporary files to reduce memory usage.
- POI_XSSF - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Read/Write .xlsx files (Excel 2007+) using Apache POI.
- POI_XSSF_SAX - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Reads .xlsx files (Excel 2007+) using Apache POI's streaming API (XSSF_SAX) to reduce memory usage.
- POI_XSSFB - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Read .xlsb (Binary Excel) files using Apache POI.
- POINT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- POINT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- POINT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- PoiSxssfProvider - Class in com.northconcepts.datapipeline.excel
-
Provider for
ExcelDocument.ProviderType.POI_SXSSF: writes .xlsx files with Apache POI's streaming SXSSF API, keeping the last 1000 rows in memory and the rest in compressed temporary files. - PoiSxssfProvider() - Constructor for class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- PoiXssfbProvider - Class in com.northconcepts.datapipeline.excel
-
Read-only provider for
ExcelDocument.ProviderType.POI_XSSFB: reads binary .xlsb sheets from aFile, returning each cell as its formatted string. - PoiXssfbProvider() - Constructor for class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- PoiXssfSaxProvider - Class in com.northconcepts.datapipeline.excel
-
Provider for
ExcelDocument.ProviderType.POI_XSSF_SAX: opens .xlsx files read-only and only from aFile; new workbooks are written as withExcelDocument.ProviderType.POI_XSSF. - PoiXssfSaxProvider() - Constructor for class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- POLYGON - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- POLYGON - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- POLYGON - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- pop() - Method in class com.northconcepts.datapipeline.core.AsyncReader
- pop() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Removes and returns the next record in this
DataReaders buffer ornullif it is empty. - pop() - Method in interface com.northconcepts.datapipeline.core.IParser
-
Consumes and returns the next character, or
IParser.EOFat the end of the input. - pop() - Method in class com.northconcepts.datapipeline.core.LineParser
- pop() - Static method in class com.northconcepts.datapipeline.core.Messages
-
Restores the current thread's container saved by the matching
Messages.push(). - pop() - Method in class com.northconcepts.datapipeline.core.Parser
- pop() - Method in class com.northconcepts.datapipeline.core.StringParser
- pop() - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidationPath
-
Removes and returns the last element of the current thread's path, releasing the thread's state once it is empty.
- POP3 - Enum constant in enum class com.northconcepts.datapipeline.email.MailStore
- POP3_OVER_SSL - Enum constant in enum class com.northconcepts.datapipeline.email.MailStore
- PORTRAIT - Enum constant in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageOrientation
- PORTRAIT - Enum constant in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageOrientation
- positiveScale(Number) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- POSTGRESQL - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset.DatabaseProvider
-
PostgreSQL database provider.
- PostgreSqlInsertWriter - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates PostgreSQL insert statement from records.
- PostgreSqlInsertWriter(String, File) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- PostgreSqlInsertWriter(String, File, boolean) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- PostgreSqlInsertWriter(String, Writer) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- PostgreSqlUpsert - Class in com.northconcepts.datapipeline.jdbc.upsert
-
A batch-able upsert strategy that relies on the SQL Merge statement.
- PostgreSqlUpsert() - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- PostgreSqlUpsert.ConflictAction - Enum Class in com.northconcepts.datapipeline.jdbc.upsert
-
The action taken when an insert conflicts on the key fields: update the existing row or do nothing.
- PostgreSqlUpsertWriter - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates PostgreSQL upsert statement from records.
- PostgreSqlUpsertWriter(String, File, boolean, String...) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Creates a writer of upserts into
tablethat use the given key fields forON CONFLICT; at least one is required. - PostgreSqlUpsertWriter(String, File, boolean, List<String>) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Creates a writer of upserts into
tablethat use the given key fields forON CONFLICT; at least one is required. - PostgreSqlUpsertWriter(String, File, String...) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Creates a writer of upserts into
tablethat use the given key fields forON CONFLICT; at least one is required. - PostgreSqlUpsertWriter(String, File, List<String>) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Creates a writer of upserts into
tablethat use the given key fields forON CONFLICT; at least one is required. - PostgreSqlUpsertWriter(String, Writer, String...) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Creates a writer of upserts into
tablethat use the given key fields forON CONFLICT; at least one is required. - PostgreSqlUpsertWriter(String, Writer, List<String>) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Creates a writer of upserts into
tablethat use the given key fields forON CONFLICT; at least one is required. - PostgresSqlPart - Class in com.northconcepts.datapipeline.sql.postgresql
-
Base class for the PostgreSQL statement builders; identifiers are quoted with double quotes.
- PostgresSqlPart() - Constructor for class com.northconcepts.datapipeline.sql.postgresql.PostgresSqlPart
- postIssueComment(String, String) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
-
Adds a comment to the issue;
bodyis the JSON request body, not the plain comment text. - postRestSearchIssues(JiraSearch) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
-
Runs the JQL search and returns a page of matching issues as JSON.
- power(Number, Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Raises number to the power of the second number
- precisionNotLessThanAbsScale(Integer, Integer) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- precisionTooLarge(String, int, int, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- prefixMessageWith(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Prefixes this exception's message with the specified text.
- prepare(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- prepare(JdbcUpsertWriter, Record) - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Called once, with the first record written, to generate the SQL and create the statement(s).
- prepare(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- prepare(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- prepare(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- prepare(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- prepare(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- prepare(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- prepare(JdbcWriter, Record) - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Called once, with the first record written, to generate the SQL and create the statement(s).
- prepare(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- prepare(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- prepare(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.MySqlPreparedStatementInsert
- prepare(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowInsertAllStatementInsert
- prepare(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowSelectUnionAllStatementInsert
- prepare(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- PreparedStatementInsert - Class in com.northconcepts.datapipeline.jdbc.insert
-
Sample Generated SQL:
INSERT INTO tableName (col1, col2, col3) VALUES (?, ?, ?) - PreparedStatementInsert() - Constructor for class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- prepend(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Prepends
prefixto each value, treating null values as empty strings. - pretty - Variable in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
- pretty - Variable in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- pretty - Variable in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- PRICERULE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- primaryForeignKeysCountMismatch(int, int) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- primaryForeignKeyTypeMismatch(String, FieldType, String, FieldType, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- primaryKeysLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- PrimaryKeyType - Enum Class in com.northconcepts.datapipeline.foundations.schema
-
See the definitions in JPA's javax.persistence.GenerationType
- PRIMITIVE - Enum constant in enum class com.northconcepts.datapipeline.json.builder.JsonNodeType
- print() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Writes just the pending prefix of a newly started line (its indentation, or the separator when not pretty).
- print(String) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Writes
sliterally, withoutString.formatprocessing; text starting a line is indented first. - print(String, Object...) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Writes
s(run throughString.formatwhen arguments are given), indenting text that starts a line. - printif(boolean, String) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
- printif(boolean, String, Object...) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
- printifNotEmpty(String, Object...) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Prints
slikeCodeWriter.print(String, Object...)unless it is null or only whitespace. - println() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
- println(String) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Writes
sliterally, withoutString.formatprocessing, and ends the line. - println(String, Object...) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Writes the text like
CodeWriter.print(String, Object...)and ends the line; the line break itself is only written when pretty printing. - printlnif(boolean) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
- printlnif(boolean, String) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
- printlnif(boolean, String, Object...) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
- printlnifNotEmpty(String, Object...) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Prints
sand ends the line likeCodeWriter.println(String, Object...)unless it is null or only whitespace. - printSqlParts(CodeWriter, List<? extends SqlPart>, String) - Static method in class com.northconcepts.datapipeline.jdbc.sql.SqlPart
-
Writes the SQL of each part to the writer, separated by
separator. - printStackTrace(PrintStream) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Prints this throwable and its backtrace to the specified print stream.
- printStackTrace(PrintWriter) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Prints this throwable and its backtrace to the specified print writer.
- PRODUCT - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- PRODUCT - Static variable in class com.northconcepts.datapipeline.core.DataEndpoint
- PRODUCT_VERSION - Static variable in class com.northconcepts.datapipeline.core.DataEndpoint
- ProductStatus - Enum Class in com.northconcepts.datapipeline.shopify.client
-
Product statuses for
ShopifyProductCriteria.setStatus(ProductStatus...);ProductStatus.toString()returns the lower-case name. - Property - Class in com.northconcepts.datapipeline.foundations.core
-
A name-value pair of strings, such as a JDBC driver property of a
JdbcConnection. - Property() - Constructor for class com.northconcepts.datapipeline.foundations.core.Property
- PropertyDiff - Class in com.northconcepts.datapipeline.foundations.difference
-
A leaf
Difffor a single value, such as a record field or an array element. - PropertyDiff() - Constructor for class com.northconcepts.datapipeline.foundations.difference.PropertyDiff
- PropertyDiff(DiffType, String, Object, Object) - Constructor for class com.northconcepts.datapipeline.foundations.difference.PropertyDiff
- Proxy() - Constructor for class com.northconcepts.datapipeline.jira.client.JiraClient.Proxy
- Proxy() - Constructor for class com.northconcepts.datapipeline.mailchimp.MailChimpClient.Proxy
- Proxy() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyClient.Proxy
- ProxyFileSource - Class in com.northconcepts.datapipeline.foundations.file
-
A
FileSourcethat delegates its file methods and record serialization to a nested file source; subclasses override selected methods. - ProxyFileSource(FileSource) - Constructor for class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- ProxyLookup - Class in com.northconcepts.datapipeline.transform.lookup
-
Abstract super-class for obtaining records from another
Lookup, possibly transforming them along the way. - ProxyLookup(Lookup) - Constructor for class com.northconcepts.datapipeline.transform.lookup.ProxyLookup
- ProxyPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline
-
Base class for inputs that wrap another
PipelineInputand decorate each reader it creates. - ProxyPipelineInput(PipelineInput) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineInput
- ProxyPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline
-
Base class for outputs that wrap another
PipelineOutputand decorate each writer it creates. - ProxyPipelineOutput(PipelineOutput) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineOutput
- ProxyReader - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for obtaining records from another
DataReader, possibly transforming them along the way. - ProxyReader(DataReader) - Constructor for class com.northconcepts.datapipeline.core.ProxyReader
-
Creates a proxy for the given (non-null) reader, which is opened and closed along with this proxy.
- ProxyWriter - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for writing records to another
DataWriter, possibly transforming them along the way. - ProxyWriter(DataWriter) - Constructor for class com.northconcepts.datapipeline.core.ProxyWriter
-
Creates a proxy for the given (non-null) writer, which is opened and closed along with this proxy.
- pruneCache() - Method in class com.northconcepts.datapipeline.core.Parser
-
Discards the already consumed characters from the lookahead buffer.
- PUBLIC - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardFilter
- PUBLISHED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- PUBLISHED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.PublishedStatus
- PublishedStatus - Enum Class in com.northconcepts.datapipeline.shopify.client
-
Product published states for
ShopifyProductCriteria.setPublishedStatus(PublishedStatus);PublishedStatus.toString()returns the lower-case name. - publishEvent(Event<T>) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Numbers the event and hands it to the executor for delivery; throws if this bus is not alive, except for lifecycle and shutdown events, which are dropped.
- push() - Static method in class com.northconcepts.datapipeline.core.Messages
-
Saves the current thread's container on a stack and starts a new, empty one; restore it with
Messages.pop(). - push(Record) - Method in class com.northconcepts.datapipeline.core.AsyncReader
- push(Record) - Method in class com.northconcepts.datapipeline.core.DataReader
-
Adds a record to this
DataReaders buffer. - push(String) - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidationPath
-
Appends an element to the current thread's path.
- put(DeMux, Record) - Method in interface com.northconcepts.datapipeline.multiplex.DeMux.IStrategy
-
Queues a source record for one or more of the demultiplexer's readers; called on the feeder thread.
- put(SplitWriter, Record) - Method in interface com.northconcepts.datapipeline.multiplex.SplitWriter.IStrategy
-
Queues a written record for one or more of the writer's readers; called on the writing thread.
- put(String, Object) - Method in class com.northconcepts.datapipeline.jsonata.JsonObject
- putExpirationDays(S3ControlClient, String, String, String, int) - Static method in class com.northconcepts.datapipeline.amazons3.AmazonS3Util
-
Puts a lifecycle configuration on
bucketwith a single enabled rule that expires objects whose keys start withpathPrefixafterdaysToLivedays.
Q
- QBO - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- QFX - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- QUERY - Enum constant in enum class com.northconcepts.datapipeline.foundations.jdbc.JdbcSourceType
- QueryCriteria - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
The WHERE or HAVING clause of a query, built from conditions combined with AND and OR; renders nothing when empty.
- QueryCriteria() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
- QueryCriteria(QueryCriteria.CriteriaType) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
- QueryCriteria(String, Object...) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
Creates WHERE criteria with one condition, such as
"id = ?", and its parameter values. - QueryCriteria.CriteriaType - Enum Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Whether a
QueryCriteriarenders as a WHERE or a HAVING clause. - QueryCriteriaPart - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Base class for the nodes of a
QueryCriteriacondition tree. - QueryCriteriaPart() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteriaPart
- QueryGrouping - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
The GROUP BY clause of a
Select; renders nothing when it has no fields. - QueryGrouping() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryGrouping
- QueryGrouping(String...) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryGrouping
- QueryOrder - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
The ORDER BY clause of a
Select; renders nothing when it has no fields. - QueryOrder() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrder
- QueryOrderPart - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
One ORDER BY entry: a field, its direction and optional null placement.
- QueryOrderPart() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
- QueryOrderPart(String, boolean) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
- QueryOrderPart(String, boolean, Boolean) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
- QueryPart - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Base class for the clauses and conditions that make up a
Selectquery. - QueryPart() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QueryPart
- QuerySelection - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
The SELECT column list of a
Select; selects*when no fields are added. - QuerySelection() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QuerySelection
- QuerySelection(String...) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QuerySelection
- QuerySource - Class in com.northconcepts.datapipeline.jdbc.sql.select
- QuerySource() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.QuerySource
- QUEUE - Enum constant in enum class com.northconcepts.datapipeline.jms.JmsDestinationType
-
Used in point-to-point messaging.
- quote(String, StringBuilder) - Static method in class com.northconcepts.datapipeline.jsonata.Utils
-
adapted from org.json.JSONObject https://github.com/stleary/JSON-java
- QUOTED_EMPTY_STRING - Enum constant in enum class com.northconcepts.datapipeline.csv.CSVWriter.ValuePolicy
-
Writes a quoted blank value using the CSVWriter's starting and ending quote properties.
R
- random() - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Returns a random number 0 invalid input: '<'= n invalid input: '<' 1
- RandomAccessInputFile - Class in com.northconcepts.datapipeline.parquet
-
A Parquetbacked by a
invalid reference
InputFileRandomAccessFile; all streams it opens share the file and its read position, and closing them does not close the file. - RandomAccessInputFile(RandomAccessFile) - Constructor for class com.northconcepts.datapipeline.parquet.RandomAccessInputFile
- RandomAccessSeekableInputStream - Class in com.northconcepts.datapipeline.parquet
-
A Parquetthat reads from a
invalid reference
SeekableInputStreamRandomAccessFile; closing it does not close the file. - RandomAccessSeekableInputStream(RandomAccessFile) - Constructor for class com.northconcepts.datapipeline.parquet.RandomAccessSeekableInputStream
- RangeList(long, long) - Constructor for class com.northconcepts.datapipeline.jsonata.Utils.RangeList
- RATE_LIMIT_EXCEEDED - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- RE_OPENED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- read() - Method in class com.northconcepts.datapipeline.core.AbstractReader
- read() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Reads the next record from this
DataReaderand increases the record-count by 1. - read() - Method in class com.northconcepts.datapipeline.core.TimedReader
- read() - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- read() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
- read() - Method in class com.northconcepts.datapipeline.meter.MeteredInputStream
- read() - Method in class com.northconcepts.datapipeline.parquet.RandomAccessSeekableInputStream
- read() - Method in class com.northconcepts.datapipeline.throttle.ThrottledInputStream
- read(byte[], int, int) - Method in class com.northconcepts.datapipeline.meter.MeteredInputStream
- read(byte[], int, int) - Method in class com.northconcepts.datapipeline.throttle.ThrottledInputStream
- read(DataInput, Record) - Static method in class com.northconcepts.datapipeline.file.FileReader
-
Reads one record from the given input into
recordand returns it, without closing the input. - read(ByteBuffer) - Method in class com.northconcepts.datapipeline.parquet.RandomAccessSeekableInputStream
- readBackgroundColor(CellStyle) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- readBackgroundColor(CellStyle) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- readColumnValue(ResultSet, int, int, String) - Method in interface com.northconcepts.datapipeline.jdbc.JdbcValueReader
-
Reads the 1-based column's value from the current row;
columnTypeis the column'sTypescode. - readColumnValue(ResultSet, int, int, String, FieldType) - Method in interface com.northconcepts.datapipeline.jdbc.JdbcValueReader
-
Reads the 1-based column's value from the current row as the given field type, returning
nullfor SQL NULL; the default ignoresfieldTypeand calls the overload without it. - readEntries(ZipEntryFilter, ZipDataReaderFactory) - Method in class com.northconcepts.datapipeline.filesystem.zip.ZipFileSystem
- reader - Variable in class com.northconcepts.datapipeline.core.TextReader
- reader - Variable in class com.northconcepts.datapipeline.xml.XmlReader
- readExcelHyperlink(Cell, Field) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- readExcelHyperlink(Cell, Field) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- readExcelStyle(Workbook, Cell, Field) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- readExcelStyle(Workbook, Cell, Field) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- readField(int, int, Field) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- readField(int, int, Field) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- readField(int, int, Field) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- readField(int, int, Field) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Copies a cell into the field: numbers and booleans, which arrive only under the UNFORMATTED_VALUE render option, become DOUBLE and BOOLEAN as in Excel; other cells are strings; blank and missing cells leave the field untouched.
- readFile(String) - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Reads the file in the DropBox root folder.
- readFile(String) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Reads the specified file in the root folder.
- readFile(String) - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Reads the specified file in the HDFS root folder.
- readFile(String) - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Reads the specified file in the root folder.
- readFile(String) - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Reads the first occurrence of a Google Drive File with matching
fileName. - readFile(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Reads the file in the S3 bucket.
- readFile(String, String) - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Reads the file in the specified DropBox folder.
- readFile(String, String) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Reads a file in the specified folder.
- readFile(String, String) - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Reads the file in the specified HDFS folder.
- readFile(String, String) - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Reads a file in the specified folder.
- readFile(String, String) - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Reads the first occurrence of a Google Drive File with matching
fileNamein the specifiedfolderName. - readFontColor(Font) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- readFontColor(Font) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- readFully(byte[]) - Method in class com.northconcepts.datapipeline.parquet.RandomAccessSeekableInputStream
- readFully(byte[], int, int) - Method in class com.northconcepts.datapipeline.parquet.RandomAccessSeekableInputStream
- readFully(ByteBuffer) - Method in class com.northconcepts.datapipeline.parquet.RandomAccessSeekableInputStream
- readGroupValue(Group, int, int, ValueNodeContainer) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Adds the value of the group's field at
fieldIndexto the container: primitives as values, lists as arrays, and maps and other groups as records. - readImpl() - Method in class com.northconcepts.datapipeline.avro.AvroReader
- readImpl() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.AbstractReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.AsyncReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.AsyncTaskReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.DataReader
-
Overridden by subclasses to read the next record from this
DataReader. - readImpl() - Method in class com.northconcepts.datapipeline.core.LimitReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.NullReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.PipedReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.ProxyReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.SequenceReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.SortingReader
- readImpl() - Method in class com.northconcepts.datapipeline.core.TextReader
- readImpl() - Method in class com.northconcepts.datapipeline.email.EmailReader
- readImpl() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
- readImpl() - Method in class com.northconcepts.datapipeline.file.FileReader
- readImpl() - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
- readImpl() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset.ColumnsDataReader
- readImpl() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetReader
- readImpl() - Method in class com.northconcepts.datapipeline.google.analytics.GoogleAnalyticsReportReader
- readImpl() - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- readImpl() - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
- readImpl() - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- readImpl() - Method in class com.northconcepts.datapipeline.group.GroupByReader
- readImpl() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
- readImpl() - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationReader
- readImpl() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfFollowedByReader
- readImpl() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfFollowsReader
- readImpl() - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfMediaReader
- readImpl() - Method in class com.northconcepts.datapipeline.instagram.InstagramTagMediaReader
- readImpl() - Method in class com.northconcepts.datapipeline.instagram.InstagramTagReader
- readImpl() - Method in class com.northconcepts.datapipeline.instagram.InstagramUserMediaReader
- readImpl() - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
- readImpl() - Method in class com.northconcepts.datapipeline.jira.JiraReader
- readImpl() - Method in class com.northconcepts.datapipeline.jms.JmsReader
- readImpl() - Method in class com.northconcepts.datapipeline.job.DataReaderIterator
- readImpl() - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
- readImpl() - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
- readImpl() - Method in class com.northconcepts.datapipeline.kafka.KafkaReader
- readImpl() - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
- readImpl() - Method in class com.northconcepts.datapipeline.memory.CollectionReader
- readImpl() - Method in class com.northconcepts.datapipeline.memory.MemoryReader
- readImpl() - Method in class com.northconcepts.datapipeline.meter.MeteredReader
- readImpl() - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
- readImpl() - Method in class com.northconcepts.datapipeline.multiplex.SplitReader
- readImpl() - Method in class com.northconcepts.datapipeline.openfinancialexchange.OpenFinancialExchangeReader
- readImpl() - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
- readImpl() - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
- readImpl() - Method in class com.northconcepts.datapipeline.pdf.PdfReader
- readImpl() - Method in class com.northconcepts.datapipeline.retry.RetryingReader
- readImpl() - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
- readImpl() - Method in class com.northconcepts.datapipeline.throttle.ThrottledReader
- readImpl() - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
- readImpl() - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- readImpl() - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
- readImpl() - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
- readImpl() - Method in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
- readImpl() - Method in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
- readImpl() - Method in class com.northconcepts.datapipeline.xml.SimpleXmlReader
- readImpl() - Method in class com.northconcepts.datapipeline.xml.XmlReader
- readImpl() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
- readNextBatch() - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Fetches the next page via
JiraReader.getIssuesRecord()and buffers its items; returns false after the last page, if the page is null or empty, or if at leastJiraReader.getMaxItems()items were already fetched. - readNextBatch() - Method in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
-
Buffers the records of the next
AbstractTwitterReader.search()page; returns false when there is no further page to read. - readNextBatchImpl() - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
-
Fetches the next page of items as records using
trelloStub; each item needs anidfield and a page smaller thanTrelloApiReader.getBatchSize()ends the read. - readNextBatchImpl() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardCardsReader
- readNextBatchImpl() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardListsReader
- readNextBatchImpl() - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
- readNextBatchImpl() - Method in class com.northconcepts.datapipeline.trello.TrelloListCardsReader
- readPrimitiveValue(Group, int, ValueNodeContainer, Type) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Adds the values of the group's primitive field at
fieldIndexto the container, converted using its logical type, or a typed null if it has none; times and timestamps are truncated to milliseconds. - readRecord(Group, int) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Converts a Parquet group into a record with one field per group field;
depthis 0 for a row and grows with nesting. - readSchema(File) - Static method in class com.northconcepts.datapipeline.parquet.ParquetUtil
-
Parses the Parquet message type schema stored as text in the file, read with the platform default charset.
- readSchema(Reader) - Static method in class com.northconcepts.datapipeline.parquet.ParquetUtil
-
Parses the reader's full text as a Parquet message type schema; the reader is closed afterwards.
- ready() - Method in interface com.northconcepts.datapipeline.core.IParser
- ready() - Method in class com.northconcepts.datapipeline.core.LineParser
- ready() - Method in class com.northconcepts.datapipeline.core.Parser
- ready() - Method in class com.northconcepts.datapipeline.core.StringParser
- REAL - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- Record - Class in com.northconcepts.datapipeline.core
-
Record holds persistent data in key-value fields as it flows through the pipeline.
- Record() - Constructor for class com.northconcepts.datapipeline.core.Record
-
Creates a new empty record with no fields.
- Record(FieldList) - Constructor for class com.northconcepts.datapipeline.core.Record
-
Creates a new record with the specified field names.
- Record(Record) - Constructor for class com.northconcepts.datapipeline.core.Record
-
Creates a new record by copying the fields from another.
- Record(String...) - Constructor for class com.northconcepts.datapipeline.core.Record
-
Creates a new record with the specified field names.
- RECORD - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- RECORD - Enum constant in enum class com.northconcepts.datapipeline.core.Node.NodeType
- RECORD - Enum constant in enum class com.northconcepts.datapipeline.core.StreamWriter.Format
- RECORD_NUMBER - Static variable in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The sequential record number starting with 0.
- RECORD_SCHEMA - Static variable in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The schema for ORC and Parquet files.
- RECORD_WITH_SESSION_PROPERTIES - Enum constant in enum class com.northconcepts.datapipeline.core.StreamWriter.Format
- Record.State - Enum Class in com.northconcepts.datapipeline.core
-
Lists the lifecycle states of a record as it flows through the pipeline.
- recordBreaks - Variable in class com.northconcepts.datapipeline.xml.XmlReader
- RecordBuffer - Class in com.northconcepts.datapipeline.buffer
-
Collects the records that share one key in a
BufferedReader; they can be read back only after the buffer is closed. - RecordBuffer(CompositeValue) - Constructor for class com.northconcepts.datapipeline.buffer.RecordBuffer
- RecordComparator - Class in com.northconcepts.datapipeline.core
-
Orders records by a list of fields, each ascending or descending with an optional
Collator; when no fields are added, records are compared on all their fields by name. - RecordComparator() - Constructor for class com.northconcepts.datapipeline.core.RecordComparator
- RecordComparator(RecordComparator) - Constructor for class com.northconcepts.datapipeline.core.RecordComparator
-
Creates a copy of the given comparator with its own copies of the field comparators.
- RecordContainer - Interface in com.northconcepts.datapipeline.core
-
A general interface for objects that are associated with a
Record. - RecordCountSequenceStrategy(long) - Constructor for class com.northconcepts.datapipeline.core.SequenceWriter.RecordCountSequenceStrategy
- RecordDeserializer - Class in com.northconcepts.datapipeline.kafka
- RecordDeserializer() - Constructor for class com.northconcepts.datapipeline.kafka.RecordDeserializer
- RecordDiff - Class in com.northconcepts.datapipeline.foundations.difference
-
A
Diffbetween two records; its children describe the differences in their fields. - RecordDiff() - Constructor for class com.northconcepts.datapipeline.foundations.difference.RecordDiff
- RecordDiff(DiffType, String, Record, Record) - Constructor for class com.northconcepts.datapipeline.foundations.difference.RecordDiff
- recordFailedValidationRule(Filter) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- RecordFieldDef - Class in com.northconcepts.datapipeline.foundations.schema
-
A
FieldDeffor nested records, validated and mapped using another entity in the same schema. - RecordFieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- RecordFieldDef(String, String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- recordHasFieldsMismatch(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- recordHasUnexpectedFields(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- RecordJsonDeserializer - Class in com.northconcepts.datapipeline.json
-
Jackson component annotated on Record to load it from JSON.
- RecordJsonDeserializer() - Constructor for class com.northconcepts.datapipeline.json.RecordJsonDeserializer
- RecordJsonSerializer - Class in com.northconcepts.datapipeline.json
-
Jackson component annotated on Record to save it to JSON.
- RecordJsonSerializer() - Constructor for class com.northconcepts.datapipeline.json.RecordJsonSerializer
- recordLineage - Variable in class com.northconcepts.datapipeline.core.DataReader
- RecordLineage - Class in com.northconcepts.datapipeline.lineage
-
Convenience wrapper to read and write record-level data lineage properties.
- RecordLineage() - Constructor for class com.northconcepts.datapipeline.lineage.RecordLineage
- RecordLineage(Record) - Constructor for class com.northconcepts.datapipeline.lineage.RecordLineage
- RecordList - Class in com.northconcepts.datapipeline.core
-
An in-memory list of records that can be sorted, searched with a
Filter, and converted to binary, arrays or a reader. - RecordList() - Constructor for class com.northconcepts.datapipeline.core.RecordList
- RecordList(int) - Constructor for class com.northconcepts.datapipeline.core.RecordList
- RecordList(DataReader) - Constructor for class com.northconcepts.datapipeline.core.RecordList
-
Creates a list of all records read from the reader, which is opened if needed and closed afterwards.
- RecordList(Record...) - Constructor for class com.northconcepts.datapipeline.core.RecordList
- RecordListener - Interface in com.northconcepts.datapipeline.eventbus
-
Listener interface for publishing and receiving records on an
EventBus, asEventBusWriterandEventBusReaderdo. - RecordListLookup - Class in com.northconcepts.datapipeline.transform.lookup
-
An in-memory lookup implementation that performs joins using a
RecordList. - RecordListLookup(RecordList, FieldList) - Constructor for class com.northconcepts.datapipeline.transform.lookup.RecordListLookup
-
Creates a RecordListLookup that returns all fields from matching records.
- RecordListLookup(RecordList, FieldList, FieldList) - Constructor for class com.northconcepts.datapipeline.transform.lookup.RecordListLookup
-
Creates a RecordListLookup that returns selected fields from matching records.
- RecordMeter - Class in com.northconcepts.datapipeline.meter
-
A
Meterthat counts records or their estimated size in bytes. - RecordMeter() - Constructor for class com.northconcepts.datapipeline.meter.RecordMeter
- RecordMeter.MeterUnit - Enum Class in com.northconcepts.datapipeline.meter
-
The unit a
RecordMetercounts in: bytes (each record's estimated size) or records. - recordMissingFields(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- recordPeriod(int) - Static method in class com.northconcepts.datapipeline.group.CreateWindowStrategy
-
Opens a new window at set record count intervals or on the first record.
- RECORDS - Enum constant in enum class com.northconcepts.datapipeline.meter.RecordMeter.MeterUnit
- RecordSerializable - Interface in com.northconcepts.datapipeline.core
-
The interface implemented by classes to participate in serialization to and from Record.
- RecordSerializer - Class in com.northconcepts.datapipeline.kafka
- RecordSerializer() - Constructor for class com.northconcepts.datapipeline.kafka.RecordSerializer
- RecordTemplateModel - Class in com.northconcepts.datapipeline.template
-
Exposes a
Recordto FreeMarker templates as a hash keyed by field name, with values wrapped by the object wrapper. - RecordTemplateModel() - Constructor for class com.northconcepts.datapipeline.template.RecordTemplateModel
- RecordTemplateModel(Record, ObjectWrapper) - Constructor for class com.northconcepts.datapipeline.template.RecordTemplateModel
- recordToBsonDocument(Record) - Static method in class com.northconcepts.datapipeline.mongodb.MongoTypeConverter
-
Converts a record to a BSON document with one entry per field, converting nested records and arrays recursively.
- RED - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- RED1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- redoLastAction() - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
-
Re-appends the most recently undone action; returns it, or null if there is nothing to redo.
- referencedEntityNotFound(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- refresh() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem.CredentialsResolverBridge
-
Forces re-resolution from the
CredentialsResolveron the next credentials request. - refresh() - Method in class com.northconcepts.datapipeline.security.CachingCredentialsResolver
- refresh() - Method in interface com.northconcepts.datapipeline.security.CredentialsResolver
-
Forces a re-fetch on the next call to
CredentialsResolver.getCredentials(). - refresh() - Method in class com.northconcepts.datapipeline.security.FileCredentialsResolver
- refreshCredentials() - Method in class com.northconcepts.datapipeline.internal.lang.FileSystem
-
Forces the resolver to re-fetch (see
CredentialsResolver.refresh()), then resolves a fresh snapshot. - refreshFileSize() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Looks the size up in S3 again, for an object that may have changed since its size was kept.
- REFUND_FAILURE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- REFUND_PENDING - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- REFUND_SUCCESS - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- REFUNDED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
- RegexNodeNameRule - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Classifies names matching a caller-supplied regular expression as dynamic.
- RegexNodeNameRule(String) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.RegexNodeNameRule
- RegexZipEntryFilter - Class in com.northconcepts.datapipeline.filesystem.zip
-
A
ZipEntryFilterthat accepts entries whose entire name, including any folder path, matches aregular expression. - RegexZipEntryFilter(String) - Constructor for class com.northconcepts.datapipeline.filesystem.zip.RegexZipEntryFilter
- registerFunction(String, Jsonata.Fn0<R>) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- registerFunction(String, Jsonata.Fn1<A, R>) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- registerFunction(String, Jsonata.Fn2<A, B, R>) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- registerFunction(String, Jsonata.JFunction) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
- RelationshipCardinality - Enum Class in com.northconcepts.datapipeline.foundations.schema
-
Whether one primary entity record relates to one or to many foreign entity records in an
EntityRelationshipDef. - relationshipWithoutCardinality(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- reloadRateLimit() - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Fetches the current rate limit from the API, replacing the cached one.
- reloadRateLimit() - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Fetches the current rate limit from the API, replacing the cached one.
- remove() - Method in class com.northconcepts.datapipeline.core.Field
-
Removes this field from its parent record.
- remove() - Static method in class com.northconcepts.datapipeline.foundations.schema.SchemaValidationPath
-
Clears the current thread's path.
- remove(int) - Method in class com.northconcepts.datapipeline.core.RecordComparator
- remove(int) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- remove(int) - Method in class com.northconcepts.datapipeline.filter.FilteringReader
-
Removes the filter at the given 0-based index.
- remove(int) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
-
Removes the attribute at the given 0-based index, in name order.
- remove(DataReader) - Method in class com.northconcepts.datapipeline.core.SequenceReader
-
Takes a reader out of the sequence; must be called before
SequenceReader.open(). - remove(DataWriter) - Method in class com.northconcepts.datapipeline.core.MultiWriter
- remove(FieldList) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Removes all the fields in the specified
fieldListfrom this list. - remove(Object) - Method in class com.northconcepts.datapipeline.jsonata.JsonObject
- remove(String) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- remove(String) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
-
Removes the named attribute; throws a
DataExceptionif there is none. - remove(String) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- remove(String) - Method in class com.northconcepts.datapipeline.security.CredentialsResolverRegistry
-
Unregisters and returns the resolver for the given id or returns
nullif there isn't one. - remove(String...) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Removes all the specified fields from this list.
- removeAll() - Method in class com.northconcepts.datapipeline.core.RecordComparator
-
Clears the field comparisons so records are compared on all their fields.
- removeAll() - Method in class com.northconcepts.datapipeline.filter.FilteringReader
- removeAll() - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- removeAll() - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- removeAllDataReader() - Method in class com.northconcepts.datapipeline.core.SequenceReader
-
Empties the sequence; must be called before
SequenceReader.open(). - removeAllDataSink() - Method in class com.northconcepts.datapipeline.core.MultiWriter
-
Removes all target writers; must be called before
MultiWriter.open(). - removeChild(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Removes the child and clears its parent; returns false if it was not a child of this node.
- removeChildNode(Node) - Method in class com.northconcepts.datapipeline.core.ArrayValue
- removeChildNode(Node) - Method in class com.northconcepts.datapipeline.core.Field
- removeChildNode(Node) - Method in class com.northconcepts.datapipeline.core.Node
-
Detaches the given child (matched by identity) from this node; called when the child is moved to another parent.
- removeChildNode(Node) - Method in class com.northconcepts.datapipeline.core.Record
- removeChildNode(Node) - Method in class com.northconcepts.datapipeline.core.SingleValue
- removeClosedSinks() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Drops closed readers from
DeMux.getSink(); the round-robin strategy calls it when it reaches a closed reader. - removeClosedTargets() - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
-
Drops closed readers from
SplitWriter.getTargets(); the round-robin strategy calls it when it reaches a closed reader. - REMOVED - Enum constant in enum class com.northconcepts.datapipeline.foundations.difference.DiffType
- RemoveDuplicateFields - Class in com.northconcepts.datapipeline.transform
-
Removes or collapses multiple fields with the same name in each record.
- RemoveDuplicateFields(RemoveDuplicateFields.IDuplicateFieldsPolicy, String...) - Constructor for class com.northconcepts.datapipeline.transform.RemoveDuplicateFields
-
Creates a transformer that applies the policy to fields sharing one of the given names, or any name if none are given.
- RemoveDuplicateFields(RemoveDuplicateFields.IDuplicateFieldsPolicy, Set<String>) - Constructor for class com.northconcepts.datapipeline.transform.RemoveDuplicateFields
-
Creates a transformer that applies the policy to fields sharing one of the given names, or any name if the set is null or empty.
- RemoveDuplicateFields.DuplicateFieldsPolicy - Enum Class in com.northconcepts.datapipeline.transform
-
Built-in policies that keep all duplicates, keep only the first or last, merge their values into an array in the first field, or rename the later ones with a numeric suffix.
- RemoveDuplicateFields.IDuplicateFieldsPolicy - Interface in com.northconcepts.datapipeline.transform
-
Strategy for resolving fields that share a name in a record, used by
RemoveDuplicateFields. - RemoveDuplicateFields.RenamePolicy - Class in com.northconcepts.datapipeline.transform
-
An alternative to
RemoveDuplicateFields.DuplicateFieldsPolicy.RENAMEthat uses a configurable separator between the original field name and the numeric suffix, preventing ambiguous names like20101when the field name itself ends in digits (e.g. - RemoveDuplicatesAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A
PipelineActionthat drops records whose values in the selected fields (all fields if none are selected) match an earlier record. - RemoveDuplicatesAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- RemoveDuplicatesReader - Class in com.northconcepts.datapipeline.core
-
A proxy that removes duplicate records.
- RemoveDuplicatesReader(DataReader) - Constructor for class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Remove duplicate records matching all fields.
- RemoveDuplicatesReader(DataReader, FieldList) - Constructor for class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Removes duplicate records based on the matching
FieldList. - RemoveDuplicatesReader(DataReader, String...) - Constructor for class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Remove duplicate records based on their field names.
- removeEventBusLifecycleListener(EventBusLifecycleListener) - Static method in class com.northconcepts.datapipeline.eventbus.EventBus
- removeExceptionListener(ExceptionListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
- removeField(int) - Method in class com.northconcepts.datapipeline.core.Record
-
Removes and returns the field at the specified index.
- removeField(Field) - Method in class com.northconcepts.datapipeline.core.Record
-
Removes this exact field instance (compared by identity); returns false if it is not in this record.
- removeField(FieldList) - Method in class com.northconcepts.datapipeline.core.Record
-
Removes a sub-field matching the specified path.
- removeField(FieldPath) - Method in class com.northconcepts.datapipeline.core.Record
-
Deletes the field at the specified path or throws an exception if it doesn't exist.
- removeField(String) - Method in class com.northconcepts.datapipeline.core.Record
-
Removes and returns the field with the specified name.
- removeFields(Collection<FieldPath>) - Method in class com.northconcepts.datapipeline.core.Record
-
Removes all fields matching the given collection of
FieldPathexpressions. - RemoveFields - Class in com.northconcepts.datapipeline.transform
-
See
FieldPathfor supported field name expressions. - RemoveFields(String...) - Constructor for class com.northconcepts.datapipeline.transform.RemoveFields
-
Creates a transformer that removes the given fields from each record, ignoring any that are missing.
- RemoveFields(Collection<String>) - Constructor for class com.northconcepts.datapipeline.transform.RemoveFields
-
Creates a transformer that removes the given fields from each record, ignoring any that are missing.
- removeFromParent() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- removeIndexInPropertyFromSchema(Record, String, String) - Static method in class com.northconcepts.datapipeline.foundations.internal.SchemaUtil
- removeJobLifecycleListener(JobLifecycleListener) - Static method in class com.northconcepts.datapipeline.job.Job
- removeListener(UntypedEventListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Deprecated.
- removeListener(Class<T>, T) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
- removeListener(Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Unsubscribes the listener from every listener interface it was added for; untyped listeners are not affected.
- removeListenersByTopic(Class<T>, Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Unsubscribes the given interface's listeners that were added with a topic equal to this one.
- removePropertyFromEntity(Record, String, String) - Static method in class com.northconcepts.datapipeline.foundations.internal.SchemaUtil
- removePropertyFromFields(Record, String, String) - Static method in class com.northconcepts.datapipeline.foundations.internal.SchemaUtil
- removePropertyFromIndex(Record, String) - Static method in class com.northconcepts.datapipeline.foundations.internal.SchemaUtil
- removeSchemaFields(List<ColumnPath>, MessageType) - Static method in class com.northconcepts.datapipeline.parquet.ParquetUtil
-
Returns the schema as text with the declarations of the given columns removed.
- removeSessionProperties() - Method in class com.northconcepts.datapipeline.core.Node
-
Removes all session properties from this session.
- removeSessionProperties() - Method in interface com.northconcepts.datapipeline.core.Session
-
Removes all session properties from this session.
- removeSessionProperties() - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- removeShutdownListener(ShutdownListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
- removeTypedListenerReference(Reference<?>) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Removes the typed listener held by the given reference once the garbage collector has cleared it.
- removeUntypedEventListener(UntypedEventListener) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
- removeUntypedEventListenerReference(Reference<?>) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Removes the untyped listener held by the given reference once the garbage collector has cleared it.
- removeUntypedEventListenersByTopic(Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Unsubscribes the untyped listeners that were added with a topic equal to this one.
- removeUntypedListenerReference(Reference<?>) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Deprecated.
- removeValue(int) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Removes and returns the underlying value of the element at the specified index.
- removeValue(Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Removes all elements whose underlying value equals the specified value.
- removeValues(long) - Method in class com.northconcepts.datapipeline.xml.XmlField
-
Removes the most recently recorded values whose node sequence number is at least
sequence. - RENAME - Enum constant in enum class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.DuplicateFieldsPolicy
- RENAME_UNDERSCORE - Enum constant in enum class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.DuplicateFieldsPolicy
- RenameField - Class in com.northconcepts.datapipeline.transform
-
See
FieldPathfor supported field name expressions. - RenameField(FieldPath, String) - Constructor for class com.northconcepts.datapipeline.transform.RenameField
-
Creates a new transformer to rename fields in a dataset using a
FieldPathas the source and a new name as the target. - RenameField(String, String) - Constructor for class com.northconcepts.datapipeline.transform.RenameField
-
Creates a new transformer to rename fields in a dataset using an expression as the source and a new name as the target.
- RenameFieldsAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A
PipelineActionthat renames fields; mappings with a blank target or the same name as the source are ignored. - RenameFieldsAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- RenameFieldsAction.FieldMapping - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A rename of one source field to a target name.
- RenamePolicy(String) - Constructor for class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.RenamePolicy
-
Creates a policy that renames each later duplicate to its name, the separator and the first unused number from 1; null means no separator.
- replace(int, int, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces the characters from the 0-based
start(inclusive) toend(exclusive, capped at the value's length) withstring. - replace(String, Object, Object, Integer) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- replaceAll(CharSequence, CharSequence) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces every match of the regular expression
regexwithreplacement($nrefers to a captured group). - replaceChar(char, char) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces every occurrence of
oldCharwithnewChar. - replaceFirst(CharSequence, CharSequence) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces the first match of the regular expression
regexwithreplacement($nrefers to a captured group). - replaceString(CharSequence, CharSequence) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Replaces every literal (non-regex) occurrence of
oldStringwithnewString. - REPLICATE - Static variable in class com.northconcepts.datapipeline.core.MultiWriter
- REPLICATE_CLONE - Static variable in class com.northconcepts.datapipeline.core.MultiWriter
- ReplicateCloneWriteStrategy() - Constructor for class com.northconcepts.datapipeline.core.MultiWriter.ReplicateCloneWriteStrategy
- ReplicateWriteStrategy() - Constructor for class com.northconcepts.datapipeline.core.MultiWriter.ReplicateWriteStrategy
- REQUEST_MIGHT_BE_AUTOMATED - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- require(String) - Method in class com.northconcepts.datapipeline.security.Credentials
-
Returns the value for the given key or throws a
DataExceptionif it's absent. - require(String) - Method in class com.northconcepts.datapipeline.security.CredentialsResolverRegistry
-
Returns the resolver registered under the given id or throws a
DataExceptionif there isn't one. - reset() - Method in class com.northconcepts.datapipeline.group.AggregateReader.AggregateOperation
-
Deprecated.Clears this operation's result; called when the reader is opened or reset.
- reset() - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Clears the accumulated result of every operation; called by
AggregateReader.open(). - reset() - Method in class com.northconcepts.datapipeline.meter.Meter
-
restarts the timer and count.
- reset() - Method in class com.northconcepts.datapipeline.meter.MeteredInputStream
- reset(boolean) - Static method in class com.northconcepts.datapipeline.core.Functions
-
Re-add all the built-in function aliases, optionally clearing the registry first.
- resetColumn() - Method in class com.northconcepts.datapipeline.core.Parser
- resetID() - Static method in class com.northconcepts.datapipeline.core.DataObject
-
Restarts the ID sequence shared by all instances, so the next one created gets ID 1.
- resetInternalId() - Static method in class com.northconcepts.datapipeline.foundations.core.FoundationObject
-
Restarts the internal ID sequence shared by all instances so the next one created gets ID 1.
- resetRecordCount() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
-
Restarts this endpoint's record-count at 0.
- resolveCredentials() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem.CredentialsResolverBridge
- resolveCredentials() - Method in class com.northconcepts.datapipeline.internal.lang.FileSystem
-
Resolves and snapshots credentials for this connection cycle.
- RESTOCK_LINE_ITEMS - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- RESTRICT - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
- RESTRICT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.ForeignKeyAction
- RESTRICT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.ForeignKeyAction
- RESTRICT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.ForeignKeyAction
- resume() - Method in class com.northconcepts.datapipeline.job.AbstractJob
- resume() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Lets a paused job continue; does nothing if it is not paused.
- resume() - Method in class com.northconcepts.datapipeline.job.Job
- RETAIN_ALL - Enum constant in enum class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.DuplicateFieldsPolicy
- RETAIN_FIRST - Enum constant in enum class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.DuplicateFieldsPolicy
- RETAIN_LAST - Enum constant in enum class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.DuplicateFieldsPolicy
- retainFileSize(AmazonS3FileSystem, String, String, Long) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Retains
sizeonly if this file still points at the object it was looked up for. - rethrowAsyncException() - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Rethrows the exception thrown by the internal thread or returns silently if no exception was thrown.
- rethrowAsyncException() - Method in class com.northconcepts.datapipeline.core.AsyncWriter
-
Rethrows the exception thrown by the internal thread or returns silently if no exception was thrown.
- rethrowAsyncException() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Re-throws an exception thrown by one of the internal AsyncWriters or returns silently if no exceptions were thrown.
- rethrowAsyncException() - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Re-throws an exception thrown by one of the internal AsyncWriters or returns silently if no exceptions were thrown.
- RetryContext - Class in com.northconcepts.datapipeline.retry
-
Describes a failed attempt of a
RetryingOperation; passed to its retry predicate to decide whether to retry. - RetryContext() - Constructor for class com.northconcepts.datapipeline.retry.RetryContext
- RetryingOperation<T> - Class in com.northconcepts.datapipeline.retry
-
A proxy that attempts to re-run on failure.
- RetryingOperation() - Constructor for class com.northconcepts.datapipeline.retry.RetryingOperation
- RetryingReader - Class in com.northconcepts.datapipeline.retry
-
A proxy that attempts to continue reading on failure.
- RetryingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.retry.RetryingReader
- RetryingWriter - Class in com.northconcepts.datapipeline.retry
-
A proxy that attempts to continue writing on failure.
- RetryingWriter(DataWriter) - Constructor for class com.northconcepts.datapipeline.retry.RetryingWriter
- RetryStrategy - Enum Class in com.northconcepts.datapipeline.retry
-
Standard
IRetryStrategybackoff policies; every policy waits the initial delay before the first retry. - returnType - Variable in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- reverse(List) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Reverses the order of items in an array
- rhsObject - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- right(int) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Keeps the last
lengthcharacters of each value; shorter values are unchanged. - RIGHT - Enum constant in enum class com.northconcepts.datapipeline.fixedwidth.FixedWidthAlign
- rightJoin(String, String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- RightJoin - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Generates a right join clause.
- RightJoin(String, String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.RightJoin
- rightPad(String, int, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- romanToDecimal(String) - Static method in class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
- ROSE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- round(Rounder) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Rounds numeric values with the given
Rounder, producing doubles. - round(Number, Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Round to half even
- ROUND_ROBIN - Enum constant in enum class com.northconcepts.datapipeline.multiplex.DeMux.Strategy
- ROUND_ROBIN - Enum constant in enum class com.northconcepts.datapipeline.multiplex.SplitWriter.Strategy
-
Sends each record to a single downstream reader by cycling through the downstream readers one-at-a-time.
- Rounder - Class in com.northconcepts.datapipeline.transform.format
-
Rounds numbers to a number of decimal places using a
Rounder.RoundingPolicy. - Rounder(Rounder.RoundingPolicy, int) - Constructor for class com.northconcepts.datapipeline.transform.format.Rounder
-
Creates a rounder; a negative
decimalPlacesrounds to the left of the decimal point (for example, -2 rounds to hundreds). - Rounder.RoundingPolicy - Enum Class in com.northconcepts.datapipeline.transform.format
-
Rounding modes supported by
Rounder. - RoundRobinWriteStrategy() - Constructor for class com.northconcepts.datapipeline.core.MultiWriter.RoundRobinWriteStrategy
- ROYAL_BLUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- RtfWriter - Class in com.northconcepts.datapipeline.rtf
-
Writes records to an RTF document stream using Apache POI.
- RtfWriter(File) - Constructor for class com.northconcepts.datapipeline.rtf.RtfWriter
- RtfWriter(OutputStream) - Constructor for class com.northconcepts.datapipeline.rtf.RtfWriter
- rule - Variable in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
- run() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader.ReaderThread
- run() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Runs this pipeline in the current thread and returns the finished job.
- run() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Executes this job in the current thread.
- run() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Executes this job in the current thread.
- run() - Method in class com.northconcepts.datapipeline.job.Job
-
Executes this job in the current thread.
- run() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Runs the feeder process in the current thread.
- run(boolean) - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Runs the feeder process in the current thread (false) or in a new thread (true).
- run(DataReader, DataWriter) - Static method in class com.northconcepts.datapipeline.job.Job
-
Transfers all records from the reader to the writer in a new job on the current thread and returns the finished job; a failure is thrown as a
DataException. - run(DataReader, DataWriter, JobCallback<DataReader, DataWriter>) - Static method in class com.northconcepts.datapipeline.job.Job
-
Runs a new transfer job on the current thread, reporting progress and the outcome to the callback; a failure is only thrown if the callback's
onFailurerethrows it. - run(Runnable) - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Runs the runnable with the same retry behaviour as
RetryingOperation.call(Callable). - runAsync() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Starts this pipeline in a new thread and returns its job without waiting for it to finish.
- runAsync() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Executes this job in a new thread.
- runAsync() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Executes this job in a new thread.
- runAsync() - Method in class com.northconcepts.datapipeline.job.Job
-
Executes this job in a new thread.
- runAsync() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Runs the feeder process in a new thread.
- runAsync(DataReader, DataWriter) - Static method in class com.northconcepts.datapipeline.job.Job
-
Starts a job on a new thread that transfers all records from the reader to the writer; returns the job immediately.
- runAsync(DataReader, DataWriter, JobCallback<DataReader, DataWriter>) - Static method in class com.northconcepts.datapipeline.job.Job
-
Starts a transfer job on a new thread that reports its progress and outcome to the callback; returns the job immediately.
- runImpl() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Performs this job's work on the run thread; call
AbstractJob.handlePause()andAbstractJob.handleCancel()regularly so pause and cancel requests take effect. - runImpl() - Method in class com.northconcepts.datapipeline.job.RunnableJobAdapter
- RunnableJobAdapter - Class in com.northconcepts.datapipeline.job
-
Runs a
Runnableas anAbstractJob; pausing has no effect and cancelling only interrupts its thread. - RunnableJobAdapter(Runnable) - Constructor for class com.northconcepts.datapipeline.job.RunnableJobAdapter
S
- S3Bucket - Class in com.northconcepts.datapipeline.amazons3
-
A backend-neutral description of an S3 bucket, returned by
AmazonS3FileSystem.listBuckets(). - S3Bucket(String, Date) - Constructor for class com.northconcepts.datapipeline.amazons3.S3Bucket
- S3ObjectListing - Class in com.northconcepts.datapipeline.amazons3
-
A backend-neutral, single page of an S3 object listing, returned by
AmazonS3FileSystem.listRootFolder(String),AmazonS3FileSystem.listFolder(String, String)andAmazonS3FileSystem.nextBatch(S3ObjectListing). - S3ObjectListing(String, String, List<S3ObjectSummary>, List<String>, boolean, String) - Constructor for class com.northconcepts.datapipeline.amazons3.S3ObjectListing
- S3ObjectSummary - Class in com.northconcepts.datapipeline.amazons3
-
A backend-neutral summary of a single object returned when listing an S3 bucket or folder.
- S3ObjectSummary(String, long, Date, String) - Constructor for class com.northconcepts.datapipeline.amazons3.S3ObjectSummary
- SALE_FAILURE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- SALE_PENDING - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- SALE_SUCCESS - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- save(File) - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
-
Writes the workbook to the given file; call it after the
ExcelWriters close since they do not save it. - save(OutputStream) - Method in class com.northconcepts.datapipeline.excel.ExcelDocument
-
Writes the workbook to the given stream; call it after the
ExcelWriters close since they do not save it. - saveAncestorAttributeFieldValues(XmlNode) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Sets the attribute fields (paths ending in an attribute step) matching the record-break node or an ancestor.
- saveAncestorNodeFieldValues(XmlNode) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Fills the still-empty element fields from ancestors of the record-break node that match their location paths.
- saveFieldValues(XmlNode) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Sets the fields whose location paths match the node and clears cascading fields whose reset path matches it.
- saveWorkbook(File) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- saveWorkbook(File) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- saveWorkbook(File) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- saveWorkbook(OutputStream) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- saveWorkbook(OutputStream) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- saveWorkbook(OutputStream) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- scaleTooLarge(String, int, int, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- scheduled(Scheduler) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers on a set clock schedule.
- scheduled(Scheduler) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes windows on a set clock schedule.
- scheduled(String, Scheduler) - Static method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Closes buffers on a set clock schedule for the specified datetime field.
- scheduled(String, Scheduler) - Static method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Closes windows on a set clock schedule for the specified datetime field.
- Scheduler - Interface in com.northconcepts.datapipeline.schedule
-
Determines the next scheduled event time from a given point in time.
- SchedulerSequenceStrategy(Scheduler) - Constructor for class com.northconcepts.datapipeline.core.SequenceWriter.SchedulerSequenceStrategy
- SCHEMA - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
- SchemaDef - Class in com.northconcepts.datapipeline.foundations.schema
-
The metadata model containing a set of related entities.
- SchemaDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- SchemaDef(String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- SchemaDefDiff - Class in com.northconcepts.datapipeline.foundations.schema.diff
-
The differences between two versions of a
SchemaDef, with child diffs for its properties, entities and relationships. - SchemaDefDiff() - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.SchemaDefDiff
- SchemaDefDiff(DiffType, String, SchemaDef, SchemaDef) - Constructor for class com.northconcepts.datapipeline.foundations.schema.diff.SchemaDefDiff
- SchemaFilter - Class in com.northconcepts.datapipeline.foundations.schema
-
A filter that matches a record against an entity definition.
- SchemaFilter(EntityDef) - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaFilter
- SchemaMessages - Class in com.northconcepts.datapipeline.foundations.i18n
-
Formats the error messages for invalid schema definitions and for values and records that fail schema validation or mapping.
- SchemaMessages() - Constructor for class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- schemaMismatch(String, String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- SchemaObject - Class in com.northconcepts.datapipeline.foundations.schema
-
Base class for the schema model (
SchemaParts,SchemaProblems and validation results), adding Java code generation toFoundationObject. - SchemaObject() - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaObject
- SchemaPart - Class in com.northconcepts.datapipeline.foundations.schema
-
Base class for the elements of a schema definition -- the
SchemaDefitself and its entities, relationships, fields, indexes and index fields. - SchemaPart() - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaPart
- SchemaPartType - Enum Class in com.northconcepts.datapipeline.foundations.schema
-
The kinds of
SchemaPart: schema, entity, entity relationship, field, index and index field. - SchemaProblem - Class in com.northconcepts.datapipeline.foundations.schema
-
Describes an issue found when checking a schema definition and the
SchemaPartit was found in. - SchemaProblem() - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaProblem
- SchemaProblem(SchemaPart, String, Object...) - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaProblem
-
Creates a problem for the given part; when arguments are passed,
detailsis aString.format(String, Object...)pattern. - SchemaProblem.Severity - Enum Class in com.northconcepts.datapipeline.foundations.schema
-
Severity levels for schema problems; currently unused.
- SchemaProblemsSupplier - Interface in com.northconcepts.datapipeline.foundations.schema
-
Implemented by schema elements that can check themselves, and optionally their children, for
SchemaProblems. - SchemaTransformer - Class in com.northconcepts.datapipeline.foundations.schema
-
Converts and validates records using the specified entity schema.
- SchemaTransformer(EntityDef) - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaTransformer
- SchemaUtil - Class in com.northconcepts.datapipeline.foundations.internal
- SchemaUtil() - Constructor for class com.northconcepts.datapipeline.foundations.internal.SchemaUtil
- SchemaValidationPath - Class in com.northconcepts.datapipeline.foundations.schema
-
Keeps a per-thread stack of the names being validated, used to build qualified field names such as
order.items.[0]for validation messages. - SchemaValidator - Class in com.northconcepts.datapipeline.foundations.schema
-
Static checks used by the schema definitions to add a
SchemaProblemto a list for each issue found. - SchemaValidator() - Constructor for class com.northconcepts.datapipeline.foundations.schema.SchemaValidator
- SEA_GREEN - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- search() - Method in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
-
Requests the next page of results (see
AbstractTwitterReader.getNextToken()); returning null ends reading. - search() - Method in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
- search() - Method in class com.northconcepts.datapipeline.twitter2.TwitterFollowerReader
- search() - Method in class com.northconcepts.datapipeline.twitter2.TwitterFollowingReader
- search() - Method in class com.northconcepts.datapipeline.twitter2.TwitterSearchReader
- search() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
- searchImpl() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineMentionsReader
- searchImpl() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Requests the next page of the user's timeline using this reader's criteria; returning null ends reading.
- searchImpl() - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineTweetsReader
- searchIssue(JiraSearch) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
-
Runs the search and returns one page of results; pass its
nextPageTokentoJiraSearch.setNextPageToken(String)for the next page. - searchIssuesById(String...) - Method in class com.northconcepts.datapipeline.jira.JiraSearch
-
Restricts the JQL to the given issue IDs by prepending
issuekey in (...), joined to any existing JQL with AND; null leaves the JQL unchanged. - searchUser(String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Returns the unique identifier of the provided Twitter handle.
- SECOND - Static variable in class com.northconcepts.datapipeline.schedule.HourlyScheduler
- secondsToDate() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of seconds since the epoch to dates (midnight in the default time zone); other values are left unchanged.
- secondsToDateTime() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts numbers of seconds since the epoch to date-times; other values are left unchanged.
- SECRET_KEY - Static variable in class com.northconcepts.datapipeline.security.Credentials
- seek(long) - Method in class com.northconcepts.datapipeline.parquet.RandomAccessSeekableInputStream
- seekingParent - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- select(String...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Adds columns or expressions to the SELECT list;
*is selected if none are added. - Select - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Builds a SELECT statement with its parameter values; as a
QuerySourceit can also be nested in another query. - Select(QuerySource...) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Creates a query over the given sources, such as tables, nested queries or
Unions; at least one is required. - Select(String...) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Creates a query over the given tables; null entries are skipped, but at least one table is required.
- Select(List<String>) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Creates a query over the given tables; null entries are skipped, but at least one table is required.
- SELECT - Enum constant in enum class com.northconcepts.datapipeline.jdbc.sql.merge.MergeUsing
- SelectArrangeFieldsAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A
PipelineActionthat keeps only the selected fields, in the order they were added, like an SQLSELECT. - SelectArrangeFieldsAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- selectFields(FieldList) - Method in class com.northconcepts.datapipeline.core.Record
-
Retains only the fields specified in the given list, removing all others and reordering to match the list's order.
- selectFields(FieldList, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Retains only the fields specified in the given list, removing all others.
- SelectFields - Class in com.northconcepts.datapipeline.transform
-
Select and arrange fields according to the supplied field names -- like an SQL SELECT statement.
- SelectFields(String...) - Constructor for class com.northconcepts.datapipeline.transform.SelectFields
- SelectFields(Collection<String>) - Constructor for class com.northconcepts.datapipeline.transform.SelectFields
- SENT_MAIL - Static variable in interface com.northconcepts.datapipeline.email.GmailFolders
- sequence - Variable in class com.northconcepts.datapipeline.jsonata.Utils.JList
- SEQUENCE - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.PrimaryKeyType
- SequenceReader - Class in com.northconcepts.datapipeline.core
-
Combines one or more DataReaders into a single stream by reading from each until empty then moving to the next.
- SequenceReader(DataReader...) - Constructor for class com.northconcepts.datapipeline.core.SequenceReader
-
Creates a reader over the given readers in order; each is opened only when reached and closed once exhausted.
- SequenceWriter - Class in com.northconcepts.datapipeline.core
-
Writes to sequence of data writers created by a factory in turn and rolled based on a ISequenceStrategy policy.
- SequenceWriter(SequenceWriter.ISequenceStrategy, SequenceWriter.DataWriterFactory) - Constructor for class com.northconcepts.datapipeline.core.SequenceWriter
- SequenceWriter.DataWriterFactory - Interface in com.northconcepts.datapipeline.core
-
Creates the nested writer for each new sequence of a
SequenceWriter. - SequenceWriter.ElapsedTimeSequenceStrategy - Class in com.northconcepts.datapipeline.core
-
Ends a sequence once it has been running for a given time; checked only when the next record arrives.
- SequenceWriter.ISequenceStrategy - Interface in com.northconcepts.datapipeline.core
-
Decides when a
SequenceWriterends the current sequence and starts a new one. - SequenceWriter.OrSequenceStrategy - Class in com.northconcepts.datapipeline.core
-
Ends the current sequence when any of the given strategies does.
- SequenceWriter.RecordCountSequenceStrategy - Class in com.northconcepts.datapipeline.core
-
Ends each sequence once it has received the given number of records.
- SequenceWriter.SchedulerSequenceStrategy - Class in com.northconcepts.datapipeline.core
-
Ends the current sequence at each time produced by a
Scheduler; checked only when the next record arrives. - SequenceWriter.Sequence - Class in com.northconcepts.datapipeline.core
-
One segment of a
SequenceWriter's output, with its 0-based index, start time and record counts. - SERIAL - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- SERIAL2 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- SERIAL4 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- SERIAL8 - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- serialize(Record, JsonGenerator, SerializerProvider) - Method in class com.northconcepts.datapipeline.json.RecordJsonSerializer
- serialize(String, Record) - Method in class com.northconcepts.datapipeline.kafka.RecordSerializer
- SERIALIZED_CLASS_NAME - Static variable in interface com.northconcepts.datapipeline.core.RecordSerializable
- serializer - Variable in class com.northconcepts.datapipeline.security.EncryptingReader
- service - Variable in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
- session - Variable in class com.northconcepts.datapipeline.core.Node
- Session - Interface in com.northconcepts.datapipeline.core
-
Session is the base type for objects that can contain temporary, non-persistent data in DataPipeline.
- SESSION_TOKEN - Static variable in class com.northconcepts.datapipeline.security.Credentials
- Session.SessionImpl - Class in com.northconcepts.datapipeline.core
-
Stores session properties in a lazily created map, keyed by property name, class name, or both.
- SessionImpl() - Constructor for class com.northconcepts.datapipeline.core.Session.SessionImpl
- set(int, Record) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- set(int, Record) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Replaces the record at the specified position in this list with a new record.
- set(int, Object) - Method in class com.northconcepts.datapipeline.core.CompositeValue
- set(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.conflict.OnConflict
-
Adds a
column=?assignment with a null parameter value. - set(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.update.Update
-
Adds a
column=?assignment with a null parameter value. - set(String, boolean) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Maps a
booleanvalue to the specified key, overwriting any previous association. - set(String, char) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Maps a character value to the specified key, overwriting any previous association.
- set(String, char[]) - Method in class com.northconcepts.datapipeline.security.Credentials.Builder
-
Sets a copy of the value for the given key or removes the key when the value is
null; the caller may wipe its own array afterwards. - set(String, double) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Maps a
doublevalue to the specified key, overwriting any previous association. - set(String, int) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Maps an
intvalue to the specified key, overwriting any previous association. - set(String, long) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Maps a
longvalue to the specified key, overwriting any previous association. - set(String, Class<?>) - Method in class com.northconcepts.datapipeline.core.FieldDeclarations
- set(String, Object) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Maps a value to the specified key, overwriting any previous association.
- set(String, Object) - Method in class com.northconcepts.datapipeline.jdbc.sql.conflict.OnConflict
-
Adds a
column=?assignment with the given parameter value. - set(String, Object) - Method in class com.northconcepts.datapipeline.jdbc.sql.update.Update
-
Adds a
column=?assignment with the given parameter value. - set(String, String) - Method in class com.northconcepts.datapipeline.security.Credentials.Builder
-
Sets the value for the given key or removes the key when the value is
null. - set(String, Collection<?>) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Maps a collection to the specified key, overwriting any previous association.
- set(String, Map<?, ?>) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Maps a java.util.Map to the specified key, overwriting any previous association.
- SET_CACHED_VALUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelReader.FailedExpressionStrategy
-
Use the last value cached in the Excel spreadsheet when cell formula/expression evaluation fails if available.
- SET_DEFAULT - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
- SET_DEFAULT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.ForeignKeyAction
- SET_DEFAULT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.ForeignKeyAction
- SET_DEFAULT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.ForeignKeyAction
- SET_EXCEPTION_MESSAGE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelReader.FailedExpressionStrategy
-
Use the failure's exception message as the field's value when a cell formula evaluation fails.
- SET_EXPRESSION - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelReader.FailedExpressionStrategy
-
Use the formula/expression as the field's value when a cell formula evaluation fails.
- SET_NULL - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelReader.FailedExpressionStrategy
-
Use
nullas the field's value when a cell formula evaluation fails. - SET_NULL - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
- SET_NULL - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.ForeignKeyAction
- SET_NULL - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.ForeignKeyAction
- SET_NULL - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.ForeignKeyAction
- setAbsolutePaths(boolean) - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
-
Indicates if the path and parent fields keep the root directory's path as given instead of being relative to it (default is false).
- setAcknowledgeMode(JmsAcknowledgeMode) - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Indicates how received messages should be acknowledged (default to
JmsAcknowledgeMode.AUTO). - setAction(int, PipelineAction) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
-
Replaces the nested action at the given 0-based index and attaches it to this action's pipeline.
- setAction(int, PipelineAction) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
-
Replaces the action at the given 0-based index.
- setActions(List<PipelineAction>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
-
Replaces the nested actions with the given list and attaches each of them to this action's pipeline.
- setActions(List<PipelineAction>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
-
Replaces all the actions with the given list and clears the redo history.
- setAdditionalProperty(String, Object) - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
-
Sets a JSON property that is not mapped to a dedicated field.
- setAdditionalProperty(String, Object) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
-
Sets a JSON property that is not mapped to a dedicated field.
- setAdditionalProperty(String, Object) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
-
Sets a JSON property that is not mapped to a dedicated field.
- setAdditionalProperty(String, Object) - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
-
Sets a JSON property that is not mapped to a dedicated field.
- setAdditionalProperty(String, Object) - Method in class com.northconcepts.datapipeline.mailchimp.list.Tag
-
Sets a JSON property that is not mapped to a dedicated field.
- setAddMissingOptionalFields(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Indicates if mapping adds missing fields that have no default value to the record as nulls or empty arrays (defaults to false).
- setAddress1(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setAddress2(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setAddTextToParent(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if each child element's text is also added to its parent's text (defaults to false); this uses more memory.
- setAddTextToParent(boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
- setAddTextToParent(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Indicates if each child node's text should be concatenated to its parent during parsing (defaults to false).
- setAddTextToParent(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if each child node's text should be concatenated to its parent during parsing (defaults to false).
- setAddUserToRecord(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
-
Indicates if the followed user's details are added to each written record (default is false).
- setAddUserToRecord(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
-
Indicates if the unfollowed user's details are added to each written record (default is false).
- setAlign(FixedWidthAlign) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
-
Sets the side this column's value is aligned to (defaults to LEFT); the fill character goes on the other side.
- setAlive() - Method in class com.northconcepts.datapipeline.core.Record
-
Resets this record's state to
Record.State.ALIVE. - setAll(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
-
Indicates if the queries are combined with
UNION ALLinstead ofUNION(default is false). - setAllowBlank(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
Indicates if empty strings are allowed as values for this field (defaults to true).
- setAllowDuplicateFieldNames(boolean) - Method in class com.northconcepts.datapipeline.transform.RenameField
-
Indicates if a field may be renamed to the name of another field in its record instead of throwing (default is false).
- setAllowedValues(ValueMatch<?>) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setAllowedValues(ValueMatch<?>) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setAllowedValues(ValueMatch<?>) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the optional set of values this field allows; they are enforced only when
FieldDef.isLimitToAllowedValues()is true. - setAllowedValues(ValueMatch<?>) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setAllowedValues(ValueMatch<?>) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setAllowedValues(ValueMatch<?>) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setAllowedValues(ValueMatch<?>) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setAllowedValues(ValueMatch<?>) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setAllowExtraFieldsInMapping(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Indicates if records may contain fields not defined in this entity without failing mapping (defaults to true).
- setAllowExtraFieldsInValidation(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Indicates if records may contain fields not defined in this entity without failing validation (defaults to true).
- setAllowMultiLineText(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Indicates if line separators are allowed inside quoted fields.
- setAllowMultiLineText(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if line separators are allowed inside quoted fields (defaults to false).
- setAllowNoConditions(boolean) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Indicates if the rule may have no conditions, in which case it always fires; otherwise validation fails (default false).
- setAllowNoOutcomes(boolean) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
-
Indicates if the rule may have no outcomes; otherwise validation fails (default false).
- setAllowNoResults(boolean) - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Indicates if no exception should be thrown if no results are found (default false, exceptions are thrown).
- setAllowQuoteInField(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Indicates if unescaped quotes are allowed in fields (default to false).
- setAllowQuoteInField(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if unescaped quotes are allowed in fields (defaults to false).
- setAlwaysIncludeEmail(boolean) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Indicates the
alwaysIncludeEmailvalue of the events request (default is true). - setAlwaysShowFooter(boolean) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Indicates if the footer should be written, even if no records were written (defaults to true).
- setAlwaysShowHeader(boolean) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Indicates if the header should be written, even if no records are written (defaults to true).
- setAmazonS3FileSystem(AmazonS3FileSystem) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- setAmazonS3FileSystem(AmazonS3FileSystem) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- setAmazonS3FileSystem(AmazonS3FileSystem) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- setApiLimitPolicy(IApiLimitPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- setApiLimitPolicy(IApiLimitPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Sets the action taken when the API call limit is reached (defaults to
ApiLimitPolicy.FAIL). - setApiLimitPolicy(IApiLimitPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Sets the action taken when the API call limit is reached (defaults to
ApiLimitPolicy.FAIL). - setApiLimitPolicy(IApiLimitPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
- setApiLimitPolicy(IApiLimitPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterWriter
- setAppend(boolean) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
-
Indicates if the output stream appends to an existing file instead of replacing it (default false).
- setApplicationName(String) - Method in class com.northconcepts.datapipeline.google.GoogleApiReader
-
Sets the application name passed to the Google API client (defaults to
"DataPipeline Analytics Reporting"). - setApplicationName(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Null restores the default; takes effect on the next
GoogleSheetDocument.open(String)orGoogleSheetDocument.createSpreadsheet(String). - setArray(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setArray(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setArray(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Forces this field to be an array by setting the
FieldDef.getMinimumElements()to zero (0) if bothFieldDef.getMinimumElements()andFieldDef.getMaximumElements()are null, otherwise, does nothing. - setArray(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setArray(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setArray(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setArray(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setArray(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setArray(ArrayValue) - Method in class com.northconcepts.datapipeline.template.ArrayTemplateModel
- setAscending(boolean) - Method in class com.northconcepts.datapipeline.core.FieldComparator
-
Indicates if fields are compared in ascending order (default is true).
- setAscending(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
-
Indicates if the column is sorted ascending; false for descending or when the database reports no sort order.
- setAscending(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Indicates if this field is sorted in ascending order in the index (defaults to true).
- setAscending(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
-
Indicates if the field sorts in ascending order; otherwise
DESCis added (default is false). - setAsymmetricAlgorithm(String) - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
-
Sets the algorithm used with the private key to decrypt the symmetric key, such as
RSA; required to open the reader. - setAsymmetricAlgorithm(String) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Sets the algorithm used with the public key to encrypt the symmetric key, such as
RSA; required to open the reader. - setAsymmetricKey(PrivateKey) - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
-
Sets the private key used to decrypt the symmetric key; required to open the reader.
- setAsymmetricKey(PublicKey) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Sets the public key used to encrypt the symmetric key; required to open the reader.
- setAttribute(Element, String, Object) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Sets the attribute to the value's text, formatting dates, times and byte arrays (as hex); null or empty values are skipped.
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Sets the user-defined key-value pairs attached to this entity (null is treated as empty).
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Sets the user-defined key-value pairs attached to this relationship (null is treated as empty).
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the user-defined key-value pairs attached to this field (null is treated as empty).
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Sets the user-defined key-value pairs attached to this schema (null is treated as empty).
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setAttributes(Attributes) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Sets whether to automatically close the database connection when this dataset is closed.
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Indicates if the database connection is closed when the reader is closed (defaults to false).
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Indicates if the database connection is closed when the writer is closed (defaults to false).
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Indicates if the database connection in this endpoint should be closed when the endpoint is closed.
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Indicates if the database connection in this endpoint should be closed when the endpoint is closed.
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Indicates if the database connection in this endpoint should be closed when the endpoint is closed.
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
-
Indicates if the MongoDB client should be closed when this reader closes (defaults to false).
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
-
Indicates if the MongoDB client should be closed when this writer closes (defaults to false).
- setAutoCloseConnection(boolean) - Method in class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
-
Indicates if the database connection in this lookup should be closed when the lookup is closed by the
LookupTransformervia aTransformingReaderorTransformingWriter. - setAutoCloseDocument(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Indicates if the ExcelDocument should be closed when this endpoint is closed.
- setAutoCloseDocument(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if the Excel document is closed when the reader is closed (defaults to false).
- setAutoCloseDocument(boolean) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
-
Indicates if the GoogleSheetDocument should be closed when this endpoint is closed.
- setAutoCloseDocument(boolean) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Indicates if the GoogleSheetDocument should be closed when this endpoint is closed.
- setAutoCloseDocument(boolean) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
-
Indicates if the PDF document is closed when the reader closes (default is false).
- setAutoCloseDocument(boolean) - Method in class com.northconcepts.datapipeline.pdf.PdfReader
-
Indicates if the PdfDocument should be closed when this endpoint is closed.
- setAutoCloseLogWriter(boolean) - Method in class com.northconcepts.datapipeline.job.AbstractJob
- setAutoCloseLogWriter(boolean) - Method in class com.northconcepts.datapipeline.job.Job
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.file.FileReader
-
Indicates if the underlying input stream should be closed when this stream closes (defaults to true).
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Indicates if the file's stream is closed when the reader is closed (defaults to true).
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Indicates if the file's stream is closed when the reader is closed (defaults to true).
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if the file's stream is closed when the reader is closed (defaults to true).
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
- setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.xml.SimpleXmlReader
-
Indicates if the
Readerpassed to the constructor is closed when this reader closes (default is true); a file opened by this reader is always closed. - setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Indicates if the
Readerpassed to the constructor is closed when this reader closes (default is true); a file opened by this reader is always closed. - setAutoCloseReader(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if the
Readerpassed to the constructor is closed when this reader closes (default is true); a file opened by this reader is always closed. - setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
-
Indicates if the underlying java.io.BufferedWriter should be closed when this stream closes (defaults to true).
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.core.TextWriter
-
Indicates if the underlying java.io.BufferedWriter should be closed when this stream closes (defaults to true).
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.file.FileReader
-
Deprecated.use
FileReader.setAutoCloseReader(boolean)instead. Indicates if the underlying input stream should be closed when this stream closes (defaults to true). - setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.file.FileWriter
-
Indicates if the underlying output stream should be closed when this stream closes (defaults to true).
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Indicates if the file's stream is closed when the writer is closed (defaults to true).
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Indicates if the file's stream is closed when the writer is closed (defaults to true).
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Indicates if the file's stream is closed when the writer is closed (defaults to true).
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if the file's stream is closed when the writer is closed (defaults to true).
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.json.JsonLinesWriter
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.json.JsonWriter
- setAutoCloseWriter(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlWriter
- setAutoFilter(int, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- setAutoFilter(int, int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- setAutoFilter(int, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- setAutoFilterColumns(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Indicates if a row containing a drop-down filter with values from each column should be added above the data rows.
- setAutoFilterColumns(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Indicates if drop-down filters are added to the first written row, usually the header (defaults to false).
- setAutofitColumns(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Indicates if the columns should be expanded to fit the widest value.
- setAutofitColumns(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Indicates if columns are widened to fit their widest value (defaults to false).
- setAutofitColumns(int, int[]) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- setAutofitColumns(int, int[]) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- setAutofitColumns(int, int[]) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- setAutoIncrement(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setAutoIncrement(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- setAutoIncrement(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets whether the column has auto-increment enabled.
- setAutoIncrement(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Indicates if
AUTO_INCREMENTis written; only applies to types whoseTableColumnType.isAutoIncrementSupported()is true. - setAutoMapping(boolean) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Indicates if incoming source fields should be mapped automatically without the need for explicit
FieldMappings (defaultfalse). - setBackgroundColor(ExcelColor) - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Sets the background color of the cell.
- setBackgroundColor(ExcelColorPalette) - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Sets the background color of the cell.
- setBasicAWSCredentials(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Authenticates this file's
AmazonS3FileSystemwith the given access key and secret key, replacing its credentials provider, unless aCredentialsResolveris set, which takes precedence. - setBasicAWSCredentials(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- setBasicAWSCredentials(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- setBasicAWSCredentials(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Authenticates with the given access key and secret key, replacing the configured credentials provider, unless a
CredentialsResolveris set, which takes precedence. - SetBatchSequenceNumberField - Class in com.northconcepts.datapipeline.transform
-
Adds a sequence (auto increment) field that is incremented with the step value when the value(s) in the specified watch fields differs from the previous record.
- SetBatchSequenceNumberField(String, double, double, boolean, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
-
Creates a transformer that numbers batches from
startin steps ofstep; whenoverwriteis false, records that already have the field keep their value. - SetBatchSequenceNumberField(String, double, double, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
-
Creates a transformer that numbers batches from
startin steps ofstep, overwriting any existing value. - SetBatchSequenceNumberField(String, long, long, boolean, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
-
Creates a transformer that numbers batches from
startin steps ofstep; whenoverwriteis false, records that already have the field keep their value. - SetBatchSequenceNumberField(String, long, long, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
-
Creates a transformer that numbers batches from
startin steps ofstep, overwriting any existing value. - SetBatchSequenceNumberField(String, BigDecimal, BigDecimal, boolean, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
-
Creates a transformer that numbers batches from
startin steps ofstep; whenoverwriteis false, records that already have the field keep their value. - SetBatchSequenceNumberField(String, BigDecimal, BigDecimal, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
-
Creates a transformer that numbers batches from
startin steps ofstep, overwriting any existing value. - SetBatchSequenceNumberField(String, BigInteger, BigInteger, boolean, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
-
Creates a transformer that numbers batches from
startin steps ofstep; whenoverwriteis false, records that already have the field keep their value. - SetBatchSequenceNumberField(String, BigInteger, BigInteger, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
-
Creates a transformer that numbers batches from
startin steps ofstep, overwriting any existing value. - setBatchSize(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Sets the number of records sent per batch update; 1 or less turns batching off (defaults to -1).
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Sets the number of events requested per page, from 1 to 100 (defaults to 50).
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
-
Sets the number of contacts requested per page, from 1 to 100 (defaults to 50).
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
-
Sets the number of messages requested per page, from
GmailMessageReader.MIN_BATCH_SIZEtoGmailMessageReader.MAX_BATCH_SIZE(defaults to 25). - setBatchSize(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Sets the number of rows sent per Sheets API request (default 500); any rows still buffered are sent by
GoogleSheetWriter.close(). - setBatchSize(int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Sets the number of records to chunk together in batch updates.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Sets the number of records to chunk together in batch updates.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Sets the number of records to chunk together in batch updates.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Sets the number of records to chunk together in batch updates.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Indicates the number of items to retrieve per batch.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
-
Sets the number of records to chunk together in batch updates.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Indicates the maximum number of records to buffer when reading ORC data (default 1024).
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Indicates the maximum number of records to buffer when reading ORC data (default 1024).
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the maximum number of records to buffer when writing ORC data (default 1024).
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates the maximum number of records to buffer when writing ORC data (default 1024).
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Sets the number of records requested per page; values above 250 are capped and values of 0 or less reset it to 250.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Sets the number of records to chunk together in batch inserts.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
-
Sets the number of records to chunk together in batch inserts.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlUpsertWriter
-
Sets the number of records to chunk together in batch upserts.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
-
Sets the number of records to chunk together in batch inserts.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Sets the number of records to chunk together in batch upserts.
- setBatchSize(int) - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Sets the number of records looked up per API request, from 1 to
TwitterUserLookupReader.MAX_BATCH_SIZE(default is 100). - setBefore(Date) - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
-
Sets the date sent to Trello as the
beforeparameter; only takes effect if set beforeTrelloApiReader.open(). - setBigDecimalPrecision(int) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Sets default precision value for BigDecimal type of values.
- setBigDecimalPrecision(int) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Sets default precision value for BigDecimal type of values.
- setBigDecimalScale(int) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the scale used when writing BigDecimal values (default 10).
- setBigDecimalScale(int) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates the scale used when writing BigDecimal values (default 10).
- setBigNumberDescriptor(NumberDescriptor) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Set NumberDescriptor with necessary details for BigInteger invalid input: '&' BigDecimal numbers only.
- setBlankCount(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the number of empty-string values; whitespace-only values are not counted as blank.
- setBold(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Sets whether bold formatting is enabled.
- setBucketName(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- setBucketName(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- setBucketName(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- setBufferStrategy(BufferStrategy) - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
-
Sets the strategy that decides when an open buffer is closed and its records released; null restores the default (200 milliseconds after the last record was added or 100 records).
- setByteCount(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the maximum length in bytes of a character column (JDBC
CHAR_OCTET_LENGTH). - setCacheFieldIndexes(boolean) - Method in class com.northconcepts.datapipeline.core.SortingReader
- setCacheFolder(String) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- setCacheFolder(String) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates the folder to store cached files during dynamic schema generation with
LocalFileDatasetor null if schema generation should be performed completely in memory usingMemoryDataset.
See alsoParquetDataWriter.setRecordsPerCacheFile(int) - SetCalculatedField - Class in com.northconcepts.datapipeline.transform
-
See
FieldPathfor supported field name expressions. - SetCalculatedField(FieldPath, String) - Constructor for class com.northconcepts.datapipeline.transform.SetCalculatedField
-
Creates a transformer that sets the field to the value of
expressionfor each record, overwriting any existing value. - SetCalculatedField(FieldPath, String, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetCalculatedField
-
Creates a transformer that sets the field to the value of
expressionfor each record unless the field exists andoverwriteis false. - SetCalculatedField(FieldPath, String, FieldDeclarations) - Constructor for class com.northconcepts.datapipeline.transform.SetCalculatedField
-
Creates a transformer that sets the field to the value of
expression, overwriting any existing value;fieldDeclarationssets the Java types the expression assumes for the declared fields. - SetCalculatedField(FieldPath, String, FieldDeclarations, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetCalculatedField
-
Creates a transformer that sets the field to the value of
expressionunless the field exists andoverwriteis false;fieldDeclarationssets the Java types the expression assumes for the declared fields. - SetCalculatedField(String, String) - Constructor for class com.northconcepts.datapipeline.transform.SetCalculatedField
-
Creates a transformer that sets the field to the value of
expressionfor each record, overwriting any existing value. - SetCalculatedField(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetCalculatedField
-
Creates a transformer that sets the field to the value of
expressionfor each record unless the field exists andoverwriteis false. - SetCalculatedField(String, String, FieldDeclarations) - Constructor for class com.northconcepts.datapipeline.transform.SetCalculatedField
-
Creates a transformer that sets the field to the value of
expression, overwriting any existing value;fieldDeclarationssets the Java types the expression assumes for the declared fields. - SetCalculatedField(String, String, FieldDeclarations, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetCalculatedField
-
Creates a transformer that sets the field to the value of
expressionunless the field exists andoverwriteis false;fieldDeclarationssets the Java types the expression assumes for the declared fields. - setCalendarId(String) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Sets the ID of the calendar to read (defaults to
"primary"). - setCallback(JobCallback<DataReader, DataWriter>) - Method in class com.northconcepts.datapipeline.job.Job
-
Sets the callback notified of this job's progress and outcome (
nullrestoresJobCallback.NULL). - setCaptureElapsedTime(boolean) - Static method in class com.northconcepts.datapipeline.core.Endpoint
-
Indicates if all endpoints (readers and writers) should record their processing time.
- setCardFilter(CardFilter) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardCardsReader
-
Sets which of the board's cards are read (defaults to
CardFilter.OPEN); null meansCardFilter.NONE. - setCardFilter(CardFilter) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardListsReader
-
Sets which cards are requested along with the board's lists; null means
CardFilter.NONEandCardFilter.VISIBLEis rejected with an exception. - setCardinality(long) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Sets the number of unique values in the index, or of rows in the table for a
tableIndexStatisticentry. - setCardinality(JdbcQuery.Cardinality) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Sets whether the query returns many rows or one; null means
JdbcQuery.Cardinality.MANY. - setCardinality(RelationshipCardinality) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- setCascade(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
-
Sets whether CASCADE is enabled.
- setCascade(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
- setCascade(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
- setCascade(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- setCascadeFieldValue(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if this field's value spans several records and should be repeated (cascaded) in each of them.
- setCascadeResetLocationPath(LocationPath) - Method in class com.northconcepts.datapipeline.xml.XmlField
-
Sets the location path whose matching elements clear the cascaded value; unlike the
Stringoverload, it leavesXmlField.isCascadeValues()unchanged. - setCascadeValues(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlField
-
Indicates if this field's last value carries over to later records until a new match replaces it (default is false).
- setCaseSensitive(boolean) - Method in class com.northconcepts.datapipeline.filter.rule.Contains
- setCatalog(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Sets the catalog name passed to
DatabaseMetaData.getTables; null (the default) does not filter by catalog. - setCatalogName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setCatalogName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcSchema
- setCatalogName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- setCharset(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Sets the character set used to read the file (defaults to UTF-8); blank uses the platform default.
- setCharset(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Sets the character set used to read the file (defaults to UTF-8); blank uses the platform default.
- setCharset(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Sets the character set used to write the file (defaults to UTF-8); blank uses the platform default.
- setCharset(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Sets the character set used to write the file (defaults to UTF-8); blank uses the platform default.
- setCharset(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Sets the character set used to write the file (defaults to UTF-8); blank uses the platform default.
- setCharset(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Sets the character set used to write the file (defaults to UTF-8); blank uses the platform default.
- setCheckConstraint(String, String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets the check constraint name and condition.
- setCheckConstraint(String, String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Sets the name and condition of a check constraint that is written after the column definition, separated by a comma.
- setCheckConstraint(String, String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Appends a check constraint to the column definition.
- setCheckConstraintCondition(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets the check constraint condition.
- setCheckConstraintCondition(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Sets the condition written verbatim inside
CHECK (...); null or blank omits the check constraint. - setCheckConstraintCondition(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Sets the condition written verbatim inside
CHECK (...); null or blank omits the check constraint. - setCheckConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets the check constraint name.
- setCheckConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Sets the name of the check constraint; an unnamed
CHECKis written when it is null or blank. - setCheckConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Sets the name of the check constraint; an unnamed
CHECKis written when it is null or blank. - setCheckIfConstraintExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
-
Indicates if
IF EXISTSclause should be added to theALTER TABLE...DROP CONSTRAINTstatement before the constraint name (default true). - setCheckIfDropTableExists(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default is true). - setCheckIfDropTableExists(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default is true). - setCheckIfDropTableExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default is true). - setCheckIfExists(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
-
Sets whether IF EXISTS clause should be included in the DROP TABLE statement.
- setCheckIfExists(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default true). - setCheckIfExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
-
Indicates if
IF EXISTSclause should be included in theDROP TABLEstatement (default true). - setCheckIfForeignTableExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Indicates if
IF EXISTSclause should be included in theALTER TABLE...ADD CONSTRAINTstatement (default true). - setCheckIfForeignTableExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if
IF EXISTSclause should be included in theALTER TABLEstatement (default is true). - setCheckIfIndexNotExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE INDEXstatement (default is true). - setCheckIfNotExists(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default true). - setCheckIfNotExists(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default true). - setCheckIfNotExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE INDEXstatement (default true). - setCheckIfNotExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default true). - setCheckIfTableExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
-
Indicates if the
IF EXISTSclause should be added to theALTER TABLEstatement before the table name (default true). - setCheckIfTableNotExists(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default is true). - setCheckIfTableNotExists(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default is true). - setCheckIfTableNotExists(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if
IF NOT EXISTSclause should be included in theCREATE TABLEstatement (default is true). - setChildren(List<TreeNode>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Replaces the children with the given list (null for none) without updating the children's parent references.
- setCity(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setClassName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Sets the fully-qualified class name of the values the JDBC driver returns for this column.
- setClassName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the fully-qualified class name of the values the JDBC driver returns for this column.
- setClient(S3Client) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Uses the given AWS SDK client instead of building one from this file system's credentials, region and endpoint settings; the caller remains responsible for closing it.
- setClientId(String) - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Sets the connection's client ID, also used as the durable subscription name when reading a topic.
- setCloseStream(boolean) - Method in class com.northconcepts.datapipeline.core.StreamWriter
-
Specifies if the stream should be closed when this writer is closed (default is false).
- setCloseWindowStrategy(CloseWindowStrategy) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Sets the strategy that decides when open windows are closed; null restores the default
CloseWindowStrategy.never(). - setCloseWriterOnClose(boolean) - Method in class com.northconcepts.datapipeline.core.DebugReader
-
Indicates if the debug output is closed when this reader is closed (default is false).
- setCloseWriterOnClose(boolean) - Method in class com.northconcepts.datapipeline.core.DebugWriter
-
Indicates if the debug output is closed when this writer is closed (default is false).
- setCollator(Collator) - Method in class com.northconcepts.datapipeline.core.FieldComparator
-
Sets the collator used to compare string values or null for natural ordering (the default).
- setCollectionId(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setCollectUniqueValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if unique values in the dataset should be collected (default
false). - setColumnName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
- setColumnName(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets the column name.
- setColumnName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- setColumnName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- setColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Sets the column names.
- setColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- setColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- setColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Sets the column names.
- setColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- setColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- setColumns(FieldList) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Indicates the columns to read from ORC file.
- setColumns(FieldList) - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Indicates the columns to read from ORC file.
- setColumns(Collection<JdbcQueryColumn>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Replaces the result columns; null clears them.
- setColumns(List<CreateTableColumn>) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Sets the columns.
- setColumns(List<CreateTableColumn>) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
- setColumns(List<CreateTableColumn>) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
- setColumnSeparator(String) - Method in class com.northconcepts.datapipeline.texttable.TextTableWriter
-
Assigns the string written between columns (defaults to two spaces).
- setColumnStatsLoaded(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Sets the flag returned by
Dataset.isColumnStatsLoaded()without callingDataset.afterColumnStatsLoaded(). - setColumnStatsReaderThreads(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
The number of threads to use to process column stats (default 2).
- setColumnStatsReaderThreads(int) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).
- setColumnStatsReaderThreads(int) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the number of threads that collect column statistics when the schema is inferred from the records (default is 2).
- setCommitBatch(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Indicates if commit is called after every batch instead of only after the last one (defaults to false).
- setCommitBatch(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Indicates if this writer should call commit on each connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).
- setCommitBatch(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Indicates if this writer should call commit on each connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).
- setCommitBatch(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Indicates if this reader should call commit on the connection after every batch is sent, otherwise commit is called after the final batch update.
- setCommitBatch(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Indicates if this writer should call commit on the connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).
- setCompany(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setCompressionCodecName(CompressionCodecName) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates the compression used for writing (default UNCOMPRESSED).
- setCompressionCodecName(CompressionCodecName) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates the compression used for writing (default UNCOMPRESSED).
- setCompressionKind(CompressionKind) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the compression used for writing (default NONE).
- setCompressionKind(CompressionKind) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates the compression used for writing (default NONE).
- setCondition(Filter) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Sets the condition under which this transformation applies or
nullif it should always be applied. - setCondition(Filter) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Sets the condition under which this transformation applies or
nullif it should always be applied. - setCondition(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
-
Sets the ON condition that decides between updating and inserting.
- setCondition(String) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Sets the condition under which this transformation applies or
nullif it should always be applied. - setCondition(LogicalExpression) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
-
Sets the condition for computing the field's value; when it is false the field gets the default value or null.
- setCondition(LogicalExpression) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- setCondition(LogicalExpression) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Sets the condition for entering this node from its parent; it is not evaluated for root and default nodes.
- setConfig(Configuration) - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Sets the Orc configuration parameters.
- setConfig(Configuration) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Sets the Orc configuration parameters.
- setConfiguration(Configuration) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Sets the Parquet configuration parameters.
- setConfiguration(Configuration) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the Parquet configuration parameters.
- setConfiguration(String, String) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Sets a single Parquet configuration parameter, keeping the others.
- setConfiguration(String, String) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Sets a single Parquet configuration parameter, keeping the others.
- setConfiguration(Map<String, String>) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Sets the Parquet configuration parameters.
- setConfiguration(Map<String, String>) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Sets the Parquet configuration parameters.
- setConflictAction(PostgreSqlUpsert.ConflictAction) - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
-
Indicates the action to perform on conflict (default ConflictAction.UPDATE).
- setConflictAction(ConflictAction) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Indicates the action to perform on conflict (default ConflictAction.UPDATE).
- setConflictAction(ConflictAction) - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
-
Indicates the action to perform on conflict (default
ConflictAction.UPDATE); null selects the default. - setConnection(JdbcConnection) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Sets the connection this query belongs to; called by
JdbcConnection.addQuery(JdbcQuery). - setConnection(JdbcConnection) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Sets the connection this table belongs to; called by
JdbcConnection.addTable(JdbcTable). - setConnectionFactory(JdbcConnectionFactory) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Sets a factory
JdbcConnection.createConnection()uses in place of the driver, URL, credentials and properties; null removes it. - setConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the constraint name.
- setConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.h2.DropTableConstraint
-
Sets the constraint name.
- setConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- setConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTableConstraint
- setConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- setConstraintName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- setContent(List<T>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
- setContinueOnException(boolean) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Indicates if exceptions thrown by operations are ignored so the remaining operations still run; the last one is kept in
BasicFieldTransformer.getException()(default is false). - setConverter(ITwitterConverter) - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Sets the converter that copies Twitter objects into records (defaults to
ITwitterConverter.DEFAULT). - setConverter(ITwitterConverter) - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Sets the converter that copies Twitter objects into records (defaults to
ITwitterConverter.DEFAULT). - setConverter(ITwitterConverter) - Method in class com.northconcepts.datapipeline.twitter.TwitterWriter
-
Sets the converter that copies Twitter objects into records (defaults to
ITwitterConverter.DEFAULT). - setCost(Double) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- setCountry(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setCountryCode(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- setCountryCode(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setCreatedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- setCreatedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- setCreatedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setCreatedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setCreatedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- setCreatedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- setCreatedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setCreatedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setCreateWindowStrategy(CreateWindowStrategy) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Sets the strategy that decides when new windows are opened; null restores the default
limitOpened(1). - setCredentialsProvider(AwsCredentialsProvider) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Sets the AWS SDK credentials provider that this file's
AmazonS3FileSystemuses when noCredentialsResolveris set. - setCredentialsProvider(AwsCredentialsProvider) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- setCredentialsProvider(AwsCredentialsProvider) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- setCredentialsProvider(AwsCredentialsProvider) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Sets the AWS SDK credentials provider used when no
CredentialsResolveris set (defaults to the standard AWS credentials provider chain). - setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Sets the backend-neutral resolver supplying this file's credentials — resolved on each connection, so rotated secrets are picked up automatically.
- setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Sets the backend-neutral resolver supplying this file system's credentials (see
CredentialsResolver). - setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Sets the resolver supplying this file system's access token (
Credentials.TOKEN) — resolved on eachDropBoxFileSystem.open(), never at construction, so rotated tokens are picked up on the next connection. - setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Sets the resolver supplying this file system's user name and password (
Credentials.USERNAME/Credentials.PASSWORD) — resolved on eachFtpFileSystem.open(), never at construction, so rotated secrets are picked up on the next connection. - setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Sets the resolver supplying this file system's user name (
Credentials.USERNAME) — resolved on eachHdfsFileSystem.open(), never at construction, so rotated values are picked up on the next connection. - setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Sets the resolver supplying this file system's user name and password (
Credentials.USERNAME/Credentials.PASSWORD) — resolved on eachSftpFileSystem.open(), never at construction, so rotated secrets are picked up on the next connection. - setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Sets the resolver supplying this file system's OAuth access token (
Credentials.TOKEN) — resolved on eachGoogleDriveFileSystem.open(), never at construction, so refreshed/rotated tokens are picked up on the next connection. - setCredentialsResolver(CredentialsResolver) - Method in class com.northconcepts.datapipeline.internal.lang.FileSystem
-
Sets the resolver supplying this file system's credentials.
- setCurrency(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setCurrent(Messages) - Static method in class com.northconcepts.datapipeline.core.Messages
-
Replaces the current thread's container (ignored while collection is disabled); not intended for application use.
- setCustomerCriteria(ShopifyCustomerCriteria) - Method in class com.northconcepts.datapipeline.shopify.ShopifyCustomerReader
-
Sets the criteria for the customers to read or null for none; it is modified in place when later pages are requested.
- setCustomStyle(String) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
-
Specifies a custom CSS style to be applied to the PDF document (default
null). - setCustomStyle(String) - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
-
Specifies a custom CSS style to be applied to the PDF document (default
null). - setData(BloombergMessageData) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- setDatabaseColumnCatalogName(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The catalog name of a column returned from the database for this field.
- setDatabaseColumnClassName(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The class name of a column returned from the database for this field.
- setDatabaseColumnDisplaySize(int) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column display size returned from the database for this field.
- setDatabaseColumnFieldType(FieldType) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The
FieldTypemapped from the Java type of the database column for this field. - setDatabaseColumnJavaType(Class<?>) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The Java type mapped from
java.sql.Types. - setDatabaseColumnName(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column name returned from the database for this field.
- setDatabaseColumnNullable(boolean) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column isNullable value returned from the database for this field.
- setDatabaseColumnPrecision(int) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column precision returned from the database for this field.
- setDatabaseColumnScale(int) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column scale returned from the database for this field.
- setDatabaseColumnSchemaName(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The schema name of a column returned from the database for this field.
- setDatabaseColumnSigned(boolean) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column isSigned value returned from the database for this field.
- setDatabaseColumnSqlType(int) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column type returned from the database for this field.
- setDatabaseColumnTableName(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The table name of a column returned from the database for this field.
- setDatabaseColumnTypeName(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The column type name returned from the database for this field.
- setDatabaseQuery(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The SQL statement used to query the database.
- setDatabaseQuery(String) - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The SQL statement used to query the database.
- setDatabaseTypeName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setDatabaseTypeName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- setDatabaseUrl(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The JDBC connection URL.
- setDatabaseUrl(String) - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The JDBC connection URL.
- setDataConnectionMode(DataConnectionMode) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
- setDataFormat(FieldType, String) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets the data format for cells containing values of the specified field type.
- setDataFormat(FieldType, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets the Excel data format, such as
0.00orm/d/yy, for cells of the given field type; neither may be null. - setDataFormat(String) - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Sets the data format string for the cell (e.g., "0.00" for decimals, "m/d/yy" for dates).
- setDataMapping(DataMapping) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- setDataMapping(DataMapping) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setDataMappingPart(DataMappingPart) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblem
- setDataMappingResult(Record, DataMappingResult) - Static method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Attaches the result to the record as a session property; does nothing if the record is null.
- setDateTimePatternDetector(DateTimePatternDetector) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the detector a
Datasetbuilt on this pipeline uses to infer date/time values in text columns; null restores the default detector. - setDateTimePatternDetector(DateTimePatternDetector) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DateTimeNodeNameRule
-
Sets the detector used to recognize date/time names (null restores the default) and clears the cached results.
- setDateTimeRenderOption(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
How date, time and duration cells are read under
UNFORMATTED_VALUE:SERIAL_NUMBER(the API default) orFORMATTED_STRING; null sends no option. - setDebug(boolean) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Indicates if this file's
AmazonS3FileSystemlogs multipart upload progress at debug level. - setDebug(boolean) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Indicates if multipart uploads log each part and their completion or abort at debug level (default is false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
-
Indicates if buffer activity (buffers opened and closed, records added) is logged at debug level (default is false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Indicates if debug mode is turned on for the mail session when the reader opens (default is false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Indicates if the bus should emit debug log messages when events are published or delivered and during the shutdown process.
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Indicates if the reader logs each parsed node to help find record break paths; not serialized (defaults to false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Indicates if the reader logs each parsed node to help find field and record break paths; not serialized (defaults to false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if the reader logs each parsed node to help find record break paths; not serialized (defaults to false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternDetector
-
Indicates if failing patterns should be logged (default false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Indicates if window activity is logged at debug level (defaults to false).
- setDebug(boolean) - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Set to
trueto log generated SQL (default false). - setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Indicates if the generated SQL should be logged (default false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Indicates if the generated SQL should be logged (default false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Indicates if the generated SQL should be logged (default false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Indicates if the generated SQL should be logged (default false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
-
Set to
trueto log generated SQL (default false). - setDebug(boolean) - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Set to
trueto log generated SQL (default false). - setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
-
Set to
trueto log generated SQL (default false). - setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Indicates if each JSON token read is logged at debug level (default is false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if debugging is enabled to print log statements.
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Indicates if debugging is enabled to print log statements.
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Indicates if each node read is logged at debug level (default is false).
- setDebug(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if each node read is logged at debug level (default is false).
- setDecimalPlaces(int) - Method in class com.northconcepts.datapipeline.transform.format.Rounder
-
Sets the number of decimal places to round to; negative values round to the left of the decimal point.
- setDecimals(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the number of fractional digits (0 where not applicable).
- setDecisionTable(DecisionTable) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- setDecisionTree(DecisionTree) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- setDeclaration(String) - Method in class com.northconcepts.datapipeline.xml.builder.XmlTemplate
-
Sets the text written verbatim on its own line before the template's nodes, typically an XML declaration (default is null, for none).
- setDefaultAdjustedToUTC(boolean) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates if all datetime fields should be marked as AdjustedToUTC.
- setDefaultAdjustedToUTC(boolean) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates if all datetime fields should be marked as AdjustedToUTC.
- setDefaultAdjustToUTC(boolean) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Deprecated.
- setDefaultBigDecimalPrecision(int) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Sets a default precision for
FieldType.BIG_DECIMAL.
This value will be used if no precision is specified forBIG_DECIMALfields (default 20). - setDefaultBigDecimalPrecision(int) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Sets a default precision for
FieldType.BIG_DECIMAL.
This value will be used if no precision is specified forBIG_DECIMALfields (default 20). - setDefaultBigDecimalPrecision(int) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Sets a default precision for
FieldType.BIG_DECIMAL.
This value will be used if no precision is specified forBIG_DECIMALfields (default 20). - setDefaultBigDecimalScale(int) - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Sets the default scale used when writing BigDecimal values (default 5).
- setDefaultBigDecimalScale(int) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Sets the default scale used when writing BigDecimal values (default 5).
- setDefaultBigDecimalScale(int) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Sets the default scale used when writing BigDecimal values (default 5).
- setDefaultBigDecimalScale(int) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the default scale used when writing BigDecimal values (default 5).
- setDefaultBigDecimalScale(Integer) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Sets a default scale for
FieldType.BIG_DECIMAL(default 5).
This value will be used if no scale is specified forBIG_DECIMALfields. - setDefaultBigDecimalScale(Integer) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Sets a default scale for
FieldType.BIG_DECIMAL(default 5).
This value will be used if no scale is specified forBIG_DECIMALfields. - setDefaultBigDecimalScale(Integer) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Sets a default scale for
FieldType.BIG_DECIMAL(default 5).
This value will be used if no scale is specified forBIG_DECIMALfields. - setDefaultBigIntegerPrecision(int) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Sets a default precision for
FieldType.BIG_INTEGER(default 20).
This value will be used if no precision is specified forBIG_INTEGERfields. - setDefaultBigIntegerPrecision(int) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Sets a default precision for
FieldType.BIG_INTEGER(default 20).
This value will be used if no precision is specified forBIG_INTEGERfields. - setDefaultBigIntegerPrecision(int) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Sets a default precision for
FieldType.BIG_INTEGER(default 20).
This value will be used if no precision is specified forBIG_INTEGERfields. - setDefaultBigNumberPrecision(int) - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Sets the default precision used when writing BigDecimal invalid input: '&' BigInteger values (default 25).
- setDefaultBigNumberPrecision(int) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Sets the default precision used when writing BigDecimal invalid input: '&' BigInteger values (default 25).
- setDefaultBigNumberPrecision(int) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Sets the default precision used when writing BigDecimal invalid input: '&' BigInteger values (default 25).
- setDefaultBigNumberPrecision(int) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the default precision used when writing BigDecimal invalid input: '&' BigInteger values (default 25).
- setDefaultNode(DecisionTreeNode) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
-
Sets the node entered when no child node's condition holds, or null to stop here.
- setDefaultType(FieldType) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Sets the default
FieldTypeused when this array is empty. - setDefaultValue(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the column's default value as unparsed text reported by the database.
- setDefaultValue(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets the default value.
- setDefaultValue(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Sets the SQL expression written verbatim after
DEFAULT(quote string literals yourself); null or blank omits it. - setDefaultValue(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Sets the SQL expression written verbatim after
DEFAULT(quote string literals yourself); null or blank omits it. - setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
-
Sets the expression that supplies the field's value when the mapped value is null or the condition is false.
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
The calculated value to set in the data if the field is null or missing.
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setDefaultValueExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setDeferrability(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Sets whether checking of this foreign key can be deferred, as a
DatabaseMetaDatacode such asimportedKeyInitiallyDeferred. - setDeleteDatabaseFileOnClose(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
-
Indicates if the MVStore file is deleted when this dataset is closed (defaults to false).
- setDeleteFilesOnClose(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Indicates if this dataset's files are deleted when it is closed (defaults to false).
- setDeleteRule(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Sets what happens to the foreign key when the referenced primary key is deleted, as a
DatabaseMetaDatacode such asimportedKeyCascade. - setDelimiter(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Sets the delimiter sent with every listing (unset by default, so listings include nested keys);
AmazonS3FileSystem.FOLDER_DELIMITERlists one folder level at a time. - setDescription(String) - Method in class com.northconcepts.datapipeline.core.Endpoint
-
Sets the optional text shown for this endpoint in
Endpoint.toString()and exception properties. - setDescription(String) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
- setDescription(String) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- setDescription(String) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
- setDescription(String) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- setDescription(String) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setDescription(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- setDescription(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- setDescription(String) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- setDescription(String) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
- setDescription(String) - Method in class com.northconcepts.datapipeline.json.JsonLinesWriter
- setDescription(String) - Method in class com.northconcepts.datapipeline.json.JsonReader
- setDescription(String) - Method in class com.northconcepts.datapipeline.json.JsonWriter
- setDescription(String) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- setDescriptionField(String) - Method in class com.northconcepts.datapipeline.trello.TrelloCardWriter
-
Sets the name of the record field holding the card description (defaults to
"description"). - setDetails(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblem
- setDetails(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaProblem
- setDetailTemplate(Template) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Sets the template written for each record; only allowed before the writer is opened.
- setDetailTemplate(String) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Sets the detail template to the template with this name, loaded through
TemplateWriter.getConfiguration(). - setDetectBigNumberValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if big decimals and big integers should be analyzed to determine their precision and scale (default
true). - setDetectBooleanValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if boolean values should be looked for in strings and undefined types (default
true). - setDetectionStrategy(TreeDetectionStrategy) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Sets the detection strategy, or
standard(false)if null; nodes already loaded are not re-detected. - setDetectNumericValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if numeric values should be looked for in strings and undefined types (default
true). - setDetectTemporalValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if date/time patterns should be looked for in strings and undefined types (default
true). - setDetectUuidValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if UUID values should be looked for in strings and undefined types (default
true). - setDirection(EmailReadDirection) - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Sets the order in which the messages are read; null resets it to
FORWARD. - setDirection(TwitterPageableReader.Direction) - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
-
Sets whether paging follows the next or the previous cursors (defaults to
TwitterPageableReader.Direction.FORWARD). - setDiscardReasonFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the name of the field added to discarded records to hold the failure message; only allowed with a discard writer.
- setDiscardReasonFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setDiscardReasonFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setDiscardReasonFieldName(String) - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Specifies the field in the record to place the description of the exception that was thrown by the failing read or
nullif one should not be added. - setDiscardReasonFieldName(String) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Specifies the field in the record to place the description of the exception that was thrown by the failing write or
nullif one should not be added. - setDiscardWriter(DataWriter) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Sets the writer that receives records not matching the Avro schema; when null, such records fail the write.
- setDiscardWriter(DataWriter) - Method in class com.northconcepts.datapipeline.core.RemoveDuplicatesReader
-
Assign a discard sink for duplicate records.
- setDiscardWriter(DataWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the writer that receives records failing source or target entity validation, instead of stopping the pipeline.
- setDiscardWriter(DataWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setDiscardWriter(DataWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setDiscardWriter(DataWriter) - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Assign a discard sink for failing records.
- setDiscardWriter(DataWriter) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Assign a discard sink for failing records.
- setDiscardWriter(DataWriter) - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Assign a discard sink for records where the lookup failed.
- setDisplayName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setDisplayName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setDisplayName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the user-friendly name for this field, used instead of the name in validation messages.
- setDisplayName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setDisplayName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setDisplayName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setDisplayName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setDisplayName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setDistinct(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySelection
-
Indicates if
SELECT DISTINCTis generated (default is false). - setDistinctValues(boolean) - Method in class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Sets whether only distinct values should be collected.
- setDoneFilter(Boolean) - Method in class com.northconcepts.datapipeline.jira.JiraEpicReader
-
Indicates which epics to return: true=done, false=not done, null=all (default is all).
- setDriverClassName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- setDropTable(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if drop table statement should be included in the output DDL for each entity in the
CreateH2DdlFromSchemaDef.schemaDef(default true). - setDropTable(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if drop table statement should be included in the output DDL for each entity in the
CreateMySqlDdlFromSchemaDef.schemaDef(default true). - setDropTable(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if drop table statement should be included in the output DDL for each entity in the
CreatePostgreSqlDdlFromSchemaDef.schemaDef(default true). - setDropTablesOnClose(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset
-
Sets whether to drop the database tables when this dataset is closed.
- setDstoff(Long) - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- setDuplicateFieldAction(Node.DuplicateNodeAction) - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Sets how looked-up fields that clash with existing field names are merged (default is APPEND).
- setDuplicateFieldPolicy(XmlReader.DuplicateFieldPolicy) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- setDuplicateFieldPolicy(XmlReader.DuplicateFieldPolicy) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
-
Sets how a field matched more than once within a record is stored (defaults to
XmlReader.DuplicateFieldPolicy.USE_LAST_VALUE). - setDuplicateFieldPolicy(XmlReader.DuplicateFieldPolicy) - Method in class com.northconcepts.datapipeline.json.JsonReader
- setDuplicateFieldPolicy(XmlReader.DuplicateFieldPolicy) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Sets how a field matched more than once in a record is handled; null restores the default
XmlReader.DuplicateFieldPolicy.USE_LAST_VALUE. - setEmailAddress(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setEmailClient(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setEmailType(EmailType) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setEmptyStringValuePolicy(CSVWriter.IValuePolicy) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Assigns the object responsible for writing empty string values (defaults to ValuePolicy.QUOTED_EMPTY_STRING).
- setEmptyStringValuePolicy(CSVWriter.ValuePolicy) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Sets how empty strings are written (defaults to
CSVWriter.ValuePolicy.QUOTED_EMPTY_STRING, a pair of quotes). - setEnabled(boolean) - Static method in class com.northconcepts.datapipeline.core.Messages
-
Indicates if messages are collected, for all threads; when false,
Messages.getCurrent()returns a container that discards them (defaults to true). - setEncodedPassword(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Sets the password already encoded with the
password encoder. - setEndDate(LocalDateTime) - Method in class com.northconcepts.datapipeline.twitter2.TwitterSearchReader
-
Indicates the newest UTC timestamp search criteria.
- setEndDate(LocalDateTime) - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Indicates the newest UTC timestamp search criteria.
- setEndingQuote(String) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Assigns the string used to mark the ending of text values that may contain commas and other special characters (defaults to double quote - ").
- setEndingQuote(String) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Assigns the string used to mark the ending of text values that may contain commas and other special characters (defaults to double quote - ").
- setEndingQuote(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Sets the string that ends a quoted value (defaults to a double quote).
- setEndingQuote(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Sets the string that ends a quoted value (defaults to a double quote).
- setEndpointOverride(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Overrides the S3 service endpoint (e.g.
- setEntities(List<EntityDef>) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Replaces the entities with the given list (not copied) and makes this schema their parent.
- setEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the parent entity; called by
EntityDefwhen this field is added to it. - setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Sets the parent entity; called by
EntityDefwhen this index is added to it. - setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setEntityDef(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setEntityExpansionPolicy(IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Sets how multi-valued entity fields are stored (defaults to
EntityExpansionPolicy.TO_STRING). - setEntityExpansionPolicy(IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Sets how multi-valued entity fields are stored (defaults to
EntityExpansionPolicy.TO_STRING). - setEntityExpansionPolicy(IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterWriter
-
Sets how multi-valued entity fields are stored (defaults to
EntityExpansionPolicy.TO_STRING). - setEntityName(String) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
- setEntityNames(String...) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Set entity names that should be included in the output DDL (all entities will be included by default).
- setEntityNames(String...) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Set entity names that should be included in the output DDL (all entities will be included by default).
- setEntityNames(String...) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Set entity names that should be included in the output DDL (all entities will be included by default).
- setEntityNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Set entity names that should be included in the output DDL (all entities will be included by default).
- setEntityNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Set entity names that should be included in the output DDL (all entities will be included by default).
- setEntityNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Set entity names that should be included in the output DDL (all entities will be included by default).
- setEntityRelationships(List<EntityRelationshipDef>) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Replaces the entity relationships with the given list (not copied) and makes this schema their parent.
- setEntitySuperClass(Class<?>) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Sets the superclass of the generated classes, or null for none; generated record serialization also calls a
RecordSerializablesuperclass. - setEntitySuperClass(Class<?>) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Sets the superclass of the generated entities, or null for none; generated record serialization also calls a
RecordSerializablesuperclass. - setEntitySuperClass(Class<?>) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Sets the superclass of the generated entities, or null for none; the fields, getters and setters it already declares are reused.
- setErrors(List<ValidationMessage>) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationResult
- setEscapePatterns(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
-
Indicates if backslashes and double quotes in the patterns are escaped in the generated Java code (defaults to false); filtering is unaffected.
- setEscapePatterns(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
-
Indicates if backslashes and double quotes in the patterns are escaped in the generated Java code (defaults to false).
- setEvaluateEntryCallback(Jsonata.EntryCallback) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- setEvaluateExitCallback(Jsonata.ExitCallback) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
- setEvaluateExpressions(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Indicates if cell formulas/expressions should be evaluated and the result set as the field's value (default true), otherwise, the cell's formula will be set as the field's value and no evaluation will take place.
- setEvaluateExpressions(boolean) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- setEvaluateExpressions(boolean) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- setEvaluateExpressions(boolean) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- setEvaluateExpressions(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if formulas are evaluated and their results read instead of the formula text (defaults to true).
- setEventCriteria(ShopifyEventCriteria) - Method in class com.northconcepts.datapipeline.shopify.ShopifyEventReader
-
Sets the criteria for the events to read or null for none; it is modified in place when later pages are requested.
- setEventFilter(EventFilter) - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Sets an extra filter events must pass besides the topic check (
nullfor none); must be called before opening. - setEventSource(Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
-
Sets the source attached to this writer's events (defaults to the writer itself); must be called before opening.
- setExample(String) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setExample(String) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setExample(String) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- setExample(String) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setExample(String) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setExample(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setExample(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setExample(String) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setExampleValueExpression(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
-
Sets the DataPipeline expression whose result, converted to the Java type, is the example value; null means a null value.
- setExcelCellStyle(ExcelCellStyle) - Method in class com.northconcepts.datapipeline.excel.ExcelFieldMetadata
-
Attaches an ExcelCellStyle to the field as a session property.
- setExcelFont(ExcelFont) - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Sets the font styling for the cell.
- setExcelHyperlink(ExcelHyperlink) - Method in class com.northconcepts.datapipeline.excel.ExcelFieldMetadata
-
Attaches an ExcelHyperlink to the field as a session property.
- setExcelReader(ExcelReader) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- setExcelReader(ExcelReader) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- setExcelReader(ExcelReader) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- setExcelWriter(ExcelWriter) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- setExcelWriter(ExcelWriter) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- setExcelWriter(ExcelWriter) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- setException(DataException) - Method in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
-
Stores an exception for the next read to throw and returns it.
- setException(DataException) - Method in class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
- setExceptionCount(long) - Method in class com.northconcepts.datapipeline.retry.RetryContext
-
Sets the total number of failures the operation has seen, including those of earlier calls.
- setExceptionOnFailure(boolean) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Sets the flag to stop processing if an exception is thrown (default) or false if they should be ignored.
- setExceptionOnFailure(boolean) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Sets the flag to stop processing if an exception is thrown (default) or false if they should be ignored.
- setExceptionOnFailure(boolean) - Method in class com.northconcepts.datapipeline.validate.ValidatingReader
-
Indicates if a record failing validation throws an exception instead of being discarded with a warning; cannot be turned on while a discard writer is set.
- setExcludeCatalogAnnotation(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if the catalog is left out of the generated
@Tableannotation (default false). - setExcludedWords(Set<String>) - Method in class com.northconcepts.datapipeline.transform.SplitWords
-
Sets the words (matched case-sensitively) to leave out of the result; null excludes none.
- setExcludeNulls(boolean) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Indicates if
nullgroups should be excluded from results (defaults to false). - setExcludeNulls(boolean) - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Indicates if this operation skips records whose source field is null (defaults to false; ignored when there is no source field).
- setExcludeSchemaAnnotation(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if the schema is left out of the generated
@Tableannotation (default false). - setExpiresOn(long) - Method in class com.northconcepts.datapipeline.security.Credentials.Builder
-
Sets the time in milliseconds when these credentials expire or zero (0) if no expiry is known.
- setExpirySkewMilliseconds(long) - Method in class com.northconcepts.datapipeline.security.CachingCredentialsResolver
-
Sets how long before the credentials' reported expiry they are considered stale.
- setExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- setExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- setExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
-
Sets the expression; must not be null.
- setExpression(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- setExpression(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- setExpression(LogicalExpression) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- setExpressionAsString(String) - Method in exception class com.northconcepts.datapipeline.expression.ParseException
-
Sets the expression that failed to parse, stored as a property of this exception.
- setFactory(DataReaderFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- setFactory(DataWriterFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- setFailedCondition(LogicalExpression) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Sets the mapping condition that was false, which stops the record from being mapped.
- setFailedExpressionStrategy(ExcelReader.FailedExpressionStrategy) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Indicates how to handle failures when evaluating cell formulas/expressions (default
ExcelReader.FailedExpressionStrategy.FAIL). - setFailedExpressionStrategy(ExcelReader.FailedExpressionStrategy) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets how a failed formula evaluation is handled (defaults to
ExcelReader.FailedExpressionStrategy.FAIL). - setFailOnException(boolean) - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader
-
Indicates if a source reader failure stops all reading and is rethrown by
DataReader.read()(default is true) instead of only being kept forAsyncMultiReader.getException(). - setFailOnLimitationNotice(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
-
Indicates if track limitation notices fail the reader rather than only being counted (default is false).
- setFetchSize(Integer) - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
The fetch size to set on the
StatementusingStatement.setFetchSize(int)ornullif the connection's default should be used (defaultnull). - setField(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if this node's values are read into a record field.
- setField(Field) - Method in class com.northconcepts.datapipeline.core.FieldLocation
-
Sets the field at this location.
- setField(Field) - Method in class com.northconcepts.datapipeline.excel.ExcelFieldMetadata
-
Sets the field for this metadata.
- setField(Field) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
- setField(Field) - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePair
- setField(FieldPath, boolean, boolean, Object) - Method in class com.northconcepts.datapipeline.core.Record
-
Sets the value at the specified
FieldPath. - setField(FieldPath, Object) - Method in class com.northconcepts.datapipeline.core.Record
-
Sets the value at the specified
FieldPath, creating intermediate fields as needed. - setField(FieldDef) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- setField(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
- setField(String, Object) - Method in class com.northconcepts.datapipeline.core.Record
-
Sets the value of the field with the given name, creating the field if necessary.
- setField(String, Object) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
-
Sets a value in the issue's fields record and returns that record, not this issue.
- SetField - Class in com.northconcepts.datapipeline.transform
-
A
Transformerthat sets a field on every record to a fixed value, creating the field if needed; whenoverwriteis false, records that already have the field are left unchanged. - SetField(FieldPath, byte[]) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, byte[], boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Boolean, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Byte) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Byte, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Character) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Character, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Double) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Double, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Float) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Float, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Integer) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Integer, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Long) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Long, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Object) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
value(an untyped null if null), overwriting any existing value. - SetField(FieldPath, Object, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
value(an untyped null if null) unless it exists andoverwriteis false. - SetField(FieldPath, Object, FieldType) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
value, overwriting any existing value; a nullvalueis stored as a null offieldType. - SetField(FieldPath, Object, FieldType, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field (created if missing) to
valueunless it exists andoverwriteis false; a nullvalueis stored as a null offieldType. - SetField(FieldPath, Short) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Short, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, String) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, String, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, BigDecimal) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, BigDecimal, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, BigInteger) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, BigInteger, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Date) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Date, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Time) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Time, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Instant) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.util.Date, overwriting any existing value. - SetField(FieldPath, Instant, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.util.Dateunless it exists andoverwriteis false. - SetField(FieldPath, LocalDate) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.sql.Date, overwriting any existing value. - SetField(FieldPath, LocalDate, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.sql.Dateunless it exists andoverwriteis false. - SetField(FieldPath, LocalDateTime) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.util.Datein the default time zone, overwriting any existing value. - SetField(FieldPath, LocalDateTime, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.util.Datein the default time zone unless it exists andoverwriteis false. - SetField(FieldPath, LocalTime) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.sql.Time, overwriting any existing value. - SetField(FieldPath, LocalTime, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.sql.Timeunless it exists andoverwriteis false. - SetField(FieldPath, Date) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, Date, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, UUID) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(FieldPath, UUID, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, byte[]) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, byte[], boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Boolean, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Byte) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Byte, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Character) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Character, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Double) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Double, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Float) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Float, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Integer) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Integer, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Long) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Long, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Object) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
value(an untyped null if null), overwriting any existing value. - SetField(String, Object, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
value(an untyped null if null) unless it exists andoverwriteis false. - SetField(String, Object, FieldType) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
value, overwriting any existing value; a nullvalueis stored as a null offieldType. - SetField(String, Object, FieldType, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field (created if missing) to
valueunless it exists andoverwriteis false; a nullvalueis stored as a null offieldType. - SetField(String, Short) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Short, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, String) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, BigDecimal) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, BigDecimal, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, BigInteger) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, BigInteger, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Date) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Date, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Time) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Time, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Instant) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.util.Date, overwriting any existing value. - SetField(String, Instant, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.util.Dateunless it exists andoverwriteis false. - SetField(String, LocalDate) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.sql.Date, overwriting any existing value. - SetField(String, LocalDate, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.sql.Dateunless it exists andoverwriteis false. - SetField(String, LocalDateTime) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.util.Datein the default time zone, overwriting any existing value. - SetField(String, LocalDateTime, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.util.Datein the default time zone unless it exists andoverwriteis false. - SetField(String, LocalTime) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.sql.Time, overwriting any existing value. - SetField(String, LocalTime, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
-
Creates a transformer that sets the field to
valueas ajava.sql.Timeunless it exists andoverwriteis false. - SetField(String, Date) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, Date, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, UUID) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- SetField(String, UUID, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetField
- setFieldIndex(int) - Method in class com.northconcepts.datapipeline.core.FieldLocation
-
Sets the zero-based field index (column position) of this field location.
- setFieldIndexes(List<JdbcFieldIndex>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- setFieldName(String) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
sets the field name associated with this exception.
- setFieldName(String) - Method in class com.northconcepts.datapipeline.core.FieldComparator
-
Sets the field path of the field to be used for comparisons.
- setFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Sets the record field name for this node; if blank, the node name is used instead.
- setFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Sets the name of the entity field this index field refers to.
- setFieldNames(String...) - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Sets the names given to each record's fields, taking precedence over names in the first row; must be called before
AbstractReader.open(). - setFieldNames(String...) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- setFieldNames(String...) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- setFieldNames(String...) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- setFieldNames(String...) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets the names given to the fields in column order, overriding any read from the first row; must not be empty.
- setFieldNames(String...) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- setFieldNames(Collection<String>) - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Sets the names given to each record's fields, taking precedence over names in the first row; must be called before
AbstractReader.open(). - setFieldNames(Collection<String>) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- setFieldNames(Collection<String>) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- setFieldNames(Collection<String>) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- setFieldNames(Collection<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets the names given to the fields in column order, overriding any read from the first row; must not be empty.
- setFieldNames(Collection<String>) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Indicates if the first row holds the field names instead of data (default is false); must be called before
AbstractReader.open(). - setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.core.AbstractWriter
-
Indicates if a header row of field names is written before the first record (default is true); must be called before
AbstractWriter.open(). - setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if the first row holds the field names (defaults to false).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if the first row read holds the field names (defaults to false).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Indicates if the first row holds the field names (defaults to false).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Indicates if a header row of field names is written first (defaults to true).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Indicates if a header row of field names is written first (defaults to true).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Indicates if a header row of field names is written first (defaults to true).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.json.JsonLinesWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.json.JsonWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
-
Specifies whether field names are written as the first row (default true).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
-
Specifies whether field names are written as the first row (default true).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
-
Indicates if the table's first row holds the field names instead of data (default is false).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.pdf.PdfReader
-
Indicates if the table's first row holds the field names instead of data (default is false).
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- setFieldNamesInFirstRow(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlWriter
- setFieldNull(FieldPath, FieldType) - Method in class com.northconcepts.datapipeline.core.Record
-
Sets the field at the specified
FieldPathto a typednullvalue, creating intermediate fields as needed. - setFieldNull(String, FieldType) - Method in class com.northconcepts.datapipeline.core.Record
-
Sets the field with the given name to a typed
nullvalue, creating the field if necessary. - setFields(BloombergMessageFields) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- setFields(FieldList) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- setFields(Record) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
- setFields(String...) - Method in class com.northconcepts.datapipeline.jira.JiraSearch
- setFields(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- setFields(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- setFields(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setFields(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setFields(List<FixedWidthField>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- setFields(List<FixedWidthField>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- setFields(List<FieldDef>) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Replaces the fields with the given list (not copied) and makes this entity their parent.
- setFields(List<String>) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageFields
- setFields(Set<AggregateGroupFieldsAction.GroupByField>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- setFields(Set<String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- setFieldSchema(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The field's schema for ORC and Parquet files.
- setFieldSeparator(char) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Assigns the string used between each field value (defaults to comma).
- setFieldSeparator(char) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Assigns the string used between each field value (defaults to comma).
- setFieldSeparator(String) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Assigns the string used between each field value (defaults to comma).
- setFieldSeparator(String) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Assigns the string used between each field value (defaults to comma).
- setFieldSeparator(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Sets the string used between field values (defaults to comma).
- setFieldSeparator(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Sets the string written between field values (defaults to comma).
- setFieldSeparator(String) - Method in class com.northconcepts.datapipeline.transform.FlattenRecord
-
Sets the separator placed between parent names, child names and array indexes in flattened field names (default is "_").
- setFieldTypes(Map<FieldType, LongAdder>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the number of values seen for each field type, nulls included.
- setFieldTypeSelectionMode(GenerateEntityFromDataset.FieldTypeSelectionMode) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Indicates how the field type should be selected for each column.
- setFile(File) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The
java.io.Fileused to create the DataReader. - setFile(File) - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The
java.io.Fileused to create the DataReader. - setFileColumnNumber(Long) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The beginning column number in the input file starting with 0.
- setFileColumnNumber(Long) - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The beginning column number in the input file starting with 0.
- setFileLineNumber(Long) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The line number in the input file starting with 0.
- setFileLineNumber(Long) - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The line number in the input file starting with 0.
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FileSinkPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- setFileSink(FileSink) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FileSourcePipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- setFileSource(FileSource) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- setFileTransferMode(FileTransferMode) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
See
FileTransferMode - setFileTransferType(FileTransferType) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
See
FileTransferType - setFileType(FileType) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Sets the file type, which is otherwise detected from the file's extension or content.
- setFileType(FileType) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- setFileType(FileType) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- setFillChar(char) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
-
Sets the character trimmed from values in columns without their own fill character (defaults to space).
- setFillChar(char) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
-
Sets the character used to pad values in columns without their own fill character (defaults to space).
- setFillChar(char) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Sets the character trimmed from values in columns without their own fill character (defaults to space).
- setFillChar(char) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Sets the character used to pad values in columns without their own fill character (defaults to space).
- setFillChar(Character) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
-
Sets this column's fill character or null to use the reader's or writer's own (a space by default).
- setFilter(Filter) - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Sets the filter limiting which records this operation applies to; null applies it to all of them.
- setFilter(Filter) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Deprecated.
- setFilter(BoardFilter...) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
-
Replaces the filters selecting which boards are read with the given values.
- setFilter(FileFilter) - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
-
Sets the filter applied to each directory listing (null accepts all); rejected directories are not recursed into.
- setFilter(EnumSet<BoardFilter>) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
-
Sets the filters selecting which boards are read (defaults to
BoardFilter.ALL); null or empty also means ALL. - setFilter(MetadataFilter) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Sets the metadata filter the reader applies when it opens the file (default is
NO_FILTER). - setFilter(MetadataFilter) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Sets the filter settings.
- setFilterCondition(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- setFilters(EventFilter...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- setFinancialStatus(FinancialStatus) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setFirstColumnIndex(int) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets the 0-based column that each record's first field is written to (defaults to 0).
- setFirstColumnIndex(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets the 0-based column each record's first field is written to (defaults to 0).
- setFirstColumnIndex(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Sets the 0-based column that each record's first field is written to when no range is set (defaults to 0).
- setFirstName(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setFirstRowIndex(int) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets the 0-based row that the first record (or the header row) is written to (defaults to 0).
- setFirstRowIndex(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets the 0-based row the header or first record is written to (defaults to 0).
- setFirstRowIndex(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Sets the 0-based row that the first record (or the header row) is written to when no range is set (defaults to 0).
- setFlattenArrayValues(boolean) - Method in class com.northconcepts.datapipeline.group.operation.GroupCollect
-
Sets whether array values should be flattened during collection.
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
-
Indicates if the underlying java.io.BufferedWriter should be flushed after each record is written (defaults to false).
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.core.TextWriter
-
Indicates if the underlying java.io.BufferedWriter should be flushed after each record is written (defaults to false).
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.file.FileWriter
-
Indicates if the underlying java.io.BufferedWriter should be flushed after each record is written.
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Indicates if the output is flushed after each record (defaults to false).
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Indicates if the output is flushed after each record (defaults to false).
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Indicates if the output is flushed after each record (defaults to false).
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if the output is flushed after each record (defaults to false).
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.json.JsonLinesWriter
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.json.JsonWriter
- setFlushOnWrite(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlWriter
- setFolderName(String) - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Sets the name of the folder to read messages from (default is
INBOX). - setFollow(long...) - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
-
Sets the IDs of the users the stream is filtered by.
- setFontColor(ExcelColor) - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Sets the font color.
- setFontColor(ExcelColorPalette) - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Sets the font color.
- setFooter(BloombergMessageFooter) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- setFooterTemplate(Template) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Sets the template written after the records; only allowed before the writer is opened.
- setFooterTemplate(String) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Sets the footer template to the template with this name, loaded through
TemplateWriter.getConfiguration(). - setForceQuote(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Indicates if all values should be quoted, even if they are not null or empty strings.
- setForceQuote(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Indicates if every non-empty value is quoted, not only those that need it (defaults to false).
- setForeignEntityName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Sets the name of the entity that holds the foreign key fields.
- setForeignKeyColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the foreign key column names.
- setForeignKeyColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- setForeignKeyColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- setForeignKeyColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the foreign key column names.
- setForeignKeyColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- setForeignKeyColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- setForeignKeyFieldNames(String...) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Sets the foreign key field names, in key order, copying them into a new list.
- setForeignKeyFieldNames(List<String>) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Sets the names of the foreign entity's fields that reference the primary entity's key, in key order.
- setForeignTableName(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the foreign table name.
- setForeignTableName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Sets the name of the table that is altered to add the foreign key (the referencing table).
- setForeignTableName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Sets the name of the table that is altered to add the foreign key (the referencing table).
- setForiegnKeyCatalogName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- setForiegnKeyColumnName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- setForiegnKeyName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Sets the name of the foreign key constraint.
- setForiegnKeySchemaName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- setForiegnKeyTableName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- setFormat(boolean) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Deprecated.
- setFormat(StreamWriter.Format) - Method in class com.northconcepts.datapipeline.core.StreamWriter
-
Sets how each record is printed; null means
StreamWriter.Format.RECORD(the default). - setFractionDigits(int) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- setFractionPart(String) - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
-
Sets the digits after the decimal point.
- setFreezeColumns(Integer) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets the number of columns to freeze at the left side of the Excel sheet.
Supported ProviderTypes are: - setFreezeColumns(Integer) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets the number of columns to freeze (make non-scrollable) in the Excel sheet.
- setFreezePane() - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- setFreezePane() - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- setFreezePane() - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- setFreezePaneImpl(int, int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- setFreezePaneImpl(int, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- setFreezePaneImpl(int, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- setFreezeRows(Integer) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets the number of rows to freeze at the top of the Excel sheet.
- setFreezeRows(Integer) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets the number of rows to freeze (make non-scrollable) in the Excel sheet.
- setFulfillmentStatus(FulfillmentStatus) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setFunctionName(String) - Method in class com.northconcepts.datapipeline.jsonata.utils.Signature
- setGenerated(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Indicates if the column is a generated (computed) column.
- setGenerateIndexes(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreateH2DdlFromSchemaDef.schemaDef(default is true). - setGenerateIndexes(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreateMySqlDdlFromSchemaDef.schemaDef(default is true). - setGenerateIndexes(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreatePostgreSqlDdlFromSchemaDef.schemaDef(default is true). - setGenerateRelationships(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreateH2DdlFromSchemaDef.schemaDef(default is true). - setGenerateRelationships(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreateMySqlDdlFromSchemaDef.schemaDef(default is true). - setGenerateRelationships(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if DDL should be generated for indexes in the
CreatePostgreSqlDdlFromSchemaDef.schemaDef(default is true). - setGmtoff(Long) - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- setGrouping(QueryGrouping) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Replaces the GROUP BY fields;
nullinstalls an empty grouping. - SetGroupSequenceNumberField - Class in com.northconcepts.datapipeline.transform
-
Adds a sequence (auto increment) field that is incremented with the step value as long as the value(s) in the specified watch fields remain the same as the previous record.
- SetGroupSequenceNumberField(String, double, double, boolean, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
-
Creates a transformer that numbers the records of each group from
startin steps ofstep; whenoverwriteis false, records that already have the field keep their value. - SetGroupSequenceNumberField(String, double, double, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
-
Creates a transformer that numbers the records of each group from
startin steps ofstep, overwriting any existing value. - SetGroupSequenceNumberField(String, long, long, boolean, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
-
Creates a transformer that numbers the records of each group from
startin steps ofstep; whenoverwriteis false, records that already have the field keep their value. - SetGroupSequenceNumberField(String, long, long, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
-
Creates a transformer that numbers the records of each group from
startin steps ofstep, overwriting any existing value. - SetGroupSequenceNumberField(String, BigDecimal, BigDecimal, boolean, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
-
Creates a transformer that numbers the records of each group from
startin steps ofstep; whenoverwriteis false, records that already have the field keep their value. - SetGroupSequenceNumberField(String, BigDecimal, BigDecimal, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
-
Creates a transformer that numbers the records of each group from
startin steps ofstep, overwriting any existing value. - SetGroupSequenceNumberField(String, BigInteger, BigInteger, boolean, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
-
Creates a transformer that numbers the records of each group from
startin steps ofstep; whenoverwriteis false, records that already have the field keep their value. - SetGroupSequenceNumberField(String, BigInteger, BigInteger, String...) - Constructor for class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
-
Creates a transformer that numbers the records of each group from
startin steps ofstep, overwriting any existing value. - setHandles(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setHaving(QueryCriteria) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Replaces the HAVING criteria, changing its type to HAVING;
nullinstalls empty criteria. - setHeader(BloombergMessageHeader) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessage
- setHeaderTemplate(Template) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Sets the template written before the records; only allowed before the writer is opened.
- setHeaderTemplate(String) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
-
Sets the header template to the template with this name, loaded through
TemplateWriter.getConfiguration(). - setHref(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- setHttpProxyHost(String) - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Sets the HTTP proxy host, applied when the client is created on the first API call.
- setHttpProxyHost(String) - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Sets the HTTP proxy host, applied when the stream is created (when a reader is opened).
- setHttpProxyPort(Integer) - Method in class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Sets the HTTP proxy port, applied when the client is created on the first API call.
- setHttpProxyPort(Integer) - Method in class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Sets the HTTP proxy port, applied when the stream is created (when a reader is opened).
- setId(Long) - Method in class com.northconcepts.datapipeline.mailchimp.list.Tag
- setId(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setId(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- setId(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setIds(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- setIds(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItemCriteria
- setIds(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setIds(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setIds(String...) - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryItemReader
-
Sets the IDs of the inventory items to read, creating the criteria if none is set.
- setIgnoreEmptyText(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- setIgnoreEmptyText(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
- setIgnoreNamespaces(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if namespaces on elements and attributes are removed (defaults to true);
falseis not supported. - setIgnoreNamespaces(boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
- setIgnoreNamespaces(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Indicates if namespaces on elements and attributes are ignored when matching expressions (default to true).
- setIgnoreNamespaces(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if namespaces on elements and attributes are to be removed (default to true).
- setIgnoreOnError(boolean) - Method in class com.northconcepts.datapipeline.jdbc.insert.MySqlPreparedStatementInsert
-
Indicates if
INSERT IGNOREis generated instead of a plainINSERT(default is false). - setImageBytes(long) - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
-
Sets the total stream length in bytes of the images counted by
PdfDocumentStatistics.getImageCount(). - setImageCount(long) - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
-
Sets the number of images in the pages' resources; an image shared by several pages is counted once per page.
- setIncludeDirectories(boolean) - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
-
Indicates if directories are returned as records too, not just files (default is false).
- setIncludeElapsedTime(boolean) - Method in class com.northconcepts.datapipeline.core.DebugReader
-
Indicates if each record's header also shows how long this reader has been open (default is false).
- setIncludeElapsedTime(boolean) - Method in class com.northconcepts.datapipeline.core.DebugWriter
-
Indicates if each record's header also shows how long this writer has been open (default is false).
- setIncludeInOutcome(boolean) - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
-
Indicates if this field's definition (variable and expression, not its value) is listed under
fieldsin the decision outcome (default is false). - setIncludeSpamAndTrash(boolean) - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
- setIncludeTemplateMasterFormDef(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Indicates if each generated entity includes a TemplateMaster
FORM_DEFdescribing its columns (default false). - setIncludeTemplateMasterFormDef(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if each generated entity includes a TemplateMaster
FORM_DEFdescribing its columns (default false). - setIndentation(String) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Sets the text written once per indent level at the start of each line (defaults to two spaces).
- setIndentCount(int) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Sets the current indent level: how many times the indentation is written at the start of each line.
- setIndex(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Index of column in table (starting at 1).
- setIndex(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- setIndexDef(IndexDef) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
-
Sets the parent index; called by
IndexDefwhen this field is added to it. - setIndexes(List<IndexDef>) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Replaces the indexes with the given list (not copied) and makes this entity their parent.
- setIndexFields(List<IndexFieldDef>) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
-
Replaces the index fields with the given list (not copied) and makes this index their parent.
- setIndexName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- setIndexName(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Sets the index name.
- setIndexName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- setIndexName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- setIndexQualifier(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Sets the index catalog (JDBC
INDEX_QUALIFIER). - setInferStringTypes(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Indicates if string and undefined types should be analyzed to determine if they represent a numeric, boolean, or date/time value (default
true). - setInitialRetryDelay(long) - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Sets the amount of time to wait (in milliseconds) after the first error, before retrying (default 1 second).
- setInitialRetryDelay(long) - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Sets the amount of time to wait (in milliseconds) after the first error, before retrying (default 1 second).
- setInitialRetryDelay(long) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Sets the amount of time to wait (in milliseconds) after the first error, before retrying (default 1 second).
- setInitialRetryDelay(long) - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Sets the delay in milliseconds before the first retry of a rate-limited request (defaults to 1000).
- setInput(PipelineInput) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- setInput(PipelineInput) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setInput(PipelineInput) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setInputAsDataReader(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the input to a
DataReaderPipelineInputthat always returns the given reader instance. - setInputAsDataReader(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setInputAsDataReader(DataReader) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setInputAsDataReaderFactory(DataReaderFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the input to a
DataReaderPipelineInputthat creates its readers with the given factory. - setInputAsDataReaderFactory(DataReaderFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setInputAsDataReaderFactory(DataReaderFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setInsertFirst(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
-
Indicates if this upsert strategy should attempt an insert before and update (the default).
- setInsertSqlPrefix(String) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
-
Sets the SQL that precedes the rows of values; the SQL buffer is truncated back to its length after each execution.
- setInsertStatement(PreparedStatement) - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
-
Replaces the statement that values are bound to and executed on; for subclasses that prepare their own SQL.
- setInsertStatement(Statement) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- setInstanceCount(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Sets the number of times this path occurred in the document.
- setInt96FieldType(FieldType) - Method in class com.northconcepts.datapipeline.parquet.tools.GenerateSchemaDefFromParquet
-
Set
FieldTypefor int96 data type of Parquet. - setInterests(Map<String, Boolean>) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setInventoryItemCriteria(ShopifyInventoryItemCriteria) - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryItemReader
-
Sets the criteria for the inventory items to read or null for none; it is modified in place when later pages are requested.
- setInventoryItemIds(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryLevelCriteria
- setInventoryLevelCriteria(ShopifyInventoryLevelCriteria) - Method in class com.northconcepts.datapipeline.shopify.ShopifyInventoryLevelReader
-
Sets the criteria for the inventory levels to read or null for none; it is modified in place when later pages are requested.
- setIpOpt(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setIpSignup(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setIssuesRecord(Record) - Method in class com.northconcepts.datapipeline.jira.JiraReader
- setIssueType(int) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
-
Sets the issue type, identified by its numeric ID.
- setItalic(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Sets whether italic formatting is enabled.
- setJavaType(Class<?>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Sets the Java type for the column's values, normally chosen by
JdbcConnection.loadQueries(). - setJavaType(Class<?>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- setJavaType(Class<?>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the Java type for the column's values, normally chosen when the table's columns are loaded.
- setJavaTypeOverride(String, Class<?>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Uses the given Java type for table and query columns of this database type name instead of the
mapper's choice. - setJdbcConnectionFactory(JdbcConnectionFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- setJdbcConnectionFactory(JdbcConnectionFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- setJdbcConnectionFactory(Connection) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Uses the given connection for every reader this input creates.
- setJdbcConnectionFactory(Connection) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Uses the given connection for every writer this output creates.
- setJdbcConnectionFactory(DataSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Obtains a new connection from the data source for each reader this input creates.
- setJdbcConnectionFactory(DataSource) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Obtains a new connection from the data source for each writer this output creates.
- setJdbcType(Class<?>, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Forces field values of the specified Java class type to be sent to the database using
PreparedStatement.setObject(parameterIndex, fieldValue, jdbcType)(instead of the appropriatePreparedStatement.setXXX()method for its field's type). - setJdbcType(Class<?>, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
Forces field values of the specified Java class type to be sent to the database using
PreparedStatement.setObject(parameterIndex, fieldValue, jdbcType)(instead of the appropriatePreparedStatement.setXXX()method for its field's type). - setJdbcType(Class<?>, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Forces field values of the specified Java class type to be sent to the database using
PreparedStatement.setObject(parameterIndex, fieldValue, jdbcType)(instead of the appropriatePreparedStatement.setXXX()method for its field's type). - setJdbcType(Class<?>, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Forces field values of the specified Java class type to be sent to the database using
PreparedStatement.setObject(parameterIndex, fieldValue, jdbcType)(instead of the appropriatePreparedStatement.setXXX()method for its field's type). - setJdbcType(String, int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
The given Java object will be converted to the given targetSqlType before being sent to the database.
- setJdbcType(String, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
The given Java object will be converted to the given targetSqlType before being sent to the database.
- setJdbcType(String, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
-
The given Java object will be converted to the given targetSqlType before being sent to the database.
- setJdbcType(String, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
The given Java object will be converted to the given targetSqlType before being sent to the database.
- setJdbcType(String, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Forces the specified field's values to be sent to the database using
PreparedStatement.setObject(parameterIndex, fieldValue, jdbcType)(instead of the appropriatePreparedStatement.setXXX()method for its field's type). - setJndiFactoryName(String) - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Indicates the JNDI name to use when looking up the ConnectionFactory (defaults to "ConnectionFactory").
- setJobExecutor(Executor) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- setJql(String) - Method in class com.northconcepts.datapipeline.jira.JiraSearch
- setJsonFactory(T) - Method in class com.northconcepts.datapipeline.google.GoogleApiReader
-
Assigns the shared JSON factory to the given Google model object unless it already has one, and returns the object.
- setKeepPolling(boolean) - Method in class com.northconcepts.datapipeline.kafka.KafkaReader
-
Indicates if the reader keeps polling while no messages arrive instead of ending after an empty poll (default is true).
- setKey(String) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
- setKeySequence(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Sets this column's 1-based position within the foreign key.
- setLanguage(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setLanguage(String...) - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- setLargeCellHandler(LargeCellHandler) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets how text values longer than
ExcelWriter.MAX_CELL_LENGTHcharacters are handled; null restores the defaultLargeCellHandler.FAIL. - setLargeCellHandler(LargeCellHandler) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets how text values longer than an Excel cell's 32,767 characters are handled (defaults to
LargeCellHandler.FAIL). - setLastChanged(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setLastException(Throwable) - Method in class com.northconcepts.datapipeline.retry.RetryContext
- setLastFieldConsumesRemaining(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
-
Set whether the last field in each record will contain the rest of each line.
- setLastFieldConsumesRemaining(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Indicates if the last field takes the rest of each line regardless of its width (defaults to false).
- setLastName(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setLastRow(int) - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Sets the 0-based index of the last row to read or -1 to read to the end (default is -1).
- setLastRow(int) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- setLastRow(int) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- setLastRow(int) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- setLastRow(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets the 0-based index of the last row to read or a negative value to read to the end of the sheet (defaults to -1).
- setLastRow(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- setLatitude(double) - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
-
Sets the latitude of the location to search for; must be called before
InstagramLocationMediaReader.open(). - setLatitude(double) - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationReader
-
Sets the latitude of the location to search for; must be called before
InstagramLocationReader.open(). - setLatitude(Long) - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- setLatitude(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setLength(Integer) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets the column length.
- setLength(Integer) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Sets the length or precision written after the type, or null for none; ignored if the type does not support one.
- setLength(Integer) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Sets the length or precision written after the type, or null for none; ignored if the type does not support one.
- setLengthSum(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the total string length of the non-null values.
- setLenient(boolean) - Method in class com.northconcepts.datapipeline.transform.SelectFields
-
Indicates if fields missing from a record are skipped instead of causing an exception (default is false).
- setLenientPattern(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
Indicates if values are parsed leniently with the pattern (defaults to true).
- setLimit(long) - Method in class com.northconcepts.datapipeline.core.LimitReader
-
Sets the maximum number of records to return after the offset.
- setLimit(Long) - Method in class com.northconcepts.datapipeline.core.LimitReader
-
Sets the maximum number of records to return after the offset; null for no limit.
- setLimitToAllowedValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setLimitToAllowedValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setLimitToAllowedValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Indicates if values must be one of
FieldDef.getAllowedValues()to pass validation (defaults to false). - setLimitToAllowedValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setLimitToAllowedValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setLimitToAllowedValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setLimitToAllowedValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setLimitToAllowedValues(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setLineSeparator(String) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Indicates the string used to separate records.
- setLineSeparatorAsCsvEscaped(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Sets the line separators from a comma-separated list of Java-escaped strings; blank restores the defaults.
- setLineSeparators(char[][]) - Method in class com.northconcepts.datapipeline.core.LineParser
-
Sets the separators that end a line, checked in array order; null ends lines like
BufferedReader.readLine(). - setLineSeparators(String...) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Indicates the string or strings used to separate records.
- setLineSeparators(String[]) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Sets the strings that separate records (defaults to LF, CRLF and CR).
- setLinks(List<Link>) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setLinks(List<Link>) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- setListener(JdbcConnectionListener) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Sets the listener notified as
JdbcConnection.loadTables(LoadTablesRequest)progresses; null installs a no-op listener. - setListFilter(ListFilter) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardListsReader
-
Sets which of the board's lists are read; null means
ListFilter.OPEN, the default. - setListId(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setListId(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- setListIdField(String) - Method in class com.northconcepts.datapipeline.trello.TrelloCardWriter
-
Sets the name of the record field holding the ID of the list to add the card to (defaults to
"listId"). - setLists(BoardLists) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
-
Sets which of each board's lists are requested; null means
BoardLists.NONE, the default. - setLoadColumns(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Indicates if each table's columns, primary key and row identifiers are loaded too, which also runs a
SELECTreturning no rows on each table (default is true). - setLoadExportedKeys(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Indicates if the foreign keys referencing each table (exported keys) are loaded (default is true).
- setLoadImportedKeys(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Indicates if each table's foreign keys to other tables (imported keys) are loaded (default is true).
- setLoadIndexes(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Indicates if each table's indexes are loaded (default is true).
- setLocation(Location) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setLocationIds(String...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryLevelCriteria
- setLocations(double[]...) - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- setLogWriter(DataWriter) - Method in class com.northconcepts.datapipeline.job.AbstractJob
- setLogWriter(DataWriter) - Method in class com.northconcepts.datapipeline.job.Job
-
Sets the writer that receives this job's statistics, one record per pipeline endpoint, when the job finishes and after each
Job.log()request; the job opens and closes it. - setLongitude(double) - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationMediaReader
-
Sets the longitude of the location to search for; must be called before
InstagramLocationMediaReader.open(). - setLongitude(double) - Method in class com.northconcepts.datapipeline.instagram.InstagramLocationReader
-
Sets the longitude of the location to search for; must be called before
InstagramLocationReader.open(). - setLongitude(Long) - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- setLongitude(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setLookupByScreenName(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Indicates if users are looked up by the screen name in the source field instead of by ID (default is false).
- setMakeIdentifiersSingular(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
- setMakeIdentifiersSingular(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Indicates if entity class names are made singular, such as
Customerfor acustomerstable (default false). - setMakeIdentifiersSingular(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if entity class names are made singular, such as
Customerfor acustomerstable (default false). - setMakeOptionalFieldsRequired(boolean) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if top-level optional columns with no nulls and equal min/max statistics may be read as required (default is false).
- setMakeOptionalFieldsRequired(boolean) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Used whether to check for
optionalcolumns that can be maderequiredusingduringinvalid reference
ColumnChunkMetaData#getStatistics()ParquetDataReader.open(). - setMakeRequiredFieldsOptional(boolean) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if top-level required columns whose statistics report nulls are read as optional (default is false).
- setMakeRequiredFieldsOptional(boolean) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
When true, check for
requiredcolumns that can be madeoptionalusing.invalid reference
ColumnChunkMetaData#getStatistics() - setMapping(List<CopyFieldsAction.FieldMapping>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- setMapping(List<RenameFieldsAction.FieldMapping>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- setMapping(Map<String, ConvertNullToValueAction.TypeValue>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
-
Sets the replacement value and type for each field name; null clears them.
- setMapping(Map<String, AddFieldsAction.TypeValue>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
-
Sets the value and type to set for each field name; null clears them.
- setMapping(Map<String, String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
-
Sets the regular expression each field's whole value must match, keyed by field name; null clears them.
- setMapping(Map<String, String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
-
Sets the sort direction (
"ascending"or"descending") for each field name, in sort-key order; null clears them. - setMapping(Map<String, String>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
-
Sets the regular expression each field's whole value must match, keyed by field name; null clears them.
- setMapTextRecordsToFields(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
-
Indicates if text-only elements become simple values instead of nested records with a
$textfield (defaults to true). - setMapTextRecordsToFields(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Indicates if elements holding only text (or nothing) become plain field values (or null) instead of nested records (default is true).
- setMaxBufferSizeInBytes(long) - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Sets the estimated size in bytes of buffered records at which the background thread pauses reading (defaults to 512 KB, minimum
AsyncReader.MINIMUM_BUFFER_SIZE). - setMaxColumnStatsRecords(Long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
The number of records to use when calculating column stats or
nullfor all records (defaultnull). - setMaxColumnsToAnalyze(Integer) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Defines the first N columns to analyze for stats for column stats.
- setMaxErrorCount(long) - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Sets the number of retries allowed across all read attempts (default max long -1).
- setMaxErrorCount(long) - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Sets the number of retries allowed across all read attempts (default max long -1).
- setMaxErrorCount(long) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Sets the number of retries allowed across all write attempts (default max long -1).
- setMaxId(long) - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
-
Searches for tweets with IDs less than the specified ID (i.e.
- setMaximum(Number) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
Sets the optional largest number (inclusive) allowed in values of this field.
- setMaximum(TemporalAccessor) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
Sets the optional latest value (inclusive) allowed in this field; use a
LocalDate,LocalTimeorLocalDateTimefor DATE, TIME or DATETIME fields respectively. - setMaximumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setMaximumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setMaximumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the maximum number of array elements allowed; a non-null value makes this field an array.
- setMaximumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setMaximumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setMaximumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setMaximumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setMaximumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setMaximumLength(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the longest string length of the non-null values (-1 if there were none).
- setMaximumLength(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
Sets the optional most number of characters in values of this field; negative values are set to the max integer and zero (0) means values must be empty.
- setMaximumLength(Long) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
-
Sets the optional most number of bytes in values of this field; negative values are set to the max long and zero (0) means values must be empty.
- setMaximumNameLength(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DateTimeNodeNameRule
-
Sets the longest name this rule will attempt to parse as a date/timestamp (default 40) and clears the cached results.
- setMaxInvalidRecords(int) - Method in class com.northconcepts.datapipeline.avro.AvroReader
-
Indicates the number of broken Avro records to skip before this reader should fail (default 1000).
- setMaxInvalidRecords(int) - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
-
Indicates the number of broken Avro records to skip before this reader should fail (default 1000).
- setMaxItems(long) - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Indicates the maximum number of items to return.
- setMaxRecordsAnalyzed(Long) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates how many records should be analyzed and cached to generate the Parquet schema if no schema was explicitly set on this writer (default is 1000).
- setMaxRecordsAnalyzed(Long) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates how many records should be analyzed and cached to generate the Parquet schema if no schema was explicitly set on this writer (default is 1000).
- setMaxResults(int) - Method in class com.northconcepts.datapipeline.jira.JiraSearch
-
Sets the number of issues requested per page (defaults to 50).
- setMaxResults(int) - Method in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
-
Indicates the maximum number of records that will be obtained by the endpoint.
- setMaxRetryCount(int) - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Sets the number of retries allowed for any individual read attempt (default 5).
- setMaxRetryCount(int) - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Sets the number of retries allowed for any individual read attempt (default 5).
- setMaxRetryCount(int) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Sets the number of retries allowed for any individual write attempt (default 5).
- setMaxRetryCount(int) - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Sets the maximum number of attempts, including the first, for a rate-limited request (defaults to 5).
- setMaxWaitTimeMillis(long) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Sets the maximum milliseconds to wait for the sample records to load, and again for their column statistics; must be positive (defaults to 10000).
- setMeasure(RecordMeter.MeterUnit) - Method in class com.northconcepts.datapipeline.meter.RecordMeter
-
Sets whether each record adds its estimated size in bytes or one to the count (defaults to BYTES).
- setMeasure(RecordMeter.MeterUnit) - Method in class com.northconcepts.datapipeline.throttle.ThrottledReader
-
Sets whether the limit counts records or their estimated size in bytes (defaults to BYTES).
- setMeasure(RecordMeter.MeterUnit) - Method in class com.northconcepts.datapipeline.throttle.ThrottledWriter
-
Sets whether the limit counts records or their estimated size in bytes (defaults to BYTES).
- setMemberId(String) - Method in class com.northconcepts.datapipeline.trello.TrelloBoardsReader
-
Sets the ID of the member whose boards are read; null or empty means
"me", the default. - setMemberRating(Long) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setMembers(List<ListMember>) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- setMergeCondition(String) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- setMergeCondition(String) - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- setMergeCondition(String) - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- setMergeFields(Map<String, Object>) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setMessage(String) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- setMethod(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- setMinimum(Number) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
Sets the optional smallest number (inclusive) allowed in values of this field.
- setMinimum(TemporalAccessor) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
Sets the optional earliest value (inclusive) allowed in this field; use a
LocalDate,LocalTimeorLocalDateTimefor DATE, TIME or DATETIME fields respectively. - setMinimumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setMinimumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setMinimumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the minimum number of array elements allowed; a non-null value makes this field an array.
- setMinimumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setMinimumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setMinimumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setMinimumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setMinimumElements(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setMinimumLength(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the shortest string length of the non-null values (-1 if there were none).
- setMinimumLength(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
Sets the optional least number of characters in values of this field; negative values are set to zero (0).
- setMinimumLength(Long) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
-
Sets the optional least number of bytes in values of this field; negative values are set to zero (0).
- setMinimumSiblings(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.AffixSiblingSetRule
-
Sets the minimum number of pattern-sharing siblings required to derive a pattern (default 3, at least 2).
- setMinimumSiblings(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
-
Sets the minimum number of structurally similar siblings required to derive a pattern (default 3, at least 2).
- setMinimumSimilarity(double) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
-
Sets the minimum Jaccard overlap between sibling structural signatures (default 0.75; greater than 0, at most 1).
- setMinRecords(long) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Sets the number of records to sample before generating the entity; must be positive (defaults to 1000).
- setMultithreaded(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Indicates if each processing stage runs in its own thread using an
AsyncReader(defaults to true). - setMultithreaded(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setMultithreaded(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setMuteUser(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
-
Indicates if each followed user is also muted (default is false).
- setMuteUser(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
-
Indicates if each unfollowed user is also muted (default is false).
- setName(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- setName(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- setName(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- setName(String) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets the name of this field.
- setName(String) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Assigns a new name to this bus.
- setName(String) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.core.Property
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.difference.PropertyDiff
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.difference.RecordDiff
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Sets the column label: its
ASalias, or its name when there is none. - setName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setName(String) - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Assigns a new name to this job.
- setName(String) - Method in interface com.northconcepts.datapipeline.job.IJob
-
Assigns a new name to this job.
- setName(String) - Method in class com.northconcepts.datapipeline.job.Job
-
Assigns a new name to this job.
- setName(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.Tag
- setName(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setName(String) - Method in class com.northconcepts.datapipeline.sql.h2.TableColumn
-
Sets the column name.
- setName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.TableColumn
- setName(String) - Method in class com.northconcepts.datapipeline.xml.XmlField
- setNameField(String) - Method in class com.northconcepts.datapipeline.trello.TrelloCardWriter
-
Sets the name of the record field holding the card name (defaults to
"name"). - setNameFromPath() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Sets the name to the file name at the end of the path.
- setNameFromPath() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- setNameFromPath() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- setNamePattern(SiblingSetPattern) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Sets the naming pattern this wildcard node was collapsed down from; it is never serialized.
- setNegative(boolean) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- setNestedAlias(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySource
-
Sets the alias written after this source in a FROM clause (
nullfor none). - setNestedAlias(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- setNestedAlias(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- setNestedAlias(String) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- setNestedDataReader(DataReader) - Method in class com.northconcepts.datapipeline.core.ProxyReader
-
Make sure to close old target and open the new one or call with
true. - setNestedDataReader(DataReader, boolean) - Method in class com.northconcepts.datapipeline.core.ProxyReader
-
Replaces the nested reader; with
manageLifecyclethe old reader is closed and, if this proxy is open, the new one is opened. - setNestedDataWriter(DataWriter) - Method in class com.northconcepts.datapipeline.core.ProxyWriter
-
Make sure to close old target and open the new one or call
ProxyWriter.setNestedDataWriter(DataWriter, boolean)withtrue. - setNestedDataWriter(DataWriter, boolean) - Method in class com.northconcepts.datapipeline.core.ProxyWriter
-
Replaces the nested writer; with
manageLifecyclethe old writer is closed and, if this proxy is open, the new one is opened. - setNestedLookup(Lookup) - Method in class com.northconcepts.datapipeline.transform.lookup.ProxyLookup
- setNewLine(String) - Method in class com.northconcepts.datapipeline.core.LinedTextWriter
-
Assigns the string used between each line (defaults to "\n" on Linux and "\r\n" on Windows).
- setNewLine(String) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Assigns the string used between each line (defaults to "\n" on Linux and "\r\n" on Windows).
- setNewLine(String) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
- setNewLine(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Sets the string written after each record (defaults to the system line separator).
- setNewLine(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Sets the string written after each record (defaults to the system line separator).
- setNewLine(String) - Method in class com.northconcepts.datapipeline.texttable.TextTableWriter
-
Assigns the string used between each line (defaults to "\n" on Linux and "\r\n" on Windows).
- setNewLineEscaped(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Sets the line separator from its Java-escaped form, as serialized.
- setNewValue(Record) - Method in class com.northconcepts.datapipeline.foundations.difference.RecordDiff
- setNewValue(Object) - Method in class com.northconcepts.datapipeline.foundations.difference.PropertyDiff
- setNewValue(T) - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- setNextPageToken(String) - Method in class com.northconcepts.datapipeline.jira.JiraSearch
-
Sets the token of the next page of results to request;
JiraIssueReaderupdates it after each page. - setNonPrettyLineSeparator(String) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Sets the text written between lines when pretty printing is off (defaults to a single space).
- setNonUnique(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Indicates if the index allows duplicate values (it is not a unique index).
- setNonUpdateFields(FieldList) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Assigns the list of fields that must not be updated if the recored already exists (default null).
- setNonUpdateFields(FieldList) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Assigns the list of fields that must not be updated if the recored already exists (default null).
- setNonUpdateFields(String...) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
-
Assigns the list of fields that must not be updated if the recored already exists (default null).
- setNonUpdateFields(String...) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Assigns the list of fields that must not be updated if the record already exists (default null).
- setNull(int, FieldType) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Replaces the element at the specified index with a typed
nullvalue. - setNull(FieldType) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to null with the given type; a null
typekeeps the type of the value it replaces. - setNullable(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Indicates if the column is known to allow nulls (false when the driver reports no nulls or unknown).
- setNullable(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Indicates if the column is known to allow nulls (false when the database reports no nulls or unknown).
- setNullable(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets whether the column is nullable.
- setNullable(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Indicates if the column accepts nulls;
NOT NULLis written when false (default true). - setNullable(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Indicates if the column accepts nulls;
NOT NULLis written when false (default true). - setNullCount(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- setNullsFirst(Boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryOrderPart
-
Indicates if nulls sort first (
NULLS FIRST) or last (NULLS LAST);null, the default, adds neither. - setNullValueFieldTypes(ConcurrentSkipListMap<FieldType, LongAdder>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- setNullValuePolicy(CSVWriter.IValuePolicy) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Assigns the object responsible for writing null values (defaults to ValuePolicy.EMPTY_STRING).
- setNullValuePolicy(CSVWriter.ValuePolicy) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Sets how null values are written (defaults to
CSVWriter.ValuePolicy.EMPTY_STRING, an unquoted blank). - setNumberDescriptor(NumberDescriptor) - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
- setNumberDescriptor(NumberDescriptor) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the sign and digit counts that fit every number recognized in string values.
- setNumberDetector(NumberDetector) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the detector a
Datasetbuilt on this pipeline uses to infer numeric values in text columns; null restores the default detector. - setObjectWrapper(ObjectWrapper) - Method in class com.northconcepts.datapipeline.template.ArrayTemplateModel
- setObjectWrapper(ObjectWrapper) - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePair
- setObjectWrapper(ObjectWrapper) - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePairIterator
- setObjectWrapper(ObjectWrapper) - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- setOffset(long) - Method in class com.northconcepts.datapipeline.core.LimitReader
-
Sets the number of leading records to skip.
- setOffset(Long) - Method in class com.northconcepts.datapipeline.core.LimitReader
-
Sets the number of leading records to skip; null skips none.
- setOldValue(Record) - Method in class com.northconcepts.datapipeline.foundations.difference.RecordDiff
- setOldValue(Object) - Method in class com.northconcepts.datapipeline.foundations.difference.PropertyDiff
- setOldValue(T) - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- setOnDeleteAction(ForeignKeyAction) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- setOnDeleteAction(ForeignKeyAction) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the ON DELETE action.
- setOnDeleteAction(ForeignKeyAction) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Sets the
ON DELETEaction; null omits the clause (the default). - setOnDeleteAction(ForeignKeyAction) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Sets the
ON DELETEaction; null omits the clause (the default). - setOnUpdateAction(ForeignKeyAction) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- setOnUpdateAction(ForeignKeyAction) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the ON UPDATE action.
- setOnUpdateAction(ForeignKeyAction) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Sets the
ON UPDATEaction; null omits the clause (the default). - setOnUpdateAction(ForeignKeyAction) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Sets the
ON UPDATEaction; null omits the clause (the default). - setOptimizeTreeStructure(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Indicates if dynamic names should collapse tree nodes together while the tree is being built (default false); unlike
TreeDetectionStrategy.standard(boolean), it does not add anOptimizeTreeStructurepass. - setOrder(QueryOrder) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Replaces the ORDER BY fields;
nullinstalls an empty ordering. - setOrderBy(String) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Sets the order in which events are requested (defaults to
"startTime"). - setOrderByField(JiraProjectReader.OrderByField) - Method in class com.northconcepts.datapipeline.jira.JiraProjectReader
-
Indicates the returned issue sort order.
- setOrderCriteria(ShopifyOrder) - Method in class com.northconcepts.datapipeline.shopify.ShopifyOrderReader
-
Sets the criteria for the orders to read or null for none; it is modified in place when later pages are requested.
- setOrdinalPosition(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
-
Sets the column's 1-based position within the index.
- setOriginalFieldIndex(int) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The index of a field set by the DataReader before any transformation or operation was performed.
- setOriginalFieldName(String) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The name of a field set by the DataReader before any transformation or operation was performed.
- setOutcome(Record) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableResult
-
Sets the fields set by the fired rule's outcomes, or by the default outcomes if no rule fired.
- setOutput(PipelineOutput) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- setOutput(PipelineOutput) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setOutput(PipelineOutput) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setOutputAsDataWriter(DataWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the output to a
DataWriterPipelineOutputthat always returns the given writer instance. - setOutputAsDataWriter(DataWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setOutputAsDataWriter(DataWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setOutputAsDataWriterFactory(DataWriterFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the output to a
DataWriterPipelineOutputthat creates its writers with the given factory. - setOutputAsDataWriterFactory(DataWriterFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setOutputAsDataWriterFactory(DataWriterFactory) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setOverwrite(boolean) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableReader
-
Indicates if outcome fields replace existing non-null fields with the same name instead of being added under a numbered name (default false).
- setOverwrite(boolean) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableWriter
-
Indicates if outcome fields replace existing non-null fields with the same name instead of being added under a numbered name (default false).
- setOverwrite(boolean) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeReader
-
Indicates if outcome fields replace existing non-null fields with the same name instead of being added under a numbered name (default false).
- setOverwrite(boolean) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeWriter
-
Indicates if outcome fields replace existing non-null fields with the same name instead of being added under a numbered name (default false).
- setOverwrite(boolean) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Overwrites the file if true, otherwise, throws an exception if the file already exists.
- setOverwrite(boolean) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Overwrites the file if true, otherwise, throws an exception if the file already exists.
- setPackage(String) - Method in class com.northconcepts.datapipeline.sourcecode.JavaCodeBuilder
-
Sets the package declared in the generated source; set it before
JavaCodeBuilder.addImport(Class)so classes in it are not imported. - setPage(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
-
Sets the 0-based page number.
- setPageCount(long) - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
- setPageOffset(int) - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Indicates the first offset to start returning.
- setPageOffset(long) - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
-
Sets the offset of the next page to request (defaults to 0); it grows by the number of members in each page read.
- setPageOrientation(MicrosoftWordWriter.PageOrientation) - Method in class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
-
Specifies the page orientation for the Word document (default
MicrosoftWordWriter.PageOrientation.PORTRAIT). - setPageOrientation(MicrosoftWordWriter.PageOrientation) - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
-
Specifies the page orientation for the Word document (default
MicrosoftWordWriter.PageOrientation.PORTRAIT). - setPageOrientation(PdfWriter.PageOrientation) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
-
Specifies the page orientation for the PDF document (default
PdfWriter.PageOrientation.PORTRAIT). - setPageOrientation(PdfWriter.PageOrientation) - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
-
Specifies the page orientation for the PDF document (default
PdfWriter.PageOrientation.PORTRAIT). - setPages(long) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Sets the number of pages the index uses, or the table uses for a
tableIndexStatisticentry. - setPageSize(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
- setPageSize(long) - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
-
Sets the number of members requested per page (defaults to 10).
- setPageSize(MicrosoftWordWriter.PageSize) - Method in class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
-
Specifies the page size for the Word document (default
MicrosoftWordWriter.PageSize.LETTER). - setPageSize(MicrosoftWordWriter.PageSize) - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
-
Specifies the page size for the Word document (default
MicrosoftWordWriter.PageSize.LETTER). - setPageSize(PdfWriter.IPageSize) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
-
Specifies the page size for the PDF document.
- setPageSize(PdfWriter.IPageSize) - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
-
Specifies the page size for the PDF document.
- setPageSize(String) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
-
Specifies the page size for the PDF document using a CSS
page/sizestring value. - setPageSize(String) - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
-
Specifies the page size for the PDF document using a CSS
page/sizestring value. - setParameters(Object[]) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Sets the values bound, in order, to the query's
?placeholders or null to run it as a plain statement. - setParameters(Collection<JdbcQueryParameter>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Replaces the parameters, given in the order of the query's
?placeholders; null clears them. - setParameterSqlTypes(int[]) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Sets the
Typescode of each parameter, in the same order, or null to bind them without a type. - setParameterValue(Field, int, PreparedStatement) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Sets statement parameter
fieldIndex + 1from the field, honoring any JDBC type assigned withsetJdbcType. - setParameterValue(Field, int, PreparedStatement, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
-
Sets the 1-based statement parameter from the field, honoring any JDBC type assigned with
setJdbcType;fieldIndexis only used in error details. - setParameterValue(Field, PreparedStatement, int) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
-
Sets the 1-based statement parameter from the field, honoring any JDBC type assigned with
setJdbcType. - setParent(TreeNode) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Sets the parent reference only; use
TreeNode.addChild(TreeNode)to also add this node to the parent's children. - setParent(String) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
-
Sets the parent issue, identified by its key.
- setParentNode(Node) - Method in class com.northconcepts.datapipeline.core.Record
- setParentNode(Node) - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Sets the parent node of this value node.
- setParseFieldNamesAsFieldPath(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
-
Indicates if each added source and target field name in the mappings should be treated as a
FieldPathexpression and parsed (when true, the default) or as a literal and used as a name, exactly as-is without parsing (when false). - setParseFieldNamesAsFieldPath(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
-
Indicates if each added field name in the mappings should be treated as a
FieldPathexpression and parsed (when true, the default) or as a literal and used as a name, exactly as-is without parsing (when false). - setParseFieldNamesAsFieldPath(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
-
Indicates if each source field name in the mappings should be treated as a
FieldPathexpression and parsed (when true, the default) or as a literal and used as a name, exactly as-is without parsing (when false). - setPassword(String) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
-
Sets the password used to open the PDF or null for none; it is serialized as plain text.
- setPasswordEncoder(Encoder<String, String>) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Sets the encoder used to store the password (defaults to
Encoder.HEX); null stores it as plain text. - setPath(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Sets the key of this file's object within its bucket.
- setPath(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- setPath(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- setPath(String) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
-
Sets the path of the local file, clearing the cached file and detected file type.
- setPath(String) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- setPath(String) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- setPattern(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
-
Sets the
SimpleDateFormatpattern used to format the values; if blank, each value's default string form is used. - setPattern(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
-
Sets the
DecimalFormatpattern used to format the values; if blank, each value's default string form is used. - setPattern(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
-
Sets the
SimpleDateFormatpattern used to parse the values. - setPattern(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
-
Sets the
DecimalFormatpattern used to parse the values; if blank, the type's standard parsing is used. - setPattern(String) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
Sets the
DecimalFormatpattern used to parse non-numeric values during mapping; null disables parsing. - setPattern(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
Sets the
DateTimeFormatterpattern used to parse non-temporal values during mapping; null disables parsing. - setPattern(String) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
The optional regular expression pattern to use when parsing incoming values during validation (not used during mapping).
- setPattern(String) - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePattern
-
Sets the date-time pattern for case-insensitive parsing.
- setPattern(Pattern) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
The optional regular expression pattern to use when parsing incoming values during validation (not used during mapping).
- setPersonFields(String) - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
-
Sets the comma-separated person fields requested for each contact.
- setPhone(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setPipeline(AbstractPipeline) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- setPipeline(AbstractPipeline) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
- setPipeline(AbstractPipeline) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MemoryDataset
- setPipeline(AbstractPipeline) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.MvStoreDataset
- setPipeline(Pipeline) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- setPipeline(Pipeline) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
-
Sets the pipeline this action belongs to; called by
Pipelinewhen the action is added to it. - setPipeline(Pipeline) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- setPlainTextPassword(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Encodes the password with the
password encoderand stores it. - setPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the zero-based position of this field in the data or null to locate it by name; mapping renames the field found at this position to this field's name.
- setPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setPrecision(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
Sets the most digits (the
BigDecimalprecision) values may have during validation; null for no limit. - setPretty(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Indicates if line breaks and indentation are added to the output (defaults to false).
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if line breaks and indentation are added to the output (defaults to false).
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.delete.Delete
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.insert.Insert
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySource
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Union
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.SqlPart
-
Indicates if
SqlPart.getSqlFragment()adds line breaks and indentation instead of using one line (default is false). - setPretty(boolean) - Method in class com.northconcepts.datapipeline.jdbc.sql.update.Update
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.json.JsonRecordWriter
-
Indicates if line breaks and indentations should be added to output (default false).
Example output (pretty = true):
[
{
"country":"Philippines"
,"capital":"Manila"
}
]
Example output (pretty = false):
[{"country":"Philippines","capital":"Manila"}]
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.json.SimpleJsonWriter
-
Indicates if line breaks and indentations should be added to output (default false).
Example output (pretty = true):
[
{
"country":"Philippines"
,"capital":"Manila"
}
]
Example output (pretty = false):
[{"country":"Philippines","capital":"Manila"}]
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Indicates if output is split into indented lines instead of joined by the non-pretty separator (default is true).
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
ALTER TABLE products
ADD CONSTRAINT fk_products_product_groups FOREIGN KEY (product_group_id)
REFERENCES product_groups
ON DELETE CASCADE
ON UPDATE CASCADE
Example output (pretty = false):
ALTER TABLE products ADD CONSTRAINT fk_products_product_groups FOREIGN KEY (product_group_id) REFERENCES product_groups ON DELETE CASCADE ON UPDATE CASCADE - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateH2DdlFromSchemaDef
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
CREATE TABLE IF NOT EXISTS table_name (
id bigint,
email text
PRIMARY KEY (user_id)
);
Example output (pretty = false):
CREATE TABLE IF NOT EXISTS table_name (id bigint, email text, PRIMARY KEY (user_id)); - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
CREATE TABLE IF NOT EXISTS table_name (
user_id int,
email text
PRIMARY KEY (user_id)
)
Example output (pretty = false):
CREATE TABLE IF NOT EXISTS table_name (user_id int, email text, PRIMARY KEY (user_id)) - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.DropTableConstraint
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
-
Indicates if line breaks and indentations should be added to output insert statement (default false).
Example output (pretty = true):
INSERT INTO `tableName` (`col1`, `col2`, `col3`)
VALUES (val1, val2, val3), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.Insert
-
Indicates if line breaks and indentations should be added to output insert statement (default false).
Example output (pretty = true):
INSERT INTO `tableName` (`col1`, `col2`, `col3`)
VALUES (val1, val2, val3), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.Upsert
-
Indicates if line breaks and indentations should be added to output upsert statement (default false).
Example output (pretty = true):
INSERT INTO `tableName` (`col1`, `col2`)
VALUES (val1, val2), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
ALTER TABLE products
ADD CONSTRAINT fk_products_product_groups FOREIGN KEY (product_group_id)
REFERENCES product_groups
ON DELETE CASCADE
ON UPDATE CASCADE
Example output (pretty = false):
ALTER TABLE products ADD CONSTRAINT fk_products_product_groups FOREIGN KEY (product_group_id) REFERENCES product_groups ON DELETE CASCADE ON UPDATE CASCADE - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateMySqlDdlFromSchemaDef
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
CREATE TABLE IF NOT EXISTS table_name (
id bigint,
email text
PRIMARY KEY (user_id)
);
Example output (pretty = false):
CREATE TABLE IF NOT EXISTS table_name (id bigint, email text, PRIMARY KEY (user_id)); - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
CREATE TABLE IF NOT EXISTS table_name (
user_id int,
email text
PRIMARY KEY (user_id)
)
Example output (pretty = false):
CREATE TABLE IF NOT EXISTS table_name (user_id int, email text, PRIMARY KEY (user_id)) - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTableConstraint
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.Insert
-
Indicates if line breaks and indentations should be added to output insert statement (default false).
Example output (pretty = true):
INSERT INTO `tableName` (`col1`, `col2`, `col3`)
VALUES (val1, val2, val3), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
-
Indicates if line breaks and indentations should be added to output insert statement (default false).
Example output (pretty = true):
INSERT INTO `tableName` (`col1`, `col2`, `col3`)
VALUES (val1, val2, val3), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlUpsertWriter
-
Indicates if line breaks and indentations should be added to output upsert statement (default false).
Example output (pretty = true):
INSERT INTO `tableName` (`col1`, `col2`)
VALUES (val1, val2), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.Upsert
-
Indicates if line breaks and indentations should be added to output upsert statement (default false).
Example output (pretty = true):
INSERT INTO `tableName` (`col1`, `col2`)
VALUES (val1, val2), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
ALTER TABLE "products"
ADD CONSTRAINT "fk_products_product_groups" FOREIGN KEY ("product_group_id")
REFERENCES "product_groups"
ON DELETE CASCADE
ON UPDATE CASCADE
Example output (pretty = false):
ALTER TABLE "products" ADD CONSTRAINT "fk_products_product_groups" FOREIGN KEY ("product_group_id") REFERENCES "product_groups" ON DELETE CASCADE ON UPDATE CASCADE - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreatePostgreSqlDdlFromSchemaDef
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
CREATE TABLE IF NOT EXISTS table_name (
id serial,
email text
PRIMARY KEY (user_id)
);
Example output (pretty = false):
CREATE TABLE IF NOT EXISTS table_name (id serial, email text, PRIMARY KEY (user_id)); - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
-
Indicates if line breaks and indentations should be added to output DDL (default false).
Example output (pretty = true):
CREATE TABLE IF NOT EXISTS "table_name" (
"user_id" serial,
"email" text
PRIMARY KEY ("user_id")
)
Example output (pretty = false):
CREATE TABLE IF NOT EXISTS "table_name" ("user_id" serial, "email" text, PRIMARY KEY ("user_id")) - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.Insert
-
Indicates if line breaks and indentations should be added to output insert statement (default false).
Example output (pretty = true):
INSERT INTO "tableName" ("col1", "col2", "col3")
VALUES (val1, val2, val3), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
-
Indicates if line breaks and indentations should be added to output insert statement (default false).
Example output (pretty = true):
INSERT INTO "tableName" ("col1", "col2", "col3")
VALUES (val1, val2, val3), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
-
Indicates if line breaks and indentations should be added to output upsert statement (default false).
Example output (pretty = true):
INSERT INTO "tableName" ("col1", "col2", "col3")
VALUES (val1, val2, val3), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.Upsert
-
Indicates if line breaks and indentations should be added to output upsert statement (default false).
Example output (pretty = true):
INSERT INTO "tableName" ("col1", "col2", "col3")
VALUES (val1, val2, val3), - setPretty(boolean) - Method in class com.northconcepts.datapipeline.xml.SimpleXmlWriter
-
Indicates if line breaks and indentations should be added to output (default false). Example output (pretty = true): <?xml version="1.0" ?> <records> <record> <field name="country">Philippines</field> </record> </records> Example output (pretty = false): <?xml version="1.0" ?><records><record><field name="country">Philippines</field></record></records>
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Indicates if line breaks and indentations should be added to output (default false).
- setPretty(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlWriter
-
Indicates if line breaks and indentations should be added to output (default false). Example output (pretty = true): <?xml version="1.0" ?> <records> <record> <field name="country">Philippines</field> </record> </records> Example output (pretty = false): <?xml version="1.0" ?><records><record><field name="country">Philippines</field></record></records>
- setPrimaryEntityName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Sets the name of the entity whose primary key the foreign key fields reference.
- setPrimaryKey(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets whether the column is a primary key.
- setPrimaryKey(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Indicates if
CreateTablelists the column in the table'sPRIMARY KEYclause. - setPrimaryKey(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Indicates if
CreateTablelists the column in the table'sPRIMARY KEYclause. - setPrimaryKeyCatalogName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- setPrimaryKeyColumnName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- setPrimaryKeyColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the primary key column names.
- setPrimaryKeyColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- setPrimaryKeyColumnNames(String...) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- setPrimaryKeyColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the primary key column names.
- setPrimaryKeyColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
- setPrimaryKeyColumnNames(List<String>) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
- setPrimaryKeyName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Sets the name of the referenced primary key constraint.
- setPrimaryKeyName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Sets the name of the primary key constraint (not a column).
- setPrimaryKeyPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setPrimaryKeyPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setPrimaryKeyPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the zero-based position of this field in its entity's primary key or null if it is not part of the key.
- setPrimaryKeyPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setPrimaryKeyPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setPrimaryKeyPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setPrimaryKeyPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setPrimaryKeyPosition(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setPrimaryKeySchemaName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- setPrimaryKeySequence(Integer) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the column's 1-based position in the primary key, or
nullif it is not part of it. - setPrimaryKeyTableName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- setPrimaryKeyType(PrimaryKeyType) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setPrimaryKeyType(PrimaryKeyType) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setPrimaryKeyType(PrimaryKeyType) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the strategy used to generate this primary key field's values; a primary key position must also be set.
- setPrimaryKeyType(PrimaryKeyType) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setPrimaryKeyType(PrimaryKeyType) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setPrimaryKeyType(PrimaryKeyType) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setPrimaryKeyType(PrimaryKeyType) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setPrimaryKeyType(PrimaryKeyType) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setPrimaryTableName(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateForeignKey
-
Sets the primary table name.
- setPrimaryTableName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateForeignKey
-
Sets the name of the table the foreign key references.
- setPrimaryTableName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateForeignKey
-
Sets the name of the table the foreign key references.
- setPrintWriter(PrintWriter) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Sets the writer for progress messages and, when not writing files, the generated source (standard output if not set).
- setPrintWriter(PrintWriter) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateRecordSerializers
-
Sets the writer the generated code is printed to (standard output if not set).
- setPrintWriter(PrintWriter) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Sets the writer that receives the generated source when not writing files (standard output if not set).
- setPrintWriter(PrintWriter) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Sets the writer that receives the generated source when not writing files (standard output if not set).
- setPriority(int) - Method in class com.northconcepts.datapipeline.core.AsyncReader
-
Sets the priority given to the background reading thread when this reader is opened, from
Thread.MIN_PRIORITYtoThread.MAX_PRIORITY(defaults toThread.NORM_PRIORITY). - setPriority(int) - Method in class com.northconcepts.datapipeline.core.AsyncWriter
-
Sets the priority given to the background writing thread when this writer is opened, from
Thread.MIN_PRIORITYtoThread.MAX_PRIORITY(defaults toThread.NORM_PRIORITY). - setProcessedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setProcessedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setProductCriteria(ShopifyProductCriteria) - Method in class com.northconcepts.datapipeline.shopify.ShopifyProductReader
-
Sets the criteria for the products to read or null for none; it is modified in place when later pages are requested.
- setProductType(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setProject(String) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
-
Sets the issue's project, identified by its key.
- setProperties(Map<String, List<String>>) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageFooter
- setProperties(Map<String, List<String>>) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageHeader
- setProperty(String, String) - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Sets a property passed to the mail session when the reader is opened.
- setProperty(String, String) - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Sets a JNDI environment property used to look up the connection factory.
- setProviderType(ExcelDocument.ProviderType) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets the provider used to read the workbook (defaults to
ExcelDocument.ProviderType.POI_XSSF). - setProviderType(ExcelDocument.ProviderType) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets the provider used to write the workbook (defaults to
ExcelDocument.ProviderType.POI_XSSF). - setProvince(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setProvinceCode(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- setPseudo(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Indicates if the column is a pseudo column, like an Oracle ROWID, reported as part of the best row identifier.
- setPublishedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setPublishedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setPublishedStatus(PublishedStatus) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setPublishLifecycleEvents(boolean) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Indicates if the bus should publish its own EventBusLifecycleListener and ShutdownListener events (defaults to
true). - setQuery(Record) - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
-
Set the JSON style query.
(e.g. - setQuery(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- setQuery(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Deprecated.Use
JdbcPipelineInput.setQueryString(String)instead. - setQuery(String) - Method in class com.northconcepts.datapipeline.google.gmail.GmailMessageReader
-
Sets the search query used to list messages; null (the default) means no query.
- setQuery(String) - Method in class com.northconcepts.datapipeline.jira.JiraProjectReader
-
Indicates the case-insensitive search filter.
- setQuery(String) - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
-
Set the JSON style query.
(e.g. - setQueryString(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- setQueueSize(int) - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
-
Sets the buffer size for downstream readers of this splitter (default is 100 records).
- setQuoteChar(char) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Assigns startingQuote and endingQuote to the same value (defaults to double quote - ").
- setQuoteChar(String) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Assigns startingQuote and endingQuote to the same value (defaults to double quote - ").
- setQuoteChar(String) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Assigns startingQuote and endingQuote to the same value (defaults to double quote - ").
- setRadix(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the radix of the size and decimals, typically 10 or 2.
- setRange(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
-
Sets the A1-notation range to read, such as
A1:B3orSheet1!A1:B3; a range without a sheet prefix is read from the sheet named or indexed on this reader (default is null for the whole sheet). - setRange(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Sets the A1-notation range to write, such as
A1:B3orSheet1!A1:B3; its first cell replaces the first row and column indexes and only that range is cleared (default is null). - setRateLimit(RateLimitStatus) - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Replaces the cached rate limit; null clears it so the next
TwitterProxyReader.getRateLimit()call reloads it from the API. - setRateLimit(RateLimitStatus) - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Replaces the cached rate limit; null clears it so the next
TwitterReader.getRateLimit()call reloads it from the API. - setRateLimit(TwitterResponse) - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
-
Updates the rate limit from the response's status; does nothing if the response or its status is null.
- setRateLimit(TwitterResponse) - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
-
Updates the rate limit from the response's status; does nothing if the response or its status is null.
- setRateLimitExceeded(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- setRateLimitExceeded(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterReader
- setReadMetadata(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Sets whether Excel metadata (such as hyperlinks and cell styles) should be read.
- setReadOnly(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setReceiveTimeout(Long) - Method in class com.northconcepts.datapipeline.jms.JmsReader
-
Sets the timeout interval for receiving messages or
nullif reads should not timeout (default tonull). - setRecord(Record) - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Sets the record associated with this exception.
- setRecord(Record) - Method in class com.northconcepts.datapipeline.core.FieldLocation
-
Sets the record containing the field at this location.
- setRecord(Record) - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
- setRecord(Record) - Method in class com.northconcepts.datapipeline.template.FieldKeyValuePairIterator
- setRecord(Record) - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- setRecordBreak(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Indicates if each instance of this node starts a new record.
- setRecordField(XmlNode, XmlField, LocationPath) - Method in class com.northconcepts.datapipeline.xml.XmlReader
-
Stores the value
pathselects from the node in the current record's field, replacing the field's value underXmlReader.DuplicateFieldPolicy.USE_LAST_VALUEand adding to it otherwise. - setRecordNumber(long) - Method in class com.northconcepts.datapipeline.lineage.FieldLineage
-
The sequential record number starting with 0.
- setRecordNumber(long) - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
Sets the sequential record number starting with 0.
- setRecords(RecordList) - Method in class com.northconcepts.datapipeline.bloomberg.BloombergMessageData
- setRecordSchema(String) - Method in class com.northconcepts.datapipeline.lineage.RecordLineage
-
The schema for ORC and Parquet files.
- setRecordsFieldName(String) - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Sets the name of the array field in each page that holds the items to return (defaults to
"values"). - setRecordsLoaded(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Sets the flag returned by
Dataset.isRecordsLoaded()without callingDataset.afterRecordsLoaded(). - setRecordsPendingInsert(int) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- setRecordsPerCacheFile(int) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- setRecordsPerCacheFile(int) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates how many records should be cached in memory to generate the Parquet schema if no schema was explicitly set on this writer (default is 10_000L).
- setRecordsPerFile(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.LocalFileDataset
-
Sets the number of records stored in each data file (defaults to 1000); only allowed before the data is loaded.
- setRecordStackTraceInMessage(boolean) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Indicates if the warning added when a transformer returns false includes a stack trace (default is true).
- setRecordStackTraceInMessage(boolean) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Indicates if the warning added when a transformer returns false includes a stack trace (default is true).
- setRecordStackTraceInMessage(boolean) - Method in class com.northconcepts.datapipeline.validate.ValidatingReader
-
Indicates if the warning recorded for each discarded record captures a stack trace (defaults to true).
- setRecordTagName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Sets the name of the element written for each record (defaults to
record); it must not be blank. - setRecordTagName(String) - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Sets the name of the element written for each record (defaults to
record); it must not be null or empty. - setRecurseDirectories(boolean) - Method in class com.northconcepts.datapipeline.file.FileSystemInfoReader
-
Indicates if sub-directories are read recursively (default is false).
- setReferencedEntityName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
-
Sets the name of the entity in the parent schema to use when validating and mapping this nested field.
- setRegion(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Sets the AWS region (e.g.
- setRel(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- setRemarks(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- setRemarks(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- setRemoteVerification(boolean) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Indicates if data connections must be with the same host as the control connection, applied at
FtpFileSystem.open()(defaults to true). - setRemoveDocumentId(boolean) - Method in class com.northconcepts.datapipeline.mongodb.MongoReader
-
Indicates if the document "_id" property should be removed from the resulting records (defaults to true).
- setRemoveFieldsWithoutColumnMetadata(boolean) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if schema fields with no column metadata in any row group are dropped from the schema used for reading (default is false).
- setRemoveFieldsWithoutColumnMetadata(boolean) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Used whether to remove fields in the schema does not have a corresponding
ColumnChunkMetaDatain the file duringParquetDataReader.open(). - setRemoveFieldsWithoutValues(boolean) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates if top-level columns that have no values in a row group are dropped from the schema used for reading (default is false).
- setRemoveFieldsWithoutValues(boolean) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Used whether to remove fields in the schema whose value count is invalid input: '<'= 0 during
ParquetDataReader.open(). - setRemoveUnsupportedChars(boolean) - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Sets whether unsupported characters are removed from field names.
- setRemoveUnsupportedChars(boolean) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Indicates if characters other than letters, digits, '_' and '-' are removed from field names (default is true).
- setRemoveUnsupportedChars(boolean) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates if characters other than letters, digits, '_' and '-' are removed from field names (default is true).
- setRemoveUnsupportedChars(boolean) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates if unsupported characters should be removed from field names (default is true).
- setRequired(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setRequired(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setRequired(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Indicates if this field must be present and not null to pass validation (defaults to false).
- setRequired(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setRequired(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setRequired(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setRequired(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setRequired(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setRequiresShipping(Boolean) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- setResource(String) - Method in class com.northconcepts.datapipeline.google.contacts.GoogleContactsReader
-
Sets the resource name whose connections are read (defaults to
"people/me"). - setRetryCount(int) - Method in class com.northconcepts.datapipeline.retry.RetryContext
-
Sets the 0-based index of the failed attempt (0 for the initial attempt, 1 for the first retry).
- setRetryPredicate(Predicate<RetryContext>) - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Sets the predicate that determines whether to retry after a failure.
- setRetryStrategy(IRetryStrategy) - Method in class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Sets the strategy for the delay before retrying a rate-limited request (defaults to
RetryStrategy.EXPONENTIAL_BACKOFF). - setReturnOrphans(boolean) - Method in class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Indicates if records failing the lookup should be returned — instead of being deleted (default is
false). - setRootFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
-
Sets the name of the top-level field holding the records array or blank to write a bare array (defaults to
data). - setRootFieldName(String) - Method in class com.northconcepts.datapipeline.json.JsonRecordWriter
-
Sets the name of the top-level field holding the records array, or null/empty to write a bare array (default is
data). - setRootNode(DecisionTreeNode) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Sets the node where evaluation starts; its condition is not evaluated.
- setRootPart(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
Replaces all conditions with the given part (
nullremoves them). - setRootTagName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Sets the name of the element wrapping all records or blank for none (defaults to
document). - setRootTagName(String) - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Sets the name of the root element wrapping all records, or null/empty for none (defaults to
document). - setRoundingMode(RoundingMode) - Method in class com.northconcepts.datapipeline.group.operation.GroupAverage
-
Sets the rounding applied to the average (defaults to
RoundingMode.HALF_UP). - setRoundingMode(RoundingMode) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the rounding algorithm used for all BigDecimal values (default is
RoundingMode.HALF_UP). - setRoundingMode(RoundingMode) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates the rounding algorithm used for all BigDecimal values (default is
RoundingMode.HALF_UP). - setRoundingMode(RoundingMode) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Indicates the rounding algorithm used for all BigDecimal values (default is
RoundingMode.HALF_UP). - setRoundingMode(RoundingMode) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Indicates the rounding algorithm used for all BigDecimal values (default is
RoundingMode.HALF_UP). - setRoundPolicy(Rounder.RoundingPolicy) - Method in class com.northconcepts.datapipeline.transform.format.Rounder
- setRowBatchVersion(RowBatchVersion) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Sets
RowBatchVersionto store ORC data. - setRowBatchVersion(RowBatchVersion) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Sets
RowBatchVersionto store ORC data. - setRowIdentifierSequence(Integer) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the column's 1-based position in the table's best row identifier, or
nullif it is not part of it. - setRowIndex(long) - Method in class com.northconcepts.datapipeline.core.FieldLocation
-
Sets the zero-based row index of this field location.
- setRuleFired(DecisionTableRule) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableResult
-
Sets the first rule whose conditions all held, or null if none did.
- setRuntimeBounds(long, int) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.Frame
-
Sets the runtime bounds for this environment
- setSampleValue(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the sample value, normally the first non-null value added to this column, as a string.
- setSanitizeInput(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if generated setters clean text values with the Jsoup basic whitelist to remove unsafe HTML (default false).
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.core.DataReader
-
Indicates if record and field lineage is captured for each record read (default is false); enabling it throws if
DataReader.isLineageSupported()is false or the product edition does not include lineage. - setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
-
Indicates if data lineage (where each record and field came from) is saved on the records read (defaults to false); enabling it throws an exception if lineage is not supported.
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- setSaveLineage(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlReader
- setScale(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Sets the number of digits to the right of the decimal point (0 where not applicable).
- setScale(int) - Method in class com.northconcepts.datapipeline.group.operation.GroupAverage
-
Sets the number of decimal places in the average (defaults to 5).
- setScale(Integer) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
-
Sets the most digits after the decimal point (the
BigDecimalscale) values may have during validation; null for no limit. - setScale(Integer) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets the column scale.
- setScale(Integer) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
-
Sets the scale written after the length, or null for none; ignored unless the type supports it and a length is set.
- setScale(Integer) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
-
Sets the scale written after the length, or null for none; ignored unless the type supports it and a length is set.
- setSchema(JdbcConnectionFactory, JdbcValueReader, String, Object...) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the schema used to write the file by copying it from the metadata of an SQL query.
- setSchema(JdbcConnectionFactory, String, Object...) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the schema used to write the file by copying it from the metadata of an SQL query.
- setSchema(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- setSchema(String) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Sets the schema used to read the file as a string.
- setSchema(String) - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Indicates the schema used to read the file.
- setSchema(Connection, JdbcValueReader, String, Object...) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the schema used to write the file by copying it from the metadata of an SQL query.
- setSchema(Connection, JdbcValueReader, String, String, String) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the schema used to write the Parquet file by copying it from the schema of a database table.
- setSchema(Connection, String, Object...) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the schema used to write the file by copying it from the metadata of an SQL query.
- setSchema(Connection, String, String, String) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the schema used to write the Parquet file by copying it from the schema of a database table.
- setSchema(MessageType) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
-
Indicates the schema used to read the file.
- setSchema(MessageType) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
-
Sets the schema used to write the file.
- setSchema(MessageType) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataReader
-
Indicates the schema used to read the file.
- setSchema(MessageType) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
-
Sets the schema used to write the file.
- setSchema(TypeDescription) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
-
Indicates the schema used to read the file.
- setSchema(TypeDescription) - Method in class com.northconcepts.datapipeline.orc.OrcDataReader
-
Indicates the schema used to read the file.
- setSchema(TypeDescription) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates the schema used to write the file.
- setSchema(TypeDescription) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Sets the schema used to write the file.
- setSchemaDef(SchemaDef) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Sets the parent schema; called by
SchemaDefwhen this entity is added to it. - setSchemaDef(SchemaDef) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Sets the parent schema; called by
SchemaDefwhen this relationship is added to it. - setSchemaName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setSchemaName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcSchema
- setSchemaName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- setSchemaPart(SchemaPart) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaProblem
- setSchemaPattern(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Sets the schema name pattern (
%and_wildcards); null (the default) does not filter by schema. - setSearchable(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Indicates if the column can be used in a WHERE clause.
- setSearchTerm(SearchTerm) - Method in class com.northconcepts.datapipeline.email.EmailReader
-
Sets the criteria selecting which messages are read; null reads every message in the folder.
- setSelection(QuerySelection) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Replaces the SELECT column list;
nullinstalls an empty one, which selects*. - setSendSkippedToDiscardWriter(boolean) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingReader
-
Indicates if records skipped by a failed mapping condition are also written to the discard writer (default false).
- setSendSkippedToDiscardWriter(boolean) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingWriter
-
Indicates if records skipped by a failed mapping condition are also written to the discard writer (default false).
- setSendSkippedToDiscardWriter(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
-
Indicates if records skipped because a mapping condition failed are also sent to the discard writer (defaults to false).
- SetSequenceNumberField - Class in com.northconcepts.datapipeline.transform
-
Adds a sequence (auto increment) field with the specified increment (step).
- SetSequenceNumberField(String, double, double) - Constructor for class com.northconcepts.datapipeline.transform.SetSequenceNumberField
-
Creates a transformer that numbers records from
startin steps ofstep, overwriting any existing value. - SetSequenceNumberField(String, double, double, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetSequenceNumberField
-
Creates a transformer that numbers records from
startin steps ofstep; whenoverwriteis false, records that already have the field are skipped without using a number. - SetSequenceNumberField(String, long, long) - Constructor for class com.northconcepts.datapipeline.transform.SetSequenceNumberField
-
Creates a transformer that numbers records from
startin steps ofstep, overwriting any existing value. - SetSequenceNumberField(String, long, long, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetSequenceNumberField
-
Creates a transformer that numbers records from
startin steps ofstep; whenoverwriteis false, records that already have the field are skipped without using a number. - SetSequenceNumberField(String, BigDecimal, BigDecimal) - Constructor for class com.northconcepts.datapipeline.transform.SetSequenceNumberField
-
Creates a transformer that numbers records from
startin steps ofstep, overwriting any existing value. - SetSequenceNumberField(String, BigDecimal, BigDecimal, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetSequenceNumberField
-
Creates a transformer that numbers records from
startin steps ofstep; whenoverwriteis false, records that already have the field are skipped without using a number. - SetSequenceNumberField(String, BigInteger, BigInteger) - Constructor for class com.northconcepts.datapipeline.transform.SetSequenceNumberField
-
Creates a transformer that numbers records from
startin steps ofstep, overwriting any existing value. - SetSequenceNumberField(String, BigInteger, BigInteger, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetSequenceNumberField
-
Creates a transformer that numbers records from
startin steps ofstep; whenoverwriteis false, records that already have the field are skipped without using a number. - setSessionProperty(Class<T>, Object) - Method in class com.northconcepts.datapipeline.core.Node
-
Sets a session property value keyed by type.
- setSessionProperty(Class<T>, Object) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- setSessionProperty(Class<T>, Object) - Method in interface com.northconcepts.datapipeline.core.Session
-
Sets a session property value keyed by type.
- setSessionProperty(Class<T>, String, Object) - Method in class com.northconcepts.datapipeline.core.Node
-
Sets a session property value keyed by the given type and name combination.
- setSessionProperty(Class<T>, String, Object) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- setSessionProperty(Class<T>, String, Object) - Method in interface com.northconcepts.datapipeline.core.Session
-
Sets a session property value keyed by the given type and name combination.
- setSessionProperty(String, Object) - Method in class com.northconcepts.datapipeline.core.Node
-
Sets a session property value keyed by name.
- setSessionProperty(String, Object) - Method in class com.northconcepts.datapipeline.core.Session.SessionImpl
- setSessionProperty(String, Object) - Method in interface com.northconcepts.datapipeline.core.Session
-
Sets a session property value keyed by name.
- setSheetIndex(int) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Sets the 0-based index of the sheet to read when no sheet name is set (defaults to 0).
- setSheetIndex(int) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets the 0-based index of the sheet to write when no sheet name is set, or the position of a newly created sheet (default is -1, the end).
- setSheetIndex(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets the 0-based index of the sheet to read when no sheet name is set (defaults to 0).
- setSheetIndex(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets the 0-based index of the sheet to write (defaults to -1, a new sheet at the end).
- setSheetIndex(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
-
Sets the 0-based index of the sheet to read when no sheet name or range names one (defaults to 0).
- setSheetIndex(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Sets the 0-based index of the sheet to write when no sheet name or range names one (defaults to 0).
- setSheetName(String) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Sets the name of the sheet to read; when set, it is used instead of the sheet index (default is null).
- setSheetName(String) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets the name of the sheet to write, reusing an existing sheet by that name or creating it (default is null).
- setSheetName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets the name of the sheet to read; when blank, the sheet at
ExcelPipelineInput.getSheetIndex()is read (defaults to null). - setSheetName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Sets the name of the sheet to write or blank to use a generated name (defaults to null).
- setSheetName(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
-
Sets the name of the sheet to read; when set, it is used instead of the sheet index (default is null).
- setSheetName(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
-
Sets the name of the sheet to write, reusing an existing sheet by that name or creating it; when set, it is used instead of the sheet index (default is null).
- setShippingAddress(ShopifyShippingAddress) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setShutdownTimeout(long) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Sets the time in milliseconds this bus will wait for events to complete before forcibly shutting down (defaults to 30 seconds).
- setSigned(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setSigned(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- setSince(Date) - Method in class com.northconcepts.datapipeline.trello.TrelloApiReader
-
Sets the date sent to Trello as the
sinceparameter; only takes effect if set beforeTrelloApiReader.open(). - setSinceId(long) - Method in class com.northconcepts.datapipeline.twitter.TwitterSearchReader
-
Searches for tweets with IDs greater than the specified ID (i.e.
- setSinceId(String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Sets the
sinceIdsearch criteria. - setSingleEvent(boolean) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
-
Indicates the
singleEventsvalue of the events request (default is true). - setSize(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Sets the column's maximum width in characters (the JDBC display size).
- setSize(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the column size: the precision for numbers, the length in characters for text and in bytes for binary data.
- setSkip(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
-
Indicates if
FixedWidthReaderdiscards this column instead of creating a field for it (default is false). - setSkipEmptyRows(boolean) - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Indicates that rows with only null values should not be returned by the reader (default is false).
- setSkipEmptyRows(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- setSkipEmptyRows(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- setSkipEmptyRows(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- setSkipEmptyRows(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if rows with only null values are skipped (defaults to false).
- setSkipEmptyRows(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if rows whose values are all null or empty are skipped (defaults to false).
- setSkipEmptyRows(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Indicates if rows with only null values are skipped (defaults to false).
- setSkipEmptyRows(boolean) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- setSku(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- setSortDirection(JiraProjectReader.SortDirection) - Method in class com.northconcepts.datapipeline.jira.JiraProjectReader
-
Sets the direction applied to the order-by field; null means
JiraProjectReader.SortDirection.DEFAULT. - setSource(Record) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Sets the source record (a
DataMappingonly sets it when it has a source entity). - setSource(String) - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
- setSourceEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
The schema entity used to convert and validate incoming data before this mapping is performed (default
null). - setSourceEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the schema entity used to convert and validate records read from the input, before any processing (null for none).
- setSourceEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setSourceEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setSourceEntityResult(ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Sets the result of validating the source record against the mapping's source entity.
- setSourceExpression(Expression) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- setSpreadsheetId(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
A bare id only (no URL), used by the next
GoogleSheetDocument.open(). - setSprintState(JiraSprintReader.SprintState) - Method in class com.northconcepts.datapipeline.jira.JiraSprintReader
-
Indicates the state to filter sprints on (default is ACTIVE).
- setSqlToJavaTypeMapper(JdbcValueReader) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Sets the strategy that picks each column's Java type from its SQL type; null restores
JdbcValueReader.OPINIONATED. - setSqlType(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
-
Sets the column's
java.sql.Typescode. - setSqlType(Integer) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
-
Sets the
java.sql.Typescode used to bind the example value, or null to let the driver infer it. - setSqlTypeIndex(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
SQL type from
Types - setStacktrace(String) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
-
Sets the stack trace of the exception behind this error.
- setStartDate(LocalDateTime) - Method in class com.northconcepts.datapipeline.twitter2.TwitterSearchReader
-
Indicates the oldest UTC timestamp search criteria.
- setStartDate(LocalDateTime) - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Indicates the oldest UTC timestamp search criteria.
- setStartingColumn(int) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Sets the 0-based index of the first column read; earlier columns are skipped (defaults to 0).
- setStartingColumn(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets the 0-based index of the first column to read (defaults to 0).
- setStartingColumn(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
-
Sets the 0-based index of the first column read; earlier columns are skipped (defaults to 0).
- setStartingOffset(long) - Method in class com.northconcepts.datapipeline.twitter.TwitterPageableReader
-
Sets the cursor of the first page requested (defaults to
TwitterPageableReader.FIRST_PAGE). - setStartingQuote(String) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Assigns the string used to mark the beginning of text values that may contain commas and other special characters (defaults to double quote - ").
- setStartingQuote(String) - Method in class com.northconcepts.datapipeline.csv.CSVWriter
-
Assigns the string used to mark the beginning of text values that may contain commas and other special characters (defaults to double quote - ").
- setStartingQuote(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Sets the string that starts a quoted value (defaults to a double quote).
- setStartingQuote(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
-
Sets the string that starts a quoted value (defaults to a double quote).
- setStartingRow(int) - Method in class com.northconcepts.datapipeline.core.AbstractReader
-
Sets the 0-based index of the first row to read; earlier rows are skipped when the reader is opened (default is 0).
- setStartingRow(int) - Method in class com.northconcepts.datapipeline.csv.CSVReader
- setStartingRow(int) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
- setStartingRow(int) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
- setStartingRow(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Sets the 0-based index of the first row to read (defaults to 0).
- setStartingRow(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetReader
- setStats(Map<String, Object>) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setStatus(ListMemberStatus) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setStatus(ListMemberStatus) - Method in class com.northconcepts.datapipeline.mailchimp.MailChimpListMemberReader
-
Sets the status used to filter the requested members or null (the default) to send no status filter.
- setStatus(OrderStatus) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setStatus(ProductStatus...) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setStatusIfNew(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setStopOnWriterEOF(boolean) - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Indicates if this reader should stop reading from the event bus when any event bus writer on the same topic finishes (default to true).
- setStrategy(IRetryStrategy) - Method in class com.northconcepts.datapipeline.retry.RetryingOperation
-
Sets the retry strategy (default
RetryStrategy.EXPONENTIAL_BACKOFF). - setStrategy(IRetryStrategy) - Method in class com.northconcepts.datapipeline.retry.RetryingReader
-
Sets the retry strategy (default
RetryStrategy.EXPONENTIAL_BACKOFF). - setStrategy(IRetryStrategy) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
-
Sets the retry strategy (default
RetryStrategy.EXPONENTIAL_BACKOFF). - setStrictArrays(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setStrictArrays(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setStrictArrays(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Indicates if values must match this field's array setting exactly (defaults to true); when false, a single value and a one-element array are interchangeable.
- setStrictArrays(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setStrictArrays(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setStrictArrays(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setStrictArrays(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setStrictArrays(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setStrictTypeMapping(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Indicates if database types should be mapped to java type based only on
java.sql.Typesas defined by Sun/Oracle (defaults to false). - setStyleFormat(FieldType, String) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Deprecated.use
ExcelWriter.setDataFormat(FieldType, String)instead.Sets the data format for cells containing values of the specified field type.
- setStyleFormat(FieldType, String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
-
Deprecated.
- setSummary(String) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
- setSuperEntityName(String) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Sets the name of the parent entity this entity inherits from (a superclass in object-oriented programming).
- setSymmetricAlgorithm(String) - Method in class com.northconcepts.datapipeline.security.AsymmetricDecryptingReader
-
Sets the algorithm of the symmetric key that encrypted the fields (default is
AES). - setSymmetricAlgorithm(String) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Sets the algorithm of the symmetric key that encrypts the fields (default is
AES). - setSymmetricAlgorithm(String) - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
-
Sets the
Cipheralgorithm used to decrypt, such asAES; required to open the reader. - setSymmetricAlgorithm(String) - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
-
Sets the
Cipheralgorithm used to encrypt, such asAES; required to open the reader. - setSymmetricKey(SecretKey) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Sets the symmetric key that encrypts the fields; if none is set, one is generated when the reader opens.
- setSymmetricKey(SecretKey) - Method in class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
-
Sets the secret key used to decrypt; required to open the reader.
- setSymmetricKey(SecretKey) - Method in class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
-
Sets the secret key used to encrypt; required to open the reader.
- setSymmetricKeyBitLength(int) - Method in class com.northconcepts.datapipeline.security.AsymmetricEncryptingReader
-
Sets the size in bits of the symmetric key generated when none is set (default is 128); it must be at least
AsymmetricEncryptingReader.MINIMUM_SYMMETRIC_LENGTH. - setTable(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcExportedKey
- setTable(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Sets the table this key belongs to; called when the key is added to a
JdbcTable. - setTable(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Sets the table this index belongs to; called by
JdbcTable.addIndex(JdbcIndex). - setTable(JdbcTable) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
-
Sets the table this column belongs to; called by
JdbcTable.addColumn(JdbcTableColumn). - setTable(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
-
Deprecated.Use
JdbcPipelineOutput.setTableName(String)instead. - setTableIndex(int) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
-
Sets the 0-based index, counted across the whole document, of the table to read (default is 0).
- setTableIndex(int) - Method in class com.northconcepts.datapipeline.pdf.PdfReader
-
Sets the 0-based index, counted across the whole document, of the table to read (default is 0).
- setTableName(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setTableName(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Sets the table name.
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTable
-
Sets the table name.
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.h2.DropTableConstraint
-
Sets the table name.
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTable
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTableConstraint
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTable
- setTableName(String) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTableConstraint
- setTableNamePattern(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Sets the table name pattern (
%and_wildcards); defaults to%for all tables. - setTableNames(String...) - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
-
Sets the table names.
- setTableNames(String...) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
-
Replaces the tables to drop with the given names; null or an empty array is ignored.
- setTableNames(String...) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
-
Replaces the tables to drop with the given names; null or an empty array is ignored.
- setTableNames(Collection<String>) - Method in class com.northconcepts.datapipeline.sql.h2.DropTable
-
Sets the table names from a collection.
- setTableNames(Collection<String>) - Method in class com.northconcepts.datapipeline.sql.mysql.DropTable
-
Replaces the tables to drop with a copy of the given names; null is ignored.
- setTableNames(Collection<String>) - Method in class com.northconcepts.datapipeline.sql.postgresql.DropTable
-
Replaces the tables to drop with a copy of the given names; null is ignored.
- setTagName(String) - Method in class com.northconcepts.datapipeline.instagram.InstagramTagMediaReader
-
Sets the tag whose recent media is read; must not be empty and must be set before
InstagramTagMediaReader.open(). - setTagName(String) - Method in class com.northconcepts.datapipeline.instagram.InstagramTagReader
-
Sets the name to search tags for; must not be empty and must be set before
InstagramTagReader.open(). - setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Sets the labels used to organize, filter, and classify this entity (null is treated as empty).
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
-
Sets the labels used to organize, filter, and classify this relationship (null is treated as empty).
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the labels used to organize, filter, and classify this field (null is treated as empty).
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
-
Sets the labels used to organize, filter, and classify this schema (null is treated as empty).
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setTags(Tags) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setTags(List<Tag>) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setTagsCount(Long) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setTarget(Record) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Sets the mapped record (left null when a condition or the source entity validation failed).
- setTargetEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
The schema entity used to convert and validate outgoing data after this mapping is performed (default
null). - setTargetEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
-
Sets the schema entity used to convert and validate records after processing, before they are written (null for none).
- setTargetEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- setTargetEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- setTargetEntityResult(ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Sets the result of validating the target record against the mapping's target entity.
- setTargetFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- setTargetFieldName(String) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- setTargetFieldName(String) - Method in class com.northconcepts.datapipeline.group.GroupOperation
-
Sets the summary record field this operation writes to; null or blank reverts to the source field.
- setTargetSchema(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.Link
- setTargetValidationEntity(EntityDef) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Deprecated.
- setTargetValidationResult(ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingResult
-
Deprecated.
- setTemporalFieldTypes(Map<FieldType, LongAdder>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the number of string values that matched a pattern of each temporal field type.
- setTemporalPatterns(Map<DateTimePattern, LongAdder>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the number of string values that matched each date/time pattern.
- setTerminateWithSemicolon(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
-
Indicates if the MERGE statement ends with a semicolon (default is false);
MergeUpsert.prepare(JdbcUpsertWriter, Record)turns this on when the database product name is Microsoft SQL Server or ASE. - setTerminateWithSemicolon(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
-
Indicates if the MERGE statement ends with a semicolon (default is false).
- setTerminateWithSemicolon(boolean) - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
-
Indicates if the MERGE statement ends with a semicolon (default is false).
- setTextBytes(long) - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
-
Sets the total size in bytes of the text extracted from all pages, encoded with the platform default charset.
- setThrowExceptionOnMissingField(boolean) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Indicates if a record missing a checked field causes an exception (the default) instead of being discarded.
- setThrowExceptionOnMissingField(boolean) - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Indicates if an exception should be thrown if the source field is missing (default to true).
- setTimeMax(Date) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- setTimeMin(Date) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- setTimestampOpt(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setTimestampSignup(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setTimezone(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.Location
- setTitle(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setTopic(Object) - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
-
Sets the topic the records are published under; must be called before opening.
- setTopicFieldName(String) - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Assigns the field name to use when adding the delivery topic to each record or
nullif the topic should not be added to records (defaults tonull). - setTopics(Object...) - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
-
Sets the topics to read records for (empty or
nullfor all topics); must be called before opening. - setTotal(long) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcResultPage
-
Sets the total number of rows across all pages.
- setTotalItems(long) - Method in class com.northconcepts.datapipeline.jira.JiraReader
-
Sets the number of items fetched so far; no further pages are fetched once it reaches
JiraReader.getMaxItems(). - setTotalItems(long) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMembers
- setTrack(String...) - Method in class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
-
Sets the keywords the stream is filtered by.
- setTracked(Boolean) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- setTransacted(boolean) - Method in class com.northconcepts.datapipeline.jms.JmsSettings
-
Indicates if the JMS session is created as transacted (default is false).
- setTransition(int) - Method in class com.northconcepts.datapipeline.jira.JiraIssue
-
Sets the transition to perform, identified by its ID.
- setTrim(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
Indicates if leading and trailing whitespace characters should be removed (default is false).
- setTrimFields(boolean) - Method in class com.northconcepts.datapipeline.csv.CSVReader
-
Indicates if space and tab characters at the beginning and ending of non-quoted-values should be removed.
- setTrimFields(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
-
Indicates if whitespace around unquoted values is removed (defaults to true).
- setTruncateFields(boolean) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthWriter
-
Indicates if values longer than their column are cut to fit instead of failing the write (default is true).
- setTruncateFields(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
-
Indicates if values longer than their column are cut to fit instead of failing the write (defaults to true).
- setType(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
-
Sets the index type as a
DatabaseMetaDatacode:tableIndexStatistic,tableIndexClustered,tableIndexHashedortableIndexOther. - setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
-
Sets the type the field's value is converted to, or null to keep the mapped value as is.
- setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Sets the data type of this field; each subclass accepts only its own kind of type, such as numeric types for
NumericFieldDef. - setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- setType(FieldType) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- setType(DiffType) - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- setType(DiffType) - Method in class com.northconcepts.datapipeline.foundations.difference.PropertyDiff
- setType(DiffType) - Method in class com.northconcepts.datapipeline.foundations.difference.RecordDiff
- setType(ConvertStringToDateTimeAction.FieldType) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
-
Sets the kind of value (date-time, date or time) the strings are parsed into; there is no default, so it must be set.
- setType(ConvertStringToNumberAction.FieldType) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
-
Sets the number type the values are parsed into; there is no default, so it must be set.
- setType(QueryCriteria.CriteriaType) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria
-
Sets the clause this criteria renders as, WHERE or HAVING;
nullmeans WHERE. - setType(TableColumnType) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets the column type.
- setType(TableColumnType) - Method in class com.northconcepts.datapipeline.sql.h2.TableColumn
-
Sets the column type.
- setType(TableColumnType) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- setType(TableColumnType) - Method in class com.northconcepts.datapipeline.sql.mysql.TableColumn
- setType(TableColumnType) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- setType(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Sets the table type reported by the database, such as
TABLEorVIEW. - setTypes(String...) - Method in class com.northconcepts.datapipeline.foundations.jdbc.LoadTablesRequest
-
Sets the table types to load, such as
TABLEorVIEW; null (the default) loads all types. - setUnderline(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelFont
-
Sets whether underline formatting is enabled.
- setUnique(boolean) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- setUnique(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateIndex
-
Sets whether this is a unique index.
- setUnique(boolean) - Method in class com.northconcepts.datapipeline.sql.h2.CreateTableColumn
-
Sets whether the column has a unique constraint.
- setUnique(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateIndex
- setUnique(boolean) - Method in class com.northconcepts.datapipeline.sql.mysql.CreateTableColumn
- setUnique(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateIndex
- setUnique(boolean) - Method in class com.northconcepts.datapipeline.sql.postgresql.CreateTableColumn
- setUniqueEmailId(String) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setUniqueImages(long) - Method in class com.northconcepts.datapipeline.pdf.PdfDocumentStatistics
-
Sets the number of distinct images, identified by their page resource name and file suffix.
- setUnitsPerSecond(int) - Method in class com.northconcepts.datapipeline.throttle.Throttle
-
Sets the maximum average rate, in the meter's units per second, that
Throttle.throttle()enforces. - setUntilId(String) - Method in class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
-
Sets the
untilIdsearch criteria. - setUpdatedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- setUpdatedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setUpdatedAtMax(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setUpdatedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- setUpdatedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryLevelCriteria
- setUpdatedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- setUpdatedAtMin(Date) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setUpdatedMin(Date) - Method in class com.northconcepts.datapipeline.google.calendar.GoogleCalendarReader
- setUpdateRule(int) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
-
Sets what happens to the foreign key when the referenced primary key is updated, as a
DatabaseMetaDatacode such asimportedKeyCascade. - setupFilteredStreamRules(Map<String, String>) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Replaces the rules currently active on the streaming endpoint with the ones sent as parameter.
- setUpsertSql(String) - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- setUpsertStatement(PreparedStatement) - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- setUrl(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- setUseBigDecimal(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
-
Indicates if JSON decimal numbers are read as
BigDecimalinstead of double (defaults to false). - setUseBigDecimal(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
-
Indicates if JSON decimal numbers are read as
BigDecimalinstead of double (defaults to false). - setUseBigDecimal(boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
-
Indicates if decimal numbers are read as BigDecimal instead of Double (default is false).
- setUseBigDecimal(boolean) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Indicates if decimal numbers are read as BigDecimal instead of Double (default is false).
- setUseBigDecimal(boolean) - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
-
Indicates if decimal numbers are read as BigDecimal instead of Double (default is false).
- setUseBigInteger(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
-
Sets whether to use
BigIntegerfor large integer values in JSON. - setUseBigInteger(boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
-
Sets whether BigInteger should be used for reading large numeric values.
- setUseBigInteger(boolean) - Method in class com.northconcepts.datapipeline.json.JsonRecordReader
-
Sets whether BigInteger should be used for reading large numeric values.
- setUseBigInteger(boolean) - Method in class com.northconcepts.datapipeline.json.SimpleJsonReader
-
Sets whether BigInteger should be used for reading large numeric values.
- setUseCatalog(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
-
Indicates if each table's catalog is passed to the column, key and index metadata lookups instead of null (default is false).
- setUseColumnLabel(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
-
Indicates if column labels (aliases) are used as field names instead of the column names (defaults to false).
- setUseColumnLabel(boolean) - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
When set to
true, column labels (or aliases) will be used for field names instead of the underlying, real column names. - setUseDatabaseIdentifiersAsDisplayNames(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Sets whether to use database identifiers as display names in generated form definitions.
- setUseInferredType(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset
-
Deprecated.
- setUsername(String) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- setUsername(String) - Method in class com.northconcepts.datapipeline.instagram.InstagramUserMediaReader
-
Sets the user whose media is read, matched exactly by username; must not be empty and must be set before
InstagramUserMediaReader.open(). - setUseSheetColumnCount(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelReader
-
Set whether to use the entire worksheet (or just the current row) when determining each record's field count.
- setUseSheetColumnCount(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
-
Indicates if every record gets a field for each column in the sheet, not just its own row's cells (defaults to false).
- setUseStrongListenerReference(boolean) - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Indicates if the event bus uses strong references (default) or soft references for holding listeners added to the bus.
- setUseTimestampInstant(boolean) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates if
Instants should be used to store datetime values. - setUseTimestampInstant(boolean) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates if
Instants should be used to store datetime values. - setUsing(IMergeUsing) - Method in class com.northconcepts.datapipeline.jdbc.sql.merge.Merge
-
Sets the strategy that renders the USING clause, such as
MergeUsing.VALUES; required before generating the SQL. - setUTC(boolean) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates if datetime values are adjusted to UTC.
- setUTC(boolean) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates if datetime values are adjusted to UTC.
- SetUuidField - Class in com.northconcepts.datapipeline.transform
-
Adds a field with a randomly generated UUID as its value.
- SetUuidField(String) - Constructor for class com.northconcepts.datapipeline.transform.SetUuidField
-
Creates a transformer that sets the field to a new random UUID string, overwriting any existing value.
- SetUuidField(String, boolean) - Constructor for class com.northconcepts.datapipeline.transform.SetUuidField
-
Creates a transformer that sets the field to a new random UUID string unless it exists and
overwriteis false. - setValidateInput(boolean) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata
-
Enable or disable input validation
- setValidation(Filter) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
-
Sets the entity validation rule that failed (see
EntityDef.addValidation(Filter)). - setValidations(List<Filter>) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Sets the filters that records must pass during validation.
- setValue(boolean) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified boolean.
- setValue(byte) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified byte.
- setValue(byte[]) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified byte array (blob).
- setValue(char) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified character.
- setValue(double) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified double.
- setValue(float) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified float.
- setValue(int) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified integer.
- setValue(int, FieldType, Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Replaces the element at the specified index with a new value of the given type.
- setValue(int, Object) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Replaces the element at the specified index with a new value, inferring the
FieldType. - setValue(long) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified long.
- setValue(short) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified short.
- setValue(Record) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified
Record. - setValue(ValueNode<?>, boolean, boolean, Object) - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Sets the value of the field or array element at this path, creating missing parts if
createis true; returns the new value node or null if the path does not resolve. - setValue(Object) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value, inferring the
FieldTypefrom the value's class. - setValue(String) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified string.
- setValue(String) - Method in class com.northconcepts.datapipeline.filter.rule.Contains
-
Sets the text that field values must contain.
- setValue(String) - Method in class com.northconcepts.datapipeline.foundations.core.Property
- setValue(String, Object) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- setValue(String, Object) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Add a constant for this mapping to use when evaluating expressions like the
FieldMapping.getSourceExpression(),AbstractFieldMapping.getCondition(), andDataMapping.getConditions(). - setValue(String, Object) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds a constant that the table's field, condition and outcome expressions can use.
- setValue(String, Object) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Adds a constant that the tree's field, condition and outcome expressions can use.
- setValue(String, Object) - Method in class com.northconcepts.datapipeline.json.builder.JsonTemplate
-
Sets a named value that the template's expressions, including per-record ones, can reference.
- setValue(String, Object) - Method in class com.northconcepts.datapipeline.xml.builder.XmlTemplate
-
Sets a named value that the template's expressions, including per-record ones, can reference.
- setValue(String, Object, Class<?>) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
-
Add a constant for this mapping to use when evaluating expressions like the
FieldMapping.getSourceExpression(),AbstractFieldMapping.getCondition(), andDataMapping.getConditions(). - setValue(String, Object, Class<?>) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
-
Adds a constant of the given type that the table's field, condition and outcome expressions can use.
- setValue(String, Object, Class<?>) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Adds a constant of the given type that the tree's field, condition and outcome expressions can use.
- setValue(String, Object, Class<?>) - Method in class com.northconcepts.datapipeline.json.builder.JsonTemplate
-
Sets a named value of the given type that the template's expressions, including per-record ones, can reference.
- setValue(String, Object, Class<?>) - Method in class com.northconcepts.datapipeline.xml.builder.XmlTemplate
-
Sets a named value of the given type that the template's expressions, including per-record ones, can reference.
- setValue(BigDecimal) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified
BigDecimal. - setValue(BigInteger) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified
BigInteger. - setValue(Date) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified date.
- setValue(Time) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified time.
- setValue(Instant) - Method in class com.northconcepts.datapipeline.core.Field
- setValue(LocalDate) - Method in class com.northconcepts.datapipeline.core.Field
- setValue(LocalDateTime) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified
LocalDateTime, converting it to aDateusing the system default time zone. - setValue(LocalTime) - Method in class com.northconcepts.datapipeline.core.Field
- setValue(Date) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified datetime.
- setValue(UUID) - Method in class com.northconcepts.datapipeline.core.Field
-
Sets this field's value to the specified
UUID. - setValueCount(long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
-
Sets the number of values seen, including nulls; array elements are counted individually.
- setValueInputOption(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
How written cells are interpreted:
RAW(the default) stores every value as sent, so dates arrive as text;USER_ENTEREDparses values as if typed into the UI, so date and time strings become date cells and a string starting with=becomes a formula. - setValueOnException(Object) - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Sets the value a field receives when transforming it throws, instead of failing; null is a valid value.
- setValueReader(JdbcValueReader) - Method in class com.northconcepts.datapipeline.jdbc.JdbcReader
-
Sets the strategy that maps column types and reads values;
nullrestoresJdbcValueReader.OPINIONATED. - setValueRenderOption(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
How cells are read:
FORMATTED_VALUE(the API default, every cell a string as shown in the UI),UNFORMATTED_VALUE(numbers and booleans arrive typed) orFORMULA; null sends no option. - setValues(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.GenericUpsert
- setValues(JdbcUpsertWriter, Record) - Method in interface com.northconcepts.datapipeline.jdbc.upsert.IUpsert
-
Applies the record's values to the pending statement(s); called for every record written.
- setValues(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MergeUpsert
- setValues(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.MySqlUpsert
- setValues(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.OracleUpsert
- setValues(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert
- setValues(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- setValues(JdbcUpsertWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
- setValues(JdbcWriter, Record) - Method in interface com.northconcepts.datapipeline.jdbc.insert.IInsert
-
Applies the record's values to the pending statement; called for every record written.
- setValues(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowPreparedStatementInsert
- setValues(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- setValues(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowInsertAllStatementInsert
- setValues(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.OracleMultiRowSelectUnionAllStatementInsert
- setValues(JdbcWriter, Record) - Method in class com.northconcepts.datapipeline.jdbc.insert.PreparedStatementInsert
- setVariable(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
-
Sets the variable that
?stands for in the expression; it must be set before the expression is parsed. - setVariable(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- setVariable(String) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- setVariable(String) - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
-
Sets the name of the expression-context variable that receives the expression's result; must not be null or empty.
- setVendor(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- setVerb(EventVerb) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- setVip(Boolean) - Method in class com.northconcepts.datapipeline.mailchimp.list.ListMember
- setWhere(QueryCriteria) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Replaces the WHERE criteria, changing its type to WHERE;
nullinstalls empty criteria. - setWholeDigits(int) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- setWholePart(String) - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
-
Sets the digits before the decimal point, without the minus sign.
- setWidth(int) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- setWrapText(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
-
Sets whether text wrapping is enabled for the cell.
- setWritable(boolean) - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- setWriteFieldsAsAttributes(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if null and single-value fields are written as attributes instead of child elements (defaults to true).
- setWriteFieldsAsAttributes(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Indicates if null and single-valued fields are written as attributes of their element instead of child elements (default is true).
- setWriteMetadata(boolean) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
-
Sets whether Excel metadata (such as hyperlinks and cell styles) should be written.
- setWriter(TransformingWriter) - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Sets the host writer; called by
TransformingWriterwhen this transformer is added to it. - setWriteStrategy(MultiWriter.WriteStrategy) - Method in class com.northconcepts.datapipeline.core.MultiWriter
-
Sets how records are distributed among the target writers (defaults to
MultiWriter.REPLICATE_CLONE). - setWriteToFile(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateQueryDaoClasses
-
Indicates if generated classes are written as files under the base folder instead of printed to the print writer (default true).
- setWriteToFile(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateSpringDataJpaClasses
-
Indicates if generated classes are written as files under the base folder instead of printed to the print writer (default true).
- setWriteToFile(boolean) - Method in class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses
-
Indicates if generated classes are written as files under the base folder instead of printed to the print writer (default true).
- setWriteUuidAsString(boolean) - Method in class com.northconcepts.datapipeline.avro.AvroWriter
-
Indicates whether UUID values are written as strings or bytes.
- setWriteUuidAsString(boolean) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
-
Indicates whether UUID values are written as strings or bytes.
- setWriteUuidAsString(boolean) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
-
Indicates whether UUID values are written as strings or bytes.
- setWriteUuidAsString(boolean) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
-
Indicates whether UUID values are written as strings or bytes.
- setWriteXmlDeclaration(boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
-
Indicates if an XML declaration is written first (defaults to false).
- setWriteXmlDeclaration(boolean) - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
-
Indicates if the output starts with an XML declaration (default is false).
- setXpathExpression(String) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- setZip(String) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- SftpFileSystem - Class in com.northconcepts.datapipeline.filesystem.sftp
-
Class for accessing the SFTP file system.
- SftpFileSystem(String, int) - Constructor for class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Connects to the specified SFTP server with credentials supplied through a
CredentialsResolver(seeSftpFileSystem.setCredentialsResolver(CredentialsResolver)). - SftpFileSystem(String, int, String, String) - Constructor for class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Connects to the specified SFTP server.
- SftpFileSystem(String, String) - Constructor for class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Connects to the specified SFTP server at localhost, default port 22.
- sheet - Variable in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- sheet - Variable in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- SHIPPED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FulfillmentStatus
- ShopifyApiReader - Class in com.northconcepts.datapipeline.shopify
-
Base class for readers that page through a Shopify Admin API resource using
page_infocursors and retry requests that fail with a 429 (rate limit) error. - ShopifyApiReader(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.ShopifyApiReader
-
Creates a reader for the store at
domain, a base URL such ashttps://example.myshopify.com, using an access token. - ShopifyClient - Interface in com.northconcepts.datapipeline.shopify.client
-
JAX-RS client for the Shopify Admin REST API (version 2023-07); each method returns the JSON response body.
- ShopifyClient.AccessToken - Class in com.northconcepts.datapipeline.shopify.client
-
Request filter that sends a token in the
X-Shopify-Access-Tokenheader. - ShopifyClient.HeaderFilter - Class in com.northconcepts.datapipeline.shopify.client
-
Response filter that copies the
page_infocursor of theLinkheader's next-page URL into anextfield of JSON responses with status 200. - ShopifyClient.Proxy - Class in com.northconcepts.datapipeline.shopify.client
-
Factory for
ShopifyClient.ShopifyStubinstances. - ShopifyClient.ShopifyStub - Class in com.northconcepts.datapipeline.shopify.client
-
Holds a
ShopifyClientproxy with the RESTEasy client and web target behind it. - ShopifyCustomerCriteria - Class in com.northconcepts.datapipeline.shopify.client
-
Filters for listing Shopify customers, as used by
ShopifyCustomerReader; properties left null are not sent. - ShopifyCustomerCriteria() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- ShopifyCustomerReader - Class in com.northconcepts.datapipeline.shopify
-
Reads customers from a Shopify store, optionally filtered by a
ShopifyCustomerCriteria. - ShopifyCustomerReader(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.ShopifyCustomerReader
-
Creates a reader for the store at
domain, a base URL such ashttps://example.myshopify.com, using an access token. - ShopifyEventCriteria - Class in com.northconcepts.datapipeline.shopify.client
-
Filters for listing Shopify events, as used by
ShopifyEventReader; properties left null are not sent. - ShopifyEventCriteria() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- ShopifyEventReader - Class in com.northconcepts.datapipeline.shopify
-
Reads events from a Shopify store, optionally filtered by a
ShopifyEventCriteria. - ShopifyEventReader(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.ShopifyEventReader
-
Creates a reader for the store at
domain, a base URL such ashttps://example.myshopify.com, using an access token. - ShopifyInventoryItem - Class in com.northconcepts.datapipeline.shopify.client
-
The inventory item fields sent by
ShopifyClient.updateInventoryItem(String, ShopifyInventoryItem); properties left null are not sent. - ShopifyInventoryItem() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItem
- ShopifyInventoryItemCriteria - Class in com.northconcepts.datapipeline.shopify.client
-
Filters for listing Shopify inventory items, as used by
ShopifyInventoryItemReader; properties left null are not sent. - ShopifyInventoryItemCriteria() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItemCriteria
- ShopifyInventoryItemReader - Class in com.northconcepts.datapipeline.shopify
-
Reads inventory items from a Shopify store, optionally filtered by a
ShopifyInventoryItemCriteria. - ShopifyInventoryItemReader(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.ShopifyInventoryItemReader
-
Creates a reader for the store at
domain, a base URL such ashttps://example.myshopify.com, using an access token. - ShopifyInventoryLevelCriteria - Class in com.northconcepts.datapipeline.shopify.client
-
Filters for listing Shopify inventory levels, as used by
ShopifyInventoryLevelReader; properties left null are not sent. - ShopifyInventoryLevelCriteria() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryLevelCriteria
- ShopifyInventoryLevelReader - Class in com.northconcepts.datapipeline.shopify
-
Reads inventory levels from a Shopify store, optionally filtered by a
ShopifyInventoryLevelCriteria. - ShopifyInventoryLevelReader(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.ShopifyInventoryLevelReader
-
Creates a reader for the store at
domain, a base URL such ashttps://example.myshopify.com, using an access token. - ShopifyLocationReader - Class in com.northconcepts.datapipeline.shopify
-
Reads the locations of a Shopify store.
- ShopifyLocationReader(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.ShopifyLocationReader
-
Creates a reader for the store at
domain, a base URL such ashttps://example.myshopify.com, using an access token. - ShopifyOrder - Class in com.northconcepts.datapipeline.shopify.client
-
Filters for listing Shopify orders, as used by
ShopifyOrderReader; properties left null are not sent. - ShopifyOrder() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- ShopifyOrderReader - Class in com.northconcepts.datapipeline.shopify
-
Reads orders from a Shopify store, optionally filtered by
ShopifyOrdercriteria. - ShopifyOrderReader(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.ShopifyOrderReader
-
Creates a reader for the store at
domain, a base URL such ashttps://example.myshopify.com, using an access token. - ShopifyProductCriteria - Class in com.northconcepts.datapipeline.shopify.client
-
Filters for listing Shopify products, as used by
ShopifyProductReader; properties left null are not sent. - ShopifyProductCriteria() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- ShopifyProductReader - Class in com.northconcepts.datapipeline.shopify
-
Reads products from a Shopify store, optionally filtered by a
ShopifyProductCriteria. - ShopifyProductReader(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.ShopifyProductReader
-
Creates a reader for the store at
domain, a base URL such ashttps://example.myshopify.com, using an access token. - ShopifyService - Class in com.northconcepts.datapipeline.shopify.client
-
Calls the Shopify Admin REST API and returns each JSON response as a
Record, rethrowing failures asDataExceptions. - ShopifyService(String, String) - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyService
-
Creates a service for the store at
domain, a base URL such ashttps://example.myshopify.com, that authenticates withapiKeyas an access token; callShopifyService.close()when done. - ShopifyShippingAddress - Class in com.northconcepts.datapipeline.shopify.client
-
Shipping address of the order sent by
ShopifyClient.updateOrder(String, ShopifyOrder); properties left null are not sent. - ShopifyShippingAddress() - Constructor for class com.northconcepts.datapipeline.shopify.client.ShopifyShippingAddress
- SHORT - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- SHORT - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- SHORT - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
- SHORT - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- shouldClose(RecordBuffer, BufferedReader, Record) - Method in class com.northconcepts.datapipeline.buffer.BufferStrategy
-
Indicates if the open buffer should be closed after adding the record.
- shouldClose(Window, GroupByReader, Record) - Method in class com.northconcepts.datapipeline.group.CloseWindowStrategy
-
Returns true if the given open window should be closed now;
recordis the record being read or null when polling. - shouldCreate(GroupByReader, Record) - Method in class com.northconcepts.datapipeline.group.CreateWindowStrategy
-
Returns true if a new window should be opened before
recordis added (null when polling); called repeatedly until it returns false. - shouldWrapWhenNested() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.QuerySource
-
Indicates if this source is parenthesized when used in a FROM clause (true except for a plain table).
- shouldWrapWhenNested() - Method in class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- shuffle(List) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Randomly shuffles the contents of an array
- shutdown() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader.ReaderThread
-
Asks this thread to stop by marking it finished and interrupting it; does nothing if it is already finished.
- shutdown() - Method in class com.northconcepts.datapipeline.eventbus.EventBus
-
Notifies the shutdown and lifecycle listeners, waits up to
EventBus.getShutdownTimeout()milliseconds for queued events, then stops the executor and removes all listeners. - ShutdownListener - Interface in com.northconcepts.datapipeline.eventbus
-
Notified when an
EventBusbegins shutting down; register withEventBus.addShutdownListener(EventFilter, ShutdownListener). - SHUTTING_DOWN - Enum constant in enum class com.northconcepts.datapipeline.eventbus.EventBus.State
- SiblingSetPattern - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
An immutable naming pattern derived from a set of sibling names — a fixed prefix and suffix around a dynamic middle segment (for example
item-*derived fromitem-1,item-2,item-3). - SiblingSetPattern(String, String, NodeNameRule) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetPattern
-
Creates a pattern whose middle segment must satisfy the required
segmentRule; null affixes are treated as empty. - SiblingSetRule - Interface in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Examines a parent's candidate children collectively and derives a
SiblingSetPatternwhen their names share a naming/wildcard pattern, or returnsnullwhen no pattern can be derived. - sift(Map<Object, Object>, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Applies a predicate function to each key/value pair in an object, and returns an object containing only the key/value pairs that passed the predicate
- signature - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- Signature - Class in com.northconcepts.datapipeline.jsonata.utils
-
Manages signature related functions
- Signature(String, String) - Constructor for class com.northconcepts.datapipeline.jsonata.utils.Signature
- signRequest(OAuthRequest, OAuth10aService) - Method in class com.northconcepts.datapipeline.twitter2.TwitterCredentials
-
Authorizes the request by OAuth 1.0a signing if an access token was given, otherwise with a bearer token header.
- SimpleJsonReader - Class in com.northconcepts.datapipeline.json
-
Reads a JSON stream created by
SimpleJsonWriter. - SimpleJsonReader(File) - Constructor for class com.northconcepts.datapipeline.json.SimpleJsonReader
- SimpleJsonReader(Reader) - Constructor for class com.northconcepts.datapipeline.json.SimpleJsonReader
- SimpleJsonWriter - Class in com.northconcepts.datapipeline.json
-
Writes JSON in the following simple format.
- SimpleJsonWriter(File) - Constructor for class com.northconcepts.datapipeline.json.SimpleJsonWriter
- SimpleJsonWriter(Writer) - Constructor for class com.northconcepts.datapipeline.json.SimpleJsonWriter
- SimpleXmlReader - Class in com.northconcepts.datapipeline.xml
-
Reads an XML stream created by
SimpleXmlWriter. - SimpleXmlReader(File) - Constructor for class com.northconcepts.datapipeline.xml.SimpleXmlReader
- SimpleXmlReader(Reader) - Constructor for class com.northconcepts.datapipeline.xml.SimpleXmlReader
- SimpleXmlWriter - Class in com.northconcepts.datapipeline.xml
-
Writes XML in the following simple format.
- SimpleXmlWriter(File) - Constructor for class com.northconcepts.datapipeline.xml.SimpleXmlWriter
- SimpleXmlWriter(Writer) - Constructor for class com.northconcepts.datapipeline.xml.SimpleXmlWriter
- single(List, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Given an array, find the single element matching a specified condition Throws an exception if the number of matching elements is not exactly one
- SINGLE_VALUE - Enum constant in enum class com.northconcepts.datapipeline.core.Node.NodeType
- singleValue(SingleValue) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called for each single (leaf) value; it has no matching end callback.
- singleValue(SingleValue) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- singleValue(SingleValue) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- SingleValue - Class in com.northconcepts.datapipeline.core
-
SingleValue is an immutable
ValueNodethat holds a single scalar value (ornull). - SingleValue(FieldType, Object) - Constructor for class com.northconcepts.datapipeline.core.SingleValue
-
Creates a value of the given type; a null type is inferred from the value's class (
FieldType.UNDEFINEDif unknown or null). - SingleValue(Object) - Constructor for class com.northconcepts.datapipeline.core.SingleValue
-
Creates a value whose type is inferred from its class (
FieldType.UNDEFINEDif unknown or null). - SingleValueOperation(String, FieldType) - Constructor for class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
-
Creates an operation that skips null values, only retyping them as nulls of
returnType. - SingleValueOperation(String, FieldType, boolean) - Constructor for class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
-
Creates an operation that stores
nullresults as nulls ofreturnType; null values reachapplyImplonly ifapplyToNullsis true (otherwise they are just retyped). - size() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns the number of elements in this array.
- size() - Method in class com.northconcepts.datapipeline.core.CompositeValue
- size() - Method in class com.northconcepts.datapipeline.core.FieldList
- size() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns the number of records in this list.
- size() - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- size() - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- size() - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- size() - Method in class com.northconcepts.datapipeline.jsonata.JsonArray
- size() - Method in class com.northconcepts.datapipeline.jsonata.JsonObject
- size() - Method in class com.northconcepts.datapipeline.jsonata.Utils.RangeList
- size() - Method in class com.northconcepts.datapipeline.template.ArrayTemplateModel
- size() - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- sizeMismatch(String, String, int, int) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- skip(int) - Method in class com.northconcepts.datapipeline.core.DataReader
-
Skips over the specified number of records.
- skip(long) - Method in class com.northconcepts.datapipeline.meter.MeteredInputStream
- SKIP - Enum constant in enum class com.northconcepts.datapipeline.core.Node.DuplicateNodeAction
-
Silently ignore the conflict and continue with the remaining fields.
- SKIP - Enum constant in enum class com.northconcepts.datapipeline.excel.LargeCellHandler
- skipField(int) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthReader
-
Appends a column of the given width whose text is discarded instead of read into a field.
- skipField(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
-
Appends a column of the given width whose text is discarded instead of read into a field.
- skipField(int) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- SKY_BLUE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- SMALLINT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- SMALLINT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- SMALLINT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- SMALLSERIAL - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- sort() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Sorts this array using the default
ValueNodeComparator. - sort(RecordComparator) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- sort(RecordComparator) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Sorts this list in place with the comparator; the sort is stable.
- sort(RecordComparator, boolean) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- sort(RecordComparator, boolean) - Method in class com.northconcepts.datapipeline.core.RecordList
- sort(Comparator<ValueNode<?>>) - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Sorts this array using the specified comparator.
- sort(List, Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Implements the merge sort (stable) with optional comparator function
- sortColumns() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
-
Sorts the result columns by name, ignoring case.
- sortColumns() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
-
Sorts the columns by name, ignoring case.
- SortFieldsAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.transform
-
A
PipelineActionthat sorts the records by one or more fields, each in ascending or descending order. - SortFieldsAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- sortFieldsByName() - Method in class com.northconcepts.datapipeline.core.Record
-
Sorts the fields in this record alphabetically by name.
- SortingReader - Class in com.northconcepts.datapipeline.core
-
A proxy that sorts records.
- SortingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.core.SortingReader
-
Creates a reader that sorts all records in memory, without overflowing to disk.
- SortingReader(DataReader, long) - Constructor for class com.northconcepts.datapipeline.core.SortingReader
- SPAM - Static variable in interface com.northconcepts.datapipeline.email.GmailFolders
- split(String, Object, Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- SplitArrayField - Class in com.northconcepts.datapipeline.transform
-
Flattens an array field by creating one record for each value.
- SplitArrayField(String) - Constructor for class com.northconcepts.datapipeline.transform.SplitArrayField
-
Creates a transformer for the named array field; it only works in a
TransformingReader, since the copies are pushed back into that reader. - SplitReader - Class in com.northconcepts.datapipeline.multiplex
-
Used by SplitWriter as a consumer when converting a single source DataReader into many downstream sources.
- SplitReader(SplitWriter) - Constructor for class com.northconcepts.datapipeline.multiplex.SplitReader
- SplitWords - Class in com.northconcepts.datapipeline.transform
-
Flattens an array field by creating one record for each value.
- SplitWords(String, String) - Constructor for class com.northconcepts.datapipeline.transform.SplitWords
-
Creates a transformer that stores the words of the source field's text as a string array in the target field, finding words with the default locale's rules.
- SplitWords(String, String, Locale) - Constructor for class com.northconcepts.datapipeline.transform.SplitWords
-
Creates a transformer that stores the words of the source field's text as a string array in the target field, finding words with the given locale's rules (the default locale if null).
- SplitWriter - Class in com.northconcepts.datapipeline.multiplex
-
Converts a single source DataReader into many downstream sources using one of the provided strategies.
- SplitWriter() - Constructor for class com.northconcepts.datapipeline.multiplex.SplitWriter
-
Creates a splitter using the
SplitWriter.Strategy.BROADCASTstrategy. - SplitWriter(SplitWriter.IStrategy) - Constructor for class com.northconcepts.datapipeline.multiplex.SplitWriter
- SplitWriter.IStrategy - Interface in com.northconcepts.datapipeline.multiplex
-
Strategy for distributing the records written to a
SplitWriteramong the readers it created. - SplitWriter.Strategy - Enum Class in com.northconcepts.datapipeline.multiplex
-
The built-in strategies: send every record to all readers or each record to one reader in turn.
- spread(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Splits an object into an array of object with one property each
- SqlPart - Class in com.northconcepts.datapipeline.jdbc.sql
-
Base class for the SQL builders: renders a SQL fragment and collects the values for its
?parameters. - SqlPart() - Constructor for class com.northconcepts.datapipeline.jdbc.sql.SqlPart
- SqlSelectGenerator - Interface in com.northconcepts.datapipeline.jdbc.sql.select
-
Interface for classes that can generate SQL SELECT statements.
- sqlToJavaType(int, int, int, boolean, boolean, String) - Method in interface com.northconcepts.datapipeline.jdbc.JdbcValueReader
-
Returns the Java class used for a column with the given
Typescode, display size, scale (decimals) and other metadata; the default applies the pre-8.0.0 mapping ofJdbcValueReader.ORIGINAL. - sqrt(Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Square root of number
- SSL_REQUIRED - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- stages - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- standard(boolean) - Static method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Returns the default strategy:
StandardNodeNameRuleplus theDetectFieldCandidates,DetectRecordBreakCandidates,OptimizeTreeStructure(only whenoptimizeTreeStructureis set), andMakeFieldNamesUniquepasses. - StandardNodeNameRule - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
The default
NodeNameRule: treats numeric names, UUID names, and names containing special characters as dynamic, matching.invalid reference
XmlNode#isWildcardCandidate(String) - StandardNodeNameRule() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StandardNodeNameRule
- STARRED - Enum constant in enum class com.northconcepts.datapipeline.trello.BoardFilter
- STARRED - Static variable in interface com.northconcepts.datapipeline.email.GmailFolders
- start() - Method in class com.northconcepts.datapipeline.jms.JmsConnection
-
Starts the connection so messages can be received; only valid after
JmsConnection.open(). - startArray() - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- startArray() - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of an array in the JSON input.
- startArray(ArrayValue) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called before the array's elements are visited.
- startArray(ArrayValue) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- startArray(ArrayValue) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- startArrayValue(A) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of an array element in the JSON input.
- startArrayValue(ArrayValue, int, ValueNode<?>) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called before the element at the given 0-based index is visited.
- startArrayValue(ArrayValue, int, ValueNode<?>) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- startArrayValue(ArrayValue, int, ValueNode<?>) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- startBoolean() - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of a boolean literal (
trueorfalse) in the JSON input. - startField(Field) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called when a field is reached, before
INodeVisitor.startFieldValue(Field, ValueNode). - startField(Field) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- startField(Field) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- startFieldValue(Field, ValueNode<?>) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called before the field's value node is visited.
- startFieldValue(Field, ValueNode<?>) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- startFieldValue(Field, ValueNode<?>) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- startFilteredStream(<any>) - Method in class com.northconcepts.datapipeline.twitter2.TwitterV2Client
-
Streams filtered Tweets in real-time based on the added filter rules.
- startingRow - Variable in class com.northconcepts.datapipeline.core.AbstractReader
- startInterval(long) - Static method in class com.northconcepts.datapipeline.group.CreateWindowStrategy
-
Opens a new window at set time intervals.
- startNull() - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of a
nullliteral in the JSON input. - startNumber() - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of a number in the JSON input.
- startObject() - Method in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- startObject() - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of an object in the JSON input.
- startObjectName(O) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of the name of an object member in the JSON input.
- startObjectValue(O, String) - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of the name of an object member in the JSON input.
- startReading(int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- startReading(int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- startReading(int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- startReading(String) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- startReading(String) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- startReading(String) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- startReading(String, String, int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Loads the sheet to read: the one a range names, else sheetName, else the sheet at sheetIndex.
- startReadingImpl(int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- startReadingImpl(int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- startReadingImpl(int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- startReadingImpl(String) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- startReadingImpl(String) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- startReadingImpl(String) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- startReadingRange(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Reads an A1-notation range such as
Sheet1!A1:B3; without a sheet prefix the API reads the first sheet. - startReadingSheet(int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- startReadingSheet(String) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
- startRecord(Record) - Method in interface com.northconcepts.datapipeline.core.INodeVisitor
-
Called before the record's fields are visited.
- startRecord(Record) - Method in class com.northconcepts.datapipeline.core.NodeVisitor
- startRecord(Record) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.SingleValueOperation
- startRecord(Record, int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- startRecord(Record, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- startRecord(Record, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- startString() - Method in class com.northconcepts.datapipeline.jsonata.JsonHandler
-
Indicates the beginning of a string in the JSON input.
- startWriting(String, int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- startWriting(String, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- startWriting(String, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- startWriting(String, String, int, int, int) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetDocument
-
Prepares the sheet to write, creating it when the name is new, and clears everything from the block's first cell to the sheet's bottom-right corner (or just the range).
- startWritingImpl(String, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- startWritingImpl(String, int) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- startWritingImpl(String, int) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- StaticCredentialsResolver - Class in com.northconcepts.datapipeline.security
-
A
CredentialsResolverthat always returns the same fixedCredentials. - StaticCredentialsResolver(Credentials) - Constructor for class com.northconcepts.datapipeline.security.StaticCredentialsResolver
- StaticCredentialsResolver(String...) - Constructor for class com.northconcepts.datapipeline.security.StaticCredentialsResolver
-
Creates a resolver from alternating key-value pairs:
new StaticCredentialsResolver(Credentials.USERNAME, "scott", Credentials.PASSWORD, "tiger"). - STATUS_IS_A_DUPLICATE - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- stop() - Method in class com.northconcepts.datapipeline.jms.JmsConnection
-
Stops the connection, first unsubscribing the durable subscription named by the settings' client ID if one is set.
- stop() - Method in class com.northconcepts.datapipeline.multiplex.DeMux
-
Makes the feeder stop before reading the next source record; the feeder thread is not interrupted.
- STOP - Enum constant in enum class com.northconcepts.datapipeline.twitter.ApiLimitPolicy
-
Stop the reader normally if the Twitter API call limit is reached.
- stopTimer() - Method in class com.northconcepts.datapipeline.meter.Meter
-
Stops the timer so the elapsed time no longer grows; later calls have no effect until
Meter.reset(). - stream() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a sequential Stream of the elements in this array.
- stream() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- stream() - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns a sequential Stream of the fields in this list.
- stream() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a sequential Stream of the fields in this record.
- stream() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns a sequential Stream of the records in this list.
- stream() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Returns a Stream over records cached in this dataset.
- STREAM - Enum constant in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferMode
-
Transfer files as a stream of bytes.
- StreamWriter - Class in com.northconcepts.datapipeline.core
-
Writes records to a stream in a human-readable format.
- StreamWriter(File) - Constructor for class com.northconcepts.datapipeline.core.StreamWriter
-
Creates a writer that overwrites the file, which this constructor opens immediately, and closes it when this writer is closed.
- StreamWriter(OutputStream) - Constructor for class com.northconcepts.datapipeline.core.StreamWriter
-
Creates a writer that encodes with the default charset and leaves the stream open when this writer is closed (see
StreamWriter.setCloseStream(boolean)). - StreamWriter(Writer) - Constructor for class com.northconcepts.datapipeline.core.StreamWriter
-
Creates a writer that leaves the given writer open when this one is closed (see
StreamWriter.setCloseStream(boolean)). - StreamWriter.Format - Enum Class in com.northconcepts.datapipeline.core
-
How a
StreamWriterprints each record (after its 0-based number): plain text, JSON, XML, or text plus session properties. - STRICT - Static variable in interface com.northconcepts.datapipeline.jdbc.JdbcValueReader
-
Maps database types to java types based only on
java.sql.Typesas defined by Sun/Oracle. - string(Object, Boolean) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Stringify arguments
- STRING - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- STRING - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- STRING - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- StringOperation(String) - Constructor for class com.northconcepts.datapipeline.transform.BasicFieldTransformer.StringOperation
-
Creates a string operation that skips null values.
- StringOperation(String, boolean) - Constructor for class com.northconcepts.datapipeline.transform.BasicFieldTransformer.StringOperation
-
Creates a string operation that receives null values (as
null) only ifapplyToNullsis true. - StringParser - Class in com.northconcepts.datapipeline.core
-
An
IParserover an in-memory string. - StringParser(String) - Constructor for class com.northconcepts.datapipeline.core.StringParser
- stringToBigDecimal() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as big decimals using
new BigDecimal(String). - stringToBigInteger() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as big integers using
new BigInteger(String). - stringToBoolean() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts the string "true" (ignoring case) to
trueand any other value tofalse. - stringToBoolean(boolean) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts a string to a boolean.
- stringToByte() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as bytes using
Byte.valueOf. - stringToChar() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts values to their first character, or the NUL character for empty strings.
- stringToDate(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as dates (
java.sql.Date) using the givenSimpleDateFormatpattern in the default time zone. - stringToDate(String, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as dates (
java.sql.Date) using the givenSimpleDateFormatpattern in the given time zone (an unknown ID falls back to GMT). - stringToDateTime(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as date-times using the given
SimpleDateFormatpattern in the default time zone. - stringToDateTime(String, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as date-times using the given
SimpleDateFormatpattern in the given time zone (an unknown ID falls back to GMT). - stringToDouble() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as doubles using
Double.valueOf. - stringToDouble(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as doubles using a
DecimalFormatwith the given pattern. - stringToDouble(DecimalFormat) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as doubles using the given
DecimalFormat. - stringToFloat() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as floats using
Float.valueOf. - stringToInt() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as ints using
Integer.valueOf. - stringToLong() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as longs using
Long.valueOf. - stringToShort() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as shorts using
Short.valueOf. - stringToTime(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as times (
java.sql.Time) using the givenSimpleDateFormatpattern in the default time zone. - stringToTime(String, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as times (
java.sql.Time) using the givenSimpleDateFormatpattern in the given time zone (an unknown ID falls back to GMT). - stringToUuid() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Parses values as UUIDs using
UUID.fromString. - StructureSiblingSetRule - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Derives a
SiblingSetPatternfrom siblings whose child structures overlap, instead of their names: each candidate's structural signature is the set of its child element and attribute names (looking through JSONobject/arraycontainer nodes), and siblings whose signatures agree aboveminimumSimilarity(Jaccard overlap) form the collapse group. - StructureSiblingSetRule() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.StructureSiblingSetRule
- sublist(int, boolean) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- sublist(int, boolean) - Method in class com.northconcepts.datapipeline.core.RecordList
- sublist(int, int, boolean) - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- sublist(int, int, boolean) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns a new list with the records from
fromIndex(inclusive) totoIndex(exclusive), cloning each record ifcloneRecordsis true. - subList(int, int) - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
-
Returns a new instance holding a copy of the values from
fromIndex(inclusive) totoIndex(exclusive). - subscribed - Enum constant in enum class com.northconcepts.datapipeline.mailchimp.list.ListMemberStatus
- substr(String, Integer, Integer) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Source = Jsonata4Java JSONataUtils.substr
- substring(int) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Keeps the characters from the 0-based
beginto the end; values shorter thanbeginbecome empty strings. - substring(int, int) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Keeps the characters from the 0-based
begin(inclusive) toend(exclusive); values shorter thanendbecome empty strings. - substring(String, Number, Number) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Create substring based on character number and length
- substringAfter(String, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Create substring after a character
- substringBefore(String, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Create substring up until a character
- sum(FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the sum of the field's non-null values as a
BigDecimal, written to the same field path. - sum(FieldPath, FieldPath) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the sum of the source field's non-null values as a
BigDecimal, written to the target field. - sum(String) - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.Adds an operation summing the field's non-null values as a
Double. - sum(String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the sum of the field's non-null values as a
BigDecimal, written to a field of the same name. - sum(String, String) - Method in class com.northconcepts.datapipeline.group.GroupByReader
-
Adds the sum of the source field's non-null values as a
BigDecimal, written to the target field. - sum(List<Number>) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Sum function
- SUM - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
- SuppliedCredentialsResolver - Class in com.northconcepts.datapipeline.security
-
A
CredentialsResolverthat delegates each resolve to aSupplier. - SuppliedCredentialsResolver(Supplier<Credentials>) - Constructor for class com.northconcepts.datapipeline.security.SuppliedCredentialsResolver
- supportsBlockSize() - Method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
- SybaseUpsert - Class in com.northconcepts.datapipeline.jdbc.upsert
-
A batch-able upsert strategy that relies on the SQL Merge statement.
- SybaseUpsert() - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.SybaseUpsert
- SYMBOL_DECIMAL_SEPARATOR - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
-
Collection of decimal format strings that defined by xsl:decimal-format.
- SYMBOL_DIGIT - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SYMBOL_GROUPING_SEPARATOR - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SYMBOL_INFINITY - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SYMBOL_MINUS_SIGN - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SYMBOL_NAN - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SYMBOL_PATTERN_SEPARATOR - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SYMBOL_PER_MILLE - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SYMBOL_PERCENT - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SYMBOL_ZERO_DIGIT - Static variable in class com.northconcepts.datapipeline.jsonata.utils.Constants
- SymmetricDecryptingReader - Class in com.northconcepts.datapipeline.security
-
A
DecryptingReaderthat decrypts fields written by aSymmetricEncryptingReader, restoring each field's original type and value. - SymmetricDecryptingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
- SymmetricDecryptingReader(DataReader, String, SecretKey) - Constructor for class com.northconcepts.datapipeline.security.SymmetricDecryptingReader
- SymmetricEncryptingReader - Class in com.northconcepts.datapipeline.security
-
An
EncryptingReaderthat encrypts fields with a symmetric key, storing each as Base64 text from which aSymmetricDecryptingReaderrestores the original type and value. - SymmetricEncryptingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
- SymmetricEncryptingReader(DataReader, String, SecretKey) - Constructor for class com.northconcepts.datapipeline.security.SymmetricEncryptingReader
- SystemPropertyCredentialsResolver - Class in com.northconcepts.datapipeline.security
-
A
CredentialsResolverthat reads credential values from JVM system properties at each resolve. - SystemPropertyCredentialsResolver() - Constructor for class com.northconcepts.datapipeline.security.SystemPropertyCredentialsResolver
T
- T - Static variable in class com.northconcepts.datapipeline.meter.Meter
- TABLE - Enum constant in enum class com.northconcepts.datapipeline.foundations.jdbc.JdbcSourceType
- TABLE - Enum constant in enum class com.northconcepts.datapipeline.foundations.schema.PrimaryKeyType
- tableBestRowIdentifiersLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest, JdbcTable) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- tableClassNameAndSignedParametersLoaded(JdbcConnection, LoadTablesRequest, JdbcTable) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
-
Called after the class name, signedness and Java type of each of the table's columns are resolved.
- TableColumn - Class in com.northconcepts.datapipeline.sql.h2
-
Represents a table column definition for H2.
- TableColumn - Class in com.northconcepts.datapipeline.sql.mysql
-
A table column's name and
TableColumnType. - TableColumn(String, TableColumnType) - Constructor for class com.northconcepts.datapipeline.sql.h2.TableColumn
-
Constructs a table column with the specified name and type.
- TableColumn(String, TableColumnType) - Constructor for class com.northconcepts.datapipeline.sql.mysql.TableColumn
- tableColumnsLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest, JdbcTable) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- TableColumnType - Enum Class in com.northconcepts.datapipeline.sql.h2
-
Represents data types for H2 table columns.
- TableColumnType - Enum Class in com.northconcepts.datapipeline.sql.mysql
-
MySQL column data types for
CreateTableColumn, noting which accept a length, a scale orAUTO_INCREMENT. - TableColumnType - Enum Class in com.northconcepts.datapipeline.sql.postgresql
-
PostgreSQL column data types for
CreateTableColumn, noting which accept a length and a scale. - TableConfig(JdbcTable, String, File, boolean) - Constructor for class com.northconcepts.datapipeline.foundations.tools.GenerateTableDaoClasses.TableConfig
-
Creates the settings for a table, making its class name singular when
makeIdentifiersSingularis true. - tableExportedKeysLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest, JdbcTable) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- tableImportedKeysLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest, JdbcTable) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- tableIndexesLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest, JdbcTable) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- tableLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest, JdbcTable) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- tableName - Variable in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
- tableName - Variable in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- tableName - Variable in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- tablePrimaryKeysLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest, JdbcTable) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- TableQuerySource - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
A single table in the FROM clause of a
Select. - TableQuerySource(String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.TableQuerySource
- tablesLoaded(JdbcConnection, DatabaseMetaData, LoadTablesRequest) - Method in interface com.northconcepts.datapipeline.foundations.jdbc.JdbcConnectionListener
- Tag - Class in com.northconcepts.datapipeline.mailchimp.list
-
A tag assigned to a MailChimp
ListMember. - Tag() - Constructor for class com.northconcepts.datapipeline.mailchimp.list.Tag
- Tags - Class in com.northconcepts.datapipeline.foundations.core
-
A sorted set of unique labels used to organize, filter and classify schema, entity, relationship and field definitions.
- Tags() - Constructor for class com.northconcepts.datapipeline.foundations.core.Tags
- Tags(String...) - Constructor for class com.northconcepts.datapipeline.foundations.core.Tags
- TailProxyReader - Class in com.northconcepts.datapipeline.memory
-
Keeps the most recent n records in an in-memory
RecordListwhich can be retrieved asynchronously while data is flowing through. - TailProxyReader(DataReader, int) - Constructor for class com.northconcepts.datapipeline.memory.TailProxyReader
-
Creates a reader that keeps the last
maxRecordsrecords read through it; a negative count is rejected. - TailWriter - Class in com.northconcepts.datapipeline.memory
-
Writes records to an in-memory
RecordList. - TailWriter(int) - Constructor for class com.northconcepts.datapipeline.memory.TailWriter
-
Creates a writer that keeps only the last
maxRecordsrecords written; a negative count is rejected. - take(DeMuxReader) - Method in interface com.northconcepts.datapipeline.multiplex.DeMux.IStrategy
-
Returns the next record from the reader's queue, blocking until one is available; called on the reader's thread.
- take(SplitReader) - Method in interface com.northconcepts.datapipeline.multiplex.SplitWriter.IStrategy
-
Returns the next record from the reader's queue, blocking until one is available; called on the reader's thread.
- TAN - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- TEAL - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- TeeReader - Class in com.northconcepts.datapipeline.core
-
A proxy reader that also writes every record passing through it to a DataWriter.
- TeeReader(DataReader, DataWriter) - Constructor for class com.northconcepts.datapipeline.core.TeeReader
-
Creates a new TeeReader.
- TeeReader(DataReader, DataWriter, boolean) - Constructor for class com.northconcepts.datapipeline.core.TeeReader
-
Creates a new TeeReader.
- TemplateObjectWrapper - Class in com.northconcepts.datapipeline.template
-
A FreeMarker
DefaultObjectWrapperthat also wrapsRecords asRecordTemplateModels andArrayValues asArrayTemplateModels. - TemplateObjectWrapper(BeansWrapperConfiguration, boolean) - Constructor for class com.northconcepts.datapipeline.template.TemplateObjectWrapper
- TemplateObjectWrapper(DefaultObjectWrapperConfiguration, boolean) - Constructor for class com.northconcepts.datapipeline.template.TemplateObjectWrapper
- TemplateObjectWrapper(Version) - Constructor for class com.northconcepts.datapipeline.template.TemplateObjectWrapper
- TemplateWriter - Class in com.northconcepts.datapipeline.template
-
Writes records to a text stream using FreeMarker template.
- TemplateWriter(File) - Constructor for class com.northconcepts.datapipeline.template.TemplateWriter
-
Creates a writer that overwrites the file and wraps values with a
TemplateObjectWrapper. - TemplateWriter(File, boolean) - Constructor for class com.northconcepts.datapipeline.template.TemplateWriter
-
Creates a writer for the file that wraps values with a
TemplateObjectWrapper. - TemplateWriter(File, boolean, boolean) - Constructor for class com.northconcepts.datapipeline.template.TemplateWriter
-
Creates a writer for the file;
useTemplateObjectWrapperchooses whether values are wrapped with aTemplateObjectWrapperbefore templates see them. - TemplateWriter(Writer) - Constructor for class com.northconcepts.datapipeline.template.TemplateWriter
-
Creates a writer that wraps values with a
TemplateObjectWrapper. - TemplateWriter(Writer, boolean) - Constructor for class com.northconcepts.datapipeline.template.TemplateWriter
-
Creates a writer;
useTemplateObjectWrapperchooses whether values are wrapped with aTemplateObjectWrapperbefore templates see them. - TemporalFieldDef - Class in com.northconcepts.datapipeline.foundations.schema
-
A
FieldDeffor date, time and datetime values with optional minimum and maximum limits and a parsing pattern for mapping. - TemporalFieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
Creates a field of type
FieldType.DATETIME. - TemporalFieldDef(String, FieldType) - Constructor for class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
-
Creates a field with the given name and type; types other than DATE, TIME and DATETIME are rejected.
- TERMINATED - Enum constant in enum class com.northconcepts.datapipeline.eventbus.EventBus.State
- test(String, String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- text - Enum constant in enum class com.northconcepts.datapipeline.mailchimp.list.EmailType
- text(String) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
-
Adds text computed from the given expression, written XML-escaped, and returns this container (not the text node).
- TEXT - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- TEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- TEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- TEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- textDoesntMatchPattern(String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- TextFieldDef - Class in com.northconcepts.datapipeline.foundations.schema
-
A
FieldDeffor text values with optional length limits, blank check, regular expression and trimming. - TextFieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
Creates a field of type
FieldType.STRING. - TextFieldDef(String, FieldType) - Constructor for class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
-
Creates a field with the given name and type; types other than STRING and CHAR are rejected.
- TextReader - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for obtaining records from a text stream.
- TextReader(File) - Constructor for class com.northconcepts.datapipeline.core.TextReader
-
Creates a reader for the file using the default charset; the file is opened by this constructor rather than by
open(). - TextReader(Reader) - Constructor for class com.northconcepts.datapipeline.core.TextReader
- TextStreamWriter - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for writing records to a text stream.
- TextStreamWriter(File) - Constructor for class com.northconcepts.datapipeline.core.TextStreamWriter
-
Creates a writer that overwrites the file, which this constructor opens immediately rather than in
open(). - TextStreamWriter(Writer) - Constructor for class com.northconcepts.datapipeline.core.TextStreamWriter
- TextTableWriter - Class in com.northconcepts.datapipeline.texttable
-
Writes records as an easy-to-read, plain-text table with padded, aligned columns — a header row of field names, a dashed separator line, then one row per record:
- TextTableWriter(File) - Constructor for class com.northconcepts.datapipeline.texttable.TextTableWriter
- TextTableWriter(File, boolean) - Constructor for class com.northconcepts.datapipeline.texttable.TextTableWriter
- TextTableWriter(Writer) - Constructor for class com.northconcepts.datapipeline.texttable.TextTableWriter
- TextWriter - Class in com.northconcepts.datapipeline.core
-
Abstract super-class for writing records to a text stream.
- TextWriter(File) - Constructor for class com.northconcepts.datapipeline.core.TextWriter
-
Creates a writer that overwrites the file, which this constructor opens immediately rather than in
open(). - TextWriter(File, boolean) - Constructor for class com.northconcepts.datapipeline.core.TextWriter
- TextWriter(Writer) - Constructor for class com.northconcepts.datapipeline.core.TextWriter
- threadLocal - Static variable in class com.northconcepts.datapipeline.job.AbstractJob
- threads - Variable in class com.northconcepts.datapipeline.core.AsyncMultiReader
- throttle() - Method in class com.northconcepts.datapipeline.throttle.Throttle
-
Sleeps the calling thread long enough to bring the meter's average rate back down to the limit; waits under 10 milliseconds are skipped.
- Throttle - Class in com.northconcepts.datapipeline.throttle
-
Limits the average rate measured by a
Meterby making the calling thread sleep while the count is ahead of the allowed rate. - Throttle(Meter, int) - Constructor for class com.northconcepts.datapipeline.throttle.Throttle
- Throttled - Interface in com.northconcepts.datapipeline.throttle
-
Implemented by streams, readers and writers whose rate is limited by a
Throttle. - ThrottledInputStream - Class in com.northconcepts.datapipeline.throttle
-
A
MeteredInputStreamthat pauses after reads when needed to keep its average rate at or below a set number of bytes per second. - ThrottledInputStream(InputStream, int) - Constructor for class com.northconcepts.datapipeline.throttle.ThrottledInputStream
-
Creates a stream that limits reads from
into an average ofunitsPerSecondbytes per second. - ThrottledOutputStream - Class in com.northconcepts.datapipeline.throttle
-
A
MeteredOutputStreamthat pauses before writes when needed to keep its average rate at or below a set number of bytes per second. - ThrottledOutputStream(OutputStream, int) - Constructor for class com.northconcepts.datapipeline.throttle.ThrottledOutputStream
-
Creates a stream that limits writes to
outto an average ofunitsPerSecondbytes per second. - ThrottledReader - Class in com.northconcepts.datapipeline.throttle
-
A proxy that limits the rate (bytes/second) at which data is read.
- ThrottledReader(DataReader, int) - Constructor for class com.northconcepts.datapipeline.throttle.ThrottledReader
-
Creates a reader that limits reading to
bytesPerSecondon average, counting each record's estimated size in bytes. - ThrottledReader(DataReader, int, RecordMeter.MeterUnit) - Constructor for class com.northconcepts.datapipeline.throttle.ThrottledReader
-
Creates a reader that limits reading to
unitsPerSecondon average, counting bytes or records depending onunits. - ThrottledWriter - Class in com.northconcepts.datapipeline.throttle
-
A proxy that limits the rate (bytes/second) at which data is written.
- ThrottledWriter(DataWriter, int) - Constructor for class com.northconcepts.datapipeline.throttle.ThrottledWriter
-
Creates a writer that limits writing to
bytesPerSecondon average, counting each record's estimated size in bytes. - ThrottledWriter(DataWriter, int, RecordMeter.MeterUnit) - Constructor for class com.northconcepts.datapipeline.throttle.ThrottledWriter
-
Creates a writer that limits writing to
unitsPerSecondon average, counting bytes or records depending onunits. - thunk - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- TIME - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- TIME - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
- TIME - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
- TIME - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- TIME - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- TIME - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- TIME - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- TIME_FORMAT - Variable in class com.northconcepts.datapipeline.jdbc.insert.MultiRowStatementInsert
- TIME_WITH_TIME_ZONE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- TIME_WITHOUT_TIME_ZONE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- Timebox - Class in com.northconcepts.datapipeline.jsonata
-
Configure max runtime / max recursion depth.
- Timebox(Jsonata.Frame) - Constructor for class com.northconcepts.datapipeline.jsonata.Timebox
-
Protect the process/browser from a runnaway expression i.e.
- Timebox(Jsonata.Frame, long, int) - Constructor for class com.northconcepts.datapipeline.jsonata.Timebox
- TimedReader - Class in com.northconcepts.datapipeline.core
-
Reads an underlying DataReader for a maximum period of time or until the source DataReader is finished.
- TimedReader(DataReader, long) - Constructor for class com.northconcepts.datapipeline.core.TimedReader
- TIMESTAMP - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- TIMESTAMP - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- TIMESTAMP - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- TIMESTAMP_FORMAT - Static variable in class com.northconcepts.datapipeline.core.DataObject
- TIMESTAMP_FORMAT - Static variable in class com.northconcepts.datapipeline.foundations.core.FoundationObject
- TIMESTAMP_WITH_TIME_ZONE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- TIMESTAMP_WITHOUT_TIME_ZONE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- TIMESTAMPTZ - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- timeToString(String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Formats time values using the given
SimpleDateFormatpattern in the default time zone. - timeToString(String, String) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Formats time values using the given
SimpleDateFormatpattern in the given time zone (an unknown ID falls back to GMT). - timeToString(DateFormat) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- TIMETZ - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- TINYBIT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- TINYBIT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- TINYBLOB - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- TINYBLOB - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- TINYTEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- TINYTEXT - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- TO_ARRAY - Enum constant in enum class com.northconcepts.datapipeline.twitter.EntityExpansionPolicy
-
Return multi-valued fields as an array.
- TO_STRING - Enum constant in enum class com.northconcepts.datapipeline.twitter.EntityExpansionPolicy
-
Return multi-valued fields as a single, space-separated string.
- toArray() - Method in class com.northconcepts.datapipeline.core.FieldList
- toArrayValue() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Returns a new array holding these records themselves (not copies), which become children of that array.
- toArrayValue(Collection<T>) - Static method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Returns an array holding each object's
RecordSerializable.toRecord()record; empty if the collection is null or empty. - toBinary() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Serializes this array to a binary byte array.
- toBinary() - Method in class com.northconcepts.datapipeline.core.Record
-
Serializes this record to a binary byte array.
- toBinary() - Method in class com.northconcepts.datapipeline.core.RecordList
-
Serializes the records to bytes in the binary format read by
RecordList.fromBinary(byte[]). - toBinary(ValueNode<?>) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array to a binary byte array.
- toBinary(ValueNode<?>, DataOutput) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array as binary data to the specified data output.
- toBinary(ValueNode<?>, OutputStream) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array as binary data to the specified output stream.
- toBinary(DataOutput) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Writes the records to the output in binary format, then closes the output if it is
Closeable. - toBinary(OutputStream) - Method in class com.northconcepts.datapipeline.core.RecordList
-
Writes the records to the stream in binary format, then closes the stream.
- toBoolean(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Evaluate an input and return a boolean
- toCsvString() - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
-
Joins the values with a comma and a space, without quoting or escaping them.
- toDataReader() - Method in class com.northconcepts.datapipeline.core.RecordList
- toDate(DateTime) - Static method in class com.northconcepts.datapipeline.google.GoogleApiReader
-
Converts a Google
DateTimeto aDate, returning null for null. - toDebugString() - Method in class com.northconcepts.datapipeline.job.AbstractJob
- toDebugString() - Method in class com.northconcepts.datapipeline.job.Job
- toExcelHyperlinkType(HyperlinkType) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- toExcelHyperlinkType(HyperlinkType) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- toException(GoogleJsonError, HttpHeaders) - Static method in class com.northconcepts.datapipeline.google.GoogleApiReader
-
Converts a Google JSON error into a
DataExceptionholding its code and each error's message, domain, location, location type and reason; the response headers are not used. - toExpression() - Method in class com.northconcepts.datapipeline.core.FieldPath
-
Returns this path as an expression, quoting names that contain characters other than letters and digits (unlike
FieldPath.toString()). - toJson() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Serializes this array to a JSON string.
- toJson() - Method in interface com.northconcepts.datapipeline.core.JsonSerializable
- toJson() - Method in class com.northconcepts.datapipeline.core.Record
-
Serializes this record to a JSON string.
- toJson() - Method in interface com.northconcepts.datapipeline.core.RecordSerializable
- toJson() - Method in class com.northconcepts.datapipeline.core.SingleValue
- toJson() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Serializes this value node to a JSON string.
- toJson() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- toJson() - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- toJson() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- toJson() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- toJson() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- toJson() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- toJson() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- toJson(boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Serializes this record to a JSON string, optionally pretty-printed.
- toJson(ValueNode<?>) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array to a JSON string.
- toJson(ValueNode<?>, boolean) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array to a JSON string, optionally pretty-printed.
- toJson(ValueNode<?>, Writer) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array as JSON to the specified writer.
- toJson(ValueNode<?>, Writer, boolean) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array as JSON to the specified writer, optionally pretty-printed.
- toJson(Writer) - Method in interface com.northconcepts.datapipeline.core.JsonSerializable
-
Writes this object as JSON to the writer, then closes the writer.
- toJson(Writer) - Method in interface com.northconcepts.datapipeline.core.RecordSerializable
- toJson(Writer) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- toJson(Writer) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- toJson(Writer, boolean) - Method in interface com.northconcepts.datapipeline.core.JsonSerializable
-
Writes this object as JSON to the writer, closing the writer afterwards if
closeWriteris true. - toJson(Writer, boolean) - Method in interface com.northconcepts.datapipeline.core.RecordSerializable
- toJson(Writer, boolean) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- toJson(Writer, boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- toJsonataData(Object) - Static method in class com.northconcepts.datapipeline.jsonata.ValueNodeMapper
-
Converts a DataPipeline
ValueNodeto a form the JSONata engine understands (Map, List, or plain Java value) without deep-copying. - token - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- Token() - Constructor for class com.northconcepts.datapipeline.jsonata.Tokenizer.Token
- TOKEN - Static variable in class com.northconcepts.datapipeline.security.Credentials
- Tokenizer - Class in com.northconcepts.datapipeline.jsonata
- Tokenizer.Token - Class in com.northconcepts.datapipeline.jsonata
- TOO_MANY_ATTACHMENT_TYPES - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- tooManyResults(Record, List<?>, RecordList) - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
-
Called when the lookup returns more than one record; throws by default.
- toOriginalString() - Method in exception class com.northconcepts.datapipeline.core.DataException
-
Returns the class name and message without the properties that
DataException.toString()appends. - TOPIC - Enum constant in enum class com.northconcepts.datapipeline.jms.JmsDestinationType
-
Used in publish/subscribe messaging.
- TopicFilter - Class in com.northconcepts.datapipeline.eventbus.filter
-
Matches any one of a set of topics -- topic A || topic B || topic C.
- TopicFilter(Object...) - Constructor for class com.northconcepts.datapipeline.eventbus.filter.TopicFilter
-
Creates a filter matching events whose topic equals one of the given topics.
- toRecord() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- toRecord() - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- toRecord() - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.core.FieldPath
- toRecord() - Method in class com.northconcepts.datapipeline.core.RecordList
- toRecord() - Method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Converts this object's state to a record that
RecordSerializable.fromRecord(Record)can load. - toRecord() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.core.Bean
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.core.Encoder.HexEncoder
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.core.Encoder.NullEncoder
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.core.Property
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMappingProblem
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.difference.Diff
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.file.ProxyFileSource
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcConnection
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcFieldIndex
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcImportedKey
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcIndex
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryColumn
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcQueryParameter
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcSchema
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTable
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.jdbc.JdbcTableColumn
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DatasetPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaProblem
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- toRecord() - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- toRecord() - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- toRecord() - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- toRecord() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyCustomerCriteria
- toRecord() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyEventCriteria
- toRecord() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryItemCriteria
- toRecord() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyInventoryLevelCriteria
- toRecord() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyOrder
- toRecord() - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyProductCriteria
- toRecord() - Method in class com.northconcepts.datapipeline.xml.XmlField
- toRecord(RecordSerializable) - Static method in interface com.northconcepts.datapipeline.core.RecordSerializable
-
Converts the object to a record that also names its class in the
RecordSerializable.SERIALIZED_CLASS_NAMEfield, soRecordSerializable.newInstanceFromRecord(Record)can recreate it; returns null for a null object. - toRecord(MediaFeedData) - Method in class com.northconcepts.datapipeline.instagram.InstagramMediaReader
-
Converts a media item to a record with its caption, author, comments, image URLs, likes, location, user and video URLs.
- toRecord(UserFeedData) - Method in class com.northconcepts.datapipeline.instagram.InstagramSelfReader
-
Converts a user to a record with their bio, full name, ID, profile picture URL, username and website.
- toString() - Method in class com.northconcepts.datapipeline.amazons3.S3Bucket
- toString() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectListing
- toString() - Method in class com.northconcepts.datapipeline.amazons3.S3ObjectSummary
- toString() - Method in class com.northconcepts.datapipeline.buffer.BufferedReader
- toString() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Returns a string representation of this array in the form
[element1, element2, ...]. - toString() - Method in class com.northconcepts.datapipeline.core.AsyncMultiReader.ReaderThread
- toString() - Method in class com.northconcepts.datapipeline.core.CompositeValue
- toString() - Method in class com.northconcepts.datapipeline.core.ConcurrentRecordList
- toString() - Method in class com.northconcepts.datapipeline.core.DataEndpoint
- toString() - Method in exception class com.northconcepts.datapipeline.core.DataException
- toString() - Method in class com.northconcepts.datapipeline.core.DataObject
- toString() - Method in class com.northconcepts.datapipeline.core.Endpoint
- toString() - Method in class com.northconcepts.datapipeline.core.Field
-
Returns a human-readable string representation of this field, including its name, type, and value.
- toString() - Method in class com.northconcepts.datapipeline.core.FieldList
- toString() - Method in class com.northconcepts.datapipeline.core.FieldLocation
- toString() - Method in class com.northconcepts.datapipeline.core.FieldPath
- toString() - Method in class com.northconcepts.datapipeline.core.LineParser
- toString() - Method in class com.northconcepts.datapipeline.core.Message
- toString() - Method in class com.northconcepts.datapipeline.core.Messages
- toString() - Method in class com.northconcepts.datapipeline.core.Node
-
Returns a human-readable string representation of this node and its contents.
- toString() - Method in class com.northconcepts.datapipeline.core.Parser
- toString() - Method in class com.northconcepts.datapipeline.core.Record
-
Returns a human-readable string representation of this node and its contents.
- toString() - Method in class com.northconcepts.datapipeline.core.RecordList
- toString() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.OrSequenceStrategy
- toString() - Method in class com.northconcepts.datapipeline.core.SequenceWriter.Sequence
- toString() - Method in class com.northconcepts.datapipeline.core.SingleValue
-
Returns a string representation of this value, truncated to
Field.MAX_DISPLAY_STRINGcharacters if necessary. - toString() - Method in class com.northconcepts.datapipeline.core.TimedReader
- toString() - Method in class com.northconcepts.datapipeline.csv.CommaSeparatedValues
- toString() - Method in class com.northconcepts.datapipeline.diagnostic.Diagnostic
- toString() - Method in class com.northconcepts.datapipeline.eventbus.Event
- toString() - Method in class com.northconcepts.datapipeline.eventbus.EventBusReader
- toString() - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
- toString() - Method in class com.northconcepts.datapipeline.excel.ExcelCellStyle
- toString() - Method in class com.northconcepts.datapipeline.excel.ExcelColor
- toString() - Method in class com.northconcepts.datapipeline.excel.ExcelFont
- toString() - Method in class com.northconcepts.datapipeline.excel.ExcelHyperlink
- toString() - Method in class com.northconcepts.datapipeline.filter.FieldCount
- toString() - Method in class com.northconcepts.datapipeline.filter.FieldExists
- toString() - Method in class com.northconcepts.datapipeline.filter.FieldFilter
- toString() - Method in class com.northconcepts.datapipeline.filter.FieldNotExists
- toString() - Method in class com.northconcepts.datapipeline.filter.FilterExpression
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.Contains
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.DateIs
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.DateIsAfter
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.DateIsBefore
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.IsEmpty
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.IsFieldType
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.IsInstanceOfJavaType
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.IsJavaType
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.IsNotEmpty
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.IsNotNull
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.IsNull
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.NotRule
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.OrRule
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.PatternMatch
- toString() - Method in class com.northconcepts.datapipeline.filter.rule.ValueMatch
- toString() - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- toString() - Method in class com.northconcepts.datapipeline.foundations.core.Bean
-
Returns a basic JSON representation of this instance.
- toString() - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- toString() - Method in class com.northconcepts.datapipeline.foundations.number.NumberMatch
- toString() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.GroupByField
- toString() - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- toString() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.RegexNodeNameRule
- toString() - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.SiblingSetPattern
- toString() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaFilter
- toString() - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaTransformer
- toString() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePattern
- toString() - Method in class com.northconcepts.datapipeline.foundations.time.DateTimePatternMatch
- toString() - Method in class com.northconcepts.datapipeline.group.AggregateReader.AggregateOperation
-
Deprecated.
- toString() - Method in class com.northconcepts.datapipeline.group.AggregateReader
-
Deprecated.
- toString() - Method in class com.northconcepts.datapipeline.group.GroupByReader
- toString() - Method in class com.northconcepts.datapipeline.group.GroupOperation
- toString() - Method in class com.northconcepts.datapipeline.group.GroupOperationField
- toString() - Method in class com.northconcepts.datapipeline.group.operation.GroupAverage
- toString() - Method in class com.northconcepts.datapipeline.group.operation.GroupCollect
- toString() - Method in class com.northconcepts.datapipeline.jdbc.sql.SqlPart
- toString() - Method in class com.northconcepts.datapipeline.job.Job
- toString() - Method in class com.northconcepts.datapipeline.jsonata.Location
- toString() - Method in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- toString() - Method in class com.northconcepts.datapipeline.memory.MemoryWriter
- toString() - Method in class com.northconcepts.datapipeline.meter.Meter
- toString() - Method in class com.northconcepts.datapipeline.parquet.file.ParquetOutputFile
- toString() - Method in class com.northconcepts.datapipeline.schedule.HourlyScheduler
- toString() - Method in class com.northconcepts.datapipeline.schedule.PeriodicScheduler
- toString() - Method in class com.northconcepts.datapipeline.security.CachingCredentialsResolver
- toString() - Method in class com.northconcepts.datapipeline.security.Credentials
- toString() - Method in class com.northconcepts.datapipeline.security.EnvironmentCredentialsResolver
- toString() - Method in class com.northconcepts.datapipeline.security.FileCredentialsResolver
- toString() - Method in class com.northconcepts.datapipeline.security.StaticCredentialsResolver
- toString() - Method in class com.northconcepts.datapipeline.security.SystemPropertyCredentialsResolver
- toString() - Method in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
- toString() - Method in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- toString() - Method in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
- toString() - Method in enum class com.northconcepts.datapipeline.shopify.client.FulfillmentStatus
- toString() - Method in enum class com.northconcepts.datapipeline.shopify.client.OrderStatus
- toString() - Method in enum class com.northconcepts.datapipeline.shopify.client.ProductStatus
- toString() - Method in enum class com.northconcepts.datapipeline.shopify.client.PublishedStatus
- toString() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer.Operation
- toString() - Method in class com.northconcepts.datapipeline.transform.CopyField
- toString() - Method in class com.northconcepts.datapipeline.transform.FastRenameField
- toString() - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
- toString() - Method in class com.northconcepts.datapipeline.transform.FlattenRecord
- toString() - Method in class com.northconcepts.datapipeline.transform.format.Rounder
- toString() - Method in class com.northconcepts.datapipeline.transform.lookup.BasicLookup
- toString() - Method in class com.northconcepts.datapipeline.transform.lookup.CachedLookup
- toString() - Method in class com.northconcepts.datapipeline.transform.lookup.DataReaderLookup
- toString() - Method in class com.northconcepts.datapipeline.transform.lookup.JdbcLookup
- toString() - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
- toString() - Method in class com.northconcepts.datapipeline.transform.lookup.RecordListLookup
- toString() - Method in class com.northconcepts.datapipeline.transform.MoveFieldAfter
- toString() - Method in class com.northconcepts.datapipeline.transform.MoveFieldBefore
- toString() - Method in class com.northconcepts.datapipeline.transform.MoveFieldToIndex
- toString() - Method in class com.northconcepts.datapipeline.transform.Ngrams
- toString() - Method in class com.northconcepts.datapipeline.transform.RemoveDuplicateFields
- toString() - Method in class com.northconcepts.datapipeline.transform.RemoveFields
- toString() - Method in class com.northconcepts.datapipeline.transform.RenameField
- toString() - Method in class com.northconcepts.datapipeline.transform.SelectFields
- toString() - Method in class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
- toString() - Method in class com.northconcepts.datapipeline.transform.SetCalculatedField
- toString() - Method in class com.northconcepts.datapipeline.transform.SetField
- toString() - Method in class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
- toString() - Method in class com.northconcepts.datapipeline.transform.SetSequenceNumberField
- toString() - Method in class com.northconcepts.datapipeline.transform.SetUuidField
- toString() - Method in class com.northconcepts.datapipeline.transform.SplitArrayField
- toString() - Method in class com.northconcepts.datapipeline.transform.SplitWords
- toString() - Method in enum class com.northconcepts.datapipeline.trello.BoardFilter
- toString() - Method in enum class com.northconcepts.datapipeline.trello.BoardLists
- toString() - Method in enum class com.northconcepts.datapipeline.trello.CardFilter
- toString() - Method in class com.northconcepts.datapipeline.trello.CommaSeparatedList
- toString() - Method in enum class com.northconcepts.datapipeline.trello.ListFilter
- toString() - Method in class com.northconcepts.datapipeline.twitter.TwitterRateLimit
- toString() - Method in class com.northconcepts.datapipeline.xml.XmlField
- toString() - Method in class com.northconcepts.datapipeline.xml.XmlRecordBreak
- toString(String) - Method in class com.northconcepts.datapipeline.core.FieldList
- toString(String, String) - Method in class com.northconcepts.datapipeline.core.FieldList
-
Returns the field names joined by
fieldSeparator, each formatted withString.format(elementFormat, name). - toString(String, String) - Static method in class com.northconcepts.datapipeline.group.AggregateReader.AggregateOperation
-
Deprecated.Returns the key identifying an operation, such as
sum of AMOUNTfor namesumand fieldamount. - toValueNode(Object) - Static method in class com.northconcepts.datapipeline.jsonata.ValueNodeMapper
-
Converts a JSONata engine result back to a DataPipeline
ValueNode. - toXml() - Method in class com.northconcepts.datapipeline.core.ArrayValue
-
Serializes this array to an XML string.
- toXml() - Method in class com.northconcepts.datapipeline.core.Record
-
Serializes this record to an XML string.
- toXml() - Method in class com.northconcepts.datapipeline.core.SingleValue
- toXml() - Method in class com.northconcepts.datapipeline.core.ValueNode
-
Serializes this value node to an XML string.
- toXml() - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns this object as indented XML without an XML declaration.
- toXml() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineInput
- toXml() - Method in class com.northconcepts.datapipeline.foundations.pipeline.ProxyPipelineOutput
- toXml(boolean) - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns this object as indented XML, starting with an XML 1.1 declaration if requested.
- toXml(boolean, boolean) - Method in class com.northconcepts.datapipeline.core.Record
-
Serializes this record to an XML string with control over the root document and formatting.
- toXml(ValueNode<?>) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array to an XML string.
- toXml(ValueNode<?>, boolean, boolean) - Static method in class com.northconcepts.datapipeline.core.Record
-
Serializes the given record or array to an XML string with control over the root document and formatting.
- toXml(ValueNode<?>, Writer) - Static method in class com.northconcepts.datapipeline.core.Record
-
Writes the record or array as unindented XML inside a
<document>root element; the writer is flushed but left open. - toXml(ValueNode<?>, Writer, boolean, boolean) - Static method in class com.northconcepts.datapipeline.core.Record
-
Writes the record or array as XML, inside a
<document>root element ifwriteRootDocumentand indented ifpretty; the writer is flushed but left open. - toXml(Writer) - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Writes this object as indented XML, without a declaration, to the writer and then closes it.
- toXml(Writer) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- toXml(Writer) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- toXml(Writer) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- toXml(Writer) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- toXml(Writer, boolean) - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Writes this object as indented XML, without a declaration, to the writer, closing it afterwards if
closeWriteris true. - toXml(Writer, boolean) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- toXml(Writer, boolean, boolean) - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Writes this object as indented XML to the writer, optionally starting with an XML 1.1 declaration and closing the writer afterwards.
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.avro.pipeline.output.AvroPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.core.FieldPath
- toXmlElement(Document) - Method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Returns an element, created with
document, describing this object; the default implementation throws aDataException. - toXmlElement(Document) - Method in class com.northconcepts.datapipeline.fixedwidth.FixedWidthField
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.core.Attributes
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.core.Tags
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.datamapping.DataMapping
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.datamapping.FieldMapping
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTable
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableCondition
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableOutcome
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.decisiontable.DecisionTableRule
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeNode
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeOutcome
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.expression.CalculatedField
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFile
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSink
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.file.LocalFileSource
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.number.NumberDescriptor
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.AbstractPipeline
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.CompositePipelineAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertDateTimeToStringAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNumberToStringAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToBooleanAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertValueToStringAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.datamapping.DataMappingAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTableAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.decision.DecisionTreeAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldExistsAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldMatchesPatternAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterFieldNotNullAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.filter.FilterMatchExpression
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.PipelineAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.CopyFieldsAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RemoveDuplicatesAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.RenameFieldsAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SelectArrangeFieldsAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.transform.SortFieldsAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.DataMappingPipeline
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Column
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.CsvPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DataReaderPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.DatasetPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.ExcelPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.FixedWidthPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JdbcPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.JsonRecordPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.CsvPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.DataWriterPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.ExcelPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.FixedWidthPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JdbcPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.JsonRecordPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.PipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityRelationshipDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.IndexFieldDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.latex.output.LatexPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.microsoft.word.output.MicrosoftWordPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.openfinancialexchange.pipeline.input.OpenFinancialExchangePipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.orc.input.OrcPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.orc.output.OrcPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.parquet.input.ParquetPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.parquet.output.ParquetPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.pdf.input.PdfPipelineInput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.pdf.output.PdfPipelineOutput
- toXmlElement(Document) - Method in class com.northconcepts.datapipeline.xml.XmlField
- transfer(DataReader, DataWriter) - Method in interface com.northconcepts.datapipeline.job.JobTemplate
-
Transfers all records from the reader to the writer on the current thread and returns the finished job.
- transfer(DataReader, DataWriter) - Method in class com.northconcepts.datapipeline.job.JobTemplateImpl
- transfer(R, W, boolean, JobCallback<R, W>) - Method in interface com.northconcepts.datapipeline.job.JobTemplate
-
Transfers all records from the reader to the writer, on a new thread if
asyncis true, reporting progress and the outcome to the callback. - transfer(R, W, boolean, JobCallback<R, W>) - Method in class com.northconcepts.datapipeline.job.JobTemplateImpl
- transform(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.SchemaTransformer
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.CopyField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.FastRenameField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.FlattenRecord
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.lookup.LookupTransformer
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.MoveFieldAfter
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.MoveFieldBefore
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.MoveFieldToIndex
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.net.GetUrlQueryParam
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.Ngrams
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.RemoveDuplicateFields
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.RemoveFields
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.RenameField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SelectFields
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SetBatchSequenceNumberField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SetCalculatedField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SetField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SetGroupSequenceNumberField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SetSequenceNumberField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SetUuidField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SplitArrayField
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.SplitWords
- transform(Record) - Method in class com.northconcepts.datapipeline.transform.Transformer
-
Applies this transformer to a record on its way through a
TransformingReaderorTransformingWriter. - transform(Tree) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.CollapseSiblingPatterns
- transform(Tree) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DetectFieldCandidates
- transform(Tree) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.DetectRecordBreakCandidates
- transform(Tree) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.MakeFieldNamesUnique
- transform(Tree) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.OptimizeTreeStructure
- transform(Tree) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeTransformer
-
Runs this pass over the loaded tree, updating its nodes in place.
- TRANSFORM - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- Transformer - Class in com.northconcepts.datapipeline.transform
-
Base class for transformations that modify each record passing through a
TransformingReaderorTransformingWriter. - Transformer() - Constructor for class com.northconcepts.datapipeline.transform.Transformer
- transformField(Field) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- transformField(Field) - Method in class com.northconcepts.datapipeline.transform.FieldTransformer
-
Transforms the given field in place; called for each named field found in the record.
- TransformingReader - Class in com.northconcepts.datapipeline.transform
-
A proxy that applies transformations to records passing through.
- TransformingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.transform.TransformingReader
-
Accepts the DataReader to transform.
- TransformingReader(DataReader, DataWriter) - Constructor for class com.northconcepts.datapipeline.transform.TransformingReader
-
Accepts the DataReader to transform and the DataWriter to send discarded records to (due to exception).
- TransformingReader(DataReader, DataWriter, String) - Constructor for class com.northconcepts.datapipeline.transform.TransformingReader
-
Accepts the DataReader to transform and the DataWriter to send discarded records to (due to exception).
- TransformingWriter - Class in com.northconcepts.datapipeline.transform
-
A proxy that applies transformations to records passing through.
- TransformingWriter(DataWriter) - Constructor for class com.northconcepts.datapipeline.transform.TransformingWriter
-
Accepts the target DataWriter of the transform.
- TransformingWriter(DataWriter, DataWriter) - Constructor for class com.northconcepts.datapipeline.transform.TransformingWriter
-
Accepts the target DataWriter of the transform and the DataWriter to send discarded records to (due to exception).
- TransformingWriter(DataWriter, DataWriter, String) - Constructor for class com.northconcepts.datapipeline.transform.TransformingWriter
-
Accepts the target DataWriter of the transform and the DataWriter to send discarded records to (due to exception).
- transformRecord(Record, Transformer, Messages) - Method in class com.northconcepts.datapipeline.transform.TransformingReader
-
Applies the transformer to the record, passing any failure (an exception or a false result) to
onFailure; returns true if the record should continue. - transformRecord(Record, Transformer, Messages) - Method in class com.northconcepts.datapipeline.transform.TransformingWriter
-
Applies the transformer to the record, passing any failure (an exception or a false result) to
onFailure; returns true if the record should continue. - transitionIssue(String, int) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
- transitionIssue(String, JiraIssue) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
-
Performs the transition set on the given issue with
JiraIssue.setTransition(int). - transport - Variable in class com.northconcepts.datapipeline.google.GoogleApiReader
- TRASH - Static variable in interface com.northconcepts.datapipeline.email.GmailFolders
- Tree - Class in com.northconcepts.datapipeline.foundations.pipeline.tree
-
Summarizes the structure of an XML or JSON document as a tree of
TreeNodes, one per distinct path, and detects which nodes are record breaks and fields. - Tree() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Creates an empty tree using
standard(false). - Tree(boolean) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Creates an empty tree using
TreeDetectionStrategy.standard(boolean)with the given structure optimization flag. - Tree(TreeDetectionStrategy) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Creates an empty tree using the given detection strategy, or
standard(false)if null. - TreeDetectionStrategy - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
Defines the algorithms used to detect record breaks and fields in a
Tree: an ordered list ofNodeNameRules that classify dynamic element/field names while the tree is being built, followed by an ordered list ofTreeTransformerpasses that run over the loaded tree. - TreeDetectionStrategy() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeDetectionStrategy
-
Creates the same strategy as
standard(false). - TreeNode - Class in com.northconcepts.datapipeline.foundations.pipeline.tree
-
One distinct element, attribute or JSON path in a
Tree, with its instance count, value statistics and record-break and field flags. - TreeNode() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- TreeNode(Tree) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
- TreeTransformer - Class in com.northconcepts.datapipeline.foundations.pipeline.tree.detect
-
A single pass in a
TreeDetectionStrategythat analyzes or restructures aTreeafter it has been loaded from an XML or JSON document. - TreeTransformer() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.tree.detect.TreeTransformer
- TrelloApiReader - Class in com.northconcepts.datapipeline.trello
-
Superclass for Trello readers supporting pagination.
- TrelloApiReader(String, String) - Constructor for class com.northconcepts.datapipeline.trello.TrelloApiReader
- TrelloApiWriter - Class in com.northconcepts.datapipeline.trello
-
Superclass for Trello writers.
- TrelloApiWriter(String, String) - Constructor for class com.northconcepts.datapipeline.trello.TrelloApiWriter
- TrelloBoardCardsReader - Class in com.northconcepts.datapipeline.trello
-
Reads the list of Trello cards belonging to a board.
- TrelloBoardCardsReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.trello.TrelloBoardCardsReader
- TrelloBoardListsReader - Class in com.northconcepts.datapipeline.trello
-
Reads the list of Trello lists belonging to a board.
- TrelloBoardListsReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.trello.TrelloBoardListsReader
- TrelloBoardsReader - Class in com.northconcepts.datapipeline.trello
-
Reads the list of Trello boards belonging to a member (or the current member if non are specified).
- TrelloBoardsReader(String, String) - Constructor for class com.northconcepts.datapipeline.trello.TrelloBoardsReader
- TrelloCardWriter - Class in com.northconcepts.datapipeline.trello
-
Writes each record to Trello as a new card in a list, reading the list ID, card name and description from configurable record fields that must all be present.
- TrelloCardWriter(String, String) - Constructor for class com.northconcepts.datapipeline.trello.TrelloCardWriter
- TrelloListCardsReader - Class in com.northconcepts.datapipeline.trello
-
Reads the list of Trello cards belonging to a list.
- TrelloListCardsReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.trello.TrelloListCardsReader
- trelloStub - Variable in class com.northconcepts.datapipeline.trello.TrelloApiReader
- trelloStub - Variable in class com.northconcepts.datapipeline.trello.TrelloApiWriter
- trim() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Removes leading and trailing characters up to and including U+0020 (the space), such as tabs and line breaks.
- trim(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Normalize and trim whitespace within a string
- trimLeft() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Removes leading characters up to and including U+0020 (the space), such as tabs and line breaks.
- trimLeft(char) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Removes all leading occurrences of the given character.
- trimRight() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Removes trailing characters up to and including U+0020 (the space), such as tabs and line breaks.
- trimRight(char) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Removes all trailing occurrences of the given character.
- TRUNCATE - Enum constant in enum class com.northconcepts.datapipeline.excel.LargeCellHandler
- tryAdvance(Consumer<? super Record>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetSpliterator
- trySplit() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.DatasetSpliterator
- TSQUERY - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- TSVECTOR - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- tuple - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- tupleStream - Variable in class com.northconcepts.datapipeline.jsonata.Utils.JList
- TURQUOISE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- TURQUOISE1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- TWEET_DELETED_OR_NOT_VISIBLE_TO_YOU - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- tweetToRecord(Status, Record, IEntityExpansionPolicy) - Method in interface com.northconcepts.datapipeline.twitter.ITwitterConverter
- tweetToRecord(Status, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterConverter
- TWITTER_REST_API_V1_IS_NO_LONGER_ACTIVE - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- TwitterConverter - Class in com.northconcepts.datapipeline.twitter
-
Default
ITwitterConverter, available asTwitterConverter.DEFAULT, that maps tweets, users and lists to record fields. - TwitterConverter() - Constructor for class com.northconcepts.datapipeline.twitter.TwitterConverter
- twitterCredentials - Variable in class com.northconcepts.datapipeline.twitter2.AbstractTwitterReader
- TwitterCredentials - Class in com.northconcepts.datapipeline.twitter2
-
The API key and secret plus an OAuth 1.0a access token or a bearer token, used to authorize Twitter API v2 requests.
- TwitterCredentials(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterCredentials
-
Creates credentials that send the given bearer token with each request.
- TwitterCredentials(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterCredentials
-
Creates credentials that sign each request with OAuth 1.0a using the given access token.
- TwitterErrorCode - Enum Class in com.northconcepts.datapipeline.twitter
-
Known Twitter API error codes, each with its error message and a longer description.
- TwitterFilterStreamReader - Class in com.northconcepts.datapipeline.twitter
-
Continuously reads tweets matching several criteria (hashtag, user, language, etc.)
- TwitterFilterStreamReader - Class in com.northconcepts.datapipeline.twitter2
-
Continuously reads filtered Tweets in real-time based on a set of filter rules.
- TwitterFilterStreamReader(TwitterStreamProvider) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- TwitterFilterStreamReader(String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- TwitterFilterStreamReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterFilterStreamReader
- TwitterFilterStreamReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFilterStreamReader
- TwitterFollowerIDsReader - Class in com.northconcepts.datapipeline.twitter
-
Reads the IDs of accounts following the specified account.
- TwitterFollowerIDsReader(TwitterProvider, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowerIDsReader
- TwitterFollowerIDsReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowerIDsReader
- TwitterFollowerIDsReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowerIDsReader
- TwitterFollowerListReader - Class in com.northconcepts.datapipeline.twitter
-
Reads the details of accounts following the specified account.
- TwitterFollowerListReader(TwitterProvider, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowerListReader
- TwitterFollowerListReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowerListReader
- TwitterFollowerListReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowerListReader
- TwitterFollowerReader - Class in com.northconcepts.datapipeline.twitter2
-
Obtains records of Twitter users that follow the specified Twitter account.
- TwitterFollowerReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterFollowerReader
-
Creates a reader for the followers of
username(max results defaults to 1000). - TwitterFollowerReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterFollowerReader
-
Creates a reader for the followers of
username(max results defaults to 1000). - TwitterFollowingIDsReader - Class in com.northconcepts.datapipeline.twitter
-
Reads the IDs of accounts a specified account follows.
- TwitterFollowingIDsReader(TwitterProvider, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowingIDsReader
- TwitterFollowingIDsReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowingIDsReader
- TwitterFollowingIDsReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowingIDsReader
- TwitterFollowingListReader - Class in com.northconcepts.datapipeline.twitter
-
Reads the details of accounts a specified account follows.
- TwitterFollowingListReader(TwitterProvider, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowingListReader
- TwitterFollowingListReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowingListReader
- TwitterFollowingListReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowingListReader
- TwitterFollowingReader - Class in com.northconcepts.datapipeline.twitter2
-
Obtains records of Twitter users that a specified Twitter account is following.
- TwitterFollowingReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterFollowingReader
-
Creates a reader for the accounts
usernamefollows (max results defaults to 1000). - TwitterFollowingReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterFollowingReader
-
Creates a reader for the accounts
usernamefollows (max results defaults to 1000). - TwitterFollowWriter - Class in com.northconcepts.datapipeline.twitter
-
Follows accounts written to it.
- TwitterFollowWriter(TwitterProvider, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
- TwitterFollowWriter(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
- TwitterFollowWriter(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
- TwitterListMemberReader - Class in com.northconcepts.datapipeline.twitter
-
Reads the users of list.
- TwitterListMemberReader(TwitterProvider, long) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
- TwitterListMemberReader(TwitterProvider, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
-
Creates a reader for the members of the list identified by its owner's screen name and slug.
- TwitterListMemberReader(String, String, long) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
- TwitterListMemberReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
-
Creates a reader for the members of the list identified by its owner's screen name and slug.
- TwitterListMemberReader(String, String, String, String, long) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
- TwitterListMemberReader(String, String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListMemberReader
-
Creates a reader for the members of the list identified by its owner's screen name and slug.
- TwitterListOwnershipReader - Class in com.northconcepts.datapipeline.twitter
-
Reads the list for the specified account.
- TwitterListOwnershipReader(TwitterProvider, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListOwnershipReader
- TwitterListOwnershipReader(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListOwnershipReader
- TwitterListOwnershipReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterListOwnershipReader
- TwitterPageableReader<E,
C> - Class in com.northconcepts.datapipeline.twitter -
Base class for Twitter readers that page through cursor-based API results, returning one record per element.
- TwitterPageableReader(String, String, TwitterProvider, int) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- TwitterPageableReader(String, String, String, String, int) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- TwitterPageableReader(String, String, String, String, String, String, int) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterPageableReader
- TwitterPageableReader.Direction - Enum Class in com.northconcepts.datapipeline.twitter
-
Paging direction: follow each page's next cursor (
FORWARD) or its previous cursor (BACKWARD). - TwitterProvider - Class in com.northconcepts.datapipeline.twitter
-
Non-streaming Twitter service provider.
- TwitterProvider(String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Creates a provider that uses application-only (OAuth 2 bearer token) authentication.
- TwitterProvider(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterProvider
-
Creates a provider that authenticates with the given user access token, or application-only if it is empty.
- TwitterProxyReader - Class in com.northconcepts.datapipeline.twitter
-
Base class for all Twitter ProxyReaders.
- TwitterProxyReader(String, String, TwitterProvider, DataReader) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- TwitterProxyReader(String, String, String, String, DataReader) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- TwitterProxyReader(String, String, String, String, String, String, DataReader) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterProxyReader
- TwitterRateLimit - Class in com.northconcepts.datapipeline.twitter
-
A snapshot of a Twitter API rate limit: the calls allowed, the calls remaining and when the limit resets.
- TwitterRateLimit(RateLimitStatus) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterRateLimit
-
Creates a snapshot of the given status; a null status yields 100 of 100 calls remaining.
- TwitterReader - Class in com.northconcepts.datapipeline.twitter
-
Base class for all Twitter DataReaders.
- TwitterReader(String, String, TwitterProvider) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterReader
- TwitterReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterReader
- TwitterReader(String, String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterReader
- TwitterSampleStreamReader - Class in com.northconcepts.datapipeline.twitter
-
Continuously reads a small random sample of all tweets.
- TwitterSampleStreamReader(TwitterStreamProvider) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterSampleStreamReader
- TwitterSampleStreamReader(String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterSampleStreamReader
- TwitterSampleStreamReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterSampleStreamReader
- TwitterSearchReader - Class in com.northconcepts.datapipeline.twitter
-
Obtains records by searching Twitter for the most recent tweets matching a search criteria.
- TwitterSearchReader - Class in com.northconcepts.datapipeline.twitter2
-
Obtains records of Tweets posted over the last 7 days that match a search criteria.
- TwitterSearchReader(TwitterProvider, String, int) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterSearchReader
-
Creates a reader for tweets matching
searchQuerythat stops aftermaxResultstweets. - TwitterSearchReader(String, String, String, int) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterSearchReader
-
Creates a reader for tweets matching
searchQuerythat stops aftermaxResultstweets. - TwitterSearchReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterSearchReader
- TwitterSearchReader(String, String, String, String, String, int) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterSearchReader
-
Creates a reader for tweets matching
searchQuerythat stops aftermaxResultstweets. - TwitterStreamProvider - Class in com.northconcepts.datapipeline.twitter
-
Streaming Twitter service provider.
- TwitterStreamProvider(String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Creates a provider that uses application-only (OAuth 2 bearer token) authentication.
- TwitterStreamProvider(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterStreamProvider
-
Creates a provider that authenticates with the given user access token, or application-only if it is empty.
- TwitterTimelineMentionsReader - Class in com.northconcepts.datapipeline.twitter2
-
Obtains records of Tweets mentioning the specified Twitter account.
- TwitterTimelineMentionsReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterTimelineMentionsReader
- TwitterTimelineMentionsReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterTimelineMentionsReader
- TwitterTimelineReader - Class in com.northconcepts.datapipeline.twitter2
-
Base class for the Twitter API v2 readers of a user's timeline, optionally limited by date and tweet ID range.
- TwitterTimelineReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
- TwitterTimelineReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterTimelineReader
- TwitterTimelineTweetsReader - Class in com.northconcepts.datapipeline.twitter2
-
Obtains records of Tweets, Retweets, replies, and Quote Tweets published by a specific Twitter account.
- TwitterTimelineTweetsReader(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterTimelineTweetsReader
- TwitterTimelineTweetsReader(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterTimelineTweetsReader
- TwitterUnfollowWriter - Class in com.northconcepts.datapipeline.twitter
-
Unfollows accounts written to it.
- TwitterUnfollowWriter(TwitterProvider, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
- TwitterUnfollowWriter(String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
- TwitterUnfollowWriter(String, String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
- TwitterUserLookupReader - Class in com.northconcepts.datapipeline.twitter
-
Adds Twitter user details to records from a nested reader by looking up the user ID or screen name in a source field.
- TwitterUserLookupReader(TwitterProvider, DataReader, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Creates a reader that looks up users by the ID or screen name at the
sourceIdFieldNamefield path. - TwitterUserLookupReader(String, String, DataReader, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Creates a reader that looks up users by the ID or screen name at the
sourceIdFieldNamefield path. - TwitterUserLookupReader(String, String, String, String, DataReader, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterUserLookupReader
-
Creates a reader that looks up users by the ID or screen name at the
sourceIdFieldNamefield path. - TwitterV2Client - Class in com.northconcepts.datapipeline.twitter2
-
Minimal Twitter API v2 client (tweet search, followers, timelines, filtered stream) used by this package's readers.
- TwitterV2Client(TwitterCredentials) - Constructor for class com.northconcepts.datapipeline.twitter2.TwitterV2Client
- TwitterWriter - Class in com.northconcepts.datapipeline.twitter
-
Base class for all Twitter DataWriters.
- TwitterWriter(TwitterProvider) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterWriter
- TwitterWriter(String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterWriter
- TwitterWriter(String, String, String, String) - Constructor for class com.northconcepts.datapipeline.twitter.TwitterWriter
- TXID_SNAPSHOT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- type - Variable in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- type(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
- TYPE - Static variable in interface com.northconcepts.datapipeline.core.RecordSerializable
- TypedListenerList<T> - Class in com.northconcepts.datapipeline.eventbus
-
Holds the listeners subscribed to an
EventBusthrough one listener interface. - TypedListenerList(Class<T>) - Constructor for class com.northconcepts.datapipeline.eventbus.TypedListenerList
- typeImport - Variable in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
- typeMismatch(String, String, String, String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- TypeValue(ConvertNullToValueAction.FieldType, String) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.TypeValue
-
Creates a replacement whose string value
vis converted to typet. - TypeValue(AddFieldsAction.FieldType, String) - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.TypeValue
-
Creates a value whose string form
vis converted to typet.
U
- UNABLE_TO_VERIFY_YOUR_CREDENTIALS - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- UNDEFINED - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- underline() - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that underlines text.
- undoLastAction() - Method in class com.northconcepts.datapipeline.foundations.pipeline.Pipeline
-
Removes the last action and keeps it for
Pipeline.redoLastAction(); returns it, or null if there are no actions. - UNFULFILLED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FulfillmentStatus
- Union - Class in com.northconcepts.datapipeline.jdbc.sql.select
-
Combines several
Selectqueries with UNION or UNION ALL; can be nested in another query as a source. - Union(Select...) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.select.Union
-
Creates a union of the given queries; at least one is required.
- UNNECESSARY - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
If value is double, returns the same value.
- UNPAID - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
- UNPUBLISHED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- UNPUBLISHED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.PublishedStatus
- UNSHIPPED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FulfillmentStatus
- unsubscribed - Enum constant in enum class com.northconcepts.datapipeline.mailchimp.list.ListMemberStatus
- unsupportedOperation(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- UntypedEventListener - Interface in com.northconcepts.datapipeline.eventbus
-
Receives events published on an
EventBuswhatever their listener interface; register withEventBus.addUntypedEventListener(UntypedEventListener). - UP - Enum constant in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
Discards the digits based on decimal places and always increments the digit prior to discarded fraction.
- Update - Class in com.northconcepts.datapipeline.jdbc.sql.update
-
Builds an
UPDATE table SET column=?, ... WHERE ...statement with its parameter values. - Update(String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.update.Update
- UPDATE - Enum constant in enum class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert.ConflictAction
- UPDATE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- UPDATE - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.ConflictAction
- updateColumns(Record, DataWriter) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Queues the record's fields for asynchronous column stats until the writer has written
Dataset.getMaxColumnStatsRecords()records; subclass writers call this for each record they cache. - updateCurrentNode() - Method in class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Reads the next XML event and updates the current node: a start element opens a child node, an end element returns to the parent and text is added to the current node.
- updateInventoryItem(String, ShopifyInventoryItem) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
-
Updates the inventory item whose ID is passed as
orderId. - updateInventoryItem(String, ShopifyInventoryItem) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
- updateInventoryLevel(String, String, int) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
-
Replaces the inventory item's available quantity at the location with
available. - updateInventoryLevel(String, String, int) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
- updateIssue(String, JiraIssue) - Method in interface com.northconcepts.datapipeline.jira.client.JiraClient
- updateIssue(String, JiraIssue) - Method in class com.northconcepts.datapipeline.jira.client.JiraService
- updateOrder(String, ShopifyOrder) - Method in interface com.northconcepts.datapipeline.shopify.client.ShopifyClient
- updateOrder(String, ShopifyOrder) - Method in class com.northconcepts.datapipeline.shopify.client.ShopifyService
- UpdateValue - Class in com.northconcepts.datapipeline.jdbc.sql.update
-
A
column=?assignment and its parameter value in an UPDATE SET list. - UpdateValue(String) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.update.UpdateValue
-
Creates an assignment with a null parameter value.
- UpdateValue(String, Object) - Constructor for class com.northconcepts.datapipeline.jdbc.sql.update.UpdateValue
- uppercase(String) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Uppercase a string
- upperCase() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts values to upper case using the default locale.
- upperCaseFirstChar() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts the first character of each value to upper case, leaving the rest unchanged.
- Upsert - Class in com.northconcepts.datapipeline.sql.h2
-
Generates an upsert statement for H2.
- Upsert - Class in com.northconcepts.datapipeline.sql.mysql
-
Generates an upsert statement for MySQL.
- Upsert - Class in com.northconcepts.datapipeline.sql.postgresql
-
Generates an upsert statement for PostgreSQL.
- Upsert(String) - Constructor for class com.northconcepts.datapipeline.sql.h2.Upsert
-
Constructs an Upsert for the specified table.
- Upsert(String) - Constructor for class com.northconcepts.datapipeline.sql.mysql.Upsert
- Upsert(String, String...) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.Upsert
-
Creates an upsert into
tablethat uses the given key fields forON CONFLICT; at least one is required. - Upsert(String, List<String>) - Constructor for class com.northconcepts.datapipeline.sql.postgresql.Upsert
-
Creates an upsert into
tablethat uses the given key fields forON CONFLICT; at least one is required. - UpsertStub(IUpsert) - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert.UpsertStub
- URL - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelHyperlinkType
-
A hyperlink to a URL (web address).
- USE_LAST_VALUE - Enum constant in enum class com.northconcepts.datapipeline.xml.XmlReader.DuplicateFieldPolicy
- USE_LIST - Enum constant in enum class com.northconcepts.datapipeline.xml.XmlReader.DuplicateFieldPolicy
- useBigDecimal(boolean) - Method in class com.northconcepts.datapipeline.json.JsonReader
-
Deprecated.Use
JsonReader.setUseBigDecimal(boolean)method instead. - useProfileCredentialsProvider(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3File
-
Authenticates this file's
AmazonS3FileSystemusing the named profile from the AWS profile files, unless aCredentialsResolveris set, which takes precedence. - useProfileCredentialsProvider(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSink
- useProfileCredentialsProvider(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSource
- useProfileCredentialsProvider(String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Authenticates using the named profile from the AWS profile files (instead of the default profile used by the default credentials provider chain), unless a
CredentialsResolveris set, which takes precedence. - USER_HAS_BEEN_SUSPENDED - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- USER_IS_OVER_DAILY_STATUS_UPDATE_LIMIT - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- USER_MUST_VERIFY_LOGIN - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- USER_NOT_FOUND - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- USER_NOT_MUTTED - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- userListToRecord(UserList, Record, IEntityExpansionPolicy) - Method in interface com.northconcepts.datapipeline.twitter.ITwitterConverter
- userListToRecord(UserList, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterConverter
- USERNAME - Static variable in class com.northconcepts.datapipeline.security.Credentials
- userToRecord(User, Record, IEntityExpansionPolicy) - Method in interface com.northconcepts.datapipeline.twitter.ITwitterConverter
- userToRecord(User, Record, IEntityExpansionPolicy) - Method in class com.northconcepts.datapipeline.twitter.TwitterConverter
- Utils - Class in com.northconcepts.datapipeline.jsonata
- Utils() - Constructor for class com.northconcepts.datapipeline.jsonata.Utils
- Utils.JList<E> - Class in com.northconcepts.datapipeline.jsonata
- Utils.RangeList - Class in com.northconcepts.datapipeline.jsonata
-
List representing an int range [a,b] Both sides are included.
- UUID - Enum constant in enum class com.northconcepts.datapipeline.core.FieldType
- UUID - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- UuidFieldDef - Class in com.northconcepts.datapipeline.foundations.schema
- UuidFieldDef() - Constructor for class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- UuidFieldDef(String, FieldType) - Constructor for class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- uuidToBytes() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts UUIDs to 16-byte arrays, most significant bits first.
- uuidToString() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
V
- validate(Object, Object) - Method in class com.northconcepts.datapipeline.jsonata.Jsonata.JFunction
- validate(Object, Object) - Method in interface com.northconcepts.datapipeline.jsonata.Jsonata.JFunctionSignatureValidation
- validate(Object, Object) - Method in class com.northconcepts.datapipeline.jsonata.utils.Signature
- VALIDATE - Enum constant in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
- validateAllowedValues(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Adds an error if
FieldDef.isLimitToAllowedValues()is true and the value is not one of the allowed values. - validateField(Field) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Validates the given field against this definition, treating null as a missing field, and returns the errors found.
- validateField(Field, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Validates the field like
FieldDef.validateField(Field), adding errors to the given result (or a new one if null) and returning it. - validateField(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Validates this field in the given record, locating it by
FieldDef.getPosition()when set and by name otherwise. - validateField(Record, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Validates this field in the record like
FieldDef.validateField(Record), adding errors to the given result (or a new one if null) and returning it. - ValidateFieldsExistsAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.validate
-
A
PipelineActionwhose generated Java code checks that records contain the selected fields;ValidateFieldsExistsAction.apply(DataReader)returns the reader unchanged. - ValidateFieldsExistsAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsExistsAction
- ValidateFieldsMatchPatternAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.validate
-
A
PipelineActionwhose generated Java code checks that fields fully match their regular expressions;ValidateFieldsMatchPatternAction.apply(DataReader)returns the reader unchanged. - ValidateFieldsMatchPatternAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsMatchPatternAction
- ValidateFieldsNotNullAction - Class in com.northconcepts.datapipeline.foundations.pipeline.action.validate
-
A
PipelineActionwhose generated Java code checks that the selected fields are not null;ValidateFieldsNotNullAction.apply(DataReader)returns the reader unchanged. - ValidateFieldsNotNullAction() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateFieldsNotNullAction
- validateInput(Object) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Validate input data types.
- ValidateMatchExpression - Class in com.northconcepts.datapipeline.foundations.pipeline.action.validate
-
A
PipelineActionwhose generated Java code checks that records satisfy a boolean expression;ValidateMatchExpression.apply(DataReader)returns the reader unchanged. - ValidateMatchExpression() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.action.validate.ValidateMatchExpression
- validateName() - Method in class com.northconcepts.datapipeline.foundations.datamapping.AbstractFieldMapping
-
Throws an exception if the target field name is not set; called before each field is mapped.
- validateRecord(Record) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Checks the record, without changing it, against this entity's fields (including inherited ones) and validation rules; returns the errors found.
- validateRecord(Record, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.EntityDef
-
Validates the record like
EntityDef.validateRecord(Record), adding errors to the given result (or a new one if null) and returning it. - validateValue(Object) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Validates a Java value against this definition, treating arrays and collections as array values, and returns the errors found.
- validateValue(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Validates the value like
FieldDef.validateValue(Object), adding errors to the given result (or a new one if null) and returning it. - validateValueImpl(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.BinaryFieldDef
- validateValueImpl(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.BooleanFieldDef
- validateValueImpl(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.FieldDef
-
Applies the subclass-specific checks to a single (non-array) value, adding any errors to the result; called after the common type, array and allowed-value checks.
- validateValueImpl(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.NumericFieldDef
- validateValueImpl(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.RecordFieldDef
- validateValueImpl(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.TemporalFieldDef
- validateValueImpl(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.TextFieldDef
- validateValueImpl(Object, ValidationResult) - Method in class com.northconcepts.datapipeline.foundations.schema.UuidFieldDef
- ValidatingReader - Class in com.northconcepts.datapipeline.validate
-
A proxy that validates records by applying a set of filters.
- ValidatingReader(DataReader) - Constructor for class com.northconcepts.datapipeline.validate.ValidatingReader
-
Creates a reader that throws an exception for the first record failing validation.
- ValidatingReader(DataReader, DataWriter) - Constructor for class com.northconcepts.datapipeline.validate.ValidatingReader
-
Accepts the DataReader to validate and the DataWriter to send discarded records to.
- ValidatingReader(DataReader, DataWriter, String) - Constructor for class com.northconcepts.datapipeline.validate.ValidatingReader
-
Accepts the DataReader to validate and the DataWriter to send discarded records to.
- ValidationMessage - Class in com.northconcepts.datapipeline.foundations.schema
-
One mapping or validation error, with the entity, field or validation rule it concerns.
- ValidationMessage() - Constructor for class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- ValidationMessage(Filter, String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- ValidationMessage(EntityDef, String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
- ValidationMessage(FieldDef, String) - Constructor for class com.northconcepts.datapipeline.foundations.schema.ValidationMessage
-
Creates a message about the given field, also setting the entity to the field's parent entity.
- ValidationResult - Class in com.northconcepts.datapipeline.foundations.schema
-
Collects the
ValidationMessageerrors produced when mapping or validating data against a schema definition. - ValidationResult() - Constructor for class com.northconcepts.datapipeline.foundations.schema.ValidationResult
- value - Variable in class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
- value(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonArray
- value(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonConditionalNode
- value(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonDetailMarker
- value(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Adds a scalar element whose value is computed by the given expression; only valid on array nodes.
- valueBuffer - Variable in class com.northconcepts.datapipeline.core.ParsingReader
- valueIsNotABoolean(String, Class<?>) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- valueIsNotARecord(String, Class<?>) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- valueIsWrongType(Object, FieldType, FieldType) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- ValueMatch<T> - Class in com.northconcepts.datapipeline.filter.rule
-
A
FieldFilterRulethat allows fields whose value equals one of its values; values are compared withequals, so their Java types must match (for example1and1Ldiffer). - ValueMatch() - Constructor for class com.northconcepts.datapipeline.filter.rule.ValueMatch
- ValueMatch(Collection<?>) - Constructor for class com.northconcepts.datapipeline.filter.rule.ValueMatch
- ValueMatch(T...) - Constructor for class com.northconcepts.datapipeline.filter.rule.ValueMatch
- valueMatches(T...) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to equal one of the given values (compared with
equals, so types must match). - ValueNode<T> - Class in com.northconcepts.datapipeline.core
-
ValueNode is the base class for all persistent values held in fields and arrays.
- ValueNode() - Constructor for class com.northconcepts.datapipeline.core.ValueNode
- ValueNodeComparator - Class in com.northconcepts.datapipeline.core
-
A comparator for
ValueNodeinstances that supports sorting and comparing records, arrays, and single values. - ValueNodeComparator() - Constructor for class com.northconcepts.datapipeline.core.ValueNodeComparator
-
Creates a new ValueNodeComparator.
- ValueNodeContainer - Interface in com.northconcepts.datapipeline.core
-
A general interface for nodes that allow values to be added to itself.
- ValueNodeMapper - Class in com.northconcepts.datapipeline.jsonata
-
Converts values between DataPipeline
ValueNodes and the maps, lists and plain Java values used by the JSONata engine. - valueNodeToBsonValue(ValueNode<?>) - Static method in class com.northconcepts.datapipeline.mongodb.MongoTypeConverter
-
Converts a value node to a BSON value (BSON null for null values); throws for big integers, big decimals and UUIDs.
- valueNotFoundInValueMatch(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- valueNotMatches(T...) - Method in class com.northconcepts.datapipeline.filter.FieldFilter
-
Adds a rule requiring the field's value to equal none of the given values (compared with
equals). - valueOf(String) - Static method in enum class com.northconcepts.datapipeline.core.DataEndpoint.State
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.core.Message.Level
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.core.Node.DuplicateNodeAction
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.core.Node.NodeType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.core.Record.State
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.core.StreamWriter.Format
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.csv.CSVWriter.ValuePolicy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.email.EmailReadDirection
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.email.MailStore
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.eventbus.EventBus.State
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.excel.ExcelHyperlinkType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.excel.ExcelReader.FailedExpressionStrategy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.excel.LargeCellHandler
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.filesystem.ftp.DataConnectionMode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferMode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.fixedwidth.FixedWidthAlign
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPartType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.difference.DiffType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.file.FileType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery.Cardinality
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.jdbc.JdbcSourceType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset.DatabaseProvider
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.PrimaryKeyType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.RelationshipCardinality
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.SchemaProblem.Severity
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset.FieldTypeSelectionMode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.jdbc.sql.merge.MergeUsing
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria.CriteriaType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert.ConflictAction
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.SortDirection
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.jira.JiraSprintReader.SprintState
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.jms.JmsAcknowledgeMode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.jms.JmsDestinationType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.json.builder.JsonNodeType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.mailchimp.list.EmailType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.mailchimp.list.ListMemberStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.meter.RecordMeter.MeterUnit
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageOrientation
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.multiplex.DeMux.Strategy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.multiplex.SplitWriter.Strategy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageOrientation
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.retry.RetryStrategy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.shopify.client.FulfillmentStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.shopify.client.OrderStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.shopify.client.ProductStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.shopify.client.PublishedStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.sql.h2.ForeignKeyAction
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.sql.mysql.ForeignKeyAction
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.sql.postgresql.ConflictAction
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.sql.postgresql.ForeignKeyAction
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.DuplicateFieldsPolicy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.trello.BoardFilter
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.trello.BoardLists
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.trello.CardFilter
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.trello.ListFilter
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.twitter.ApiLimitPolicy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.twitter.EntityExpansionPolicy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.twitter.TwitterPageableReader.Direction
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class com.northconcepts.datapipeline.xml.XmlReader.DuplicateFieldPolicy
-
Returns the enum constant of this class with the specified name.
- valueOfRule(int) - Static method in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
-
Returns the action for the given JDBC
DatabaseMetaDataupdate or delete rule or null if the value is unknown. - values() - Static method in enum class com.northconcepts.datapipeline.core.DataEndpoint.State
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.core.FieldType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.core.Message.Level
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.core.Node.DuplicateNodeAction
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.core.Node.NodeType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.core.Record.State
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.core.StreamWriter.Format
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.csv.CSVWriter.ValuePolicy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.email.EmailReadDirection
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.email.MailStore
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.eventbus.EventBus.State
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.excel.ExcelDocument.ProviderType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.excel.ExcelHyperlinkType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.excel.ExcelReader.FailedExpressionStrategy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.excel.LargeCellHandler
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.filesystem.ftp.DataConnectionMode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferMode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.filesystem.ftp.FileTransferType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.fixedwidth.FixedWidthAlign
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.datamapping.DataMappingPartType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.difference.DiffType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.file.FileType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.jdbc.JdbcQuery.Cardinality
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.jdbc.JdbcSourceType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.ActionGroup
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.aggregate.AggregateGroupFieldsAction.OperatorType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertNullToValueAction.FieldType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToDateTimeAction.FieldType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.convert.ConvertStringToNumberAction.FieldType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.action.transform.AddFieldsAction.FieldType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.pipeline.dataset.JdbcDataset.DatabaseProvider
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.schema.ForeignKeyAction
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.schema.PrimaryKeyType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.schema.RelationshipCardinality
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.schema.SchemaPartType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.schema.SchemaProblem.Severity
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset.FieldTypeSelectionMode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.jdbc.sql.merge.MergeUsing
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria.CriteriaType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.jdbc.upsert.PostgreSqlUpsert.ConflictAction
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.OrderByField
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.jira.JiraProjectReader.SortDirection
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.jira.JiraSprintReader.SprintState
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.jms.JmsAcknowledgeMode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.jms.JmsDestinationType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.json.builder.JsonNodeType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.mailchimp.list.EmailType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.mailchimp.list.ListMemberStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.meter.RecordMeter.MeterUnit
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageOrientation
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter.PageSize
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.multiplex.DeMux.Strategy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.multiplex.SplitWriter.Strategy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageOrientation
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.pdf.PdfWriter.PageSize
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.retry.RetryStrategy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.shopify.client.EventFilter
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.shopify.client.FulfillmentStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.shopify.client.OrderStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.shopify.client.ProductStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.shopify.client.PublishedStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.sql.h2.ForeignKeyAction
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.sql.mysql.ForeignKeyAction
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.sql.postgresql.ConflictAction
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.sql.postgresql.ForeignKeyAction
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Method in class com.northconcepts.datapipeline.template.RecordTemplateModel
- values() - Static method in enum class com.northconcepts.datapipeline.transform.format.Rounder.RoundingPolicy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.transform.RemoveDuplicateFields.DuplicateFieldsPolicy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.trello.BoardFilter
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.trello.BoardLists
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.trello.CardFilter
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.trello.ListFilter
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.twitter.ApiLimitPolicy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.twitter.EntityExpansionPolicy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.twitter.TwitterPageableReader.Direction
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class com.northconcepts.datapipeline.xml.XmlReader.DuplicateFieldPolicy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- VALUES - Enum constant in enum class com.northconcepts.datapipeline.jdbc.sql.merge.MergeUsing
- valueToNull(Object) - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
-
Converts a field to
nullif its value matches the specified parameter. - valueTooEarly(String, TemporalAccessor, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- valueTooLate(String, TemporalAccessor, Object) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- valueTooLong(String, Number, Number) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- valueTooShort(String, Number, Number) - Static method in class com.northconcepts.datapipeline.foundations.i18n.SchemaMessages
- valueToString() - Method in class com.northconcepts.datapipeline.transform.BasicFieldTransformer
- valueToString(Object) - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Converts a value of this type to a string or returns null for null; BLOB values are abbreviated to their first and last bytes and BIG_DECIMAL values are written in plain notation without trailing zeros.
- valueToStringImpl(Object) - Method in enum class com.northconcepts.datapipeline.core.FieldType
-
Converts a non-null value for
FieldType.valueToString(Object); defaults to the value'stoString(). - VARBINARY - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- VARBINARY - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- VARBIT - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- VARCHAR - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- VARCHAR - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- VARCHAR - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- VariableFieldsUpsert - Class in com.northconcepts.datapipeline.jdbc.upsert
-
A upsert strategy that wraps another strategy to support a variable set of fields.
- VariableFieldsUpsert(VariableFieldsUpsert.IUpsertFactory) - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
-
Creates an upsert that asks the factory for a new strategy for each distinct sequence of field names.
- VariableFieldsUpsert(Class<? extends IUpsert>) - Constructor for class com.northconcepts.datapipeline.jdbc.upsert.VariableFieldsUpsert
-
Creates an upsert that instantiates
upsertType(via its no-arg constructor) for each distinct sequence of field names. - VariableFieldsUpsert.IUpsertFactory - Interface in com.northconcepts.datapipeline.jdbc.upsert
-
Creates the strategy used for each distinct sequence of field names.
- VariableFieldsUpsert.UpsertStub - Class in com.northconcepts.datapipeline.jdbc.upsert
-
Pairs a strategy with the number of records it has upserted.
- variableNameIsReserved(String) - Static method in class com.northconcepts.datapipeline.foundations.i18n.FoundationMessages
- VENDOR - Static variable in class com.northconcepts.datapipeline.core.DataEndpoint
- VIOLET - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- VISIBLE - Enum constant in enum class com.northconcepts.datapipeline.trello.CardFilter
- visit(boolean, Consumer<TreeNode>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.Tree
-
Passes every node, depth-first, to the consumer, visiting parents before their children when
headFirstis true and after them otherwise. - visit(boolean, Consumer<TreeNode>) - Method in class com.northconcepts.datapipeline.foundations.pipeline.tree.TreeNode
-
Passes this node and its descendants, depth-first, to the consumer, visiting parents before their children when
headFirstis true and after them otherwise; the consumer may change the children. - visit(Node, INodeVisitor) - Static method in class com.northconcepts.datapipeline.core.NodeVisitor
-
Walks the node and its descendants depth-first, calling the visitor's callbacks; does nothing for a null node and rethrows failures as a
DataException. - visit(DecisionTreeVisitor) - Method in class com.northconcepts.datapipeline.foundations.decisiontree.DecisionTree
-
Calls the visitor for every node, depth-first from the root, visiting each node's children before its default node.
- visitNode(List<DecisionTreeNode>, DecisionTreeNode) - Method in interface com.northconcepts.datapipeline.foundations.decisiontree.DecisionTreeVisitor
-
Called for each node with
pathholding its ancestors from the root down; the list is reused, so copy it to keep it. - VOID_FAILURE - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- VOID_PENDING - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- VOID_SUCCESS - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.EventVerb
- VOIDED - Enum constant in enum class com.northconcepts.datapipeline.shopify.client.FinancialStatus
W
- WAIT - Enum constant in enum class com.northconcepts.datapipeline.twitter.ApiLimitPolicy
-
Wait for the limits to be reset if the Twitter API call limit is reached.
- waitForColumnStatsToLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Blocks until column stats collection ends, checking once a second; returns at once if none is running.
- waitForColumnStatsToLoad(long, long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Blocks until column stats cover
minRecordsrecords, collection ends ormaxWaitTimeMillismilliseconds pass. - waitForRecordsToLoad() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Blocks until all records are loaded (see
Dataset.waitUntilJobFinished()); column stats may still be in progress. - waitForRecordsToLoad(long, long) - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Blocks until at least
minRecordsrecords are loaded, loading ends ormaxWaitTimeMillismilliseconds pass. - waitUntilFinished() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Waits for this job to complete.
- waitUntilFinished() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Waits for this job to complete.
- waitUntilFinished() - Method in class com.northconcepts.datapipeline.job.Job
-
Waits for this job to complete.
- waitUntilFinished(long) - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Waits up to
timeoutmilliseconds for this job to complete or throwsInterruptedException. - waitUntilFinished(long) - Method in interface com.northconcepts.datapipeline.job.IJob
-
Waits up to
timeoutmilliseconds for this job to complete or throwsInterruptedException. - waitUntilFinished(long) - Method in class com.northconcepts.datapipeline.job.Job
-
Waits up to
timeoutmilliseconds for this job to complete or throwsInterruptedException. - waitUntilJobFinished() - Method in class com.northconcepts.datapipeline.foundations.pipeline.dataset.Dataset
-
Blocks until the job returned by
Dataset.getJob()finishes; returns at once if there is none. - waitUntilStarted() - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Waits for this job to start.
- waitUntilStarted() - Method in interface com.northconcepts.datapipeline.job.IJob
-
Waits for this job to start.
- waitUntilStarted() - Method in class com.northconcepts.datapipeline.job.Job
-
Waits for this job to start.
- waitUntilStarted(long) - Method in class com.northconcepts.datapipeline.job.AbstractJob
-
Waits up to
timeoutmilliseconds for this job to start or throwsInterruptedException. - waitUntilStarted(long) - Method in interface com.northconcepts.datapipeline.job.IJob
-
Waits up to
timeoutmilliseconds for this job to start or throwsInterruptedException. - waitUntilStarted(long) - Method in class com.northconcepts.datapipeline.job.Job
-
Waits up to
timeoutmilliseconds for this job to start or throwsInterruptedException. - WARNING - Enum constant in enum class com.northconcepts.datapipeline.core.Message.Level
- WEBP - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- when(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonFragment
- when(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Adds and returns a fragment whose nodes are written only when the given logical expression is true.
- when(String) - Method in class com.northconcepts.datapipeline.json.builder.JsonValue
- when(String) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
-
Adds and returns a group of nodes written only when the given logical expression is true.
- where(boolean, String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Adds a condition and its parameter values to the WHERE clause with AND (if
andConjunctionis true) or OR. - where(QueryCriteriaPart) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
Replaces all WHERE conditions with the given part.
- where(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.delete.Delete
-
ANDs a condition, such as
"id = ?", and its parameter values with any existing WHERE conditions. - where(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.select.Select
-
ANDs a condition, such as
"id = ?", and its parameter values with the existing WHERE conditions. - where(String, Object...) - Method in class com.northconcepts.datapipeline.jdbc.sql.update.Update
-
ANDs a condition, such as
"id = ?", and its parameter values with any existing WHERE conditions. - WHERE - Enum constant in enum class com.northconcepts.datapipeline.jdbc.sql.select.QueryCriteria.CriteriaType
- WHITE - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- WHITE1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- WildcardZipEntryFilter - Class in com.northconcepts.datapipeline.filesystem.zip
-
A
ZipEntryFilterthat accepts entries whose name, including any folder path, matches a wildcard pattern (?for one character,*for zero or more). - WildcardZipEntryFilter(String) - Constructor for class com.northconcepts.datapipeline.filesystem.zip.WildcardZipEntryFilter
-
Creates a filter whose case sensitivity follows the current operating system (case-insensitive on Windows).
- WildcardZipEntryFilter(String, boolean) - Constructor for class com.northconcepts.datapipeline.filesystem.zip.WildcardZipEntryFilter
- Window - Class in com.northconcepts.datapipeline.group
-
Windows accept detail data for aggregation while open and only yield its summary after being closed.
- Window(GroupByReader) - Constructor for class com.northconcepts.datapipeline.group.Window
-
Creates a window using the reader's group-by fields, operations and null-group setting.
- wordsToLong(String) - Static method in class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
-
long version of above
- wordsToNumber(String) - Static method in class com.northconcepts.datapipeline.jsonata.utils.DateTimeUtils
- workbook - Variable in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- workbook - Variable in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- wrap(RecordList, ObjectWrapper) - Static method in class com.northconcepts.datapipeline.template.RecordTemplateModel
-
Returns a new list with each record of the list wrapped in a model that uses the given object wrapper.
- wrap(String, String, String, String) - Static method in interface com.northconcepts.datapipeline.jdbc.JdbcConnectionFactory
-
Returns a factory that opens a new connection on each call by instantiating the named
Driverclass. - wrap(String, String, Properties, String, String) - Static method in interface com.northconcepts.datapipeline.jdbc.JdbcConnectionFactory
-
Returns a factory that opens a new connection on each call by instantiating the named
Driverclass, passing the properties plus the credentials asuserandpassword. - wrap(String, Throwable) - Static method in exception class com.northconcepts.datapipeline.core.DataException
-
Converts an exception to a
DataExceptionand prefixes the original message with the specified text. - wrap(Throwable) - Static method in exception class com.northconcepts.datapipeline.core.DataException
-
Converts an exception to a
DataException. - wrap(Throwable, DataExceptionContributor...) - Static method in exception class com.northconcepts.datapipeline.core.DataException
-
Wraps the exception as
DataException.wrap(Throwable)does and adds the properties of each non-null contributor. - wrap(Throwable, String, DataExceptionContributor...) - Static method in exception class com.northconcepts.datapipeline.core.DataException
-
Wraps the exception as
DataException.wrap(Throwable)does and adds the properties of each non-null contributor, usingnamePrefixas the start of their keys. - wrap(Connection) - Static method in interface com.northconcepts.datapipeline.jdbc.JdbcConnectionFactory
-
Returns a factory that always hands out the given connection;
JdbcConnectionFactory.closeConnection(Connection)leaves it open andJdbcConnectionFactory.close()closes it. - wrap(Collection<Record>, ObjectWrapper) - Static method in class com.northconcepts.datapipeline.template.RecordTemplateModel
-
Returns a new list with each record of the collection wrapped in a model that uses the given object wrapper.
- wrap(DataSource) - Static method in interface com.northconcepts.datapipeline.jdbc.JdbcConnectionFactory
-
Returns a factory that obtains each connection from
dataSource.getConnection(). - wrap(DataSource, String, String) - Static method in interface com.northconcepts.datapipeline.jdbc.JdbcConnectionFactory
-
Returns a factory that obtains each connection from
dataSource.getConnection(username, password). - wrapText() - Static method in interface com.northconcepts.datapipeline.excel.ExcelCellStyleDecorator
-
Returns a decorator that enables text wrapping.
- write(byte[], int, int) - Method in class com.northconcepts.datapipeline.meter.MeteredOutputStream
- write(byte[], int, int) - Method in class com.northconcepts.datapipeline.throttle.ThrottledOutputStream
- write(int) - Method in class com.northconcepts.datapipeline.meter.MeteredOutputStream
- write(int) - Method in class com.northconcepts.datapipeline.throttle.ThrottledOutputStream
- write(Record) - Method in class com.northconcepts.datapipeline.core.AbstractWriter
- write(Record) - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- write(Record) - Method in class com.northconcepts.datapipeline.core.DataWriter
-
Writes the specified record to this
DataWriterand increases the record-count by 1. - write(Record) - Method in class com.northconcepts.datapipeline.core.TextStreamWriter
- write(Record) - Method in class com.northconcepts.datapipeline.core.TextWriter
- write(Record) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- write(Record) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- write(Record, List<DataWriter>) - Method in class com.northconcepts.datapipeline.core.MultiWriter.AvailableCapacityWriteStrategy
- write(Record, List<DataWriter>) - Method in class com.northconcepts.datapipeline.core.MultiWriter.ReplicateCloneWriteStrategy
- write(Record, List<DataWriter>) - Method in class com.northconcepts.datapipeline.core.MultiWriter.ReplicateWriteStrategy
- write(Record, List<DataWriter>) - Method in class com.northconcepts.datapipeline.core.MultiWriter.RoundRobinWriteStrategy
- write(Record, List<DataWriter>) - Method in class com.northconcepts.datapipeline.core.MultiWriter.WriteStrategy
-
Writes the record to one or more of the target writers; the list is never empty.
- write(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlAttribute
-
Writes the attribute as
name="value", both XML-escaped, unless its condition is false. - write(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlExpression
-
Writes the expression's result XML-escaped, or nothing when it evaluates to null.
- write(DataOutput, Record) - Static method in class com.northconcepts.datapipeline.file.FileWriter
-
Writes one record to the given output, flushing but not closing it, and returns the record.
- write(String) - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Deprecated.
- writeCellStyle(Workbook, DataFormat, Cell, Field) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- writeCellStyle(Workbook, DataFormat, Cell, Field) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- writeEnd(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Writes this node's closing output, wrapping any failure in a
DataExceptionthat describes the node. - writeEnd(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Writes this node's closing output, wrapping any failure in a
DataException. - writeEndImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonArray
- writeEndImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonField
- writeEndImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonFragment
- writeEndImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Writes this node's closing output, if any (such as an end-object or end-array token), after its children.
- writeEndImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonObject
- writeEndImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonPrimitive
- writeEndImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlConditionalNode
- writeEndImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlElement
- writeEndImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlFragment
- writeEndImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Writes this node's closing output, such as an element's end tag, after its children are written.
- writeEndImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlText
- writeField(int, int, int, int, Field) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- writeField(int, int, int, int, Field) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- writeField(int, int, int, int, Field) - Method in class com.northconcepts.datapipeline.excel.PoiXssfbProvider
- writeFile(String) - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Writes the file to the DropBox File System.
- writeFile(String) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Writes a file to the root folder.
- writeFile(String) - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Writes the file to the HDFS File System.
- writeFile(String) - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Writes a file to the root folder.
- writeFile(String) - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Writes the file to the Google Drive File System.
- writeFile(String, String) - Method in class com.northconcepts.datapipeline.filesystem.dropbox.DropBoxFileSystem
-
Writes the file to the specified folder in the DropBox File System.
- writeFile(String, String) - Method in class com.northconcepts.datapipeline.filesystem.ftp.FtpFileSystem
-
Writes a file to the specified folder.
- writeFile(String, String) - Method in class com.northconcepts.datapipeline.filesystem.hdfs.HdfsFileSystem
-
Writes the file to the HDFS File System.
- writeFile(String, String) - Method in class com.northconcepts.datapipeline.filesystem.sftp.SftpFileSystem
-
Writes a file to the specified folder.
- writeFile(String, String) - Method in class com.northconcepts.datapipeline.googledrive.GoogleDriveFileSystem
-
Write the file to the specified folder.
- writeHyperlink(CreationHelper, Cell, Field) - Method in class com.northconcepts.datapipeline.excel.PoiSxssfProvider
- writeHyperlink(CreationHelper, Cell, Field) - Method in class com.northconcepts.datapipeline.excel.PoiXssfSaxProvider
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.avro.AvroWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.AbstractWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.AsyncWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.DataWriter
-
Overridden by subclasses to write the specified record to this
DataWriter. - writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.MultiWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.NullWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.PipedWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.ProxyWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.SequenceWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.core.StreamWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.eventbus.EventBusWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.file.FileWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiUpsertWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.jdbc.JdbcMultiWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.jdbc.JdbcUpsertWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.jdbc.JdbcWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.jms.JmsWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.json.JsonRecordWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.kafka.KafkaWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.memory.CollectionWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.memory.MapWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.memory.MemoryWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.memory.TailWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.mongodb.MongoWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.multiplex.SplitWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.orc.OrcDataWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.parquet.ParquetDataWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.pdf.PdfWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.retry.RetryingWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.trello.TrelloApiWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.twitter.TwitterFollowWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.twitter.TwitterUnfollowWriter
- writeImpl(Record) - Method in class com.northconcepts.datapipeline.xml.XmlRecordWriter
- writeImpl(Record, TrelloClient) - Method in class com.northconcepts.datapipeline.trello.TrelloApiWriter
-
Writes the record to Trello with the client opened by this writer; called by
TrelloApiWriter.writeImpl(Record)for each record. - writeImpl(Record, TrelloClient) - Method in class com.northconcepts.datapipeline.trello.TrelloCardWriter
- writeImpl(PrintWriter, StreamWriter, Record) - Method in enum class com.northconcepts.datapipeline.core.StreamWriter.Format
- writeMultipartFile(String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Returns a stream that uploads to the given bucket and key as a multipart upload, in parts of
AmazonS3FileSystem.MINIMUM_PART_SIZEbytes sent from a background thread. - writeMultipartFile(String, String, String) - Method in class com.northconcepts.datapipeline.amazons3.AmazonS3FileSystem
-
Same as
AmazonS3FileSystem.writeMultipartFile(String, String), but also sets the object's content type unlesscontentTypeis null or blank. - writeNewLine() - Method in class com.northconcepts.datapipeline.sourcecode.CodeWriter
-
Deprecated.
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.core.AbstractWriter
-
Writes one row; called first for the header row (see
AbstractWriter.isHeaderRow()) when field names are written, then for each record. - writeRecord(Record) - Method in class com.northconcepts.datapipeline.core.LinedTextWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.excel.ExcelWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.google.sheets.GoogleSheetWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.json.JsonWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.json.SimpleJsonWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.latex.LatexWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.microsoft.word.MicrosoftWordWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.rtf.RtfWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.sql.h2.H2InsertWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlInsertWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.sql.mysql.MySqlUpsertWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlInsertWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.sql.postgresql.PostgreSqlUpsertWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.template.TemplateWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.texttable.TextTableWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.xml.SimpleXmlWriter
- writeRecord(Record) - Method in class com.northconcepts.datapipeline.xml.XmlWriter
- writeStart(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Writes this node's opening output, wrapping any failure in a
DataExceptionthat describes the node. - writeStart(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Writes this node's opening output, wrapping any failure in a
DataException. - writeStartImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonArray
- writeStartImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonField
- writeStartImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonFragment
- writeStartImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonNode
-
Writes this node's opening output, if any: a start-object or start-array token, a field name or a scalar value.
- writeStartImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonObject
- writeStartImpl(ExpressionContext, JsonGenerator) - Method in class com.northconcepts.datapipeline.json.builder.JsonPrimitive
- writeStartImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlConditionalNode
- writeStartImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlElement
- writeStartImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlFragment
- writeStartImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlNode
-
Writes this node's opening output, such as an element's start tag or a text node's content.
- writeStartImpl(ExpressionContext, CodeWriter) - Method in class com.northconcepts.datapipeline.xml.builder.XmlText
- WriteStrategy() - Constructor for class com.northconcepts.datapipeline.core.MultiWriter.WriteStrategy
- writeXml(T, StreamResult, boolean) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
-
Writes the bean's
XmlSerializable.toXmlElement(Document)as indented XML without a declaration, then flushes the target and closes it ifcloseStreamis true. - writeXml(T, StreamResult, boolean, boolean) - Static method in interface com.northconcepts.datapipeline.core.XmlSerializable
X
- XLS - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- XLSB - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- XLSX - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- XML - Enum constant in enum class com.northconcepts.datapipeline.core.StreamWriter.Format
- XML - Enum constant in enum class com.northconcepts.datapipeline.foundations.file.FileType
- XML - Enum constant in enum class com.northconcepts.datapipeline.sql.postgresql.TableColumnType
- XML_INPUT_FACTORY_KEY - Static variable in class com.northconcepts.datapipeline.core.DataEndpoint
- XML_SERIALIZED_CLASS_NAME - Static variable in interface com.northconcepts.datapipeline.core.XmlSerializable
- XmlAttribute - Class in com.northconcepts.datapipeline.xml.builder
-
An attribute of an
XmlElementwhose name and value are expressions, optionally written only when a condition is true. - XmlAttribute(String, String) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlAttribute
-
Creates an attribute whose name and value are expressions; quote literal text, as in
'id'. - XmlAttribute(String, String, String) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlAttribute
-
Creates an attribute that is written only when the logical expression
conditionis true. - XmlConditionalNode - Class in com.northconcepts.datapipeline.xml.builder
-
A group of template nodes written only when its logical expression is true; created by
XmlNodeContainer.when(String). - XmlConditionalNode(XmlNodeContainer, String) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlConditionalNode
- XmlDetailMarker - Class in com.northconcepts.datapipeline.xml.builder
-
Marks where records go in an
XmlTemplate; the nodes added to it are written once for each record. - XmlElement - Class in com.northconcepts.datapipeline.xml.builder
-
An element in an
XmlTemplatewhose name is an expression; holds attributes and child nodes. - XmlElement(XmlNodeContainer, String) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlElement
-
Creates an element named by evaluating
name, without adding it toparentasXmlNodeContainer.element(String)does. - XmlExpression - Class in com.northconcepts.datapipeline.xml.builder
-
An expression for an element name, attribute or text in an
XmlTemplate, written XML-escaped. - XmlExpression(String) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlExpression
- XmlField - Class in com.northconcepts.datapipeline.xml
-
Maps the values found at a location path to a named record field for
XmlReader, optionally cascading the last value into later records. - XmlField() - Constructor for class com.northconcepts.datapipeline.xml.XmlField
- XmlField(String, String, boolean) - Constructor for class com.northconcepts.datapipeline.xml.XmlField
-
Creates a field read from the location path; with
cascadeValues, its last value carries over to later records until a new match replaces it. - XmlField(String, String, String) - Constructor for class com.northconcepts.datapipeline.xml.XmlField
-
Creates a cascading field whose carried-over value is cleared by elements matching
cascadeResetLocationPath; a null or empty reset path turns cascading off. - XmlFragment - Class in com.northconcepts.datapipeline.xml.builder
-
A group of template nodes that writes only its children, with no markup of its own.
- XmlFragment(XmlNodeContainer) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlFragment
- XmlLogicalExpression - Class in com.northconcepts.datapipeline.xml.builder
-
A boolean expression that decides whether conditional template nodes or attributes are written.
- XmlLogicalExpression(String) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlLogicalExpression
- XmlNode - Class in com.northconcepts.datapipeline.xml.builder
-
Base class for the nodes of an
XmlTemplate; each writes its opening and closing markup to aCodeWriter. - XmlNode(XmlNodeContainer) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlNode
- XmlNodeContainer - Class in com.northconcepts.datapipeline.xml.builder
-
Base class for template nodes with children; provides the
XmlNodeContainer.element(String),XmlNodeContainer.text(String),XmlNodeContainer.when(String)andXmlNodeContainer.detail()builder methods. - XmlNodeContainer(XmlNodeContainer) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlNodeContainer
- XmlPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Reads a pipeline's source data from an XML
FileSourceusing anXmlReader, which selects fields and record breaks by location path (a subset of XPath). - XmlPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.XmlPipelineInput
- XmlReader - Class in com.northconcepts.datapipeline.xml
-
Obtains records from an XML stream.
- XmlReader(File) - Constructor for class com.northconcepts.datapipeline.xml.XmlReader
- XmlReader(Reader) - Constructor for class com.northconcepts.datapipeline.xml.XmlReader
- XmlReader(XMLStreamReader) - Constructor for class com.northconcepts.datapipeline.xml.XmlReader
-
Creates a reader for an existing StAX stream; closing this reader closes the stream reader but not its underlying input.
- XmlReader(XmlNodeReader) - Constructor for class com.northconcepts.datapipeline.xml.XmlReader
-
Creates a reader over the given node source; used by subclasses that present other formats, such as JSON or Java beans, as XML nodes.
- XmlReader.DuplicateFieldPolicy - Enum Class in com.northconcepts.datapipeline.xml
-
Strategy for a field whose location path matches more than once within the same record.
- XmlRecordBreak - Class in com.northconcepts.datapipeline.xml
-
A location path, such as
//book, identifying the elements that mark records for the XML and JSON readers. - XmlRecordBreak() - Constructor for class com.northconcepts.datapipeline.xml.XmlRecordBreak
- XmlRecordBreak(String) - Constructor for class com.northconcepts.datapipeline.xml.XmlRecordBreak
- XmlRecordPipelineInput - Class in com.northconcepts.datapipeline.foundations.pipeline.input
-
Reads a pipeline's source data from an XML
FileSourceusing anXmlRecordReader, which turns each element matching a record break into one nested record. - XmlRecordPipelineInput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.input.XmlRecordPipelineInput
- XmlRecordPipelineOutput - Class in com.northconcepts.datapipeline.foundations.pipeline.output
-
Writes a pipeline's records as XML elements to a
FileSinkusing anXmlRecordWriter. - XmlRecordPipelineOutput() - Constructor for class com.northconcepts.datapipeline.foundations.pipeline.output.XmlRecordPipelineOutput
- XmlRecordReader - Class in com.northconcepts.datapipeline.xml
-
Obtains records from an XML stream, turning each element matched by a record break into a record of its child elements (as nested records) and attributes (as
@namefields). - XmlRecordReader(File) - Constructor for class com.northconcepts.datapipeline.xml.XmlRecordReader
- XmlRecordReader(Reader) - Constructor for class com.northconcepts.datapipeline.xml.XmlRecordReader
- XmlRecordReader(XMLStreamReader) - Constructor for class com.northconcepts.datapipeline.xml.XmlRecordReader
-
Creates a reader for an existing StAX stream; closing this reader closes the stream reader but not its underlying input.
- XmlRecordWriter - Class in com.northconcepts.datapipeline.xml
-
Writes XML using the structure of each record's natural representation.
- XmlRecordWriter(File) - Constructor for class com.northconcepts.datapipeline.xml.XmlRecordWriter
- XmlRecordWriter(Writer) - Constructor for class com.northconcepts.datapipeline.xml.XmlRecordWriter
- XmlSerializable - Interface in com.northconcepts.datapipeline.core
-
The interface implemented by classes to participate in serialization to and from XML.
- XmlTemplate - Class in com.northconcepts.datapipeline.xml.builder
-
Describes the XML an
XmlWriterproduces: nodes before theXmlNodeContainer.detail()marker form the header, the marker's nodes are written once per record and the remaining nodes form the footer. - XmlTemplate() - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlTemplate
- XmlText - Class in com.northconcepts.datapipeline.xml.builder
-
Text in an
XmlTemplatecomputed from an expression and written XML-escaped. - XmlText(XmlNodeContainer, String) - Constructor for class com.northconcepts.datapipeline.xml.builder.XmlText
-
Creates text computed from the
textexpression; unlikeXmlNodeContainer.text(String), it is not added toparent. - XmlWriter - Class in com.northconcepts.datapipeline.xml
-
Writes records to an XML stream using a template.
- XmlWriter(XmlTemplate, File) - Constructor for class com.northconcepts.datapipeline.xml.XmlWriter
- XmlWriter(XmlTemplate, Writer) - Constructor for class com.northconcepts.datapipeline.xml.XmlWriter
Y
- YEAR - Enum constant in enum class com.northconcepts.datapipeline.sql.h2.TableColumnType
- YEAR - Enum constant in enum class com.northconcepts.datapipeline.sql.mysql.TableColumnType
- YELLOW - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- YELLOW1 - Enum constant in enum class com.northconcepts.datapipeline.excel.ExcelColorPalette
- YOU_ARE_NOT_AUTHORIZED_TO_SEE_THIS_STATUS - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- YOU_ARE_UNABLE_TO_FOLLOW_MORE_PEOPLE_AT_THIS_TIME - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
- YOUR_ACCOUNT_IS_SUSPENDED - Enum constant in enum class com.northconcepts.datapipeline.twitter.TwitterErrorCode
Z
- zip(Utils.JList<List>) - Static method in class com.northconcepts.datapipeline.jsonata.Functions
-
Convolves (zips) each value from a set of arrays
- ZipDataReaderFactory - Interface in com.northconcepts.datapipeline.filesystem.zip
-
Creates a
DataReaderfor an entry of a zip file. - ZipEntryFilter - Interface in com.northconcepts.datapipeline.filesystem.zip
-
Decides which entries of a zip file
listEntries(ZipEntryFilter)returns. - ZipFileSystem - Class in com.northconcepts.datapipeline.filesystem.zip
-
Class for accessing zips as file systems.
- ZipFileSystem(File) - Constructor for class com.northconcepts.datapipeline.filesystem.zip.ZipFileSystem
_
- _jsonata_lambda - Variable in class com.northconcepts.datapipeline.jsonata.Parser.Symbol
- _JsonHandler() - Constructor for class com.northconcepts.datapipeline.jsonata.Json._JsonHandler
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form
JiraIssue.setField(String, Object)instead.