Package com.northconcepts.datapipeline.transform
package com.northconcepts.datapipeline.transform
Restructure data using a variety of built-in and customizable operations.
-
ClassDescriptionSee
FieldPathfor supported field name expressions.A named step that aBasicFieldTransformerapplies to each of its fields.AnBasicFieldTransformer.Operationapplied to each single value in a field, including array elements and values in nested records.ABasicFieldTransformer.SingleValueOperationthat transforms the string form of each value into a new string.Creates a duplicate field with the specified target name.Deprecated.An performant alternative toRenameFieldthat assumes 1) a flat table structure (no nested fields or arrays), 2) columns are always in the same position from row to row 3) no missing fields (nulls field values are okay), and 4) the target name does not already exist (otherwise there will be two fields with the same name).SeeFieldPathfor supported field name expressions.Flattens an array field by creating one record for each value.Deprecated.useSelectFieldsSeeFieldPathfor supported field name expressions.SeeFieldPathfor supported field name expressions.A transformer used to move a named field to a new position.Extracts each run/sequence of N words from the source field and stores them in a target field as an array.Removes or collapses multiple fields with the same name in each record.Built-in policies that keep all duplicates, keep only the first or last, merge their values into an array in the first field, or rename the later ones with a numeric suffix.Strategy for resolving fields that share a name in a record, used byRemoveDuplicateFields.An alternative toRemoveDuplicateFields.DuplicateFieldsPolicy.RENAMEthat uses a configurable separator between the original field name and the numeric suffix, preventing ambiguous names like20101when the field name itself ends in digits (e.g.SeeFieldPathfor supported field name expressions.SeeFieldPathfor supported field name expressions.Select and arrange fields according to the supplied field names -- like an SQL SELECT statement.Adds a sequence (auto increment) field that is incremented with the step value when the value(s) in the specified watch fields differs from the previous record.SeeFieldPathfor supported field name expressions.ATransformerthat sets a field on every record to a fixed value, creating the field if needed; whenoverwriteis false, records that already have the field are left unchanged.Adds a sequence (auto increment) field that is incremented with the step value as long as the value(s) in the specified watch fields remain the same as the previous record.Adds a sequence (auto increment) field with the specified increment (step).Adds a field with a randomly generated UUID as its value.Flattens an array field by creating one record for each value.Flattens an array field by creating one record for each value.Base class for transformations that modify each record passing through aTransformingReaderorTransformingWriter.A proxy that applies transformations to records passing through.A proxy that applies transformations to records passing through.
RemoveFields