Class FileSystemInfoReader
java.lang.Object
com.northconcepts.datapipeline.core.DataObject
com.northconcepts.datapipeline.core.Endpoint
com.northconcepts.datapipeline.core.DataEndpoint
com.northconcepts.datapipeline.core.DataReader
com.northconcepts.datapipeline.file.FileSystemInfoReader
Creates records from the metadata of files within a directory.
-
Nested Class Summary
Nested classes/interfaces inherited from class com.northconcepts.datapipeline.core.DataEndpoint
DataEndpoint.State -
Field Summary
Fields inherited from class com.northconcepts.datapipeline.core.DataReader
fieldLineage, recordLineageFields inherited from class com.northconcepts.datapipeline.core.DataEndpoint
lastRecord, PRODUCT, PRODUCT_VERSION, VENDOR, XML_INPUT_FACTORY_KEYFields inherited from class com.northconcepts.datapipeline.core.Endpoint
BUFFER_SIZE, captureElapsedTime, DEFAULT_READ_BUFFER_SIZEFields inherited from class com.northconcepts.datapipeline.core.DataObject
id, log, name, TIMESTAMP_FORMAT -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionaddExceptionProperties(DataException exception) Adds this endpoint's current state to aDataException.voidclose()Indicates that this endpoint has finished reading or writing.booleanIndicates if the path and parent fields keep the root directory's path as given instead of being relative to it (default is false).Returns the filter applied to each directory listing (null accepts all); rejected directories are not recursed into.booleanIndicates if directories are returned as records too, not just files (default is false).booleanIndicates if sub-directories are read recursively (default is false).voidopen()Makes this endpoint ready for reading or writing.protected RecordreadImpl()Overridden by subclasses to read the next record from thisDataReader.setAbsolutePaths(boolean absolutePaths) Indicates if the path and parent fields keep the root directory's path as given instead of being relative to it (default is false).setFilter(FileFilter filter) Sets the filter applied to each directory listing (null accepts all); rejected directories are not recursed into.setIncludeDirectories(boolean includeDirectories) Indicates if directories are returned as records too, not just files (default is false).setRecurseDirectories(boolean recurseDirectories) Indicates if sub-directories are read recursively (default is false).Methods inherited from class com.northconcepts.datapipeline.core.DataReader
addLineage, available, getBufferSize, getNestedEndpoint, getNestedReader, getReader, getRootEndpoint, getRootReader, isExhausted, isLineageSupported, isSaveLineage, peek, pop, push, read, setSaveLineage, skipMethods inherited from class com.northconcepts.datapipeline.core.DataEndpoint
decrementRecordCount, enableJmx, getLastRecord, getRecordCount, getRecordCountAsBigInteger, getRecordCountAsString, incrementRecordCount, isRecordCountBigInteger, resetRecordCount, toStringMethods inherited from class com.northconcepts.datapipeline.core.Endpoint
addElapsedtime, assertClosed, assertNotOpened, assertOpened, finalize, getClosedOn, getDescription, getElapsedTime, getElapsedTimeAsString, getOpenedOn, getOpenElapsedTime, getOpenElapsedTimeAsString, getSelfTime, getSelfTimeAsString, getState, isCaptureElapsedTime, isClosed, isOpen, setCaptureElapsedTime, setDescription
-
Constructor Details
-
FileSystemInfoReader
-
-
Method Details
-
getFilter
Returns the filter applied to each directory listing (null accepts all); rejected directories are not recursed into. -
setFilter
Sets the filter applied to each directory listing (null accepts all); rejected directories are not recursed into. -
getRecurseDirectories
public boolean getRecurseDirectories()Indicates if sub-directories are read recursively (default is false). -
setRecurseDirectories
Indicates if sub-directories are read recursively (default is false). -
getIncludeDirectories
public boolean getIncludeDirectories()Indicates if directories are returned as records too, not just files (default is false). -
setIncludeDirectories
Indicates if directories are returned as records too, not just files (default is false). -
getAbsolutePaths
public boolean getAbsolutePaths()Indicates if the path and parent fields keep the root directory's path as given instead of being relative to it (default is false). -
setAbsolutePaths
Indicates if the path and parent fields keep the root directory's path as given instead of being relative to it (default is false). -
addExceptionProperties
Description copied from class:EndpointAdds this endpoint's current state to aDataException. Since this method is called whenever an exception is thrown, subclasses should override it to add their specific information.- Overrides:
addExceptionPropertiesin classDataReader
-
open
Description copied from class:DataEndpointMakes this endpoint ready for reading or writing.- Overrides:
openin classDataEndpoint- Throws:
DataException
-
close
public void close()Description copied from class:DataEndpointIndicates that this endpoint has finished reading or writing.- Overrides:
closein classDataEndpoint
-
readImpl
Description copied from class:DataReaderOverridden by subclasses to read the next record from thisDataReader. The default implementation ofDataReader.read()now insures that this method will not be called again after it returns anull.If no record is available,
nullwill be returned.Contract for subclasses (see also
docs/authoring/DataReader.md):- Return
nullexactly once to signal end-of-stream. - Do not call this method directly —
DataReader.read()is the template method that wraps exceptions, increments the record count, and tracks lineage. - Do not call
DataEndpoint.incrementRecordCount()here;DataReader.read()already does. - Throw raw exceptions;
DataReader.read()wraps them viaexception(throwable).
- Specified by:
readImplin classDataReader- Throws:
Throwable
- Return
-