Indexed file loader allows you to watch a specific file system folder for files and pick them up to a work queue to process them. Processed files are hashed and indexed and are processed again only if their contents are changed.
PREREQUISITES
IIS application pool user has modification rights set in the watched directory.
WORK QUEUE CLASS
This loader uses TextFile.
CONFIGURE FILE LOADER
To fill Your Work Queue from files, on tab Creation You have to fill the External Source field with Index File and fill Connection String as described later. All other fields of External Source group are not applicable and should remain empty.
CONFIGURE CONNECTION STRING
The connection string can consist of the following parts:
path | Path to a directory, where the loader sniffs for files |
searchPattern | Wildcard expression that defines which files loader will load to work queue |
indexFile | Full path to index file, in which loader stores information on processed files. The loader will create it during the first run if it doesn’t exist. |
compressedArchivesAsSubfolders | If set to true , compressed archives in the watched folder are scanned for their content and processed. ZIP archives are supported. The default value is false . |