Indexed File Loader

Indexed file loader allows you to watch a specific file system folder for files and pick them up to a work queue to process them. Processed files are hashed and indexed and are processed again only if their contents are changed.

PREREQUISITES

IIS application pool user has modification rights set in the watched directory.

WORK QUEUE CLASS

This loader uses TextFile.

CONFIGURE FILE LOADER

To fill Your Work Queue from files, on tab Creation You have to fill the External Source field with Index File and fill Connection String as described later. All other fields of External Source group are not applicable and should remain empty.

CONFIGURE CONNECTION STRING

The connection string can consist of the following parts:

path Path to a directory, where the loader sniffs for files
searchPattern Wildcard expression that defines which files loader will load to work queue
indexFile Full path to index file, in which loader stores information on processed files. The loader will create it during the first run if it doesn’t exist.
compressedArchivesAsSubfolders If set to true, compressed archives in the watched folder are scanned for their content and processed. ZIP archives are supported. The default value is false.