File Loader

File loader allows you to watch a specific file system folder for files and pick them up to a work queue where they can be processed.

Prerequisites

  • IIS application pool user has modification rights set in watched directory.

WORK QUEUE CLASS

This loader uses TextFile or BinaryFile work queue classes (see mode connection string).

Configure file loader

In order to fill Your Work Queue from files, on tab Creation You have to fill the External Source field with File and fill Connection String as described later. All other fields of External Source group are not applicable and should remain empty.

6258690_567x417

Configure Connection String

The connection string can consist from the following parts:

path Path to a directory, where the loader sniffs for files
searchPattern Wildcard expression that defines which files loader will load to work queue
mode One of TEXT and BINARY. Use TEXT if work queue class you have set to TextFile, user BINARY if work queue class is BinaryFile.
encoding Characer encoding of files in path direcotry. ('utf-8', ...). Available encodings are names of all available encodings of System.Text.Encoding .net class (http://msdn.microsoft.com/cs-cz/library/system.text.encoding%28v=vs.110%29.aspx). Beware: 'utf8' is not valid encoding string.
compression

Indicates a compression algorithm of the file. Supported values:

  • ZIP - Indicates that the file is compressed using ZIP method.
aggregate If set to true multiple source files (if present in the scanned folder or contained in the loaded compressed file) will load into a single work queue entry. Normally each file produces a separate entry. This is useful e.g. for scenarios where multiple CSV files contain information about a single record and you need to process them in a single step.