Type Alias DataSourceFileCrawlScope

Scope for the file crawler.

type DataSourceFileCrawlScope = {
    depth: number;
    extensions?: string[];
    maxFilesPerFolder?: number;
    maxFilesTotal?: number;
    maxSize?: number;
    modifiedAfter?: string;
}
Index

Properties

depth: number

The number of levels of sub folders that should be considered

extensions?: string[]

list of file extensions to be considered

maxFilesPerFolder?: number

Maximum number of files per folder that should be considered

maxFilesTotal?: number

Total number of files that should be considered

maxSize?: number

Optional parameter. Max size of downloaded files in bytes

modifiedAfter?: string

only files modified after this time should be indexed. If set older files will be removed from index.