Type Alias DataSourceFileConfig

Specification on where to fetch the files for. This is required when the type == 'file'. Only one of path and files can be set. Path takes precedence if both are provided.

type DataSourceFileConfig = {
    connectionId: string;
    crawlPatterns?: DataSourceCrawlPattern[];
    files?: string[];
    folder?: string;
    scope?: DataSourceFileCrawlScope;
    userId: string;
}
Index

Properties

connectionId: string

connection id to be used to retrieve the raw data

crawlPatterns?: DataSourceCrawlPattern[]

Pattern matching links to crawl

files?: string[]
folder?: string

Root folder for traversing.

Scope for the file crawler.

userId: string

userId of the owner of the datasource fileConfig