Type Alias Chunking

type Chunking = {
    keepSeparator: boolean;
    overlap: number;
    separators: string[];
    size: number;
    type: string;
}

Index

Properties

keepSeparator overlap separators size type

Properties

keepSeparator

keepSeparator: boolean

Allows to keep or remove separators used

overlap

overlap: number

Chunk overlap, should be less than size

separators

separators: string[]

List of separators to chunk by

size

size: number

Size of chunks

type

type: string

Chunking strategy