Chunking
Splitting documents into pieces small enough to be compared one at a time, with the overlap between pieces decided before the split.
- See also: Embedding
- See also: Token
- Used in: Retrieval & Embeddings
Splitting documents into pieces small enough to be compared one at a time, with the overlap between pieces decided before the split.