Chunking Options
Strategies
Fixed Size (Default)
Semantic
Sentence-Based
Best Practices
Match chunk size to content
Match chunk size to content
Technical docs: 500–800 tokens with 50–100 overlap (semantic). FAQs: 200–400 with 20–50 overlap (fixed).
Long articles
Long articles
Use 800–1200 token chunks with 100–200 overlap and semantic splitting for narrative content.
Code and mixed media
Code and mixed media
Keep code chunks around 300–500 tokens with ~50 overlap; prefer fixed splitting for source files.
Related
Knowledge Base
Build a knowledge base
Knowledge Module
Full API reference

