Deduplicate Chunks • Rust AI Agent SDK

deduplicate_chunks: Deduplicate chunks by content similarity.

deduplicate_chunks

Function

</div>

This function is defined in the rag module.

Deduplicate chunks by content similarity.

python

def deduplicate_chunks(chunks: Vec<ContextChunk>, _threshold: f32) -> Vec<ContextChunk>

ParamField Vec<ContextChunk>

No description available.

ParamField f32

No description available.

View on GitHub

praisonai/src/rag/mod.rs at line 635