Token Budget • Rust AI Agent SDK
TokenBudget: Token budget for context management.
TokenBudget
Defined in the RAG module.
Rust AI Agent SDK
Token budget for context management.
Fields
| Name | Type | Description |
|---|---|---|
total | usize | Total available tokens |
system | usize | Tokens for system prompt |
context | usize | Tokens for context |
response | usize | Tokens for response |
reserved | usize | Reserved tokens |
Methods
new
fn new(total: usize) -> SelfCreate a new token budget
Parameters:
| Name | Type |
|---|---|
total | usize |
available_context
fn available_context(&self) -> usizeGet available context tokens
can_add_context
fn can_add_context(&self, tokens: usize) -> boolCheck if budget allows more context
Parameters:
| Name | Type |
|---|---|
tokens | usize |
Source
View on GitHubpraisonai/src/rag/mod.rs at line 355