LLM Provider • Rust AI Agent SDK
LlmProvider: Trait for LLM providers
LlmProvider
Defined in the LLM module.
Rust AI Agent SDK
Trait for LLM providers
Methods
chat
async fn chat(
&self,
messages: &[Message],
tools: Option<&[ToolDefinition]>,
) -> Result<LlmResponse>Send a chat completion request
Parameters:
| Name | Type |
|---|---|
messages | &[Message] |
tools | Option<&[ToolDefinition]> |
chat_stream
async fn chat_stream(
&self,
messages: &[Message],
tools: Option<&[ToolDefinition]>,
) -> Result<Box<dyn futures::Stream<Item = Result<String>> + Send + Unpin>>Stream a chat completion (returns chunks)
Parameters:
| Name | Type |
|---|---|
messages | &[Message] |
tools | Option<&[ToolDefinition]> |
model
fn model(&self) -> &strGet the model name
Source
View on GitHubpraisonai/src/llm/mod.rs at line 0