Skip to main content

chat_stream

AsyncMethod
This is a method of the LlmProvider class in the llm module.
Stream a chat completion (returns chunks)

Signature

Parameters

&[Message]
required
No description available.
Option<&[ToolDefinition]>
required
No description available.

Returns

Result<Box<dyn futures::Stream<Item = Result<String>> + Send + Unpin>>
The result of the operation.