Quick Start
How It Works
Configuration Options
| Option | Type | Default | Description |
|---|---|---|---|
stream | boolean | true | Enable streaming responses |
verbose | boolean | false | Show formatted output while streaming |
Common Patterns
Interactive Chat Application
Long-Form Content Generation
Batch Processing (Disable Streaming)
Best Practices
Keep stream: true for user-facing interfaces
Keep stream: true for user-facing interfaces
Streaming dramatically improves perceived performance. Users see responses immediately rather than waiting. Keep it enabled for any chat or interactive application.
Disable streaming for batch processing
Disable streaming for batch processing
When processing many documents or requests without a live user,
stream: false is faster and simpler — you get back the complete string directly from chat().Use verbose for development
Use verbose for development
Set
verbose: true during development to see formatted streaming output in the console. Disable it in production API endpoints where you only need the return value.Streaming works with all providers
Streaming works with all providers
Every supported LLM provider (OpenAI, Anthropic, Google, Groq, etc.) supports streaming. You do not need to change the provider to enable it.
Related
Agent
Full agent configuration
Providers
LLM provider setup

