Skip to main content
Caching stores LLM responses to avoid redundant API calls, cutting costs and speeding up repeat queries. 
from praisonaiagents import Agent

agent = Agent(
    name="Assistant",
    instructions="Answer customer support questions.",
    caching=True,
)

agent.start("What is your return policy?")
The user asks the same support question again; a cache hit returns the prior answer without another LLM call.

​
Quick Start

1

Level 1 — Bool (simplest)

Enable caching with a single flag — identical requests return instantly from cache.
from praisonaiagents import Agent

agent = Agent(
    name="Support Bot",
    instructions="You are a helpful assistant.",
    caching=True,
)

agent.start("Summarise the benefits of caching.")
2

Level 2 — String (preset)

Pass "prompt" to enable provider-level prompt caching alongside response caching.
from praisonaiagents import Agent

agent = Agent(
    name="Support Bot",
    instructions="You are a helpful assistant.",
    caching="prompt",
)

agent.start("Summarise the benefits of caching.")
3

Level 3 — Config class (full control)

Use CachingConfig to control response caching and provider-level prompt caching separately.
from praisonaiagents import Agent, CachingConfig

agent = Agent(
    name="Researcher",
    instructions="Answer research questions using memory.",
    llm="anthropic/claude-3-5-sonnet",
    caching=CachingConfig(
        enabled=True,
        prompt_caching=True,
    ),
)

agent.start("What are the cost savings from prompt caching?")

​
How It Works

PhaseWhat happens
1. Request receivedAgent checks the cache using the request as key
2. Cache hitStored response returned instantly — no API cost
3. Cache missLLM processes the request, result stored for next time
4. Prompt cachingProvider caches stable prefix (system prompt, tools) across turns

​
Choosing Your Caching Level

​
Configuration Options

Full list of options, types, and defaults — CachingConfig
OptionTypeDefaultDescription
enabledboolTrueEnable or disable response caching
prompt_cachingbool | NoneNoneEnable provider-level prompt caching (Anthropic, Google)

​
Common Patterns

​
Pattern 1 — FAQ Bot with response caching

Identical user questions are answered from cache, saving API calls. 
from praisonaiagents import Agent

agent = Agent(
    name="FAQ Bot",
    instructions="Answer frequently asked questions about our product.",
    caching=True,
)

response1 = agent.start("What are your business hours?")
response2 = agent.start("What are your business hours?")  # cache hit

​
Pattern 2 — Research agent with prompt caching

Large system prompts and tool definitions are cached at the provider level, reducing token costs on every turn. 
from praisonaiagents import Agent, CachingConfig

agent = Agent(
    name="Research Assistant",
    instructions="You are an expert research assistant with access to a large knowledge base.",
    llm="anthropic/claude-3-5-sonnet",
    memory=True,
    caching=CachingConfig(
        enabled=True,
        prompt_caching=True,
    ),
)

agent.start("Summarise last month's findings on climate data.")
agent.start("What trends stand out?")  # stable prefix cached

​
Pattern 3 — Disable caching for real-time data

Turn off caching when responses must always be fresh. 
from praisonaiagents import Agent, CachingConfig

agent = Agent(
    name="Live Prices",
    instructions="Report real-time stock prices.",
    caching=CachingConfig(enabled=False),
)

agent.start("What is the current price of AAPL?")

​
Best Practices

Caching delivers the most value when users ask similar questions repeatedly — support bots, FAQ systems, and document Q&A are ideal candidates. Start with caching=True and measure cache-hit rates before adding configuration.
If your instructions string is long (policies, personas, tool lists), setting prompt_caching=True caches the stable prefix at the provider level. This reduces per-turn token cost significantly on Anthropic and Google models.
Pricing feeds, live dashboards, and highly personalised answers change on every request. Set CachingConfig(enabled=False) to bypass the cache entirely and always call the LLM.
Pairing caching=True with memory=True lets the agent recall past sessions while still serving cached responses for repeated questions — fewer API calls and consistent answers.

Prompt Caching — provider-level caching for stable context

Prompt Cache Optimization — tips to maximise cache hit rates