Ttft Ms • AI Agents Framework
ttft_ms: Get time to first token in ms.
ttft_ms
Method
</div>
This is a method of the StreamingTracker class in the profiler module.
Get time to first token in ms.
Signature
def ttft_ms() -> floatReturns
ResponseField
floatThe result of the operation.
Source
View on GitHubpraisonai/profiler.py at line 197