StreamMetrics

Defined in the streaming module.

Rust AI Agent SDK Timing metrics for a streaming response.

Fields

Name	Type	Description
`request_start`	`u64`	Request start time (ms)
`headers_received`	`u64`	Headers received time (ms)
`first_token`	`u64`	First token time (ms)
`last_token`	`u64`	Last token time (ms)
`stream_end`	`u64`	Stream end time (ms)
`token_count`	`usize`	Token count
`start_instant`	`Option<Instant>`	Internal start instant for precise timing

Methods

`new`

fn new() -> Self

Create new metrics

`ttft_ms`

fn ttft_ms(&self) -> u64

Time To First Token in milliseconds

`stream_duration_ms`

fn stream_duration_ms(&self) -> u64

Stream duration in milliseconds

`total_time_ms`

fn total_time_ms(&self) -> u64

Total time in milliseconds

`tokens_per_second`

fn tokens_per_second(&self) -> f64

Tokens per second

`update_from_event`

fn update_from_event(&mut self, event: &StreamEvent) -> ()

Update metrics from a stream event Parameters:

Name	Type
`event`	`&StreamEvent`

`mark_request_start`

fn mark_request_start(&mut self) -> ()

Mark request start

`mark_first_token`

fn mark_first_token(&mut self) -> ()

Mark first token

`mark_last_token`

fn mark_last_token(&mut self) -> ()

Mark last token

`mark_stream_end`

fn mark_stream_end(&mut self) -> ()

Mark stream end

`increment_tokens`

fn increment_tokens(&mut self) -> ()

Increment token count

Source

View on GitHub

praisonai/src/streaming/mod.rs at line 242

​StreamMetrics

​Fields

​Methods

​new

​ttft_ms

​stream_duration_ms

​total_time_ms

​tokens_per_second

​update_from_event

​mark_request_start

​mark_first_token

​mark_last_token

​mark_stream_end

​increment_tokens

​Source