Skip to main content

Module gateway

Module gateway 

Source

Structs§

CompletionConfig
Configuration for LLM completion.
ModelContextWindow
Provider-advertised context capacity; independent of completion configuration.
StreamMetrics
Provider-neutral final generation metrics.
StreamProgress
Provider-neutral progress for a streamed provider frame.

Enums§

ReasoningEffort
Reasoning effort level for models that support extended thinking
ResponseFormat
Format specification for LLM responses
StreamChunk
Streaming response chunk

Traits§

LlmGateway
Abstract interface for LLM providers