Skip to main content

RESPONSE_FORMAT_WARNING

Constant RESPONSE_FORMAT_WARNING 

Source
pub const RESPONSE_FORMAT_WARNING: &str = "response_format_warning";
Expand description

Response metadata key for the Warning header oMLX sends when it could not enforce a requested structured output format.

When oMLX cannot compile a grammar for json_object or json_schema, it falls back to instructions in the prompt and says so in a Warning header. The gateway records the header value here and logs a warning. It does not retry or fail: callers validate content as they would anyway.