Recent Failure Trace
Latest failed or recovered requests.
Top Model Usage
Tokens and top models in the selected window.
Overview
Live runtime health and request flow.
Overview
Live health metrics and proxy request traffic flow.
Time range
Last 30 minutes
Failover Health
Provider health scores based on success rate, latency, and key availability.
Requests
Live proxy request details, routing traces, and token usage.
Recent request records.
Providers
Runtime health, model coverage, key state, and routing readiness.
No model capabilities loaded
Routing Policy & Rules
Configure multi-provider scheduling, retry status codes, and circuit-breaker behavior.
Rule Table?
Failure Policies?
Config & Statistics
SQLite persistenceModel routing and mapping, provider config, runtime and probe settings, long-term usage statistics.
Model Routes?
Add or edit route
No model routes configured
Open this tab to load usage statistics.
Usage trend
Usage breakdown
Compare the selected range without mixing client requests and upstream consumption.
Statistics data management
Clear permanent statisticsStarts a new statistics generation. Request history is not deleted.
Open this tab to load model data.
Provider Model Map?
No provider model overrides configured
Providers?
No provider config loaded
Audit Trail?
No audit events recorded
Runtime Config?
No config loaded
Global Proxy?
Health Monitor?
Idle Health Checker
Adaptive probing based on traffic patterns. Probes the most recently used model's providers in priority order.
Patrol Health Checker
Full sweep of all providers and keys at a fixed interval using streaming probes. Discovers dead keys and triggers circuit breakers.
How they differ
| Readiness probe | Full sweep | |
|---|---|---|
| Purpose | ||
| Cadence | ||
| Scope | ||
| Routing modes |
Idle Checker
—
Next probe
—
Tier
—
Patrol Checker
—
Last run
—
Result
—
Next run
—
Conversion Diagnostics
Advanced overlay tools Validate, export masked JSON, or clear runtime_config.
Show overlay preview
{}
Raw Snapshot?
Show masked JSON
{}
Playground
Test runtime model formats, parameters, and response streams.
Live test
Message sandbox
System Settings
Client keys, model pricing, and runtime operations.
Client API Keys ?
Issue virtual keys for downstream clients with per-key quota and model scope.