Skip to main content
Two lightweight endpoints you’ll use when scripting against the engine without a client library.

GET /v1/models

Returns every model the engine knows about, with pricing and per-model routing stats.

Response

Curl

GET /health

Used by load balancers and healthchecks.

Response (:8080 — gateway)

Response (:8000 — management API)

status is one of healthy, degraded (router loaded but embedder down, for example), or unhealthy. Treat anything other than healthy as “don’t route new traffic”.