One governed entry point for your teams' LLM access.
AI Gateway
ZopNight now offers an AI Gateway: a single, governed front door to your LLM providers, with scoped virtual keys per team or app, budgets to cap AI spend, and cost reports broken down by key, provider, and model. Imported Helm services in ZopDay now show the live public URL they route to.
What's in this release
- New ZopNight: AI Gateway. A single, governed entry point for your teams' access to LLM providers: issue scoped virtual keys per team or app, each limited to the providers and models you allow; cap AI spend with budgets so a runaway workload can't blow past its limit; see usage and spend broken down across keys, providers, and models; and govern who can view, create, edit, or delete virtual keys and models through your existing roles, scoped to specific providers when needed
- Improved ZopDay: the "How to access" card for an imported (Helm) service now shows the live public URL the cluster's Ingress routes to it; when nothing routes to it, the in-cluster endpoint shows as before