Console EE
A closed-source enterprise overlay on top of open-source Console. Adds GPU fleet management, isolated code sandboxes, realtime voice, LDAP/Active Directory SSO, automated prompt optimization, and cluster administration — gated per tenant by a signed license.
Licensed per tenant — no public package
Console EE ships as a private overlay merged onto open-source Console at build time and unlocked by a signed, offline-verifiable license. Start with self-hosted Console today, then add the enterprise edition when you need GPU fleets, sandboxes, directory SSO, or realtime voice.
What's in the box
Enterprises that run Console at scale and need managed GPU infrastructure, isolated agent execution, corporate directory SSO, and compliance-grade licensing on top of the open-source control plane. Each capability is opt-in — use the parts that fit, leave the rest.
GPU Fleet Management
Orchestrate multi-host GPU clusters with agent registration, heartbeating, workload distribution, bulk deployment, a shared model library, and terminal access to each node.
Sandbox Execution
Run agent and user code in isolated, containerised sandboxes with volumes, git integration, file operations, preview ports, and live terminal sessions.
LDAP / Active Directory SSO
Authenticate against corporate directories over LDAP/LDAPS with just-in-time provisioning, group-to-role mapping, and scheduled group sync.
Prompt Optimization Engine
Automatically tune prompts with evaluation-driven beam search, variant generation, and safe promotion into versioned prompt deployments.
Realtime Voice & Audio
WebSocket OpenAI-Realtime-style protocol with streaming text/audio, speech synthesis, transcription, and a Twilio bridge for telephony.
Cluster Administration
Admin dashboard and APIs to manage multi-cluster infrastructure with fleet-wide visibility and control.
Per-Tenant Licensing
Offline-verifiable signed licenses gate enterprise routes per tenant — community builds stay 404, licensed tenants unlock EE features without code changes.
Overlay Architecture
Enterprise code lives in a private overlay merged at build time via database mixins and a plugin registry — the open-source core is never modified.
How it runs
Console EE is an overlay, not a fork: the open-source core stays untouched while enterprise plugins and database mixins merge in at build time. A signed, per-tenant license gates every enterprise route — unlicensed tenants get the same 404 as a community build.
Enterprise services
- GPU fleet management
- Sandbox execution
- Realtime voice & audio
- Prompt optimization
Identity & access
- LDAP / AD SSO
- JIT provisioning
- Group → role mapping
- Per-tenant license
Operations
- Cluster admin
- Shared model library
- Offline license verify
- Untouched OSS core
Quickstart
Install, configure, run. The example below is the smallest piece of code that does something useful in production.
How it compares
Against the enterprise · console options teams most often weigh — focused on operational concerns, not feature inventories.
| Capability | Console EE | Cognipeer Console (OSS) | Portkey Enterprise | LiteLLM Enterprise |
|---|---|---|---|---|
| Self-Hosted | ● native | ● native | ◐ partial | ● native |
| Directory SSO | ● native | ○ missing | ● native | ● native |
| GPU Fleet | ● native | ○ missing | ○ missing | ○ missing |
| Code Sandbox | ● native | ◐ partial | ○ missing | ○ missing |
| Realtime Voice | ● native | ○ missing | ○ missing | ○ missing |
| Prompt Optimization | ● native | ○ missing | ◐ partial | ○ missing |