Agent Server
A production-ready serving layer that registers, versions, and exposes multiple AI agents as secure, streaming-enabled REST services with Swagger/OpenAPI documentation.
What's in the box
Backend teams that need to publish agents as versioned APIs with streaming, auth, storage, and OpenAPI discovery. Each capability is opt-in — use the parts that fit, leave the rest.
Multi-Agent Registry
Registers and manages multiple agents within a central serving catalogue.
REST API
Exposes agents as standardised RESTful endpoints for application integration.
SSE Streaming
Streams real-time agent responses via Server-Sent Events.
Swagger / OpenAPI
Auto-generates interactive API documentation and testing interfaces.
Auth (JWT / Token)
Secures endpoints using token-based and JWT authentication models.
Publish & Version
Controls agent lifecycle through versioning, release, and publishing workflows.
Storage (Postgres / Mongo)
Persists conversations, messages, and metadata in scalable databases.
File Upload
Supports document ingestion and attachment handling within agent interactions.
How it runs
Wrap any number of agents and publish them as versioned, streaming REST endpoints with OpenAPI discovery, JWT auth, and pluggable storage.
Registry
- Multi-agent catalog
- Per-agent versions
- Lifecycle hooks
- Discovery endpoint
Transport
- REST + JSON
- Server-Sent Events
- File uploads
- OpenAPI / Swagger
Persistence
- Conversations
- Messages
- Files
- Trace events
Quickstart
Install, configure, run. The example below is the smallest piece of code that does something useful in production.
How it compares
Against the around agent sdk options teams most often weigh — focused on operational concerns, not feature inventories.
| Capability | Agent Server | Custom FastAPI / Express | OpenAI Assistants API | LangServe (LangChain) |
|---|---|---|---|---|
| Multi-Agent Serving | ● native | ◐ partial | ○ missing | ◐ partial |
| Streaming (SSE) | ● native | ◐ partial | ● native | ◐ partial |
| Built-in Auth | ● native | ◐ partial | ● native | ◐ partial |
| Built-in Storage | ● native | ◐ partial | ● native | ◐ partial |
| File Handling | ● native | ◐ partial | ◐ partial | ◐ partial |
| OpenAPI / Swagger | ● native | ◐ partial | ○ missing | ◐ partial |
Patterns that use Agent Server
Production-tested recipes powered by this package.
Autonomous AI Agents
Build agents that plan, execute tools, and deliver structured outputs with full deterministic control and observability.
Customer Support Bot
Deploy conversational AI with streaming responses, human-in-the-loop escalation, guardrails, and tool transparency.
Multi-Agent Orchestration
Compose multiple specialised agents that hand off tasks, share context, and collaborate on complex workflows.