Fully Self-Hosted · Single Instance 2GB · Never Markup Token Fees
BYOK (bring your own keys) — you pay providers at standard rates. We license a single 2GB instance, never by seats or token markup. Larger memory or multi-instance goes through Enterprise.
The core is built on Rust. At the gateway-forwarding level, each 1GB of memory sustains roughly 100M tokens per minute (TPM) and ~500 requests per minute (RPM), comfortably serving ~100 typical users. These are reference figures: actual throughput is bounded by your own providers’ rate limits and request complexity, and is not an SLA commitment.
Included on every plan: BYOK with zero token markup · 100+ provider routing · client access control · prompt caching · cost quotas
Free
Fully self-hosted · Single license
512MB single instance, no log retention — right for evaluation and POCs, not production traffic.
- ✓100+ LLM routing · Fallback · Load balancing
- ✓Cross-vendor model mixing · in-agent downgrade (plan locked / non-plan auto-downgrade)
- ✓Client access control (User-Agent policy)
- ✓Prompt caching
- ✓BYOK (bring your own keys, no markup)
- ✓512MB memory cap · SQLite · single instance
- ✓GitHub Actions code review via your own gateway
- ✓No log retention
Pro
/ month · 2GB single instance (fixed cap) · 21-day free trial
Fixed 2GB cap, no add-on. For multi-node, compliance (Audit/DLP), or the Management API, go Enterprise.
- ✓All Free features
- ✓2GB memory · single instance (fixed cap, no add-on)
- ✓Log retention
- ✓Enterprise SSO (OIDC: Azure AD / Okta / generic, plus SAML 2.0 + SCIM)
- ✓PostgreSQL · 2GB memory
- ✓Email / ticket support
100% refund within 30 days if unsatisfied
Enterprise
By memory capacity · Billed annually · 30-day refund
- ✓All Pro features
- ✓Capacity-based billing (nodes × memory, flat $400/GB/mo)
- ✓Multi-node / cluster deployment
- ✓GitHub Actions code review via your own gateway
- ✓Microsoft 365 add-in (Excel/Word/PPT/Outlook, paid add-on)
- ✓Extended log retention
- ✓Priority support response
- ✓Compliance (Audit / DLP)
- ✓Management API (programmatic API key · quota · usage query · audit export)
Need more capacity or a custom setup? Contact us →
Feature Comparison
| Capability | Free | Pro | Enterprise |
|---|---|---|---|
| Multi-Model Routing · Fallback · Load Balancing | ✓ | ✓ | ✓ |
| Cross-Vendor Model Mixing (Planning/Execution by Vendor) | ✓ | ✓ | ✓ |
| In-Agent Model Downgrade (plan locked / non-plan auto-downgrade) | ✓ | ✓ | ✓ |
| Prompt Caching | ✓ | ✓ | ✓ |
| BYOK (Bring Your Own Keys, No Markup) | ✓ | ✓ | ✓ |
| Memory Tier | 512MB | 2GB (fixed) | Custom |
| Storage / Database | SQLite (single instance) | PostgreSQL · 2GB | PostgreSQL + Redis Cluster |
| Deployment Scale | 1 instance | 1 instance · 2GB | Multi-Node / Cluster |
| Throughput per GB (reference) | — | 2GB ≈ 200M TPM / 1,000 RPM | ≈ 100M TPM / 500 RPM per GB |
| Log Retention | None | Retained | Extended Retention |
| SSO (OIDC / SAML 2.0) | — | ✓ | ✓ |
| SCIM 2.0 auto-provisioning | — | ✓ | ✓ |
| Compliance (Audit / DLP) | — | — | ✓ |
| Management API (programmatic key · quota · usage · audit) | — | — | ✓ |
| Self-owned rate card / price snapshots (incl. private pricing) | ✓ | ✓ | ✓ |
| Cost quotas (daily / monthly, three-level inheritance) | ✓ | ✓ | ✓ |
| Support Response | Community | Email / Ticket | Priority Response |
| Mode-Aware Model Policy (plan/execute, enforceable) | ✓ | ✓ | ✓ |
| Client Access Control (User-Agent policy) | ✓ | ✓ | ✓ |
| GitHub Actions Code Review (via your gateway) | ✓ | ✓ | ✓ |
| Microsoft 365 Add-in (Excel/Word/PPT/Outlook, self-hosted) | — | Add-on | Add-on |
| Purview sensitivity-label gating (addin.access / file.upload) | — | — | ✓ |