Experiential Gateway Launch: Pricing Impact
Experiential open-sources an LLM gateway with BYOK routing, budgets, and trace-trained optimization. See costs, limits, and who should test it.
By AI Pricing Guru Editorial Team
AI Pricing Guru articles are maintained by the editorial workflow behind the site: daily pricing snapshots, provider source checks, and review passes for model launches, subscription limits, and billing changes.
TL;DR
- Experiential v0.6.0 combines an Apache-2.0 LLM gateway, spend controls, trace-based routing, and optional model fine-tuning.
- Local use has no software-license fee, and the project describes hosted BYOK as free pass-through; model, evaluation, and training charges remain.
- The launch does not prove that production usage automatically creates a better model: release evidence ran no live provider calls or real training.
- Best fit: teams with repeatable, scoreable agent tasks and enough traces to compare cost per accepted result.
Candidate routes for an Experiential evaluation
USD per 1M tokens. Input and output rates are charted separately.
Estimate the underlying model bill
Assumes 75% input tokens and 25% output tokens using current per-million rates.
Qwen3.5 9B
together
$1.90
- Input share
- $1.28
- Output share
- $0.625
Qwen3.6-27B
novita
$13.50
- Input share
- $4.50
- Output share
- $9.00
Claude Sonnet 5
anthropic
$40.00
- Input share
- $15.00
- Output share
- $25.00
GPT-5.6 Sol
openai
$80.00
- Input share
- $30.00
- Output share
- $50.00
Live small-model and frontier API rates
| Model | Provider | Input / 1M | Cached / 1M | Output / 1M |
|---|---|---|---|---|
| Qwen3.5 9B | together | $0.17 | n/a | $0.25 |
| Qwen3.6-27B | novita | $0.6 | n/a | $3.60 |
| Claude Sonnet 5 | anthropic | $2.00 | $0.2 | $10.00 |
| GPT-5.6 Sol | openai | $4.00 | $0.4 | $20.00 |
Built from pricing.json at publish time.
Experiential Labs launched Experiential v0.6.0 on Hacker News as an “open OpenRouter” that can learn from usage. The Apache-2.0 project puts hosted, bring-your-own-key, and local models behind one OpenAI-compatible gateway, then uses agent traces to fit a workload-specific router or fine-tune an open model.
The cost opportunity is real, but the headline needs a boundary: Experiential is a control plane, not a newly priced foundation model. Savings depend on which models the router selects, how often it switches, and whether accepted-task quality survives the move.
What changed
This is a substantial expansion of the World Model Optimizer release we analyzed in July.
| Area | Earlier WMO release | Experiential v0.6.0 | Pricing effect |
|---|---|---|---|
| Serving | Project-specific optimized endpoint | Local and hosted gateway with OpenAI and Anthropic-compatible surfaces | One integration can reach several billing routes |
| Providers | Routing candidates used during optimization | OpenAI, Anthropic, Gemini, Azure, Bedrock, Fireworks, OpenRouter, and compatible or local endpoints | BYOK keeps the underlying provider invoice |
| Cost control | Optimization budget and savings analysis | Identity, alias, provider, and monthly spend controls | Caps exposure; does not lower token rates by itself |
| Learning loop | Fit a router from traces | Build a router, collect more traces, then optionally fine-tune an owned open model | Evaluation and training add costs before savings are proven |
| License | Previously unclear during our July check | Apache 2.0 in the repository and PyPI package | No separate source-code license fee |
The gateway uses a compiled Rust data plane with Python orchestration. It records content-free usage data—tokens, route, latency, and estimated cost—while the project says prompts, responses, raw tool arguments, and provider secrets are not stored in its local SQLite ledger.
Pricing impact
Experiential does not publish one universal gateway token rate. The repository describes hosted BYOK as free pass-through; those calls still appear on the connected provider’s bill. Hosted platform credits and host-managed routes are separate, while local users pay their chosen providers or local infrastructure.
| Deployment path | Experiential charge disclosed | What still costs money |
|---|---|---|
| Local gateway | Apache-2.0 software; no license fee | Provider API calls, hardware, and operations |
| Hosted BYOK | Described as free pass-through | The connected provider’s usage |
| Hosted managed models | No universal public rate card | Credits or route-specific model usage |
| Router/model optimization | No flat outcome price | Simulations, judges, embeddings, sandboxes, and optional Tinker training |
The live modules above show current candidate-model rates from our maintained dataset. Use the token calculator to model the mix, then compare OpenAI pricing and Anthropic pricing before moving traffic.
Does usage really create a better model?
Not automatically. Traces first become a simulation and evaluation set. Experiential can fit a router that chooses among existing models; after more traffic, it can optionally fine-tune an open model through Tinker.
The v0.6.0 release scope explicitly says its certification made no live credential-gated provider calls, ran no real Tinker training, and makes no trained-versus-base quality claim. Its deterministic router evidence also recorded no hosted-service spend. That proves software behavior, not production savings or model improvement.
Caching is another constraint. In the Hacker News discussion, the founder said the router should rarely switch models—or switch at task boundaries—and may conclude that one model already sits on the workload’s cost-quality frontier. That is more credible than routing every prompt independently, which can destroy provider cache reuse.
Who benefits—and who loses
Teams with repeatable, automatically scored agent tasks benefit most: support triage, extraction, coding workflows with tests, and bounded tool use. They can replay real traces and optimize for cost per accepted result instead of token price alone.
Teams with sparse traces, subjective outputs, strict prompt-caching economics, or high failure costs should wait. The release’s provider matrix is fixture-tested, but every credential-gated live provider cell is marked unrun. Production teams still need canaries for billing, streaming, tool calls, retries, and fallbacks.
What developers should do now
- Install the gateway locally and connect one provider key before adding hosted routes.
- Replay a recent, permissioned trace set with fixed pass/fail checks and a finite evaluation budget.
- Compare the fitted router against the best single model, including cache discounts, retries, judges, and training.
- Roll out at task boundaries with a hard monthly cap; keep the incumbent route as fallback.
For the countercase, read why Manifest retired its prompt router. Teams evaluating hosted open-model candidates can check Novita’s current model catalog before building a routing pool.
Affiliate disclosure: AI Pricing Guru may earn a commission from the sponsored Novita link at no extra cost to you. It does not affect this analysis.
Bottom line
Experiential v0.6.0 is a credible open gateway and evaluation toolkit, not a guaranteed discount engine. Its best idea is the feedback loop: measure real tasks, fit routing policy, and only then consider training a model.
Test it if your workload is repetitive and scoreable. Do not forecast savings from the Show HN headline alone; require a held-out result, cache-aware billing data, and cost per accepted task.
Sources: the Experiential repository, v0.6.0 release, release scope, gateway architecture, Hacker News discussion, PyPI package, our Experiential Labs pricing tracker, and the live AI pricing dataset. Sources checked August 28, 2026.