An open-source Rust model gateway that routes LLM requests across 1000+ models from multiple providers, using ML-driven smart routing (OTel traces, text world models, nearest-neighbor classifiers) to optimize cost/quality per request. It takes zero markup, supports BYOK, and offers an opt-in feature where user traffic trains a custom model.
Background
OpenRouter is a popular commercial LLM model gateway/aggregator. This project positions itself as a zero-markup, open-source alternative with smart routing capabilities.
- Source
- Hacker News (RSS)
- Published
- Aug 28, 2026 at 05:18 AM
- Score
- 6.0 / 10