Not Diamond
Intelligent model router that predicts the optimal LLM for each query, improving accuracy up to 60% while reducing inference costs by 30%
Overview
Not Diamond is an intelligent model router that automatically predicts which AI model will provide the best response for each query. Unlike static model selection or simple load balancing, Not Diamond uses trained routing algorithms to optimize the accuracy-to-cost tradeoff dynamically. The platform sits between your application and AI providers, making real-time routing decisions based on query characteristics. It also includes automatic prompt optimization that adapts prompts across different models without manual intervention. Backed by IBM Ventures, Jeff Dean (Google DeepMind), and prominent AI leaders, Not Diamond is building infrastructure for the multi-model future.
The Verdict
Who Should Use Not Diamond?
Best For
- Teams using multiple LLM providers
- Cost-conscious production workloads
- Apps needing dynamic quality optimization
- Coding agents requiring model flexibility
- Enterprises avoiding vendor lock-in
Not Ideal For
- Single-model applications
- Latency-critical use cases (adds routing hop)
- Teams committed to one provider
- Very low volume usage
What's Great
- Intelligent per-query routing (not just load balancing)
- Up to 60% accuracy improvement with prompt optimization
- 30% cost reduction on inference
- Pre-trained router works in under 5 minutes
- Custom routers trainable on your data
- SOC-2 and ISO 27001 compliant
- Backed by IBM Ventures and AI leaders
Watch Out For
- Early-stage startup (founded Feb 2024)
- Adds 10-100ms routing latency
- Limited public reviews available
- Enterprise pricing requires sales contact
Pricing
View all features & details
Core Features
- Intelligent query routing
- Pre-trained chat auto mode
- Custom router training
- Automatic prompt optimization
- Prompt portability across models
- Custom evaluation metrics
Integration
- Python SDK (PyPI)
- TypeScript SDK (npm)
- REST API
- Stack-agnostic design
- Works with existing gateways
Compliance
- SOC-2 certified
- ISO 27001 certified
- Zero-data-retention options
- 24/7 enterprise support
Notable Customers
- Hugging Face
- Dropbox
- IBM
- DoorDash
- OpenRouter
- Samwell AI
How It Compares
| Feature | Not Diamond | OpenRouter | LiteLLM | Portkey |
|---|---|---|---|---|
| Routing Type | Intelligent prediction | Fallback-based | Configurable | Rules-based |
| Accuracy Optimization | Yes (up to 60%) | No | No | No |
| Prompt Optimization | Automatic | No | No | Manual |
| Custom Training | Yes | No | No | No |
| Latency Added | 10-100ms | Minimal | Self-hosted | Minimal |
| Free Tier | 10K routes/mo | Pay-per-use | Free OSS | Limited |
| Best For | Quality optimization | Model access | Self-hosting | Enterprise observability |