Labs

Experimental features and upcoming capabilities. These may change or be removed.

Auto Exacto Routing

beta

Adaptive quality routing that automatically selects the best operator based on real-time quality scores, not just latency.

Operator Benchmarks

alpha

Standardized benchmark suite for operators. Compare TTFT, throughput, and quality across operators for the same model.

Structured Output Routing

alpha

Route structured output requests (JSON mode, tool calling) to operators with the highest success rates for those features.

Model Distillation Pipeline

coming soon

Use large model outputs to fine-tune smaller models via operator-hosted training Blueprints.