Auto Router (Beta)

A routing meta-model that classifies incoming requests and directs them to downstream models chosen for the specific task.

Strengths

Routes requests to task-appropriate models without requiring manual model selection, potentially improving task-specific performance across diverse workloads.

Best for

Applications with varied request types that benefit from having different specialized models handle different task categories.

Limitations

Adds routing latency and depends on classification accuracy; not suitable when you need deterministic behavior or require a specific model's capabilities.