Auto Router

A routing meta-model that classifies incoming requests and directs them to downstream models chosen for the specific task.

Strengths

Automatically selects the most appropriate model for each request, reducing manual model selection overhead and potentially improving cost-efficiency by routing simpler queries to faster models.

Best for

Applications where request types vary widely and optimal model choice depends on task characteristics, or where you want to balance performance and efficiency without managing multiple model calls yourself.

Limitations

Still in beta, so routing decisions may not always match human judgment, and you have limited visibility into which downstream model is chosen for a given request.