Patterns · Vol. 16

Pattern

Multi-model routing for cost

Reduce average cost per request by routing easy tasks to cheaper models and reserving expensive models for tasks that genuinely need them, with a routing layer that classifies requests and selects the appropriate model.

Classification — Routing requests to different models based on task complexity and cost requirements.

Full entry

The complete treatment — problem, how it works, when to use it, sources, and examples — lives in the volume below.

Browse the full pattern index or the catalog.