Tag

routing

2 results tagged "routing"

Projects

↗
route-switch Go

Research into cost-quality optimisation for LLM routing. Routes across providers by strategy and reruns MIPROv2 prompt tuning on captured traces.

MIT MIPROv2 code

Articles

LLM Cognition

Intelligent LLM Routing: Spending Compute Where It Matters

How route-switch routes LLM traffic by configured strategy, logs every call to DuckDB and SQLite, and reruns MIPROv2 prompt optimisation on captured traces.

routingMIPROv2cost-optimisation