Arch-Router: Aligning LLM Routing with Human Preferences

(arxiv.org)

9 points | by handfuloflight 17 hours ago

2 comments

honorable_coder 17 hours ago
The core insight of decoupling route selection from model assignment is rooted in first principles engineering thinking. Someone recently wrote about their work in more detail here:
https://medium.com/@dracattusdev/finally-an-llm-router-that-...
sparacha 17 hours ago
Hey! I built this. AMA. The model router is built into the proxy layer here: https://github.com/katanemo/archgw