handoff
by kingd2925-beep
A local router learns from chat history to direct requests to cheaper or stronger models
Train a tiny local router on your own AI chat history. It decides in ~0.1 s which requests a cheap model can handle and which need the strong one — with an honest report card. Built on Laya · MIT