leanroute

by kdandu001-arch

Provides a Laya-powered decision SDK and gateway for blocking attacks and routing LLM requests

A fast decision layer in front of any LLM: blocks attacks, sends easy requests to cheap models, hard ones to strong models, and shows the money saved. OpenAI-compatible, self-hostable, powered by Laya.

Related projects