by bearcut
Routes LLM requests using Laya-based security, intent, and complexity decisions
Guardrail Layer and Decision Orchestration Shield will be an asynchronous, sub-50ms LLM guardrail & routing proxy powered by non-autoregressive decision encoders (Laya AI). Evaluates security (noul), intent (choice), and complexity (score) in a single forward pass to drop attacks, serve vector cache, and cut cloud LLM costs.
Platforms
Use cases
Related projects
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
laya
convaiinnovations
A multilingual-ready System 1 model that returns calibrated typed decisions over text in one pass
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
laya-multilingual
convaiinnovations
A multilingual System 1 model that returns calibrated typed decisions over text in one pass
openJev-verdict-2.0
Heman10x-NGU
Develops and benchmarks a non-autoregressive typed-decision model against Jev and Laya