by FSSCoding
Serves GPU-accelerated Laya inference over HTTP with caching and a CLI
GPU-accelerated Laya inference over HTTP. A 421M-parameter System-1 decision model (onnxruntime-gpu) served by a lean FastAPI app. Laya does not generate text: you give it a state (a ticket, an email, a JSON object) and a set of typed questions, and it returns calibrated probabilities for every answer in a single forward pass.
Platforms
Related projects
colibri
JustVugg
Runs large open models locally in pure C, including Laya for typed decisions
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
laya
convaiinnovations
A multilingual-ready System 1 model that returns calibrated typed decisions over text in one pass
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
laya
receptron
Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime