by tamnd
A Rust inference engine and HTTP server runs Laya checkpoints across CPU, CUDA, and Apple GPUs
Typed decisions over text in milliseconds. A Rust inference engine and server that answers choice, score and yes or no questions with calibrated probabilities, compatible with Jev and Laya. The bar is 10x faster on every benchmark at equal or better accuracy.
Platforms
Related projects
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
laya
receptron
Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime
openJev-verdict-2.0
Heman10x-NGU
Develops and benchmarks a non-autoregressive typed-decision model against Jev and Laya
laya-ultrafast
ipenywis
Runs a browser automation agent using local Laya decisions through MLX