by GTC6244
Ports Laya inference to Rust with native Candle support, a router, HTTP server, and CLI
Pure-Rust port of the Laya non-autoregressive System-1 decision engine — native candle inference (ModernBERT/mmBERT), Router, HTTP server, CLI. Matches PyTorch to 1e-4.
Platforms
Use cases
Related projects
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
laya
receptron
Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime
keel
codejunkie99
A macOS coding workspace uses local Laya or hosted Jev to select task routes
laya-mlx
aac6fef
An MLX FP16 conversion of Laya for native inference on Apple silicon