laya-cuda
by Banshal-Yadav
Ports Laya typed-decision inference to PyTorch CUDA with GPU and CPU acceleration
Platforms
On X
laya-CUDA runs Snake at 110 decisions per second on an RTX 4050
laya-CUDA running snake live at 110 decisions/sec (8.7 ms latency) on an RTX 4050. • pre-allocated static CUDA graphs • pative PyTorch CUDA port of @mizorewww's laya-mlx • live WebSocket browser engine repo:
Project: laya-cuda→Related projects
colibri
JustVugg
Runs large open models locally in pure C, including Laya for typed decisions
40.1k·GitHub repo
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
23.9k·GitHub repo
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
6.3k·GitHub repo
C
laya
convaiinnovations
A multilingual-ready System 1 model that returns calibrated typed decisions over text in one pass
58.1k·HF model
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
1.4k·GitHub repo
laya
receptron
Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime
450·GitHub repo