laya-inference-engine
by aaditagrawal
Provides a GPU inference engine and performance modes for Laya on NVIDIA Blackwell
an experimental blackwell optimised inference engine for laya, an open source system one model
Platforms
Use cases
Related projects
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
23.9k·GitHub repo
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
6.3k·GitHub repo
C
laya
convaiinnovations
A multilingual-ready System 1 model that returns calibrated typed decisions over text in one pass
3.5k·HF model
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
1.4k·GitHub repo
laya
receptron
Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime
450·GitHub repo
openJev-verdict-2.0
Heman10x-NGU
Develops and benchmarks a non-autoregressive typed-decision model against Jev and Laya
285·GitHub repo