by li-ming1
Runs the Laya decision model on CPU with a dependency-free Zig runtime
A from-scratch, dependency-free Zig CPU runtime for the Laya System-1 decision model: tokenizer + mmBERT-base encoder + decision head in one binary, no Python/torch/BLAS. Work in progress, see README.
Platforms
Use cases
Related projects
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
laya
receptron
Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime
laya-mlx
aac6fef
An MLX FP16 conversion of Laya for native inference on Apple silicon
laya.cpp
lkarlslund
A native C++ runtime runs Laya typed-decision models across GPU and Apple backends