Laya for runtimes & ports
Ports and inference engines that run the Laya weights.
245 projects
laya-LiteRT
litert-community
Converts Laya decision encoders into LiteRT graphs for Android GPU inference
laya-onnx
tozp
Hosts ONNX-converted English Laya model weights in FP32, FP16, and INT8 formats
laya-gguf
ZeroDegress
A GGUF conversion of Laya for inference with the laya-rust engine
laya-onnx-int8
inferenceprince
Provides an int8 weight-only ONNX export of Laya for ONNX Runtime
Laya-English-LiteRT
litert-community
Runs Laya English and typed-decision checkpoints on Android GPUs with LiteRT
Laya-Multilingual-MXFP8
sahilchachra
An MXFP8 MLX quantization of Laya multilingual's encoder backbone for Apple Silicon
laya-gguf-persian-multilingual-decision
fibonacciai
A Persian-optimized multilingual GGUF conversion of the Laya typed-decision model
laya-en-fp32-swev
danielamitay
Exports Laya as a Core ML model for local typed decisions through the Swev Swift package
laya-multilingual-coreai
smdesai
Provides a Core AI conversion of multilingual Laya for typed decisions on Apple devices
laya-multilingual-onnx
soyelmismo
Provides CPU-optimized, quantized ONNX checkpoints for multilingual Laya
laya-typed-decisions-web-q8
alfred361
Provides a quantized web build of Laya typed-decision models
layaForWeb
VishalMysore
Provides quantized ONNX checkpoints and a demo for running Laya in browsers
laya-onnx
rarha
Provides an ONNX export of the Laya model
laya-mlx
millat
Converts Laya to a native MLX FP16 checkpoint for inference on Apple silicon
laya-System1
0xSojalSec
Provides multilingual Laya checkpoints for typed decisions over text and JSON states
laya-onnx
mariojcr
Exports Laya checkpoints to ONNX for inference with ONNX Runtime
laya-ov-int8
rupeshs
An int8 OpenVINO export of Laya for CPU inference
laya-jev
KonghaYao
Runs local Laya inference and exposes Jev-compatible HTTP endpoints
LayaKit
tahby
A Swift package for running Laya typed decisions on-device with Core ML
ultra_laya
roadius2
A fork of Laya adds multilingual decision routing and checkpoint selection
laya-go
lengoman
Provides Go types, routing, batching, and transports for using local Laya checkpoints
laya
xosi
Runs Laya typed-decision inference locally on Apple Silicon with MLX
laya-server
pambrose
Implements a Jev-compatible API server backed by local Laya checkpoints
localjev-mlx
rimusz
A self-hosted System One judgment service for Apple Silicon using laya-mlx
More ways to use Laya