Laya for runtimes & ports
Ports and inference engines that run the Laya weights.
488 projects
laya.axera
AXERA-TECH
Exports and calibrates Laya models for AXERA NPU deployment
laya-serve
stiermid
Serves local Laya decision models through a Jev-compatible HTTP API
openzl-laya
madeye
Adds optional on-device Laya routing to OpenZL compression on Linux and macOS
laya-cuda
Alexw1111
Provides a lightweight CUDA inference library for Laya
laya-rs
Fanaperana
Reimplements Laya in Rust for zero-shot text classification with verified numerical parity
laya-candle
mannlohchab
Runs English Laya decision-model inference using the Candle framework
laya-research
igun997
Runs a grocery-market decision research bench with a Laya model behind its API
laya-go
brennanMKE
Pure-Go inference and a drop-in HTTP server run the Laya System 1 decision model
apex-decisioncore
AAH20
A pure-Python decision kernel combining state-space dynamics, action pruning, safety projection, and audit logging
laya-java
apscot
Runs Laya typed-decision models in Java and provides compatible endpoints and Spring Boot tooling
laya-multilingual-GGUF
andreilungeanu
Provides quantized and full-precision Laya Multilingual GGUF files for llama.cpp
laya-multilingual-F16-GGUF
meshllm
Packages Laya Multilingual as an F16 GGUF fixture for MeshLLM System One smoke tests
laya-multilingual-gguf
fr0stbit3
Provides F16 and quantized GGUF conversions of the multilingual Laya model for llama.cpp
Laya-Multilingual-MXFP8
sahilchachra
An MXFP8 MLX quantization of Laya multilingual's encoder backbone for Apple Silicon
laya-gguf
ZeroDegress
A GGUF conversion of Laya for inference with the laya-rust engine
laya-onnx-int8
inferenceprince
Provides an int8 weight-only ONNX export of Laya for ONNX Runtime
laya-mm-guard-v3-gguf
OidoStudio
Packages a calibrated Laya prompt-injection guardrail fine-tune for the Go Laya server
laya-coreml-adaptive-fp16
aac6fef
Provides an adaptive FP16 Core ML conversion of the Laya model for Apple silicon
laya-onnx
tozp
Hosts ONNX-converted English Laya model weights in FP32, FP16, and INT8 formats
laya
Dariusdup
Provides a multilingual non-autoregressive model for calibrated typed decisions over text
Laya-Multilingual-CoreAI
mlboydaisuke
Exports Laya multilingual as an on-device Apple model for macOS and iPhone
laya-mobile
charioteer
Converts the Laya model to Core ML and ONNX for on-device use on iOS and Android
laya-en-fp32-swev
danielamitay
Exports Laya as a Core ML model for local typed decisions through the Swev Swift package
laya-typed-decisions-421m-coreml-ane
NMTZ
Provides fixed-shape Core ML artifacts converted from the 421M Laya typed-decisions checkpoint
More ways to use Laya