Laya for runtimes & ports

laya-rs

redwolf2019

Provides a Rust HTTP inference runtime and server for multilingual Laya models

zlaya

dip-proto

Runs Laya inference locally in Zig, including native and WebAssembly targets

laya-rs

apiplant

Reimplements Laya inference and training in Rust using the Candle framework

laya-apple

tc3oliver

Runs Laya locally on Apple Silicon with MLX GPU and Apple Neural Engine support

Laya4j

githubMJ

A Java 17+ SDK runs Laya typed-decision models through ONNX Runtime

kevala

bvolpato

A Rust WebAssembly engine runs Laya and other decision models locally in browsers

Packages the Laya decision model as a Core ML bundle for Apple devices

laya

he-jev

A Hugging Face repository provides Laya multilingual and typed-decision model checkpoints

Converts the multilingual Laya model to GGUF with quantized variants

Converts Laya to GGUF and provides quantized weights with a separate decision head

Runs Laya typed-decision inference natively on Apple silicon with MLX

vgi-laya

lmangani

Runs local Laya inference in DuckDB to filter, classify, and score rows

laya-onnx

MstyAI

Runs Laya decision models locally with ONNX Runtime through a Go library and CLI

laya-fast

DJLougen

Runs Laya typed decisions on Apple Silicon with MLX and optional Core ML execution

deqio

ILuce

Serves multiple typed-decision models, including Laya, through a local API and browser UI

Exports multilingual Laya as a portable Core ML bundle for Apple devices

Runs multilingual Laya on Android GPUs using LiteRT

Exports multilingual Laya to ONNX for native and browser WebGPU inference

laya.cpp

shpati

Ports the Laya model to C and C++ for CPU inference on Linux and Windows

laymbda

HQarroum

Runs the Laya decision model as a CPU-only AWS Lambda function with SnapStart

laya-candle

b0xtch

Runs Laya safetensors natively in Rust with Candle and CPU, Metal, or CUDA backends

laya-zig

li-ming1

Runs the Laya decision model on CPU with a dependency-free Zig runtime

Packages Laya checkpoints for deployment on AXERA AX650 and AX8850 NPUs

Provides quantized ONNX exports of English and multilingual Laya checkpoints