Laya for runtimes & ports

Ports and inference engines that run the Laya weights.

245 projects

L

laya-LiteRT

litert-community

Converts Laya decision encoders into LiteRT graphs for Android GPU inference

152·HF model
T

laya-onnx

tozp

Hosts ONNX-converted English Laya model weights in FP32, FP16, and INT8 formats

146·HF model
Z

laya-gguf

ZeroDegress

A GGUF conversion of Laya for inference with the laya-rust engine

135·HF model
I

laya-onnx-int8

inferenceprince

Provides an int8 weight-only ONNX export of Laya for ONNX Runtime

104·HF model
L

Laya-English-LiteRT

litert-community

Runs Laya English and typed-decision checkpoints on Android GPUs with LiteRT

94·HF model
S

Laya-Multilingual-MXFP8

sahilchachra

An MXFP8 MLX quantization of Laya multilingual's encoder backbone for Apple Silicon

93·HF model
F

laya-gguf-persian-multilingual-decision

fibonacciai

A Persian-optimized multilingual GGUF conversion of the Laya typed-decision model

91·HF model
D

laya-en-fp32-swev

danielamitay

Exports Laya as a Core ML model for local typed decisions through the Swev Swift package

5·HF model
S

laya-multilingual-coreai

smdesai

Provides a Core AI conversion of multilingual Laya for typed decisions on Apple devices

1·HF model
S

laya-multilingual-onnx

soyelmismo

Provides CPU-optimized, quantized ONNX checkpoints for multilingual Laya

1·HF model
A

laya-typed-decisions-web-q8

alfred361

Provides a quantized web build of Laya typed-decision models

1·HF model
V

layaForWeb

VishalMysore

Provides quantized ONNX checkpoints and a demo for running Laya in browsers

1·HF model
R

laya-onnx

rarha

Provides an ONNX export of the Laya model

1·HF model
M

laya-mlx

millat

Converts Laya to a native MLX FP16 checkpoint for inference on Apple silicon

1·HF model
0

laya-System1

0xSojalSec

Provides multilingual Laya checkpoints for typed decisions over text and JSON states

1·HF model
M

laya-onnx

mariojcr

Exports Laya checkpoints to ONNX for inference with ONNX Runtime

1·HF model
R

laya-ov-int8

rupeshs

An int8 OpenVINO export of Laya for CPU inference

1·HF model

laya-jev

KonghaYao

Runs local Laya inference and exposes Jev-compatible HTTP endpoints

1·GitHub repo

LayaKit

tahby

A Swift package for running Laya typed decisions on-device with Core ML

1·GitHub repo

ultra_laya

roadius2

A fork of Laya adds multilingual decision routing and checkpoint selection

1·GitHub repo

laya-go

lengoman

Provides Go types, routing, batching, and transports for using local Laya checkpoints

1·GitHub repo

laya

xosi

Runs Laya typed-decision inference locally on Apple Silicon with MLX

1·GitHub repo

laya-server

pambrose

Implements a Jev-compatible API server backed by local Laya checkpoints

1·GitHub repo

localjev-mlx

rimusz

A self-hosted System One judgment service for Apple Silicon using laya-mlx

1·GitHub repo

More ways to use Laya