Laya for runtimes & ports

Ports and inference engines that run the Laya weights.

488 projects

S

laya-multilingual-coreai

smdesai

Provides a Core AI conversion of multilingual Laya for typed decisions on Apple devices

1·HF model
A

laya-typed-decisions-web-q8

alfred361

Provides a quantized web build of Laya typed-decision models

1·HF model
V

layaForWeb

VishalMysore

Provides quantized ONNX checkpoints and a demo for running Laya in browsers

1·HF model
R

laya-onnx

rarha

Provides an ONNX export of the Laya model

1·HF model
M

laya-mlx

millat

Converts Laya to a native MLX FP16 checkpoint for inference on Apple silicon

1·HF model
S

laya-multilingual-onnx-int8

Sharjeelbaig

Provides an INT8 ONNX quantization of Laya multilingual for CPU inference in JavaScript and TypeScript

1·HF model
N

laya

nishanth-kj

Provides a multilingual typed-decision model and Python package with optional serving and integration extras

1·HF model
V

layaForWebTrained

VishalMysore

Provides a quantized ONNX version of Laya typed decisions for browser inference

1·HF model
I

laya

Infin8-AI

Hosts multilingual, English, and typed-decisions checkpoints for the Laya decision model

1·HF model
A

daylens-laya-onnx

aaronalexS

Provides an ONNX conversion of Laya for local activity labeling in the Daylens desktop app

1·HF model
G

laya-web-q8

go-vertika

Provides an 8-bit ONNX quantization of Laya for in-browser decision inference

1·HF model
M

laya-en-fp16

marrviin

FP16 ONNX export of the English Laya checkpoint (no model card)

1·HF model
D

laya-onnx

duration465

Exports Laya’s multilingual checkpoint to ONNX for use with the @receptron/laya Node.js package

1·HF model
E

laya-mmbert-npu-s25u

Edgsj

Deploys a Laya mmBERT model on the Galaxy S25 Ultra Hexagon NPU

1·HF model
N

laya-typed-decisions-onnx

ningsuhen

Converts Laya typed decisions to fp16 ONNX for browser inference with WebGPU

1·HF model

laya-jev

KonghaYao

Runs local Laya inference and exposes Jev-compatible HTTP endpoints

1·GitHub repo

ultra_laya

roadius2

A fork of Laya adds multilingual decision routing and checkpoint selection

1·GitHub repo

laya-go

lengoman

Provides Go types, routing, batching, and transports for using local Laya checkpoints

1·GitHub repo

JevCoreML

GodModeAI2025

Provides Core ML decision models, a Swift package, an HTTP server, and a demo app

1·GitHub repo

laya

xosi

Runs Laya typed-decision inference locally on Apple Silicon with MLX

1·GitHub repo

laya-server

pambrose

Implements a Jev-compatible API server backed by local Laya checkpoints

1·GitHub repo

laya

ganeshdipdumbare

Serves Laya typed-decision predictions over HTTP in a self-hosted Docker deployment

1·GitHub repo

laya-micro

osamabinIaggin

Prunes and quantizes Laya for low-memory single-board computer deployment

1·GitHub repo

laya-mlx-per-turn-classifier

M37Labs

Demonstrates per-turn customer message classification with Laya on Apple Silicon

1·GitHub repo

More ways to use Laya