Laya for runtimes & ports

Ports and inference engines that run the Laya weights.

488 projects

laya.axera

AXERA-TECH

Exports and calibrates Laya models for AXERA NPU deployment

2·GitHub repo

laya-serve

stiermid

Serves local Laya decision models through a Jev-compatible HTTP API

2·GitHub repo

openzl-laya

madeye

Adds optional on-device Laya routing to OpenZL compression on Linux and macOS

2·GitHub repo

laya-cuda

Alexw1111

Provides a lightweight CUDA inference library for Laya

2·GitHub repo

laya-rs

Fanaperana

Reimplements Laya in Rust for zero-shot text classification with verified numerical parity

2·GitHub repo

laya-candle

mannlohchab

Runs English Laya decision-model inference using the Candle framework

2·GitHub repo

laya-research

igun997

Runs a grocery-market decision research bench with a Laya model behind its API

2·GitHub repo

laya-go

brennanMKE

Pure-Go inference and a drop-in HTTP server run the Laya System 1 decision model

2·GitHub repo

apex-decisioncore

AAH20

A pure-Python decision kernel combining state-space dynamics, action pruning, safety projection, and audit logging

2·GitHub repo

laya-java

apscot

Runs Laya typed-decision models in Java and provides compatible endpoints and Spring Boot tooling

2·GitHub repo
A

laya-multilingual-GGUF

andreilungeanu

Provides quantized and full-precision Laya Multilingual GGUF files for llama.cpp

650·HF model
M

laya-multilingual-F16-GGUF

meshllm

Packages Laya Multilingual as an F16 GGUF fixture for MeshLLM System One smoke tests

627·HF model
F

laya-multilingual-gguf

fr0stbit3

Provides F16 and quantized GGUF conversions of the multilingual Laya model for llama.cpp

592·HF model
S

Laya-Multilingual-MXFP8

sahilchachra

An MXFP8 MLX quantization of Laya multilingual's encoder backbone for Apple Silicon

274·HF model
Z

laya-gguf

ZeroDegress

A GGUF conversion of Laya for inference with the laya-rust engine

212·HF model
I

laya-onnx-int8

inferenceprince

Provides an int8 weight-only ONNX export of Laya for ONNX Runtime

199·HF model
O

laya-mm-guard-v3-gguf

OidoStudio

Packages a calibrated Laya prompt-injection guardrail fine-tune for the Go Laya server

48·HF model
A

laya-coreml-adaptive-fp16

aac6fef

Provides an adaptive FP16 Core ML conversion of the Laya model for Apple silicon

40·HF model
T

laya-onnx

tozp

Hosts ONNX-converted English Laya model weights in FP32, FP16, and INT8 formats

34·HF model
D

laya

Dariusdup

Provides a multilingual non-autoregressive model for calibrated typed decisions over text

18·HF model
M

Laya-Multilingual-CoreAI

mlboydaisuke

Exports Laya multilingual as an on-device Apple model for macOS and iPhone

13·HF model
C

laya-mobile

charioteer

Converts the Laya model to Core ML and ONNX for on-device use on iOS and Android

5·HF model
D

laya-en-fp32-swev

danielamitay

Exports Laya as a Core ML model for local typed decisions through the Swev Swift package

1·HF model
N

laya-typed-decisions-421m-coreml-ane

NMTZ

Provides fixed-shape Core ML artifacts converted from the 421M Laya typed-decisions checkpoint

1·HF model

More ways to use Laya