Laya for runtimes & ports

Ports and inference engines that run the Laya weights.

488 projects

colibri

JustVugg

Runs large open models locally in pure C, including Laya for typed decisions

40.1k·GitHub repo

laya

NandhaKishorM

Runs multilingual typed-decision models and provides routing, serving, and integration options

23.9k·GitHub repo

laya-mlx

mizorewww

Runs Laya typed-decision models locally on Apple Silicon using MLX

6.3k·GitHub repo

laya-coreml

mizorewww

Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine

1.4k·GitHub repo

laya

receptron

Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime

450·GitHub repo

jev-cookbook

datawhalechina

Teaches Jev and demonstrates fine-tuning and serving the open-source Laya model

158·GitHub repo
A

laya-mlx

aac6fef

An MLX FP16 conversion of Laya for native inference on Apple silicon

121·HF model

laya.cpp

lkarlslund

A native C++ runtime runs Laya typed-decision models across GPU and Apple backends

89·GitHub repo

system-one-foundation-models

peterfriese

Bridges Laya and Jev System One decision models into Apple’s Foundation Models framework

72·GitHub repo
F

laya-coreml

FluidInference

A Core ML conversion of Laya Multilingual for inference on Apple devices

100·HF model
G

Laya-GGUF

ggml-org

Provides an automatically converted Laya GGUF model for use with llama.cpp-compatible software

18.3k·HF model

laya-opencv

uu889

Combines OpenCV measurements with Laya or Jev decisions in a local visual-inspection workbench

28·GitHub repo
M

laya-GGUF

mys

Compiles the English Laya decision model into GGUF files using ggmlc

786·HF model

ollaya

ollaya-dev

Pulls and serves local decision models, including Laya, through a TypeSafe-compatible API

24·GitHub repo

laya-mps

afshinm

Runs Laya typed-decision inference locally on Apple Silicon using Metal Performance Shaders

22·GitHub repo

layaForWeb

vishalmysore

Runs a quantized ONNX version of the Laya decision model entirely in the browser

18·GitHub repo

lev

jlt-commons

Implements a typed decision engine using Laya checkpoints and GGUF chat models

17·GitHub repo

laya-goish

centillex-labs

Runs Laya GGUF models in a Rust HTTP server for structured text decisions

17·GitHub repo

laya_ex

ChristianAlexander

Provides a native Nx and Bumblebee runtime for ConvAI Innovations' Laya model

16·GitHub repo
M

laya-multilingual-GGUF

mys

Compiles the multilingual Laya decision model into GGUF files using ggmlc

1.9k·HF model
M

laya-onnx

Mattepiu

Exports a fine-tuned Laya decision model to ONNX for Python and Node.js inference

15·HF model
A

laya-multilingual-mlx

aac6fef

Converts the multilingual Laya decision model to MLX for Apple silicon

15·HF model

ruby-laya

codenamev

Provides a Ruby port of Laya with typed decisions, checkpoint routing, and ONNX Runtime inference

15·GitHub repo
F

laya-gguf

fr0stbit3

Converts Laya to GGUF and provides quantized weights with a separate decision head

558·HF model

More ways to use Laya