Laya for runtimes & ports

Ports and inference engines that run the Laya weights.

245 projects

laya-cpp

samiul000

Implements native C++ Laya inference with ONNX Runtime, benchmarking, and INT8 quantization

0·GitHub repo

laya-finetuning

tehtommeh

Runs Laya locally with an API and UI, serving multiple checkpoints through the official SDK

0·GitHub repo

Laya-Decision

GTC6244

Ports Laya inference to Rust with native Candle support, a router, HTTP server, and CLI

0·GitHub repo

laya-js

johnhenry

Runs Laya typed decisions in JavaScript across MLX, WebGPU and CPU backends

0·GitHub repo

laya-neutron

open-ep

Runs the Jev model on an NXP i.MX 95 Neutron NPU

0·GitHub repo

poc-laya

MayukhCars24

Measures Laya classification latency with a FastAPI backend, web console, and observability tools

0·GitHub repo

laya_playground

Sathish-30

Provides a local Gradio app for downloading and testing the Laya typed-decision model

0·GitHub repo

myLaya

RyanPeng1111

Provides an offline Windows CPU workbench for multilingual Laya decision inference

0·GitHub repo

laya-dataset-manager

fabiobraganet

Organizes Markdown knowledge and prepares datasets alongside local Laya inference

0·GitHub repo

laya-multilingual-dml

minicom365

Runs and benchmarks Laya Multilingual on AMD hardware using DirectML

0·GitHub repo

laya-multilingual-qnn

asopitech

Runs Laya's multilingual decision model on Qualcomm Hexagon NPU through ONNX Runtime QNN

0·GitHub repo

laya-system-one

italoalmeida0

Provides a local JavaScript Laya decision engine with WebGPU and WASM acceleration

0·GitHub repo

laya-r-mlx

tjameswilliams

Provides a native Rust inference engine for Laya with MLX and candle backends

0·GitHub repo

laya-mlx-windows-cuda

oboroge0

Documents running the MLX Laya model on Windows with an NVIDIA GPU

0·GitHub repo

MacJev-322M-4K-Laya-GGUF

lawrence3699

Runs a quantized Laya-derived decision model through llama.cpp and a Python decision head

0·GitHub repo

MacJev-322M-4K-Laya-MLX

lawrence3699

Runs the MacJev typed-decision model natively on Apple silicon with MLX and compares it with Laya

0·GitHub repo

usejev

ali-master

Serves Laya through native ONNX inference on Bun with a TypeSafe-compatible API and bilingual playground

0·GitHub repo

easy-open-jevs-instance

CarlosChiva

Deploys local Open-Jev and Laya inference services with Docker Compose and a test client

0·GitHub repo

ohmylaya

QuBiit0

Installs laya.cpp and exposes local Laya decisions to coding agents through MCP and an agent skill

0·GitHub repo

narde

anliang0306

Reimplements the Laya decision engine and verifies behavioral parity against upstream

0·GitHub repo

Verdict

TobyNoSkillSon

Keeps local System One models, including Laya, ready for coding-agent classification and scoring

0·GitHub repo

laya

airen3339

A Python package and model router for multilingual typed decisions in a single forward pass

0·GitHub repo

laya

wenli03

Provides multilingual typed-decision checkpoints and a router for single-pass inference

0·GitHub repo

Laya

jersonboydmilan

Provides a multilingual typed-decision engine with checkpoint routing and Python interfaces

0·GitHub repo

More ways to use Laya