Laya for runtimes & ports
Ports and inference engines that run the Laya weights.
245 projects
laya-cpp
samiul000
Implements native C++ Laya inference with ONNX Runtime, benchmarking, and INT8 quantization
laya-finetuning
tehtommeh
Runs Laya locally with an API and UI, serving multiple checkpoints through the official SDK
Laya-Decision
GTC6244
Ports Laya inference to Rust with native Candle support, a router, HTTP server, and CLI
laya-js
johnhenry
Runs Laya typed decisions in JavaScript across MLX, WebGPU and CPU backends
laya-neutron
open-ep
Runs the Jev model on an NXP i.MX 95 Neutron NPU
poc-laya
MayukhCars24
Measures Laya classification latency with a FastAPI backend, web console, and observability tools
laya_playground
Sathish-30
Provides a local Gradio app for downloading and testing the Laya typed-decision model
myLaya
RyanPeng1111
Provides an offline Windows CPU workbench for multilingual Laya decision inference
laya-dataset-manager
fabiobraganet
Organizes Markdown knowledge and prepares datasets alongside local Laya inference
laya-multilingual-dml
minicom365
Runs and benchmarks Laya Multilingual on AMD hardware using DirectML
laya-multilingual-qnn
asopitech
Runs Laya's multilingual decision model on Qualcomm Hexagon NPU through ONNX Runtime QNN
laya-system-one
italoalmeida0
Provides a local JavaScript Laya decision engine with WebGPU and WASM acceleration
laya-r-mlx
tjameswilliams
Provides a native Rust inference engine for Laya with MLX and candle backends
laya-mlx-windows-cuda
oboroge0
Documents running the MLX Laya model on Windows with an NVIDIA GPU
MacJev-322M-4K-Laya-GGUF
lawrence3699
Runs a quantized Laya-derived decision model through llama.cpp and a Python decision head
MacJev-322M-4K-Laya-MLX
lawrence3699
Runs the MacJev typed-decision model natively on Apple silicon with MLX and compares it with Laya
usejev
ali-master
Serves Laya through native ONNX inference on Bun with a TypeSafe-compatible API and bilingual playground
easy-open-jevs-instance
CarlosChiva
Deploys local Open-Jev and Laya inference services with Docker Compose and a test client
ohmylaya
QuBiit0
Installs laya.cpp and exposes local Laya decisions to coding agents through MCP and an agent skill
narde
anliang0306
Reimplements the Laya decision engine and verifies behavioral parity against upstream
Verdict
TobyNoSkillSon
Keeps local System One models, including Laya, ready for coding-agent classification and scoring
laya
airen3339
A Python package and model router for multilingual typed decisions in a single forward pass
laya
wenli03
Provides multilingual typed-decision checkpoints and a router for single-pass inference
Laya
jersonboydmilan
Provides a multilingual typed-decision engine with checkpoint routing and Python interfaces
More ways to use Laya