Laya × C / C++

Laya in C and C++, including llama.cpp-style runtimes.

23 projects

laya.cpp

lkarlslund

A native C++ runtime runs Laya typed-decision models across GPU and Apple backends

89·GitHub repo

lev

jlt-commons

Implements a typed decision engine using Laya checkpoints and GGUF chat models

17·GitHub repo
M

laya-GGUF

mys

Compiles the English Laya decision model into GGUF files using ggmlc

4k·HF model
M

laya-multilingual-GGUF

mys

Compiles the multilingual Laya decision model into GGUF files using ggmlc

6.1k·HF model
W

laya-multilingual-GGUF

Weidows

Converts the multilingual Laya model to GGUF with quantized variants

2.5k·HF model
F

laya-gguf

fr0stbit3

Converts Laya to GGUF and provides quantized weights with a separate decision head

1.6k·HF model

laya.cpp

shpati

Ports the Laya model to C and C++ for CPU inference on Linux and Windows

4·GitHub repo

openzl-laya

madeye

Adds optional on-device Laya routing to OpenZL compression on Linux and macOS

2·GitHub repo
F

laya-multilingual-gguf

fr0stbit3

Provides F16 and quantized GGUF conversions of the multilingual Laya model for llama.cpp

665·HF model
W

laya-neutron-gguf

wigcheng5566

A GGUF package of Laya's encoder and decision head for CPU and Neutron NPU inference

173·HF model

laya-unity

0x440-1me

A Unity SDK for local Laya-compatible servers and TypeSafe System One endpoints

1·GitHub repo

jevtpp

wiatrM

A C++20 library for typed model-backed decisions with optional ONNX Runtime and native Laya backends

1·GitHub repo

laya-vk

sulistta

Ports the Laya decision runtime to a Vulkan/IREE encoder backend for AMD and Qualcomm GPUs

0·GitHub repo

laya.cpp

kyr0

Implements native C++ inference and a JEV-compatible server for Laya typed decisions

0·GitHub repo

papaya

m0rphtail

Serves Laya typed decisions locally on Raspberry Pi using llama.cpp and a reconstructed decision head

0·GitHub repo

layar

nullean

A .NET port of Laya provides ONNX and TorchSharp inference backends and CLI tools

0·GitHub repo

laya-cpp

samiul000

Implements native C++ Laya inference with ONNX Runtime, benchmarking, and INT8 quantization

0·GitHub repo

laya-neutron

open-ep

Runs the Jev model on an NXP i.MX 95 Neutron NPU

0·GitHub repo

laya-system-one

italoalmeida0

Provides a local JavaScript Laya decision engine with WebGPU and WASM acceleration

0·GitHub repo

laya-r-mlx

tjameswilliams

Provides a native Rust inference engine for Laya with MLX and candle backends

0·GitHub repo

MacJev-322M-4K-Laya-GGUF

lawrence3699

Runs a quantized Laya-derived decision model through llama.cpp and a Python decision head

0·GitHub repo

ohmylaya

QuBiit0

Installs laya.cpp and exposes local Laya decisions to coding agents through MCP and an agent skill

0·GitHub repo

Tenstorrent.Blackhole-convaiinnovations_laya

Thatch-cloud

Develops a Tenstorrent Blackhole inference backend and service integration for Laya

0·GitHub repo

More ways to use Laya