Laya × GGUF

lev

jlt-commons

Implements a typed decision engine using Laya checkpoints and GGUF chat models

laya-goish

centillex-labs

Runs Laya GGUF models in a Rust HTTP server for structured text decisions

Compiles the English Laya decision model into GGUF files using ggmlc

Compiles the multilingual Laya decision model into GGUF files using ggmlc

Converts the multilingual Laya model to GGUF with quantized variants

Converts Laya to GGUF and provides quantized weights with a separate decision head

Provides GGUF builds of Laya's typed-decisions model compiled with ggmlc

Provides F16 and quantized GGUF conversions of the multilingual Laya model for llama.cpp

A GGUF package of Laya's encoder and decision head for CPU and Neutron NPU inference

A GGUF conversion of Laya for inference with the laya-rust engine

A Persian-optimized multilingual GGUF conversion of the Laya typed-decision model

laya-rust

zerodegress

Implements a Rust inference engine for Laya with CUDA, CPU, and MLX backends

jevtpp

wiatrM

A C++20 library for typed model-backed decisions with optional ONNX Runtime and native Laya backends

MacJev-322M-4K-Laya-GGUF

lawrence3699

Runs a quantized Laya-derived decision model through llama.cpp and a Python decision head