Laya × GGUF

Quantized GGUF builds of the Laya weights.

39 projects

G

Laya-GGUF

ggml-org

Provides an automatically converted Laya GGUF model for use with llama.cpp-compatible software

18.3k·HF model
M

laya-GGUF

mys

Compiles the English Laya decision model into GGUF files using ggmlc

786·HF model

lev

jlt-commons

Implements a typed decision engine using Laya checkpoints and GGUF chat models

17·GitHub repo

laya-goish

centillex-labs

Runs Laya GGUF models in a Rust HTTP server for structured text decisions

17·GitHub repo
M

laya-multilingual-GGUF

mys

Compiles the multilingual Laya decision model into GGUF files using ggmlc

1.9k·HF model
F

laya-gguf

fr0stbit3

Converts Laya to GGUF and provides quantized weights with a separate decision head

558·HF model
C

MacJev-322M-4K-Laya-GGUF

chaoliangUNSW

Provides GGUF encoder files and a runtime for running MacJev with llama.cpp

2.1k·HF model
W

laya-multilingual-GGUF

Weidows

Converts the multilingual Laya model to GGUF with quantized variants

1.1k·HF model
M

laya-typed-decisions-GGUF

mys

Provides GGUF builds of Laya's typed-decisions model compiled with ggmlc

604·HF model
F

laya-gguf-persian-multilingual-decision

fibonacciai

A Persian-optimized multilingual GGUF conversion of the Laya typed-decision model

555·HF model

jevtpp

wiatrM

A C++20 library for typed model-backed decisions with optional ONNX Runtime and native Laya backends

3·GitHub repo
W

laya-neutron-gguf

wigcheng5566

A GGUF package of Laya's encoder and decision head for CPU and Neutron NPU inference

159·HF model
A

laya-multilingual-GGUF

andreilungeanu

Provides quantized and full-precision Laya Multilingual GGUF files for llama.cpp

650·HF model
M

laya-multilingual-F16-GGUF

meshllm

Packages Laya Multilingual as an F16 GGUF fixture for MeshLLM System One smoke tests

627·HF model
F

laya-multilingual-gguf

fr0stbit3

Provides F16 and quantized GGUF conversions of the multilingual Laya model for llama.cpp

592·HF model
A

laya-modernbert-decision-90pct

ameerhmz5

Fine-tunes Laya into a ModernBERT decision model and offers deployment formats

473·HF model
Z

laya-gguf

ZeroDegress

A GGUF conversion of Laya for inference with the laya-rust engine

212·HF model
O

laya-mm-guard-v3-gguf

OidoStudio

Packages a calibrated Laya prompt-injection guardrail fine-tune for the Go Laya server

48·HF model
L

laya-command-head

leehack

Provides a fine-tuned Laya decision head for classifying commands in a Dart app

1·HF model

laya-rust

zerodegress

Implements a Rust inference engine for Laya with CUDA, CPU, and MLX backends

1·GitHub repo

MacJev-322M-4K-Laya-GGUF

lawrence3699

Runs a quantized Laya-derived decision model through llama.cpp and a Python decision head

0·GitHub repo
G

is-even-a-decision

GitHub Actions

Checks whether numbers are even using a local open-weights Laya decision model

0·npm package

laya-desktop

mategog

A desktop workbench runs Laya decisions offline, calibrates questions, and serves an API and MCP

0·GitHub repo

laya-ollama-demo

pyardley

Routes support tickets with Laya and uses Ollama to draft replies when needed

0·GitHub repo

More ways to use Laya