Laya × GGUF
Quantized GGUF builds of the Laya weights.
39 projects
Laya-GGUF
ggml-org
Provides an automatically converted Laya GGUF model for use with llama.cpp-compatible software
laya-GGUF
mys
Compiles the English Laya decision model into GGUF files using ggmlc
lev
jlt-commons
Implements a typed decision engine using Laya checkpoints and GGUF chat models
laya-goish
centillex-labs
Runs Laya GGUF models in a Rust HTTP server for structured text decisions
laya-multilingual-GGUF
mys
Compiles the multilingual Laya decision model into GGUF files using ggmlc
laya-gguf
fr0stbit3
Converts Laya to GGUF and provides quantized weights with a separate decision head
MacJev-322M-4K-Laya-GGUF
chaoliangUNSW
Provides GGUF encoder files and a runtime for running MacJev with llama.cpp
laya-multilingual-GGUF
Weidows
Converts the multilingual Laya model to GGUF with quantized variants
laya-typed-decisions-GGUF
mys
Provides GGUF builds of Laya's typed-decisions model compiled with ggmlc
laya-gguf-persian-multilingual-decision
fibonacciai
A Persian-optimized multilingual GGUF conversion of the Laya typed-decision model
jevtpp
wiatrM
A C++20 library for typed model-backed decisions with optional ONNX Runtime and native Laya backends
laya-neutron-gguf
wigcheng5566
A GGUF package of Laya's encoder and decision head for CPU and Neutron NPU inference
laya-multilingual-GGUF
andreilungeanu
Provides quantized and full-precision Laya Multilingual GGUF files for llama.cpp
laya-multilingual-F16-GGUF
meshllm
Packages Laya Multilingual as an F16 GGUF fixture for MeshLLM System One smoke tests
laya-multilingual-gguf
fr0stbit3
Provides F16 and quantized GGUF conversions of the multilingual Laya model for llama.cpp
laya-modernbert-decision-90pct
ameerhmz5
Fine-tunes Laya into a ModernBERT decision model and offers deployment formats
laya-gguf
ZeroDegress
A GGUF conversion of Laya for inference with the laya-rust engine
laya-mm-guard-v3-gguf
OidoStudio
Packages a calibrated Laya prompt-injection guardrail fine-tune for the Go Laya server
laya-command-head
leehack
Provides a fine-tuned Laya decision head for classifying commands in a Dart app
laya-rust
zerodegress
Implements a Rust inference engine for Laya with CUDA, CPU, and MLX backends
MacJev-322M-4K-Laya-GGUF
lawrence3699
Runs a quantized Laya-derived decision model through llama.cpp and a Python decision head
is-even-a-decision
GitHub Actions
Checks whether numbers are even using a local open-weights Laya decision model
laya-desktop
mategog
A desktop workbench runs Laya decisions offline, calibrates questions, and serves an API and MCP
laya-ollama-demo
pyardley
Routes support tickets with Laya and uses Ollama to draft replies when needed
More ways to use Laya