Laya for Rust
Rust has several independent Laya runtimes. Some load the upstream safetensors directly with Hugging Face candle, others run ONNX exports or ggmlc GGUF files, and a few wrap the model in a Jev-compatible HTTP server.
77 projects
ferrum
SampleBias
Plans a Hermit unikernel whose resource policies are selected by an external Laya process
evolve-router
holny
Routes LLM requests through a local gateway using Jev and a multilingual heuristic
laya-ov-rs
rupeshs
Provides Rust inference for Laya decision models exported to OpenVINO
decisionlint
nolindnaidoo
Lints Jev and Luna decision-model questions in CI, editors, and an MCP server
laya-coding-curriculum-78k
callensxavier
A coding curriculum dataset for training Laya-LoRA and other structured-decision models
janderscience-skills
janderson1719
Provides a corporate agentic workforce of specialized skills with a Jev/Laya decision engine
laya-rs
codesoda
A planned Rust runtime for local Laya decisions with Metal acceleration and a Jev-compatible HTTP API
layad
a1re1
A local HTTP daemon that keeps a Python Laya decision model resident for repeated inference
laya-candle
Kelwing
Implements a pure-Rust runtime for Laya decision models using Candle
pg-laya
IAmJSD
Adds native Candle-powered Laya inference for typed decisions inside PostgreSQL
rsdecider-inference
House-of-Imaginations
Runs Laya decision models in a Rust server using ONNX Runtime
morph-desktop
Locaryn
Controls Windows applications and desktop input with rapid decisions from Laya
laya-snake
D9-cell
Runs Laya in Rust to play Snake in a terminal or browser dashboard
laya-mlx-rs
andyjusa
A native Rust and MLX implementation runs Laya decision models on Apple Silicon
vej
ppmpreetham
Reimplements Jev and Laya from scratch in Rust to study their core principles
ooda
FuturePresentLabs
Provides a Rust client and type system for Jev and Laya-compatible decision APIs
Laya-Decision
GTC6244
Ports Laya inference to Rust with native Candle support, a router, HTTP server, and CLI
laya-dataset-manager
fabiobraganet
Organizes Markdown knowledge and prepares datasets alongside local Laya inference
laya-r-mlx
tjameswilliams
Provides a native Rust inference engine for Laya with MLX and candle backends
kime-bench
tamnd
Benchmarks kime against Laya, laya-mlx, laya-coreml, and Jev on matched hardware
ewm-laya-bonsai-lab
alexmy21
Uses notebooks to inspect a Rust Laya daemon's interactions and compare Laya with Jev and a mock
kime-compat
tamnd
Checks whether kime supports TypeSafe and Laya APIs, clients, SDKs, and tests
laya-studio
jiaheng6
Provides a Windows desktop client for installing, running, testing, and serving Laya models
laya-rust
moecly
Rust client for a Laya /v1/systemone server with typed requests and responses
Libraries
laya-rust is a pure-Rust port on candle with no Python, torch or ONNX export step. It runs on CPU, Metal or CUDA:
cargo build --release # CPU, library + laya CLI
cargo build --release --features metal # Apple GPU
cargo build --release --features cuda # NVIDIA
let agent = Agent::from_dir("models/laya-base", Options::default())?;
let response = agent.system_one(&json!("Charged twice for order #4417."), &questions)?;
It also includes a local web console (--features serve) and an exfil_triage example. The README reports it catches 10 of 11 credential-exfiltration commands on a thirty-command held-out set at a 0.5 threshold.
laya-candle is another candle port with a Router, loading checkpoints from the Hub (Rust 1.88+):
[dependencies]
laya-candle = "0.1"
serde_json = "1"
Servers
sys1 is a System One compatible API server on axum and candle, with token-based batching:
cargo install sys1 --features cpu
sys1 --model-id convaiinnovations/laya --dtype auto
It answers at /v1/systemone, and its README reports about 14 ms per query on an NVIDIA RTX Pro 6000.
Also: ollaya, an Ollama-style daemon written in Rust; laya-rs, a Linux CPU server on ONNX Runtime; and laya-goish, which serves ggmlc GGUF files.
Apps
laya-pong is a browser Pong game with the physics in WebAssembly and the decision from native Laya over HTTP, at 18.7 ms p50 on Metal according to its README. keel is a Rust/GPUI coding workspace with a local Laya selector.
Caveats
laya-rust builds f32 only on CPU, because candle has no f16 CPU kernels. That doubles the weights to 1.69 GB resident. laya-rs uses POST /v1/system-one (with a hyphen), so it is not a drop-in Jev endpoint. Its README says so directly.
More ways to use Laya