Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
167 projects
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
laya.cpp
lkarlslund
A native C++ runtime runs Laya typed-decision models across GPU and Apple backends
laya-server
1Panel-dev
Self-hosts Laya decision models through an API and web interface compatible with Jev
sys1
alvarobartt
Serves Laya decision models through a Rust System One API with CPU, CUDA, and Metal support
arbiter
0xBakeer
Serves Laya and other typed-decision models locally with a Jev-compatible API
stuntd
bladedevoff
Learns typed decision heads on a frozen Laya encoder and serves them through Jev- and OpenAI-compatible APIs
ollaya
ollaya-dev
Pulls and serves local decision models, including Laya, through a TypeSafe-compatible API
laya-mps
afshinm
Runs Laya typed-decision inference locally on Apple Silicon using Metal Performance Shaders
lev
jlt-commons
Implements a typed decision engine using Laya checkpoints and GGUF chat models
laya-goish
centillex-labs
Runs Laya GGUF models in a Rust HTTP server for structured text decisions
edgejev
yzfly
Exports, quantizes, and serves Laya and other Jev-style models for offline CPU inference
laya-openvino
rupeshs
Adds an OpenVINO inference backend and serving support for Laya checkpoints
laya-rs
redwolf2019
Provides a Rust HTTP inference runtime and server for multilingual Laya models
laya-apple
tc3oliver
Runs Laya locally on Apple Silicon with MLX GPU and Apple Neural Engine support
laya-jev-compatible-server
exfly
Serves Laya through a TypeSafe Jev-compatible HTTP API
laya-go
neko233-com
Provides a Go server and agent integrations for structured Laya decisions
deqio
ILuce
Serves multiple typed-decision models, including Laya, through a local API and browser UI
laymbda
HQarroum
Runs the Laya decision model as a CPU-only AWS Lambda function with SnapStart
Laya
ljw98
Provides a local web console and HTTP API for running Laya typed-decision models
docker-laya
chneau
Serves Laya typed-decision predictions through an authenticated, multi-checkpoint FastAPI service
laya-mcp
rdutra
An MCP server exposes local Laya-CoreML decisions through persistent decision tools
JevCoreML
GodModeAI2025
Provides Core ML decision models, a Swift package, an HTTP server, and a demo app
laya-jev-api
smallnest
Serves local Laya Core ML inference through a Jev-compatible HTTP API
laya-serve
stiermid
Serves local Laya decision models through a Jev-compatible HTTP API
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
More ways to use Laya