Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
167 projects
laya-server
noahbclarkson
Runs Laya behind a local TypeSafe System One API for compatible clients
laya-server
MrLYC
Provides an authenticated CPU-based HTTP service and decision console for Laya models
laya-api
WissemHajbi
Provides a Dockerized local HTTP API for Laya model inference
laya-console
wearshoes
A console provides API keys, a playground, and usage tools for the Laya decision API
laya-local
koljahuang
Runs Laya locally with a browser playground, REST API, and SageMaker deployment tools
laya-api-go
jstdlee
A Go REST API serves requests through a persistent Python Laya runtime worker
laya-gfx1030
Thotheris
Runs and benchmarks the Laya decision model on Windows with an AMD Radeon RX 6900 XT
keemsisi-laya-js
keemsisi
Provides JavaScript clients and a Node server adapter for Laya typed decisions
SnakeGame-laya
Cong-Quang
Serves a Laya-powered decision API for a self-playing Snake game
laya-mlx-rs
andyjusa
A native Rust and MLX implementation runs Laya decision models on Apple Silicon
agent-firewall-laya
wmsing
Serves Laya semantic scores through a local HTTP sidecar for agent-firewall
jev-laya-local-daemon
ThreeLightStudio
Provides a localhost API for typed decisions using local Laya or hosted Jev
switchyard
mayur2109
A local decision service exposes Laya's typed answers to agents and automation systems
laya-mlx-jev-compat
matt-starburst
Serves a local MLX Laya model through a Jev-compatible HTTP endpoint
system-one
arhamj
Serves Laya typed decisions from Apple silicon over a private Tailscale endpoint
papaya
m0rphtail
Serves Laya typed decisions locally on Raspberry Pi using llama.cpp and a reconstructed decision head
laya
StevenJPx2
Provides a Swift and Core ML runtime, daemon, CLI, and distillation tools for Laya
laya
lucasnpinheiro
Runs Laya in a Docker container and exposes predictions through an HTTP API and MCP server
system1
cloudn1ne
Containerizes Laya as a self-hosted HTTP server compatible with the TypeSafe Jev API
laya-api
rykhalskyi
Provides an API server for Laya prediction requests with API-key management and rate limits
laya-service
42tr
Packages Laya's HTTP serving API in a Docker image
jevlaya
holiq
Integrates local Laya inference and hosted Jev into a provider-agnostic decision framework
laya_demo
Cokefish9527
Deploys Laya ONNX weights locally on CPU and serves decisions through an HTTP API
laya-serve
c4bbage
Serves Laya inference with Go, dynamic batching, and TensorRT or CUDA execution
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
More ways to use Laya