Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
361 projects
leanroute
kdandu001-arch
Provides a Laya-powered decision SDK and gateway for blocking attacks and routing LLM requests
laya
HydriaOne
Serves Laya routing predictions in Docker and includes an offline scenario inspector
LayaService
wj1313677
Serves the Laya decision model through a local REST API using MLX on Apple Silicon
LayaOnAWS
goodbyedavid
Deploys a Laya inference server on Amazon ECS with GPU capacity in an AWS account
layajev
metalagman
A Go server runs Laya locally behind a Jev-compatible decision API
laya-api
agk4444
Serves Laya typed-decision models through a CPU-based HTTP API
Laya-Firehose
AdityaRawat00189
Ingests incoming data, classifies it with Laya, and routes items by urgency
laya-server
roilanrodriguez55
Runs the real Laya server locally or in Docker and provides Bruno API tests
laya-server
zachary-walters
Serves Laya classification, scoring, and detection endpoints with Apple Silicon acceleration
laya-studio
jiaheng6
Provides a Windows desktop client for installing, running, testing, and serving Laya models
laya-deploy
iintothewind
Deploys and benchmarks Laya Serve on Windows with Docker and a temporary public tunnel
Laya_wrapper
ugelucero
Wraps Laya checkpoints in a command-line tool and FastAPI service for request routing
local-laya
maurostorch
Runs Laya as a Dockerized HTTP service with a web interface
laya-docker
moecly
Docker Compose setup for running a Laya server
laya-mcp-server
carl0s
An MCP server and REST endpoint expose Laya for structured text and JSON decisions
laya-local-http-server
ratheesh-aot
Serves the Laya typed-decision model through a local HTTP API using MLX or PyTorch
dev
phix
Hardens and rebrands Laya as a local typed-decision engine with server and MCP support
Sent1nel
srinath1505
A guardrail SDK and API routes policy decisions through hosted Jev or self-hosted Laya
xcrystal
dgu0323
Scores cryptocurrency relevance and market signals in X posts with a local Laya server
laya-service
manul-audio
Wraps Laya predictions in a FastAPI service for Paperclip agent decisions
laya-ui
bharath-ui1027
Provides a multilingual Laya decision engine with UI components and optional serving integrations
laya-image
muck-stump
Provides a container image for deploying Laya on AMD-accelerated OpenShift
laya-docker
beremaran
A Docker image runs Laya as a GPU-backed, Jev-compatible HTTP server
laya-web-app
meossistant
Provides an offline web runtime for Laya with OpenVINO and PyTorch backends
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
Hosted Laya APIs
If you would rather not run a server at all, some services host Laya behind the same /v1/systemone wire format, among them layahost (EU, run by the makers of laya.tools) and Laya Studio (Switzerland). A one-click Railway template sits in between: still self-hosting, on Railway's machines. What to compare between them and your own server: Hosted Laya API: when not to self-host.
More ways to use Laya