Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
361 projects
laya-service
42tr
Packages Laya's HTTP serving API in a Docker image
jevlaya
holiq
Integrates local Laya inference and hosted Jev into a provider-agnostic decision framework
laya_demo
Cokefish9527
Deploys Laya ONNX weights locally on CPU and serves decisions through an HTTP API
laya-server
adrian-purnama
Dockerized FastAPI server that keeps a Laya Router resident and serves decisions
laya-serve
c4bbage
Serves Laya inference with Go, dynamic batching, and TensorRT or CUDA execution
laya-infra
ulevitsky
Deploys Laya and its playground with Docker Compose or Kubernetes
laya-finetuning
tehtommeh
Runs Laya locally with an API and UI, serving multiple checkpoints through the official SDK
laya-api
hugomes14
Serves a multilingual ticket classification model through an HTTP API
laya-http
shaul1991
Serves local Laya predictions through an authenticated self-hosted HTTP API
Laya-Decision
GTC6244
Ports Laya inference to Rust with native Candle support, a router, HTTP server, and CLI
laya-server
cmoro-deusto
Serves Laya System 1 decisions through a Jev-compatible REST API
laya-ts
mikeboe
Serves the Laya model over an API and benchmarks it against the hosted Jev API
laya-service
idCntrue
Exposes the Laya non-autoregressive decision engine through a production HTTP service
codex_laya_dev
sirogarasu
Provides a Codex devcontainer and GPU API sidecar for running the Laya model
laya-decision-engine
vampirethoran
Serves local Laya typed decisions over HTTP with multilingual routing and inference metrics
laya-kev-docker
AndiMajore
Deploys Laya and Kev decision servers in configurable CUDA-enabled Docker containers
laya-system-one
italoalmeida0
Provides a local JavaScript Laya decision engine with WebGPU and WASM acceleration
jev-systemone-local
katya4oyu
Plans a local Jev-compatible System One server with MLX, Core ML, and ONNX Laya backends
jev-to-laya-proxy
diwakersurya
A Bun proxy exposes the TypeSafe Jev API and forwards requests to a local Laya server
jev-kev-laya-selfhost
suarify
Provides a Dockerized, self-hosted HTTP API for Laya typed decisions with agent-skill documentation
usejev
ali-master
Serves Laya through native ONNX inference on Bun with a TypeSafe-compatible API and bilingual playground
easy-open-jevs-instance
CarlosChiva
Deploys local Open-Jev and Laya inference services with Docker Compose and a test client
Wayfinder
manish-9245
Serves Laya decisions through an HTTP gateway with policies, a web console and an MCP server
sparky-reflex
Applied-AI-Solutions-hub
Routes desktop app messages locally with the Laya decision model through a Windows service
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
Hosted Laya APIs
If you would rather not run a server at all, some services host Laya behind the same /v1/systemone wire format, among them layahost (EU, run by the makers of laya.tools) and Laya Studio (Switzerland). A one-click Railway template sits in between: still self-hosting, on Railway's machines. What to compare between them and your own server: Hosted Laya API: when not to self-host.
More ways to use Laya