Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
167 projects
laya-infra
ulevitsky
Deploys Laya and its playground with Docker Compose or Kubernetes
laya-finetuning
tehtommeh
Runs Laya locally with an API and UI, serving multiple checkpoints through the official SDK
laya-api
hugomes14
Serves a multilingual ticket classification model through an HTTP API
laya-http
shaul1991
Serves local Laya predictions through an authenticated self-hosted HTTP API
Laya-Decision
GTC6244
Ports Laya inference to Rust with native Candle support, a router, HTTP server, and CLI
laya-server
cmoro-deusto
Serves Laya System 1 decisions through a Jev-compatible REST API
laya-ts
mikeboe
Serves the Laya model over an API and benchmarks it against the hosted Jev API
laya-service
idCntrue
Exposes the Laya non-autoregressive decision engine through a production HTTP service
codex_laya_dev
sirogarasu
Provides a Codex devcontainer and GPU API sidecar for running the Laya model
laya-decision-engine
vampirethoran
Serves local Laya typed decisions over HTTP with multilingual routing and inference metrics
laya-kev-docker
AndiMajore
Deploys Laya and Kev decision servers in configurable CUDA-enabled Docker containers
laya-system-one
italoalmeida0
Provides a local JavaScript Laya decision engine with WebGPU and WASM acceleration
jev-systemone-local
katya4oyu
Plans a local Jev-compatible System One server with MLX, Core ML, and ONNX Laya backends
jev-to-laya-proxy
diwakersurya
A Bun proxy exposes the TypeSafe Jev API and forwards requests to a local Laya server
jev-kev-laya-selfhost
suarify
Provides a Dockerized, self-hosted HTTP API for Laya typed decisions with agent-skill documentation
usejev
ali-master
Serves Laya through native ONNX inference on Bun with a TypeSafe-compatible API and bilingual playground
easy-open-jevs-instance
CarlosChiva
Deploys local Open-Jev and Laya inference services with Docker Compose and a test client
Wayfinder
manish-9245
Serves Laya decisions through an HTTP gateway with policies, a web console and an MCP server
sparky-reflex
Applied-AI-Solutions-hub
Routes desktop app messages locally with the Laya decision model through a Windows service
leanroute
kdandu001-arch
Provides a Laya-powered decision SDK and gateway for blocking attacks and routing LLM requests
laya
HydriaOne
Serves Laya routing predictions in Docker and includes an offline scenario inspector
LayaService
wj1313677
Serves the Laya decision model through a local REST API using MLX on Apple Silicon
LayaOnAWS
goodbyedavid
Deploys a Laya inference server on Amazon ECS with GPU capacity in an AWS account
layajev
metalagman
A Go server runs Laya locally behind a Jev-compatible decision API
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
More ways to use Laya