Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
361 projects
laya-deploy
stevenke1981
Deploys Laya locally with an HTTP decisions API and MCP computer-use support
laya-api
mehrdadjalili
Serves multilingual Laya inference through a FastAPI endpoint with language-based model routing
watchfox-open
sethsazure
An email-watching API uses self-hosted Laya typed decisions to trigger signed webhooks for matching messages
laya-interp
bruce249
Deploys Ollaya serving Laya on an Azure CPU VM with an SSH-tunneled Streamlit interface
laya-serv
tuvl-io
Packages Laya checkpoints in a container and serves decisions over the System One API
layahost
Demo
Hosted Laya API, Jev-compatible, with Cloudflare Clef on the same endpoint
laya-serve
tuvl-io
Packages the Laya decision model in a container and serves it through the SystemOne API
@marg-adk/verdict
GitHub Actions
Provides typed decision cascades with Laya support, calibration, an MCP server, and an HTTP server
laya-api
v1d1tt
Serves Laya decisions through a Jev-compatible System One API endpoint
laya-skill-router
bappisinsane
Routes Hermes Agent requests to skills using Laya’s typed decisions and calibrated probabilities
system-one-mcp
es11225599
Exposes typed decisions from System One backends, including Laya, through MCP tools
layamd
mauimauer
Serves and fine-tunes Laya decision models on AMD Strix Halo using a custom HIP engine
laya-for-trading-bot
JuaniTrotti
Provides a trading decision API that uses Laya to evaluate entry and exit signals
jev-local
orthagonal
Provides a Rust decision-model server with configurable Laya, Jev, and other backends
laya-flow-builder
myrest
A visual decision-tree editor and HTTP API run multilingual Laya ONNX models
laya
two-workspaces
A Railway template serves the Laya decision model through a Jev-compatible HTTP API
laya-strix
alytaphoenix
Runs fine-tuned Laya decision inference on an AMD XDNA2 NPU and serves it through the Jev protocol
jev-alternative
devrecated
Fine-tunes Laya on labelled data, calibrates probabilities, evaluates results, and provides Jev-compatible serving
layaprototype
Joscart
Provides a Spanish-language business credit approval prototype using the Laya Router
laya-api
snorripall
Provides an API for running the Laya model on Nvidia and Apple Silicon hardware
myvillage-laya-api
mjpsm
Serves Laya decision-model predictions through an API and playground for MyVillage
sample-laya-system-one-ecs-gpu
aws-samples
Deploys Laya on Amazon ECS GPU and compares its decisions with Amazon Nova
laya-demo
meysam0213
Runs a web playground and JSON API for Laya’s typed decision predictions
laya-decision-model
zuwiizu
Fine-tunes Convai Laya on agent-fleet judgments with training, evaluation, registry, and serving tools
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
Hosted Laya APIs
If you would rather not run a server at all, some services host Laya behind the same /v1/systemone wire format, among them layahost (EU, run by the makers of laya.tools) and Laya Studio (Switzerland). A one-click Railway template sits in between: still self-hosting, on Railway's machines. What to compare between them and your own server: Hosted Laya API: when not to self-host.
More ways to use Laya