Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
167 projects
Decis
chaitin
Serves open decision models through a self-hosted TypeSafe System One API
stuntdouble
ReallyArtificial
Proxies Jev requests to local decision models and compares their answers on recorded traffic
decidealot
psyb0t
Serves local Laya and Von decision models through TypeSafe-compatible HTTP and MCP APIs
nlp-serving
saugataroyarghya
A BentoML playground serving and comparing focused NLP models, including Laya
laya-jev
KonghaYao
Runs local Laya inference and exposes Jev-compatible HTTP endpoints
fastlaya
emtay-com
Serves English and multilingual Laya decision models through a FastAPI service
laya-server
pambrose
Implements a Jev-compatible API server backed by local Laya checkpoints
laya-mcp
PerryLink
An MCP server for Laya typed decisions with preflight checks and persisted calibration
laya-mac-serve
chrisns
Serves Laya from a macOS menu bar app through an OpenAI-compatible HTTP endpoint
localjev-mlx
rimusz
A self-hosted System One judgment service for Apple Silicon using laya-mlx
laya
ganeshdipdumbare
Serves Laya typed-decision predictions over HTTP in a self-hosted Docker deployment
laya
DilwoarH
Wraps the Laya Router agent in a Flask API for typed-decision predictions
laya_dashboard
ghozifadilah
A REST API and web studio serve Laya decisions and manage workflows
decision-infra
hufaei
Routes typed-decision requests to hosted Jev or local Reflex, SemIf, and Laya models
Tern
AmRitJain0442
A model router uses local Laya-MLX inference to select between configurable provider tiers
system-one-router
mmornati
A Go gateway routes prompts to language models using Jev or a locally running Laya decision model
kime
tamnd
A Rust inference engine and HTTP server runs Laya checkpoints across CPU, CUDA, and Apple GPUs
laya-console
biyyl234
Provides a local web console and REST API for Laya inference and intent classification
laya-decision-api
bmw8080
An HTTP service wraps local Laya with OpenAPI documentation and Java, TypeScript, and Python SDKs
meldecision
meldltd
Serves Laya decision models through a GoFiber API using ONNX Runtime
laya-rs
codesoda
A planned Rust runtime for local Laya decisions with Metal acceleration and a Jev-compatible HTTP API
laya-playground
marcosnovaesq
Runs Laya locally behind a TypeSafe-compatible API and provides a web UI for testing requests
laya
robit-man
Provides a FastAPI service and web interface for testing Laya decisions and latency
layad
a1re1
A local HTTP daemon that keeps a Python Laya decision model resident for repeated inference
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
More ways to use Laya