Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
167 projects
laya-api
agk4444
Serves Laya typed-decision models through a CPU-based HTTP API
Laya-Firehose
AdityaRawat00189
Ingests incoming data, classifies it with Laya, and routes items by urgency
laya-server
roilanrodriguez55
Runs the real Laya server locally or in Docker and provides Bruno API tests
laya-server
zachary-walters
Serves Laya classification, scoring, and detection endpoints with Apple Silicon acceleration
laya-studio
jiaheng6
Provides a Windows desktop client for installing, running, testing, and serving Laya models
laya-deploy
iintothewind
Deploys and benchmarks Laya Serve on Windows with Docker and a temporary public tunnel
Laya_wrapper
ugelucero
Wraps Laya checkpoints in a command-line tool and FastAPI service for request routing
local-laya
maurostorch
Runs Laya as a Dockerized HTTP service with a web interface
laya-mcp-server
carl0s
An MCP server and REST endpoint expose Laya for structured text and JSON decisions
laya-local-http-server
ratheesh-aot
Serves the Laya typed-decision model through a local HTTP API using MLX or PyTorch
dev
phix
Hardens and rebrands Laya as a local typed-decision engine with server and MCP support
Sent1nel
srinath1505
A guardrail SDK and API routes policy decisions through hosted Jev or self-hosted Laya
xcrystal
dgu0323
Scores cryptocurrency relevance and market signals in X posts with a local Laya server
laya-service
manul-audio
Wraps Laya predictions in a FastAPI service for Paperclip agent decisions
laya-ui
bharath-ui1027
Provides a multilingual Laya decision engine with UI components and optional serving integrations
laya-image
muck-stump
Provides a container image for deploying Laya on AMD-accelerated OpenShift
laya-docker
beremaran
A Docker image runs Laya as a GPU-backed, Jev-compatible HTTP server
laya-web-app
meossistant
Provides an offline web runtime for Laya with OpenVINO and PyTorch backends
laya-local-system
h7mei
Serves local Laya decisions through a web UI and Jev-compatible HTTP API
@zatsepin/jigor
zatsepin
Offers a CLI and HTTP gateway for local ONNX Laya and von models and remote Jev decisions
laya-triage
Mezahir2025
Provides a Laya-based message triage API for Make.com
laya_api
Anuragggggggg
Serves Laya typed-decision endpoints for generic decisions and candidate routing
laya-server
MalikAwais11
Serves BudgetMate decision requests through a Laya API and provides a health endpoint
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
More ways to use Laya