Self-host a Laya API server
Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.
167 projects
laya-router
MiguelCarrascoB
A FastAPI router uses Laya typed decisions to route prompts by complexity
laya-mcp
EbiPenMan
Serves a persistent local Laya model through an MCP Streamable HTTP server
laya-server
phaser
A Jev-compatible HTTP server serves local Laya typed decisions on Apple silicon
local-laya
binbandit
Runs Laya-MLX locally with an HTTP API and a TypeScript client
laya-deploy
Pidbid
Deploys Laya as a local judgment backend for omp with an HTTP bridge, MCP tools, and installation scripts
laya-server
SUSTYuxiao
A local inference wrapper and HTTP server for Laya with native and Jev-compatible prediction endpoints
classify-goblin
Sharkelot
A local typed-decision service offers Laya alongside rules, DistilBERT, and Qwen backends
laya
bitofant
Packages a self-hosted Laya model with Docker lifecycle management and an NVIDIA GPU inference endpoint
laya
inematds
A Portuguese triage application wraps Laya with a local interface, API, CLI, and reproducible evaluation
layaApi
patelkrish-27
A REST server exposes Laya typed-decision inference with low-VRAM checkpoint management
laya2typesafeapi
yunhai-dev
Serves the multilingual Laya decision model through a self-hosted TypeSafe-compatible API
homebrew-laya-mac-serve
chrisns
Provides a Homebrew tap for installing Laya Serve, a macOS app exposing an OpenAI-compatible classifier endpoint
system-one-api
jrmmendes
Exposes Laya for probabilistic text classification through a REST API
laya-setup
rexleimo
Installs and manages a local Laya decision service across Windows, Linux, and macOS
laya-dev
AVMG20
A local HTTP server exposes Laya through a Jev-compatible API and includes a browser playground
laya_demo
jingyuan9527
Runs Laya locally as a persistent HTTP service with automatic device selection
laya-mcp
devthinker-ai
Serves Laya typed decisions over MCP and HTTP on Apple Silicon using MLX
laya-api
benwyrosdick
Provides a hosted API for Laya typed decisions with account management, API keys, and a playground
laya-api
mlnima
Serves Laya Multilingual through a local Python HTTP API and MCP service
laya-linux
scottvannucci-sys
Provides local Linux inference and serving for Laya typed-decision models
laya-crystalball
InteractiveNinja
Wraps Laya typed-choice inference in a FastAPI service with calibrated confidence and option probabilities
Laya-test
LouisMoretti
Runs Laya locally for message classification and benchmarks its server and prediction performance
laya-mcp
jerepaira
Exposes local Laya typed decisions as tools for MCP clients
laya-api
marcosoliveeira1
Wraps the Laya decision-model library in a FastAPI service with Docker deployment support
Official: laya-serve
From the core README:
pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
"state": {"body": "billed twice, refund please or we cancel"},
"questions": {"dept": {"type": "choice", "instructions": "which team?",
"criteria": {"billing": "refunds", "tech": "bugs"}}}
}'
Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.
ollaya
ollaya works like Ollama for decision models:
curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."
It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.
Docker
LAYA SERVER adds a web console and API-key management:
docker run -d --name laya-server --init --restart unless-stopped \
-p 8080:8080 \
-v laya-data:/data \
-e LAYA_ADMIN_USERNAME=admin \
-e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
1panel/laya-server:latest
docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.
Native servers
laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.
Differences from Jev
The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.
More ways to use Laya