Self-host a Laya API server

Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.

361 projects

Fraudshield-Laya

23f3004075

A real-time fraud prevention engine with Laya and other decision-model backends

0·GitHub repo

layastudio

Lu-cong-1

Provides a local visual workbench for testing, evaluating, and serving Laya decision models

0·GitHub repo

laya_server

smarty-kiki

Serves a local Laya decision model through a Jev-compatible API on Apple Silicon

0·GitHub repo

laya-serve

enlotec

Serves Laya typed decisions through REST and MCP endpoints

0·GitHub repo

laya-api

polites-co-jp

Provides a signed relay API for Laya endpoints and a development chat client

0·GitHub repo

laya-go-server

Djancyp

Serves Laya GGUF models through a local HTTP API built with Go and llama.cpp

0·GitHub repo
H

layam

husien4

Hugging Face Space exposing a Laya Router REST endpoint with API-key auth

0·HF Space

laya_playground

git-Ktu

Provides a local web playground and API server for testing Laya classifications, scores, and yes-or-no decisions

0·GitHub repo

laya-stack

ellickjohnson

Deploys the Laya decision-engine server as a Jev-compatible Portainer stack

0·GitHub repo

laya-terminal-pong

victormartinho360

Implements terminal Pong with Laya-controlled paddles through a local HTTP server

0·GitHub repo
S

laya-engine

sdfafe

A server exposing multilingual Laya typed decisions through an HTTP endpoint

0·HF Space
Y

laya-api

yanng404

A hosted backend running laya-serve with preloaded checkpoints and Jev-compatible endpoints

0·HF Space

laya

MigoXV

Provides a local Python CLI and HTTP service for Laya typed-decision inference

0·GitHub repo

layaservice

gatorgator77eg-glitch

Serves Laya typed-decision inference through a reusable API with documented schemas and metrics

0·GitHub repo

play.supabase.compute.laya-ai

kallebysantos

Deploys an open-source Laya model on Supabase Compute with a prediction API

0·GitHub repo

sysone

inovacc

A Rust binary runs Laya through ONNX Runtime and serves the System One HTTP protocol

0·GitHub repo

FastFence

llama-lovers

A local policy gateway uses Laya and other models to assess agent inputs and outputs

0·GitHub repo
D

laya

DIGITALFORENSIK

Serves Laya multilingual inference through an authenticated SystemOne API

0·HF Space

aubin

Emrevrg

Provides calibrated decision models, computer-use tools, and a Laya/Jev-compatible API

0·GitHub repo

Laya-Render

gtang3646

Deploys a quantized Laya decision model as an ONNX-powered HTTP API on Render

0·GitHub repo

laya-guardrail

FBR65

Checks text sentence by sentence with Laya before allowing an LLM call

0·GitHub repo

laya-mcp-server

AIAI-Laboratory

A self-hosted Laya decision service exposes MCP and REST APIs for AI agents

0·GitHub repo

laya-self-host

Fayaz-Deen

A self-hosted Laya inference server exposes a Jev-compatible system-one endpoint

0·GitHub repo
R

@blackbelt-technology/pi-dashboard-system-one-plugin

robertcsakany

Adds dashboard controls and managed local servers for System 1 decision models, including Laya

0·npm package

Official: laya-serve

From the core README:

pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve   # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
  "state": {"body": "billed twice, refund please or we cancel"},
  "questions": {"dept": {"type": "choice", "instructions": "which team?",
                "criteria": {"billing": "refunds", "tech": "bugs"}}}
}'

Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.

ollaya

ollaya works like Ollama for decision models:

curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."

It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.

Docker

LAYA SERVER adds a web console and API-key management:

docker run -d --name laya-server --init --restart unless-stopped \
  -p 8080:8080 \
  -v laya-data:/data \
  -e LAYA_ADMIN_USERNAME=admin \
  -e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
  1panel/laya-server:latest

docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.

Native servers

laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.

Differences from Jev

The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.

Hosted Laya APIs

If you would rather not run a server at all, some services host Laya behind the same /v1/systemone wire format, among them layahost (EU, run by the makers of laya.tools) and Laya Studio (Switzerland). A one-click Railway template sits in between: still self-hosting, on Railway's machines. What to compare between them and your own server: Hosted Laya API: when not to self-host.

More ways to use Laya