Self-host a Laya API server

Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.

361 projects

laya-local-system

h7mei

Serves local Laya decisions through a web UI and Jev-compatible HTTP API

0·GitHub repo
Z

@zatsepin/jigor

zatsepin

Offers a CLI and HTTP gateway for local ONNX Laya and von models and remote Jev decisions

0·npm package
M

laya-triage

Mezahir2025

Provides a Laya-based message triage API for Make.com

0·HF Space
A

laya_api

Anuragggggggg

Serves Laya typed-decision endpoints for generic decisions and candidate routing

0·HF Space
N

laya-router

naufalacksaa

Hugging Face Space that serves Laya's /v1/systemone API with a small Gradio page

0·HF Space
M

laya-server

MalikAwais11

Serves BudgetMate decision requests through a Laya API and provides a health endpoint

0·HF Space

laya-shim

bunkerlab-net

Serves Laya or Laya-MLX behind TypeSafe's System One API route

0·GitHub repo

laya-docker

hrodic

Packages the Laya decision model as an offline Docker service using ONNX Runtime

0·GitHub repo

open-laya

skorotkiewicz

Provides a local HTTP API and MCP tools for Laya decisions

0·GitHub repo
J

maclaya

jannisleifeld

Serves local Laya models on Apple Silicon through a Jev-compatible API with a dashboard and playground

0·npm package

laya-mlx-server

tankerwng2

Serves laya-mlx over HTTP using the Jev protocol and exposes an MCP interface

0·GitHub repo

laya

HENILCHOPRA

Provides a multilingual, non-autoregressive model for typed decisions and optional serving integrations

0·GitHub repo

laya-workflow

oliveagle

Ports a workflow engine to Rust and includes an inference crate that serves the Laya model

0·GitHub repo

layajev

openbear-it

Serves Laya through a Jev-compatible HTTP API with CPU-only and multi-architecture container support

0·GitHub repo

workwe-laya

WorkWeonline

Provides a multilingual System 1 decision engine with typed outputs and optional serving and integration extras

0·GitHub repo

laya-node-server

localhost-anon

A fully offline Node.js server and playground runs Laya through ONNX Runtime

0·GitHub repo

fast-typed-classifier

navneetlal

A Python gRPC service classifies inputs with Laya's typed-decision models

0·GitHub repo

statim

BEKO2210

A native C++ engine that runs Laya checkpoints and serves the Jev/Laya decision protocol

0·GitHub repo

EmailDetective

kaicao

Classifies messages as phishing or legitimate with Laya in an Agno agent served locally

0·GitHub repo

laya-node

felipenmoura

A Node.js wrapper runs Laya as an authenticated Express classification server

0·GitHub repo

Tiyakaloud

herveyyy

A Python server uses Laya and ModernBERT for support triage, classification, scoring, and routing

0·GitHub repo

laya-play

teochenglim

Docker images package Laya’s built-in HTTP server for REST-based typed decisions

0·GitHub repo

laya-server

criguex

A local Jev-compatible server runs Laya and can cascade uncertain decisions to Jev

0·GitHub repo

laya-api

Lucasborges198

A Flask API uses Laya to classify business email messages into predefined intents

0·GitHub repo

Official: laya-serve

From the core README:

pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve   # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
  "state": {"body": "billed twice, refund please or we cancel"},
  "questions": {"dept": {"type": "choice", "instructions": "which team?",
                "criteria": {"billing": "refunds", "tech": "bugs"}}}
}'

Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.

ollaya

ollaya works like Ollama for decision models:

curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."

It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.

Docker

LAYA SERVER adds a web console and API-key management:

docker run -d --name laya-server --init --restart unless-stopped \
  -p 8080:8080 \
  -v laya-data:/data \
  -e LAYA_ADMIN_USERNAME=admin \
  -e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
  1panel/laya-server:latest

docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.

Native servers

laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.

Differences from Jev

The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.

Hosted Laya APIs

If you would rather not run a server at all, some services host Laya behind the same /v1/systemone wire format, among them layahost (EU, run by the makers of laya.tools) and Laya Studio (Switzerland). A one-click Railway template sits in between: still self-hosting, on Railway's machines. What to compare between them and your own server: Hosted Laya API: when not to self-host.

More ways to use Laya