Self-host a Laya API server

Most Laya servers implement the same `POST /v1/systemone` wire format as TypeSafe's hosted Jev API. An existing Jev client can often switch to a self-hosted Laya by changing its base URL. The answers then come from Laya, a different and smaller model.

361 projects

S

kronos-laya-engine

sdfafe

Combines Kronos forecasts with Laya decisions to produce crypto trading signals

0·HF Space

laya

VedantAndhale

Deploys a Laya decision API on Hugging Face Spaces

0·GitHub repo

assemble-api

felipeirl

Runs the Assemble app's API server with a Laya guardrail

0·GitHub repo
L

laya-superfast

LazyHuman

Serves Laya decisions through an MCP bridge and browser automation relay

0·HF Space
V

laya

VedantAndhale

Deploys Laya's typed-decision API on Hugging Face Spaces

0·HF Space

agora-decision-console

PoisonXploIT

A typed-decision console serves local Laya and Eikos backends alongside optional Jev access

0·GitHub repo

laya-oscar-server

skorotkiewicz

Serves Laya and Oscar decision models through a shared HTTP API

0·GitHub repo

noevia-services

sbstndalton

Provides Python sidecars for noevia, including a Laya service and model management

0·GitHub repo

cuda-laya

ptrecenti

Deploys the Laya decision model as a CUDA-accelerated HTTP service in Docker

0·GitHub repo

laya-ctl

r1cc4rd0m4zz4

Manages laya-serve as a background daemon with memory profiles and readiness probes

0·GitHub repo

laya-client

ikabeee

Serves Laya typed decisions through a self-hosted, Jev-compatible REST API

0·GitHub repo

open-laya

yeohjarvis-source

Serves Laya text and multimodal inference through an authenticated MLX API

0·GitHub repo

camunda-laya-connector

bpmforbusiness

Connects Camunda 8 BPMN service tasks to Laya's Jev-compatible decision API

0·GitHub repo

NLP-Support

decooding

Classifies and routes support tickets with Laya and escalates complex cases to Gemini

0·GitHub repo

decide-gateway

thinx-pro

Routes typed decision requests to Jev, Laya, or language-model backends with confidence escalation and red-team testing

0·GitHub repo

decision-lite

cckyros

Provides a Jev-compatible MCP decision server with pluggable local and hosted model backends

0·GitHub repo

layalike

mage-uwu

Provides a multilingual System 1 decision engine with typed outputs and integrations for serving and agent frameworks

0·GitHub repo

Laya

muhammadbilalcp

Provides a multilingual, non-autoregressive decision engine with Python, server, and integration packages

0·GitHub repo

Laya-

muhammadbilalcp

Provides a multilingual, non-autoregressive decision engine with Python, server, and integration packages

0·GitHub repo

Jev-Laya

SilverRuler

Runs Laya locally behind a Jev-compatible API and browser playground

0·GitHub repo

LayaJev-Proxmox

HatchetMan111

Installs and serves the PyTorch Laya decision model locally on Proxmox with a web UI

0·GitHub repo
L

aimtas-system-one-laya-slm

letrthang

Serves a multilingual, farm-focused Laya decision model through a Jev-compatible API

0·HF Space

laya

ajax625

Runs the Laya decision model as an HTTP server in a local Docker setup

0·GitHub repo

laya-service

FSSCoding

Serves GPU-accelerated Laya inference over HTTP with caching and a CLI

0·GitHub repo

Official: laya-serve

From the core README:

pip install "laya[serve]"
LAYA_DEVICE=cuda LAYA_PRELOAD=1 laya-serve   # binds 0.0.0.0:8000, preloads all 3 checkpoints
curl -s localhost:8000/v1/systemone -H 'content-type: application/json' -d '{
  "state": {"body": "billed twice, refund please or we cancel"},
  "questions": {"dept": {"type": "choice", "instructions": "which team?",
                "criteria": {"billing": "refunds", "tech": "bugs"}}}
}'

Set LAYA_API_KEY to require a bearer token. Other settings are LAYA_HOST, LAYA_PORT, LAYA_MODELS and LAYA_THREADS. A Nix flake and a NixOS module are included.

ollaya

ollaya works like Ollama for decision models:

curl -fsSL https://ollaya.dev/install.sh | sh
ollaya run laya --preset triage "I was charged twice for my subscription this month and want a refund."

It serves /v1/systemone, and the README says the official TypeSafe SDK works unchanged with TYPESAFE_BASE_URL=http://localhost:11435.

Docker

LAYA SERVER adds a web console and API-key management:

docker run -d --name laya-server --init --restart unless-stopped \
  -p 8080:8080 \
  -v laya-data:/data \
  -e LAYA_ADMIN_USERNAME=admin \
  -e LAYA_ADMIN_PASSWORD='change-this-admin-password' \
  1panel/laya-server:latest

docker-laya publishes ghcr.io/chneau/laya for amd64 and arm64. Its README reports roughly 0.35 s per predict on CPU.

Native servers

laya.cpp (C++, CUDA, Vulkan and Core ML), sys1 (Rust on candle) and laya-apple (MLX plus Neural Engine) all serve /v1/systemone.

Differences from Jev

The core README lists three for client ports. Options share a token budget instead of Jev's 255-option cap. Every score level needs a description. confidence is computed differently, so a threshold tuned on Jev does not transfer; gate on answer_confidence instead. laya-rs uses /v1/system-one with a hyphen and is not a drop-in replacement.

Hosted Laya APIs

If you would rather not run a server at all, some services host Laya behind the same /v1/systemone wire format, among them layahost (EU, run by the makers of laya.tools) and Laya Studio (Switzerland). A one-click Railway template sits in between: still self-hosting, on Railway's machines. What to compare between them and your own server: Hosted Laya API: when not to self-host.

More ways to use Laya