Laya for runtimes & ports

laya

NandhaKishorM

Runs multilingual typed-decision models and provides routing, serving, and integration options

laya-mlx

mizorewww

Runs Laya typed-decision models locally on Apple Silicon using MLX

laya-coreml

mizorewww

Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine

laya

receptron

Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime

An MLX FP16 conversion of Laya for native inference on Apple silicon

laya.cpp

lkarlslund

A native C++ runtime runs Laya typed-decision models across GPU and Apple backends

A Core ML conversion of Laya Multilingual for inference on Apple devices

ollaya

ollaya-dev

Pulls and serves local decision models, including Laya, through a TypeSafe-compatible API

laya-mps

afshinm

Runs Laya typed-decision inference locally on Apple Silicon using Metal Performance Shaders

lev

jlt-commons

Implements a typed decision engine using Laya checkpoints and GGUF chat models

layaForWeb

vishalmysore

Runs a quantized ONNX version of the Laya decision model entirely in the browser

laya-goish

centillex-labs

Runs Laya GGUF models in a Rust HTTP server for structured text decisions

Compiles the English Laya decision model into GGUF files using ggmlc

laya_ex

ChristianAlexander

Provides a native Nx and Bumblebee runtime for ConvAI Innovations' Laya model

ruby-laya

codenamev

Provides a Ruby port of Laya with typed decisions, checkpoint routing, and ONNX Runtime inference

Exports a fine-tuned Laya decision model to ONNX for Python and Node.js inference

Converts the multilingual Laya decision model to MLX for Apple silicon

edgejev

yzfly

Exports, quantizes, and serves Laya and other Jev-style models for offline CPU inference

open-jev-laya

killkli

Runs Laya multilingual ONNX inference in browser-based decision demos

Compiles the multilingual Laya decision model into GGUF files using ggmlc

Packages the multilingual Laya decision model as a Core ML bundle for Apple devices

laya-rust

aovestdipaperino

Implements pure-Rust inference for Laya using the Candle framework

laya-candle

Trystan-SA

Runs Laya checkpoints locally from Rust using the Candle inference framework

laya-openvino

rupeshs

Adds an OpenVINO inference backend and serving support for Laya checkpoints