Laya for runtimes & ports

edgejev

yzfly

Exports, quantizes, and serves Laya and other Jev-style models for offline CPU inference

open-jev-laya

killkli

Runs Laya multilingual ONNX inference in browser-based decision demos

Packages the multilingual Laya decision model as a Core ML bundle for Apple devices

laya-candle

Trystan-SA

Runs Laya checkpoints locally from Rust using the Candle inference framework

laya-openvino

rupeshs

Adds an OpenVINO inference backend and serving support for Laya checkpoints

laya-rs

redwolf2019

Provides a Rust HTTP inference runtime and server for multilingual Laya models

laya-rs

apiplant

Reimplements Laya inference and training in Rust using the Candle framework

zlaya

dip-proto

Runs Laya inference locally in Zig, including native and WebAssembly targets

laya-rust

aovestdipaperino

Implements pure-Rust inference for Laya using the Candle framework

laya-apple

tc3oliver

Runs Laya locally on Apple Silicon with MLX GPU and Apple Neural Engine support

laya-security-guardrail

shashvik

Runs local Laya typed decisions as cybersecurity inspection and guardrail checks

Packages the Laya decision model as a Core ML bundle for Apple devices

laya

he-jev

A Hugging Face repository provides Laya multilingual and typed-decision model checkpoints

Laya4j

githubMJ

A Java 17+ SDK runs Laya typed-decision models through ONNX Runtime

kevala

bvolpato

A Rust WebAssembly engine runs Laya and other decision models locally in browsers

kime

tamnd

A Rust inference engine and HTTP server runs Laya checkpoints across CPU, CUDA, and Apple GPUs

Provides GGUF encoder files and a runtime for running MacJev with llama.cpp

Runs multilingual Laya on Android GPUs using LiteRT

Converts the multilingual Laya model to GGUF with quantized variants

Provides GGUF builds of Laya's typed-decisions model compiled with ggmlc

Runs Laya typed-decision inference natively on Apple silicon with MLX

Runs the MacJev decision model natively on Apple silicon with an MLX runtime

laya-fast

DJLougen

Runs Laya typed decisions on Apple Silicon with MLX and optional Core ML execution

Provides an ONNX conversion of Laya multilingual for use with Transformers.js