L
Laya-Multilingual-LiteRT
by litert-community
Runs multilingual Laya on Android GPUs using LiteRT
Platforms
Use cases
On X
Laya LiteRT runs on a Qualcomm NPU, answering five email questions in 0.18 seconds
Laya on LiteRT now runs on the Qualcomm NPU. A decision encoder (Apache-2.0): a text and options in your words in, an answer with its probability out. Clip: 5 questions on one email, Galaxy S26: GPU (FP32) 0.30 s, then NPU 0.18 s, timed by the app.
Project: Laya-Multilingual-LiteRT→Related projects
colibri
JustVugg
Runs large open models locally in pure C, including Laya for typed decisions
40.1k·GitHub repo
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
23.9k·GitHub repo
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
6.3k·GitHub repo
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
1.4k·GitHub repo
laya
receptron
Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime
450·GitHub repo
jev-cookbook
datawhalechina
Teaches Jev and demonstrates fine-tuning and serving the open-source Laya model
158·GitHub repo