by Mirrorium227
Ports the Laya multilingual decision model to RK3576 NPU devices with RKNN acceleration
基于 RKNN 将 Laya 多语言决策模型适配到 Rockchip RK3576 NPU，支持中文意图分类与语义路由。提供 96/256/1024 token 分桶的三图 FP16 推理版本，采用 CPU/NPU 协同计算，保留完整 Laya API 输出
Platforms
Use cases
Related projects
colibri
JustVugg
Runs large open models locally in pure C, including Laya for typed decisions
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
laya
convaiinnovations
A multilingual-ready System 1 model that returns calibrated typed decisions over text in one pass
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
laya
receptron
Runs Laya typed-decision models from Node.js and TypeScript through ONNX Runtime