Laya-Android-SDK

by alifthi

A C/C++ inference library for Laya decision models

A C/C++ inference library for Laya decision models, built on ggml. Laya pairs a ModernBERT encoder with a decision head. Given a state and a set of questions, it returns a calibrated answer for each question. Three question types are supported: Type Output --------------------------------------------------------------- choice the most probable option and its probability score the expected level, sum(i p[i]) noul P(true) Each answer also includes a confidence value, computed as 1 minus the normalized entropy of the calibrated distribution. The whole model (tokenizer, encoder, head and calibration) is stored in a single GGUF file and runs as one ggml graph. llama.cpp is used only to read the tokenizer vocabulary from that file.

Related projects