KVev
by AdudodlaVarish
Serves cached long-document chat and uses Laya for offline routing experiments
Cache-aware multi-turn LLM inference with rule-based KV reuse, FP8 storage via LMCache, and offline LAYA evaluation.
Platforms
Use cases
Related projects
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
23.9k·GitHub repo
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
6.3k·GitHub repo
C
laya
convaiinnovations
A multilingual-ready System 1 model that returns calibrated typed decisions over text in one pass
3.5k·HF model
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
1.4k·GitHub repo
openJev-verdict-2.0
Heman10x-NGU
Develops and benchmarks a non-autoregressive typed-decision model against Jev and Laya
285·GitHub repo
C
laya-multilingual
convaiinnovations
A multilingual System 1 model that returns calibrated typed decisions over text in one pass
257·HF model