by alilibx
Benchmarks typed-decision models, including Laya, across labelled datasets for accuracy, calibration, latency and cost
System One Bench: typed-decision models (TypeSafe Jev, OpenAI Decisions, open-weight Laya) on real labelled datasets, with accuracy, calibration, latency and cost, plus a live race
Platforms
Use cases
On X
5/5 It's a living benchmark: I'll keep adding models as they ship. Next up: Fastino GLiDE, Laya Multilingual, and plain chat-model baselines. Results, charts and method: Code and raw data:
Project: system-one-bench→Related projects
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
openJev-verdict-2.0
Heman10x-NGU
Develops and benchmarks a non-autoregressive typed-decision model against Jev and Laya
laya-ultrafast
ipenywis
Runs a browser automation agent using local Laya decisions through MLX
laya-playground
wdobry
A local website combines Laya model demos, games, a benchmark, and an agent skill
laya-vs-jev
virajbhartiya
A side-by-side T-Rex game compares local Laya and hosted Jev decision models
