by Shray15
Benchmarks Laya against a local LLM for selecting MCP tools
Benchmarking Laya (fast calibrated classifier) vs. a local LLM (native tool-calling) for MCP tool selection: accuracy, latency, scaling, and confidence-gating, all against real MCP tools.
Platforms
Related projects
laya
NandhaKishorM
Runs multilingual typed-decision models and provides routing, serving, and integration options
laya-mlx
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using MLX
laya
convaiinnovations
A multilingual-ready System 1 model that returns calibrated typed decisions over text in one pass
laya-coreml
mizorewww
Runs Laya typed-decision models locally on Apple Silicon using Core ML and the Neural Engine
typesafe-mcp
itsmostafa
Connects AI agents to typed-decision models through an MCP server
openJev-verdict-2.0
Heman10x-NGU
Develops and benchmarks a non-autoregressive typed-decision model against Jev and Laya