laya-compactor
by Gjusev
Compacts RAG context by scoring and removing less relevant retrieved documents with Laya
Context compaction for RAG and agents: relevance-score every chunk with a local System 1 decision model and cut tokens before they reach the LLM
Platforms
Use cases