AI 精选动态
智能评分 80
TokenPilot: Cache-Efficient Context Management for LLM Agents
AI 推荐理由
此方法实现 61–87% 成本降低且保持性能，值得细读。核心解读
TokenPilot 通过 ingestion-aware compaction 与 lifecycle-aware eviction 的组合，在 PinchBench 与 Claw-Eval 上实现 61–87% 成本下降，同时保持竞争力的性能评分；其做法是先清理新工具结果再进入上下文，并保持早期 prompt 布局稳定，延迟删除已完成任务历史以供后续任务使用。
全文
TokenPilot reduces LLM agent costs via ingestion-aware compaction and lifecycle-aware eviction.
Achieves 61–87% cost reduction on PinchBench and Claw-Eval with competitive scores.
Argues that cheaper AI agents need stable memory, not just shorter prompts.
Older methods usually cut or summarize the history, but that can shift the text around and break the prompt cache, which is the system that reuses unchanged prompt text to save money.
TokenPilot tries to fix both sides at once by cleaning new tool results before they enter the context and by keeping the early prompt layout stable across tasks.
It also waits before deleting old task history, because finished work can still help later tasks that refer to the same files or goals.
----
Link – arxiv. org/abs/2606.17016v1
Title: "TokenPilot: Cache-Efficient Context Management for LLM Agents"
