Signal Brief

自改进AI代理需共同进化基准

论文提出自改进AI代理的基准应随代理共同进化,在Lean证明代理实验中,15代后协同进化代理在miniF2F上达到45.1%解决率,固定基准代理为32.0%,种子为12.7%。

twitter关注列表 elvis (@omarsar0) 发布 2026-07-22 收录 2026-07-22 观察

一句话判断

该论文提出的基准共同进化方法可突破固定基准的性能天花板,值得关注具体实现细节。

核心信息

论文提出自改进AI代理的基准应随代理共同进化,在Lean证明代理实验中,15代后协同进化代理在miniF2F上达到45.1%解决率,固定基准代理为32.0%,种子为12.7%。

原始内容

I agree with what this AI paper suggests. Self-improving agents should evolve their benchmarks too. (bookmark it) Self-improving agents are one of the most important directions in AI right now, and most of them optimize against a fixed benchmark. This paper argues the benchmark should evolve alongside the agent. The setup is a self-evolving Lean proof agent. A small trusted runtime wraps a fully mutable workspace of workflow, prompts, and tools, so the agent can rewrite how it decomposes proofs, uses compiler feedback, and repairs failures. What makes it different is coevolution. Between generations the champion revises the active task distribution through a mastery-throttled curriculum that adds harder proof obligations only after the current level is mastered. All of it stays inside a Lean-grounded loop, so a success counts only when the behavior yields verified proofs under a trusted snapshot. Over 15 generations the best coevolving agent reaches 45.1% held-out solve rate on miniF2F, versus 12.7% for the seed and 32.0% for the best fixed-benchmark agent. Grounding every reward in a formal verifier is how you get self-modification without reward hacking, and coevolving the curriculum pushes the ceiling higher. Paper: https://t.co/NDiN8RMcXO Learn to build effective AI agents in our academy: https://t.co/1e8RZKs4uX ![photo](https://pbs.twimg.com/media/HN1l9-na8AAIUIf.png)

相关动态

01

AI 推翻 30 年图论猜想

GPT 5.6 Pro 反驳了 Dinitz-Garg-Goemans 猜想(开放约 30 年),通过简单提示词(如“做个突破”)发现反例:分数流成本 58 时,不可分割流成本至少 60。

twitter关注列表2026-07-22#技术突破#AI模型#研究
观察
02

结构化输出导致模型同质化

康奈尔大学一项针对44个模型的研究发现,要求模型以JSON格式输出会导致回答同质化:在开放式选词提示中,JSON格式将模态答案比例从41%提升至64%,独特答案从52减少到36;这种效应出现在JSON和XML上,但在YAML和CSV上消失。

twitter关注列表2026-07-22#研究#模型#数据
观察