一句话判断
该论文提出的基准共同进化方法可突破固定基准的性能天花板,值得关注具体实现细节。
核心信息
论文提出自改进AI代理的基准应随代理共同进化,在Lean证明代理实验中,15代后协同进化代理在miniF2F上达到45.1%解决率,固定基准代理为32.0%,种子为12.7%。
原始内容
I agree with what this AI paper suggests.
Self-improving agents should evolve their benchmarks too.
(bookmark it)
Self-improving agents are one of the most important directions in AI right now, and most of them optimize against a fixed benchmark. This paper argues the benchmark should evolve alongside the agent.
The setup is a self-evolving Lean proof agent. A small trusted runtime wraps a fully mutable workspace of workflow, prompts, and tools, so the agent can rewrite how it decomposes proofs, uses compiler feedback, and repairs failures.
What makes it different is coevolution. Between generations the champion revises the active task distribution through a mastery-throttled curriculum that adds harder proof obligations only after the current level is mastered.
All of it stays inside a Lean-grounded loop, so a success counts only when the behavior yields verified proofs under a trusted snapshot. Over 15 generations the best coevolving agent reaches 45.1% held-out solve rate on miniF2F, versus 12.7% for the seed and 32.0% for the best fixed-benchmark agent.
Grounding every reward in a formal verifier is how you get self-modification without reward hacking, and coevolving the curriculum pushes the ceiling higher.
Paper: https://t.co/NDiN8RMcXO
Learn to build effective AI agents in our academy: https://t.co/1e8RZKs4uX

相关动态
01
AI 推翻 30 年图论猜想
GPT 5.6 Pro 反驳了 Dinitz-Garg-Goemans 猜想(开放约 30 年),通过简单提示词(如“做个突破”)发现反例:分数流成本 58 时,不可分割流成本至少 60。
观察
02
结构化输出导致模型同质化
康奈尔大学一项针对44个模型的研究发现,要求模型以JSON格式输出会导致回答同质化:在开放式选词提示中,JSON格式将模态答案比例从41%提升至64%,独特答案从52减少到36;这种效应出现在JSON和XML上,但在YAML和CSV上消失。
观察
03
BBC 称某初创公司为「AI 的未来家伙」
BBC 分析称,某初创公司在 AI 领域表现出色,将其描述为『AI 的未来家伙』。该公司的模型性能已达到 90% 准确率,但具体技术细节未公开。
高优先级
04
AI发现Dinitz-Garg-Goemans猜想反例
GPT-5.6 Pro 发现了图论中开放约30年的 Dinitz-Garg-Goemans 猜想的一个反例,该反例显示存在分数流成本58且任何不可分流量成本至少60的图。
观察
05
ABot-World-0:单张桌面 GPU 运行无限交互世界
AK 发布推文展示 ABot-World-0 项目,实现在单张桌面 GPU 上运行无限交互世界演示,附带论文链接与视频演示。
观察