Signal Brief

验证成为AI扩展新方向:论文无需微调提升准确性

Stanford、NVIDIA和UC Berkeley发表论文,提出一种无需训练的验证器,通过读取连续校准分数而非离散评分来提升准确性,在Terminal-Bench V2、SWE-Bench Verified、RoboRewardBench、MedAgentBench上分别达到86.5%、78.2...

twitter关注列表 elvis (@omarsar0) 发布 2026-07-07 收录 2026-07-07 观察

一句话判断

该工作提出验证作为扩展新轴,无需微调即可提升准确性,值得关注其方法论细节。

核心信息

Stanford、NVIDIA和UC Berkeley发表论文,提出一种无需训练的验证器,通过读取连续校准分数而非离散评分来提升准确性,在Terminal-Bench V2、SWE-Bench Verified、RoboRewardBench、MedAgentBench上分别达到86.5%、78.2%、87.4%、73.3%。

原始内容

NEW AI paper worth bookmarking. This is something I called early, and this paper confirms it: verification has emerged as a new important scaling axis. Here is the simple explainer and what this paper shows. We have seen lots of progress in scaling pre-training, post-training, and test-time compute. For post-training and test-time compute, we are still in its early phases. But one of the most important new directions is using LLMs as verifiers. Verifiers are fundamental to scaling AI. This work from Stanford, NVIDIA, and UC Berkeley builds a training-free verifier that reads a continuous, calibrated score straight off the scoring-token logits instead of trusting a discrete grade. Three knobs move accuracy without any fine-tuning. Score granularity for cleaner separation, repeated evaluation for lower variance, and criteria decomposition for lower complexity. The numbers land across very different domains. 86.5% on Terminal-Bench V2, 78.2% on SWE-Bench Verified, 87.4% on RoboRewardBench, and 73.3% on MedAgentBench. The same continuous score doubles as dense reward for SAC and GRPO and as a task-progress signal shipped in a Claude Code extension. Paper: https://t.co/D9PkrZEvkb Learn to build effective AI agents in our academy: https://t.co/1e8RZKs4uX ![photo](https://pbs.twimg.com/media/HMpOMsfaQAA58Jo.jpg)

相关动态

02

Kimi K3 在 SpreadsheetBench 2 上排名第一

Kimi K3 在 SpreadsheetBench 2 基准测试中排名第一,超越 Claude Fable 5,完成 34.8% 的 workflow 任务。该基准测试涉及 321 个专家策划任务,平均每个任务包含 11.8 个工作表和 593.5 个单元格更改,聚焦于完整的电子表格工作簿执行。

twitter关注列表2026-07-18#模型#技术突破#评测
观察
03

Mind Lab 开源长文本强化学习项目

Mind Lab 开源了一个长文本强化学习(RL)项目,支持 2M tokens 的长上下文。相比以往需要数千个 GPU 的 1M 上下文研究,该项目仅需 8 个 GPU 即可完成,大幅降低了超长上下文研究的算力门槛。

twitter关注列表2026-07-17#开源#技术突破#模型
观察
04

Kimi K3非对称竞争分析

Kimi K3在Arena前端/WebDev人类盲测中以1679 Elo排名第一,领先Fable 5(1631)和GPT-5.6 Sol(1618),但在综合智能指数中仅排第四(57.1分),落后Fable 5(59.9)和GPT-5.6 Sol(58.9)。K3定价15美元/百万输出tokens,远低于Fable 5的50美元,并计划7...

twitter关注列表2026-07-18#AI#模型#技术突破
观察
05

二年级学生Jo Nagai发现蝴蝶可遗传记忆

日本东京都二年级学生Jo Nagai注意到养育的食蚜 caterpillars 在蝴蝶化后仍保持对薰衣草的回避行为,经Georgetown大学Entomologist Dr. Martha Weiss合作完成实验:70%训练过的蝴蝶及其后代均表现出对薰衣草的遗传性回避,记忆在全变态发育中保存并遗传。

twitter关注列表2026-07-18#研究#技术突破#信息
值得跟进