Signal Brief

Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning

研究人员发现,即使在强推理模型中,长上下文下模型会无差别复制输入文本的惰性,导致准确率下降。他们提出一种基于证据感知的强化学习奖励机制,通过惩罚复制无关内容、奖励关注关键文本,将准确率提升最多4.6个百分点。

twitter关注列表 Rohan Paul (@rohanpaul_ai) 发布 2026-07-23 收录 2026-07-23 观察

一句话判断

值得阅读原文,了解奖励机制的具体设计和实验细节,对改进长上下文推理有启发。

核心信息

研究人员发现,即使在强推理模型中,长上下文下模型会无差别复制输入文本的惰性,导致准确率下降。他们提出一种基于证据感知的强化学习奖励机制,通过惩罚复制无关内容、奖励关注关键文本,将准确率提升最多4.6个百分点。

原始内容

Many assumed that once long-context models could reason, the old challenge of simply finding the right text was behind us. This paper shows that is wrong. Even strong reasoning models slip into a lazy habit of copying big chunks of the input into their own thinking, and the habit gets worse the longer the input is, quietly eating their token budget and dragging accuracy down. Copying itself is fine; the damage comes from copying the wrong stuff. Models that copy the few lines that actually matter tend to get the answer right, while models that copy the surrounding filler tend to get it wrong. They developed a simple reward that stops long-context language models from mindlessly copying their input, lifting accuracy by up to 4.6 points. The fix rewards the model for engaging with the small set of text that actually matters and penalizes it for copying the irrelevant filler around it. – arxiv. org/abs/2607.19345 Title: "Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning" ![photo](https://pbs.twimg.com/media/HN4wfE4bQAAUjaU.png)

相关动态

02

RedNote AI 模型获 IMO 满分 42/42

RedNote(小红书母公司)旗下 AI 模型 dots-note-3.0 在国际数学奥林匹克竞赛(IMO)中获得 42/42 满分,成为首个达成此成就的 AI 系统。该模型直接阅读原始竞赛文档,通过结合自然语言推理与 Python 代码执行的代理循环,经草稿测试、破坏、修复及自我审查后提交答案,全程无人工改写或提示。对比之下,Googl...

twitter关注列表2026-07-23#AI#技术突破#大模型
值得跟进
03

RedNote AI模型IMO满分42分

RedNote(小红书)的AI模型dots-note-3.0在国际数学奥林匹克竞赛中获得满分42分,而Google DeepMind和OpenAI去年仅得35分。该模型直接阅读原题,使用自然语言推理与自执行Python代码的智能体循环,并具备自我审查机制,最终在禁止外部帮助的条件下取得满分。模型为dots3系列最小版本,承诺未来开源。

twitter关注列表2026-07-23#技术突破#大模型#AI模型
观察
05

PaddlePaddle开源HPD-Parsing文档解析器

PaddlePaddle在ModelScope上开源发布1B参数文档解析器HPD-Parsing(Apache 2.0),采用层级并行解码替代逐页序列生成,在OmniDocBench v1.6上得分94.91%报告为端到端统一解析器SOTA,吞吐达4752 TPS,较最快对比解析器高1.62倍、较自回归基线高3.06倍,长文档延迟降低5....

twitter关注列表2026-07-23#开源#模型发布#技术突破
观察