Signal Brief

ICML2026 论文速递

Surya Ganguli 及其合作的研究团队在 ICML2026 主会议展示多篇论文。发布了包括层次谱方法、深度强化学习特征保持、时间尺度分析等在内的多篇理论研究(2026)。涉及 Hugo Tabanelli、Yatin Dandi、Luca Pesce、Florent Krzakala 等作者...

twitter关注列表 Yann LeCun (@ylecun) 发布 2026-07-05 收录 2026-07-06 观察

一句话判断

这些论文首次提出了层次谱方法和时间缩放理论,为高维学习提供新的理论框架。

核心信息

Surya Ganguli 及其合作的研究团队在 ICML2026 主会议展示多篇论文。发布了包括层次谱方法、深度强化学习特征保持、时间尺度分析等在内的多篇理论研究(2026)。涉及 Hugo Tabanelli、Yatin Dandi、Luca Pesce、Florent Krzakala 等作者的多篇论文,涵盖高维注意力、随机矩阵视角等主题。

原始内容

Yann LeCun (@ylecun) 转发了 Surya Ganguli (@SuryaGanguli) 的帖子: Check out all the amazing work from our @SimonsFdn Collaboration on the Physics of Learning and Neural Computation (https://t.co/TfOKlQxCrE) presented at the main meeting of @ICMLconf #ICML2026 Tuesday Efficient Learning of Compositional Targets with Hierarchical Spectral Methods,Hugo Tabanelli, Yatin Dandi, Luca Pesce, and Florent Krzakala https://t.co/wix8AkXVcl CompleteP for RL: Maintaining Feature Learning When Scaling Deep Reinforcement Learning M Ganesh Kumar, Adam Lee, Blake Bordelon , Cengiz Pehlevan https://t.co/Ox6AgFt5LU Universal One-third Time Scaling in Learning Peaked Distributions Yizhou Liu, Ziming Liu, Cengiz Pehlevan, Jeff Gore https://t.co/QzIQf5ANde Wednesday A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models, Leonardo Defilippis, Florent Krzakala, Bruno Loureiro, Antoine Maillard https://t.co/x4zZVfTHP9 Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws Fabrizio Boncoraglio, Vittorio Erba, Emanuele Troiani, Yizhou Xu, Florent Krzakala, Lenka Zdeborová https://t.co/CKWt5qGyOR A Solvable High-Dimensional Model Where Nonlinear Autoencoders Learn Structure Invisible to PCA While Test Loss Misaligns With Generalization Vicente Mendes, Lorenzo Bardone, Cédric Koller, Jorge Medina Moreira, Vittorio Erba ⋅ Emanuele Troiani, Lenka Zdeborova https://t.co/rgDY2ieGJR Deep networks learn to parse uniform-depth context-free languages from local statistics Jack T. Parley, Francesco Cagnetta, Matthieu Wyart https://t.co/yrqjxZTrAp Demystifying LLM-as-a-Judge: Analytically Tractable Model for Inference-Time Scaling Indranil Halder, Cengiz Pehlevan https://t.co/ERCgkiOyIt On the Existence of Consistent Adversarial Attacks in High-Dimensional Linear Classification Matteo Vilucchio, Lenka Zdeborova, Bruno Loureiro https://t.co/KDpelqRLla Robust Stochastic Gradient Posterior Sampling with Lattice Based Discretisation Zier Mensch, Lars Holdijk, Samuel Duffield, Maxwell Aifer, Patrick Coles, Max Welling, Miranda C. N. Cheng https://t.co/ikqMhKQOfJ Teaching Models to Teach Themselves: Reasoning at the Edge of Learnability Shobhita Sundaram, John Quan, Ariel Kwiatkowski, Kartik Ahuja, Yann Ollivier, Julia Kempe https://t.co/wjgSrAbJ25 Thursday Deriving Neural Scaling Laws from the Statistics of Natural Language Francesco Cagnetta ⋅ Allan Raventos ⋅ Surya Ganguli ⋅ Matthieu Wyart https://t.co/b6nKYqNulh Symmetry in language statistics shapes the geometry of model representations Dhruva Karkada, Daniel Korchinski, Andres Nava, Matthieu Wyart, Yasaman Bahri https://t.co/Y58fJt9qmk A Random Matrix Perspective on the Consistency of Diffusion Models Binxu Wang, Jacob A Zavatone-Veth, Cengiz Pehlevan https://t.co/snM0EAxv3Q Hyperparameter Transfer with Mixture-of-Expert Layers Tianze Jiang, Blake Bordelon, Cengiz Pehlevan, Boris Hanin https://t.co/dIe32NuQTS Analytic Bijections for Smooth and Interpretable Normalizing Flows Mathis Gerdes, Miranda C. N. Cheng https://t.co/kWCw1EHGn4 Efficient RL Training for LLMs with Experience Replay Charles Arnal, Vivien Cabannnes, Taco Cohen, Julia Kempe, Remi Munos https://t.co/EjmNErAFpC Embedding Trust: Semantic Isotropy Predicts Nonfactuality in Long-Form Text Generation Dhrupad Bhardwaj, Julia Kempe, Tim G. J. Rudner https://t.co/MknrTodSaX What Characterizes Effective Reasoning? Revisiting Length, Review, and Structure of CoT Yunzhen Feng, Julia Kempe, Cheng Zhang, Parag Jain, Anthony Hartshorn https://t.co/S18yTP5fy5 From Kepler to Newton: Inductive Biases Guide Learned World Models in Transformers Ziming Liu, Surya Ganguli, Andreas Tolias https://t.co/H7eFnYtYQC

相关动态

02

Kimi K3 在 SpreadsheetBench 2 上排名第一

Kimi K3 在 SpreadsheetBench 2 基准测试中排名第一,超越 Claude Fable 5,完成 34.8% 的 workflow 任务。该基准测试涉及 321 个专家策划任务,平均每个任务包含 11.8 个工作表和 593.5 个单元格更改,聚焦于完整的电子表格工作簿执行。

twitter关注列表2026-07-18#模型#技术突破#评测
观察
03

Mind Lab 开源长文本强化学习项目

Mind Lab 开源了一个长文本强化学习(RL)项目,支持 2M tokens 的长上下文。相比以往需要数千个 GPU 的 1M 上下文研究,该项目仅需 8 个 GPU 即可完成,大幅降低了超长上下文研究的算力门槛。

twitter关注列表2026-07-17#开源#技术突破#模型
观察
04

Kimi K3非对称竞争分析

Kimi K3在Arena前端/WebDev人类盲测中以1679 Elo排名第一,领先Fable 5(1631)和GPT-5.6 Sol(1618),但在综合智能指数中仅排第四(57.1分),落后Fable 5(59.9)和GPT-5.6 Sol(58.9)。K3定价15美元/百万输出tokens,远低于Fable 5的50美元,并计划7...

twitter关注列表2026-07-18#AI#模型#技术突破
观察
05

二年级学生Jo Nagai发现蝴蝶可遗传记忆

日本东京都二年级学生Jo Nagai注意到养育的食蚜 caterpillars 在蝴蝶化后仍保持对薰衣草的回避行为,经Georgetown大学Entomologist Dr. Martha Weiss合作完成实验:70%训练过的蝴蝶及其后代均表现出对薰衣草的遗传性回避,记忆在全变态发育中保存并遗传。

twitter关注列表2026-07-18#研究#技术突破#信息
值得跟进