JAE DAILY / RESEARCH OBSERVATORY

AI 研究观察

Research Digest · 人工智能学术前沿追踪 · 2026年11月11日
32
arXiv 论文
3
机构与作者深读
29
HF 精选
10
音频语音
0
社区讨论
今日精选3技术深读文章发现库专题导图研究方向补充3 每周补读完整候选库 语音与音频10 大语言模型8 视觉生成6 工程进展8
HF 精选 + 点赞数 任务分栏:说话人日志 / ASD / 音视频理解 机构信息不等于论文质量 候选召回、社区热度与证据审读分别核对

今日论文精选 · 好论文优先

本期 3 篇
跨方向研究已核对作者报告

SLA:在持续预训练与下游训练中共同注入空间对齐监督

主要贡献教机器人把视觉和三维空间对应起来:让动作模型在持续预训练和任务训练两阶段都向冻结的三维模型学习空间特征,部署时不增加这套教师模块。

关键亮点在相同预训练数据下,RoboTwin 的一个受控设置中成功率从无对齐的 48.2% 提到两阶段都对齐的 72.3%。

选读 94/100
数据、局限与查阅路线

SLA: Scaling Spatial-Language-Action Model via Continual Pre-training

选读评分 94/100社区热度 100/100 · 审读依据 85/100(编辑刻度)
OpenAlex 引用 0 · 统计于 2026-11-11 UTC / HF 点赞 86 · 统计于 2026-11-11 UTC
公开信号覆盖有限 · 新预印本引用有明显收录与积累时滞;0次引用不表示质量差。
原文依据

表6同等满量预训练数据下,RoboTwin Clean2Random无对齐48.2%,仅预训练对齐63.2%,两阶段对齐72.3%。表3较π0.5的46.0%提高26.3个百分点;协议为50任务、每任务100次测试。

局限与条件

表2的LIBERO-Plus仅比最强列示基线87.1%高0.3个百分点;未给训练种子方差,不能认定显著全面领先。状态dropout影响很大;表1的171万段是筛选前源数据规模。预训练需48张H100约110小时。

延伸读法

优先读表6两阶段空间对齐的交叉消融,再看状态dropout、层选择和预训练数据量;区分训练策略收益与榜单领先。

原文审读 · 2026-11-10 · 原论文与实验表 ↗
核对v1全文表2、3、6–11及评测协议,并核对官方代码README与HF集合;强度指报告内受控证据,未独立复现。

原文完整摘要

Reliable robotic manipulation requires both semantic understanding and precise control in three-dimensional space. However, vision-language-action (VLA) foundations largely inherit visual representations from 2D vision-language pre-training, while spatial supervision is often introduced only during task-specific adaptation. Developing spatial understanding as a transferable foundation-model capability therefore calls for learning from broader robot experience. We present SLA, a Spatial-Language-Action Model that scales implicit spatial alignment to continual pre-training and maintains it during downstream post-training. Initialized from a pretrained pi05 policy, SLA jointly optimizes action prediction and alignment between intermediate visual embeddings and spatial representations from a frozen 3D perception model. We curate and unify heterogeneous robot datasets to support spatial learning across diverse embodiments, tasks, and scenes. To accommodate this diversity, we introduce feature-dependent gates that adaptively aggregate visual embeddings from multiple VLA layers for spatial supervision. The teacher further exploits partially available depth and camera calibration alongside RGB observations, enabling effective use of heterogeneous geometric annotations. Probabilistic state dropout encourages reliance on visual cues and mitigates overfitting to demonstration trajectories. All auxiliary components are used only during training, allowing direct reuse of pretrained VLA weights and preserving the original inference architecture.

音视频理解已核对原文节选

SleuthVLM:全能视频理解真的需要视频内音频吗?

主要贡献质疑全能多模态模型必须直接输入原生音频的惯性做法,提出SleuthVLM架构:仅通过语音转写文本作为时间索引,由视觉语言模型自主调用工具主动检索视频关键帧完成问答。

关键亮点在不直接读取音频的情况下,基于Opus 5.5的SleuthVLM在4个全模态视频基准上取得了75.0%的平均准确率,优于直接输入音频的闭源全模态模型。

选读 60.6/100
数据、局限与查阅路线

SleuthVLM: Do We Really Need Audio-in-Video for Omni Video Understanding?

选读评分 60.6/100社区热度 44.3/100 · 审读依据 85/100(编辑刻度)
HF 点赞 6 · 统计于 2026-11-11 UTC
公开信号覆盖有限
原文依据
贡献依据

质疑全能多模态模型必须直接输入原生音频的惯性做法,提出SleuthVLM架构:仅通过语音转写文本作为时间索引,由视觉语言模型自主调用工具主动检索视频关键帧完成问答。

We ask whether a model needs to hear the audio directly at all, and present SleuthVLM, an agent harness built on a VLM that never hears the audio directly: speech will be transcribed into text, and the VLM will sleuth the video on its own without any predefined workflow.
原文依据

在统一的Qwen3.8-27B基座和中等探索预算下,严格通过剥离音频转写文本或剥离词级时间戳,对比测试核心组件的边际贡献。

All ablations use SleuthVLM (Qwen3.8-27B) at medium effort (A0: the medium row of Table 1). Table 5 removes the transcript (A1: only the muted video and the question remain) or only its word times (A2)
结果依据

在不直接读取音频的情况下,基于Opus 5.5的SleuthVLM在4个全模态视频基准上取得了75.0%的平均准确率,优于直接输入音频的闭源全模态模型。

Without direct access to audio, SleuthVLM with Opus 5.5 achieves the highest average accuracy of 75.0%, outperforming all closed-source omni models.
边界依据

转写机制无法直接解决纯音乐、旋律或乐器识别等非言语问题,系统仍需回退并依赖额外的专用音频描述工具辅助感知。

Table 13 gives the audio_caption tool of Section 4.3 on the 448 questions about the music itself: the questions a benchmark labels as music tasks, and those whose text asks about music, melody, rhythm or instruments rather than lyrics. The model calls the tool on 84% of them, and accuracy rises from 48.9% to 58.7%
局限与条件

在依赖非语音音效、纯音乐等无语音线索的问题上,纯转写文本指引效果有限,需要依赖额外的音频描述工具(audio_caption);且多轮智能体调用的延迟和token开销显著高于单轮端到端模型。

延伸读法

重点阅读第3.4节与第4节利用带时间戳文本索引引导视觉智能体主动检索的机制,以及表5中去除转写文本及词级时间戳对长短视频表现的消融分析。

原文节选自动核对 · 2026-11-11 · 原论文与实验表 ↗
自动核对论文 HTML 节选中的作者报告与原文引句;未独立复现。

原文完整摘要

Omni models answer questions about videos by jointly processing sampled frames and audio in one turn, with progress driven largely by scaling model size and omni training data. We ask whether a model needs to hear the audio directly at all, and present SleuthVLM, an agent harness built on a VLM that never hears the audio directly: speech will be transcribed into text, and the VLM will sleuth the video on its own without any predefined workflow. On four omni benchmarks with videos up to 90 minutes, SleuthVLM achieves the best average accuracy: \textbf{75.0%}, 2.6 points above Gemini 3.8 Flash, and it also tops the Video-MME-v2 leaderboard with \textbf{77.8%}; with an open-source 27B VLM, it beats all open-source omni models. We draw three findings: SleuthVLM beats a model that glances; hearing is not the bottleneck, agentic ability is; omni understanding needs better agentic ability, not just more omni data for modality alignment. So we provide a simple but effective starting point for doing omni video understanding. Omni understanding needs better agents, not just bigger models that hear.

主动说话人检测已核对作者报告

Beyond Visible Speakers:结合上下文与说话人注册的主动说话人检测

主要贡献多人同框时,不再只看单张脸,而是让其他人脸提供上下文。另用预先录下的注册语音,让系统在目标没出现在画面里时也能判断此人是否在说话。

关键亮点平常测试只小幅改善;遮去目标 75% 的视觉轨迹后,最高多出 13.3 个 mAP 点,优势主要体现在视觉不完整时。

数据、局限与查阅路线

Beyond Visible Speakers: Context-Aware Active Speaker Detection with Speaker Registration

选读评分暂不计算社区数据暂缺 · 审读依据 70/100(编辑刻度) · 综合分待社区信号积累
OpenAlex 引用 0 · 统计于 2026-11-11 UTC
公开信号覆盖有限 · 新预印本引用有明显收录与积累时滞;0次引用不表示质量差。
原文依据

表1相对原版 ROAM-ASD 的常规基准提升约0.1–0.9 mAP;最高13.3 mAP 的提升来自移除75%目标轨迹视觉信息的特定测试。

局限与条件

任务是主动说话人检测,不等于完整的说话人日志;注册说话人分支需要预先提供注册语音。演示网页不等于完整训练与评测代码已经可复现。

延伸读法

看多个可见人脸之间的上下文推理,以及注册语音如何补充目标人脸缺失时的活跃检测;分别读常规测试和缺失视觉的压力测试。

原文审读 · 2026-11-10 · 原论文与实验表 ↗
核对 v1 全文表1及视觉移除实验;未独立运行代码或复现实验。

原文完整摘要

Active speaker detection (ASD) relies on audiovisual correspondence between speech and visible faces, yet this correspondence becomes unreliable in crowded scenes, or when visual evidence is unavailable. We introduce ROAM-ASD-C and ROAM-ASD-CR to extend ROAM-ASD with contextual and identity-aware reasoning. ROAM-ASD-C jointly reasons across simultaneously visible candidates, allowing other faces to provide complementary evidence when the target observation is ambiguous or incomplete. ROAM-ASD-CR incorporates registered-speaker representations derived from enrollment speech, allowing detection of whether a speaker is active even when that speaker is not visually observed. ROAM-ASD-C achieves state-of-the-art performance across five ASD benchmarks: 96.8% mAP on AVA, 98.9% on WASD, 88.8% on UniTalk, 98.7% on Talkies, and 99.5% on ASW. It also improves ROAM-ASD by up to 13.3 mAP under 75% target-track visual removal.

如何评分与推荐

先核对实验与结论边界,通过门槛后再参考社区信号。选读评分=60%社区热度+40%审读依据,用于安排阅读顺序;任一缺失时暂不计算总分。

社区热度采用已取得的点赞、Star、引用等公开信号,按论文年龄分档、对数压缩。页面保留原始数量、统计日期与来源,未公开的收藏数不作估计,热度也不是质量百分位。

审读依据采用编辑刻度:有限 30、混合 45、中等 70、较强 85 分,反映已核对的作者报告能支持多强的阅读建议。精选须有固定版本的原文依据;尚未核验的实验单独标注。方向匹配不计入评分,数据资源、评测与应用研究按用途保留。

热门待核验 · 23 篇
专题思维导图音视频与说话人 · 3 个研究问题
一段多人对话,系统需要回答什么?
  • 主动说话人检测

    画面里谁正在说?

    根据音频和画面判断哪个候选人正在发言,重点看遮挡或人脸缺失时的表现。

    Beyond Visible Speakers:结合上下文与说话人注册的主动说话人检测

    作者报告表1相对原版 ROAM-ASD 的常规基准提升约0.1–0.9 mAP;最高13.3 mAP 的提升来自移除75%目标轨迹视觉信息的特定测试。

    解读边界任务是主动说话人检测,不等于完整的说话人日志;注册说话人分支需要预先提供注册语音。演示网页不等于完整训练与评测代码已经可复现。

  • 说话人日志

    谁在什么时候说?

    为录音标出各说话人的发言时间,关注重叠、晚加入的说话人和在线延迟。

    S2SND-v2:用说话人适配的 w2v-BERT 2.0 统一在线与离线说话人日志

    作者报告表2中,同数据重训的 S2SND 基线与最终模型在8个测试集的平均 DER:在线17.15%→14.52%,离线14.45%→12.03%。报告采用无 oracle VAD、0秒 collar 的条件。

    解读边界跨论文系统的数据与评测协议不完全一致,不能据此认定全面领先。运行成本与代码可复现性尚未独立核实,实际迁移仍需在你的数据上验证。

  • 目标说话人语音识别

    目标说话人说了什么?

    把目标说话人的话转成文字。采用日志作为输入时,要区分预测日志和人工标注条件。

    Pandemonium:利用跨说话人交互进行长音频目标说话人语音识别

    作者报告表1在预测 Precision-3 说话人条件下,DiCoP→最终模型平均 cpWER 为19.8%→19.2%;oracle 条件为16.7%→14.7%。报告覆盖6个会议测试集,表3提供组件消融。

    解读边界它是依赖日志条件的目标说话人 ASR,不是替代前端的新独立日志系统;仍依赖 Precision-3。最终系统同时改变训练数据与组件,不能把全部提升归因于单一模块。

说话人时间线可以作为按人转写的输入。各分支的实验评估不同任务,请在各自的测试条件下理解。

研究方向补充 · 音视频与说话人

3 篇
说话人日志已核对作者报告

S2SND-v2:用说话人适配的 w2v-BERT 2.0 统一在线与离线说话人日志

主要贡献把实时和离线的“谁在什么时候说话”放进同一个系统。它改造了语音特征和说话人查询,专门处理多人重叠以及录到一半才开口的人。

关键亮点用相同数据重训基线后,8 个测试集的平均日志错误率在线从 17.15% 降到 14.52%,离线也下降。

数据、局限与查阅路线

S2SND-v2: Unified Online and Offline Speaker Diarization with Speaker-Adapted w2v-BERT 2.0

选读评分暂不计算社区数据暂缺 · 审读依据 70/100(编辑刻度) · 综合分待社区信号积累
OpenAlex 引用 0 · 统计于 2026-11-11 UTC
公开信号覆盖有限 · 新预印本引用有明显收录与积累时滞;0次引用不表示质量差。
原文依据

表2中,同数据重训的 S2SND 基线与最终模型在8个测试集的平均 DER:在线17.15%→14.52%,离线14.45%→12.03%。报告采用无 oracle VAD、0秒 collar 的条件。

局限与条件

跨论文系统的数据与评测协议不完全一致,不能据此认定全面领先。运行成本与代码可复现性尚未独立核实,实际迁移仍需在你的数据上验证。

延伸读法

看说话人适配前端、重叠感知查询掩码及晚加入说话人训练,分别解决哪个在线日志误差;重点对照同数据重训基线。

原文审读 · 2026-11-10 · 原论文与实验表 ↗
核对 v1 全文表2、消融和评测条件中的作者报告;未独立运行代码或复现实验。

原文完整摘要

This paper presents S2SND-v2, a unified online and offline speaker diarization framework built on S2SND that improves acoustic feature extraction and the use of the resulting representations. For acoustic feature extraction, we introduce a speaker-adapted w2v-BERT 2.0 front end and compare full and pruned construction routes. To better use these features, overlap-aware activity-query masking improves speaker embedding extraction under overlap, while late-speaker training aligns unknown-speaker training with online inference conditions. Combining these improvements, the pruned system achieves competitive average diarization error rates of 14.52% online and 12.03% offline across eight test sets.

目标说话人语音识别已核对作者报告

Pandemonium:利用跨说话人交互进行长音频目标说话人语音识别

主要贡献识别长会议录音中某个目标说话人时,让各说话人的识别分支互相交换信息,减少串词与归属错误。它仍需要上游先找出不同说话人。

关键亮点用预测日志而非真实标签做输入时,作者报告的平均 cpWER 从 19.8% 降到 19.2%;这比看理想条件更贴近实际使用。

数据、局限与查阅路线

Pandemonium: Longform Target-Speaker Speech Recognition with Cross-Speaker Interactions

选读评分暂不计算社区数据暂缺 · 审读依据 70/100(编辑刻度)
公开数据暂缺,不记作零分。暂无可核实公开信号
原文依据

表1在预测 Precision-3 说话人条件下,DiCoP→最终模型平均 cpWER 为19.8%→19.2%;oracle 条件为16.7%→14.7%。报告覆盖6个会议测试集,表3提供组件消融。

局限与条件

它是依赖日志条件的目标说话人 ASR,不是替代前端的新独立日志系统;仍依赖 Precision-3。最终系统同时改变训练数据与组件,不能把全部提升归因于单一模块。

延伸读法

看长上下文骨干、跨说话人注意力和 STNO 掩码修正如何改变说话人归属的 ASR,优先读预测日志条件而非只看 oracle 结果。

原文审读 · 2026-11-10 · 原论文与实验表 ↗
核对 v1 全文表1、表3及预测/真实说话人条件区别;未独立运行代码或复现实验。

原文完整摘要

Diarization-conditioned target-speaker ASR (TS-ASR), in particular Diarization-conditioned Whisper (DiCoW), is an accurate and data-efficient approach to multi-talker transcription. It has, however, three structural limitations: the model transcribes each speaker independently, operates on short (30 s) windows, and optimizes its diarization and TS-ASR components separately. We address the first two. We integrate the diarization conditioning into a longform Parakeet backbone (DiCoP) and add cross-speaker attention, which lets the model attend across the speaker dimension so that speakers are no longer decoded in isolation, and an STNO mask refiner that re-estimates the diarization-derived conditioning. As conversational data with genuine multi-speaker interaction is scarce, we scale training with a pseudo-labeling pipeline that mines 5.4k hours of in-the-wild multi-speaker audio from YODAS2. Combining these with synthetic and real data yields state-of-the-art results across several meeting benchmarks. We open-source the resulting models, DiCoP and Pandemonium, and the pseudo-labeled data.

音视频理解实验待核验

轮次至关重要:基于轮次级信度分配推进流式视频强化学习

AI 摘要提出TurnWise轮次级GRPO框架,通过静音补全前缀评分和轮次均值策略优化,分离单步动作的剩余回报并均衡输出权重,显著改善流式视频决策与冗余问题。

原文完整摘要

Streaming video understanding requires models to repeatedly decide whether to respond or continue observing. Recently, Group Relative Policy Optimization (GRPO) has been applied to this setting, with existing approaches emphasizing reward design while retaining a single trajectory-level advantage across turns. Such shared credit can reinforce redundant replies after earlier successes and discourage useful follow-ups after earlier failures. We propose TurnWise, a turn-level GRPO framework that aligns learning with individual streaming decisions. TurnWise addresses the mismatch between trajectory-level feedback and turn-level interaction, promoting informative responses and reducing redundancy. Specifically, turn-level credit assignment uses silence-completed prefix scoring to construct group-relative advantages from each decision's remaining return, separating its learning signal from earlier rewards. Turn-mean policy optimization averages token losses within each turn and then across turns, giving response and waiting decisions equal weight regardless of output length. These complementary designs improve streaming policy learning without a learned critic or additional rollouts. Extensive experiments show our method outperforms prior RL approaches for streaming video understanding.

数据、局限与查阅路线

Turns Matter: Advancing Streaming Video RL via Turn-Level Credit

选读评分暂不计算社区热度 78.1/100 · 原文依据待核验
OpenAlex 引用 0 · 统计于 2026-11-11 UTC / HF 点赞 30 · 统计于 2026-11-11 UTC
公开信号覆盖有限 · 新预印本引用有明显收录与积累时滞;0次引用不表示质量差。

仅做方向初筛;全文实验与复现条件尚未核验。

每周补读

2026-11-02 至 2026-11-08 · 已留档 0/7 天

只回看已留档、未进选读的候选。新增可核对的原文依据、关联代码或实质版本更新,才列入补读。 单纯热度变化不会入选;范围以现有记录为准。

上一周暂无可用快照。先从本期留档,等有前后记录可对照,再列出补读。

机构与作者深读

先看内容深度,再分散来源

研究解读、机制教程与工程实践,每期最多3篇;更多通过初筛的文章可在下方发现库检索。

Meta Engineering · 2026-11-10

TLX:面向大规模生产级机器学习的硬件原生GPU编译器扩展

工程团队原稿

主要内容 · AI 初审TLX通过显式的warp-group和cluster级别编排,兼顾了新型硬件特性的利用与开发迭代效率。

可借鉴之处 TLX通过自动推断布局,降低了传统手写算子融合中繁复的人工布局对齐开销。

为什么选读 · 获取范围

机制与方法、示例与实践、评测与对照、局限与权衡、论文或代码入口。这些是可见的内容信号,结论未经独立验证。

订阅源正文或摘要。

完整初审概述 Meta介绍了为弥合GPU底层硬件控制与高层生产力鸿沟而开发的Triton低级扩展(TLX)。文章阐述了TLX在Warp Group编排、同步机制、内存编排及集群执行等方面的设计机制,并展示了其在减少布局管理开销和促进算子融合方面的工程价值。TLX已被应用于Meta的推荐系统与大规模LLM预训练生产环境。

具体阅读价值 文章详细披露了在现代GPU(如Hopper、Blackwell及AMD架构)上平衡编程效率与硬件极致性能的具体系统设计机制。其关于自动布局推断解决算子融合复杂度的方案、以及以Warp Group为粒度的软流水线设计思路,对深度学习编译器与高性能算子开发人员具有极高的参考与迁移价值。

文章为Meta工程团队的原稿自述,带有自身技术路线的宣传倾向;本次节选未核到详细的端到端基准对比数据与代码实现细节,且部分前沿硬件支持与全自动生成(如Auto-TLX)在本次节选呈现的内容中仍处于规划或开发阶段。

TLX introduces explicit warp-group and cluster-level orchestration, letting developers adopt new hardware capabilities without sacrificing velocity.

读原文 ↗
NVIDIA Developer · 2026-11-10

在车载算力与延迟限制下运行端侧自动驾驶因果推理模型

工程团队原稿

主要内容 · AI 初审模型采用自适应推理机制,仅在必要时生成因果推理,从而在常规行驶中降低计算开销。

可借鉴之处 文档给出了可在DRIVE AGX Thor上复现的端到端评估步骤,其优化后推理延迟在160至190毫秒之间。

为什么选读 · 获取范围

机制与方法、示例与实践、评测与对照、局限与权衡、论文或代码入口。这些是可见的内容信号,结论未经独立验证。

网页正文节选。

完整初审概述 英伟达介绍了面向车载端侧平台(DRIVE AGX Thor)设计的端侧自适应推理VLA模型Alpamayo 2 Edge,并阐述了评估与奖励模型AlpaJudge。文章说明了如何通过自适应因果推理控制Token生成以节约算力,并在闭环强化学习中使用对齐人类标准的裁判模型评分作为奖励,同时给出了在Thor平台上的部署评估流程与实验表现。

具体阅读价值 针对端侧具身智能/自动驾驶领域“端到端多模态推理模型算力受限”的核心痛点,提出了自适应因果推理与参考/无参考裁判奖励模型结合的完整工程落地闭环。文中给出了具体的运行时配置、延迟指标(160-190ms)以及代码调用模式,具备较高的系统参考价值。

文章属于英伟达官方工程团队对自身全家桶芯片(DRIVE AGX Thor)和生态工具链的方案推广,带有一定产品宣传属性;本次节选未核到AlpaJudge奖励函数对抗性漏洞与实际复杂长尾路况闭环测试的完整量化报告。

It reasons adaptively , generating reasoning only when needed, reducing unnecessary token generation and conserving inference compute during routine driving.

读原文 ↗
PyTorch Blog · 2026-11-10

在TPU v7上使用SGLang-TorchTPU优化816B超大MoE模型推理

项目团队原稿

主要内容 · AI 初审核心系统将62层解码或验证融合进单一Pallas程序,实现权重搬运与计算的流水线隐藏。

可借鉴之处 通过按行数拆分专家循环,成功避免重载分支导致轻量路径频繁发生寄存器溢出。

为什么选读 · 获取范围

机制与方法、示例与实践、评测与对照、局限与权衡、论文或代码入口。这些是可见的内容信号,结论未经独立验证。

订阅源正文或摘要。

完整初审概述 文章介绍了如何使用SGLang与TorchTPU在单台4芯片TPU v7主机上高效部署816B参数的Meta Muse Spark Open MoE模型。其核心采用了单Pallas巨型算子(megakernel),将所有62层的解码或验证步融合执行,并将权重加载与KV读取隐藏在计算流水线后。此外,文章还详细拆解了通过循环拆分解决寄存器溢出、以及FP8直接输入MXU等底层优化方案。

具体阅读价值 提供了极具实践价值的底层大模型推理系统级优化案例,特别是针对MoE分支结构中大分支导致寄存器溢出这一经典编译器瓶颈,给出了“拆分为轻量循环和重度循环”的具体工程解法与耗时收益分析,方法可迁移至其他硬件平台的超长上下文与MoE推理调优。

本篇为项目团队的原稿博客,展示的成本和吞吐对比包含其特定硬件和量化(NVFP4/FP8)配置;关于模型全生命周期的完整评估和具体Pallas实现细节在本次节选中未完全展开,需结合其开源实现验证。

At the center is a megakernel: all 62 layers of a decode or verify step run as one Pallas program, and every weight load, KV…

读原文 ↗
COLLECTION RECEIPT

保留候选,方便查漏

已完成所列检索窗口
3255 全部候选 32 版面选读 435 留待选读 18/18 检索完成

已抓取的论文全部保留,未入选也可检索、查看摘要和收藏。覆盖范围限于下列 arXiv / HF 日期窗口,不能保证收录全部相关文献。

查看来源、日期窗口与抓取结果

统计时间:2026-11-11T06:04:36.012375 UTC · 按分类与研究专题检索。

  • HF 2026-11-05 · 完成 · 39/39 条
  • HF 2026-11-06 · 完成 · 32/32 条
  • HF 2026-11-07 · 完成 · 0/0 条
  • HF 2026-11-08 · 完成 · 0/0 条
  • HF 2026-11-09 · 完成 · 34/34 条
  • HF 2026-11-10 · 完成 · 39/39 条
  • HF 2026-11-11 · 完成 · 17/17 条
  • cs.CL · 完成 · 511/511 条 · UTC 2026-11-04 — 2026-11-11
  • cs.AI · 完成 · 1216/1216 条 · UTC 2026-11-04 — 2026-11-11
  • cs.LG · 完成 · 1255/1255 条 · UTC 2026-11-04 — 2026-11-11
  • stat.ML · 完成 · 145/145 条 · UTC 2026-11-04 — 2026-11-11
  • cs.CV · 完成 · 775/775 条 · UTC 2026-11-04 — 2026-11-11
  • cs.MM · 完成 · 18/18 条 · UTC 2026-11-04 — 2026-11-11
  • eess.AS · 完成 · 53/53 条 · UTC 2026-11-04 — 2026-11-11
  • cs.SD · 完成 · 78/78 条 · UTC 2026-11-04 — 2026-11-11
  • eess.SP · 完成 · 165/165 条 · UTC 2026-11-04 — 2026-11-11
  • 专题 · Speaker Diarization · 完成 · 27/27 条 · UTC 2026-10-21 — 2026-11-11
  • HF 补抓 1 · 完成 · 74/74 条 · UTC 2026-10-21 — 2026-11-11
检索全部已抓取论文(含未入选)

下载本期完整候选数据

技术文章发现库 759 条发现 · AI初审建议读 3 篇 · 源可读12/12

机构原始解读、大学研究博客、项目团队教程与具名作者分别标注。权威来源仍须有机制、示例、评测或局限等正文依据,公告不占深读名额;这是选读初筛,未经独立事实核验。

默认显示AI初审建议读的文章。另有33条通过正文深度初筛;可切换“全部发现”检查未审、未补全和未入选内容,初审失败不会当作低质量。

发现记录:2026-11-11 10:46 UTC。保留180天内内容,旧文章显示原始发布日期;仅覆盖这些订阅源的可见条目,未获取全文和来源失败均保留提示。

展开后加载发现记录。

来源覆盖与失败记录

正文补抓有每轮16篇上限;未补全的候选保留在库中,不视为低质量。内容深度刻度只安排选读,不是学术质量评分。

语音与音频
SPEECH & AUDIO
10 篇
arXiv HF 22 赞 按需选读语音识别HF精选22赞 arXiv · HF 补抓 1 10-31
通过结构感知内核快速准确的相对位置注意力
Fast and Exact Relative-Position Attention via Structure-Aware Kernels

AI 摘要相对位置注意力机制为跨各种变压器架构的 RoPE 提供了令人信服的替代方案,在音频等领域提供卓越的性能。这些机制通常通过添加内容位置或偏见位置术语来修改注意力分数。与 RoPE 不同,RoPE 直接在查询和键上通过每个令牌旋转来编码位置,相对位置项通常需要成对的偏移相关计算或查找,这使得它们与融合注意力内核的集成变得复杂,并随着序列规模的扩展引入严重的内存、带宽和计算开销。为了解决这个瓶颈,我们提出了一种精确注意算法,它将附加相对位置项合并到 FlashAttention 式平铺计算中。我们的方法(1)使用偏移感知平铺来避免冗余索引和内存访问,(2)仅计算必要的键/查询关系产品,并在前向和后向传递中跨令牌对重用它们,(3)使用基于偏移的梯度分片和聚合,消除原子争用。我们在不同的相对位置注意力机制中提供统一、高效的 Triton 实现,并根据简单和专门的实现对其进行评估。

原文完整摘要

Relative-position attention mechanisms offer compelling alternatives to RoPE across various transformer architectures, delivering superior performance in domains such as audio. These mechanisms typically modify attention scores by adding content-position or bias-position terms. Unlike RoPE, which encodes position via per-token rotations directly on the queries and keys, relative-position terms generally require pairwise offset-dependent computation or lookups, complicating their integration into fused attention kernels and introducing severe memory, bandwidth, and compute overheads as sequences scale. To address this bottleneck, we propose an exact attention algorithm that incorporates additive relative-position terms into FlashAttention-style tiled computation. Our method (1) uses offset-aware tiling to avoid redundant indexing and memory accesses, (2) computes only the necessary key/query-relation products and reuses them across token pairs in both forward and backward passes, and (3) uses offset-based gradient sharding and aggregation, eliminating atomic contention. We provide a unified, efficient Triton implementation across diverse relative-position attention mechanisms and evaluate it against naive and specialized implementations. For 8K-token sequences, our method speeds up the forward (backward) pass by 1.8-6.4$\times$ (2.0-21$\times$) and reduces peak memory up to 2.9-128$\times$ (1.4-54$\times$) over the strongest baseline for each mechanism, enabling long-context end-to-end transcription that is 1.8$\times$ faster and uses 2.4$\times$ less memory. Our method thus provides a drop-in, hardware-efficient solution for scaling relative-position attention transformers.

选读评分暂不计算社区热度 62.5/100 · 原文依据待核验
HF 点赞 22 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 90 赞 按需选读语音识别HF精选90赞 arXiv · cs.CL 11-04
孔子4-R2T2:一种用于实时转录的稳定前缀流式ASR模型
Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription

AI 摘要流式语音识别越来越多地被机器(例如翻译器和语音代理)所使用,这些机器在出现时对每个令牌进行操作。后来修改的令牌会导致浪费工作或错误操作。在这项工作中,我们提出了 Kongfz4-R2T2(Real Real-Time Transcription 的缩写),这是一种稳定前缀流式 ASR 模型,它从不修改其早期输出,同时保持高精度和低延迟。 R2T2是通过对Qwen3-ASR-1.7B在1500小时的中英文音频上进行后训练而获得的,同时冻结其预训练的音频编码器和投影仪。该适应基于最长稳定前缀(LSP)的概念,这是我们在这项工作中引入的一个新概念。我们证明LSP在前缀顺序下是单调的,与全音频输出一致,并且在等于整个早期输出的标签中最大。从 LSP 标签中学习可以将全上下文模型转换为稳定前缀流模型,而无需任何架构更改。广泛的评估表明,R2T2 使流式识别接近基本模型的全上下文质量,同时提供具有低发射延迟的稳定文本。

原文完整摘要

Streaming speech recognition is increasingly consumed by machines, such as translators and voice agents, that act on each token as it appears. A token that is later revised costs wasted work or a wrong action. In this work, we present Confucius4-R2T2 (short for Real Real-Time Transcription), a stable-prefix streaming ASR model that never modifies its earlier output while maintaining high accuracy and low latency. R2T2 is obtained by post-training Qwen3-ASR-1.7B on 1,500 hours of Chinese and English audio while freezing its pre-trained audio encoder and projector. The adaptation is based on the concept of Longest Stable Prefix (LSP), a new notion that we introduce in this work. We prove that LSP is monotone under the prefix order, consistent with the full-audio output, and maximal among labels that equal a whole earlier output. Learning from LSP labels converts a full-context model into a stable-prefix streaming one without any architectural change. Extensive evaluations show that R2T2 brings streaming recognition close to the base model's full-context quality while delivering stable text with low emission lag. Its gains extend beyond the post-training languages, demonstrating a practical path from full-context ASR to stable streaming. We open-source the model weights and code at https://huggingface.co/netease-youdao/Confucius4-R2T2 and https://github.com/netease-youdao/Confucius4-R2T2.

选读评分暂不计算社区热度 100/100 · 原文依据待核验
OpenAlex 引用 0 · 统计于 2026-11-11 UTC / HF 点赞 90 · 统计于 2026-11-11 UTC
公开信号覆盖有限 · 新预印本引用有明显收录与积累时滞;0次引用不表示质量差。
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 8 赞 按需选读语音识别HF精选8赞 arXiv · HF 补抓 1 11-02
VidDub:用于两步视频配音的替换感知蒸馏
VidDub: Replacement-Aware Distillation for Two-Step Video Dubbing

AI 摘要视频配音旨在合成与目标语音匹配的嘴唇动作,同时保留源视频的说话者身份、头部姿势和背景。现有的编辑器主要是通过在原始配对音频下进行自我重建来进行训练的,尽管当驾驶语音被替换时,源嘴会成为冲突的目标。我们引入了替换感知的跨音频监督:配对音频样本使用全帧重建,而未配对的替换音频样本掩盖了源嘴重建损失,并仅通过视听同步来监督嘴,同时保留未掩盖的面部区域和背景。由于离线配音预先提供了完整的源视频和目标语音,因此我们推出了 VidDub,这是一个全上下文扩散编辑器,可简化为两个去噪步骤 (2 NFE)。我们具有替换意识的老师首先学习准确的嘴唇同步,而不会回归到冲突的源嘴部运动。然后,匹配轨迹回归将教师的 CFG 引导轨迹传输给两步学生,分布匹配蒸馏在步进压缩后恢复视觉质量。我们将发布精选的训练数据集、VidDub-Bench、固定的配对和跨音频评估清单、预处理输出和统一评估代码。

原文完整摘要

Video dubbing aims to synthesize lip movements that match target speech while preserving the speaker identity, head pose, and background of a source video. Existing editors are predominantly trained via self-reconstruction under original paired audio, even though the source mouth becomes a conflicting target when driving speech is replaced. We introduce replacement-aware cross-audio supervision: paired-audio samples use full-frame reconstruction, whereas unpaired replacement-audio samples mask out source-mouth reconstruction losses and supervise the mouth solely through audio-visual synchronization while preserving unmasked facial regions and background. Because offline dubbing provides the complete source video and target speech beforehand, we present VidDub, a full-context diffusion editor distilled into two denoising steps (2 NFE). Our replacement-aware teacher first learns accurate lip synchronization without regressing toward conflicting source mouth movements. Matched trajectory regression then transfers the teacher's CFG-guided trajectories to a two-step student, and distribution matching distillation recovers visual quality after step compression. We will release the curated training dataset, VidDub-Bench, fixed paired- and cross-audio evaluation manifests, preprocessing outputs, and unified evaluation code. Across three training seeds, masking out conflicting source-mouth reconstruction improves cross-audio Sync-C by 0.833; the final two-step model combines strong lip synchronization with superior visual quality, identity preservation, and visual speech recognition across four benchmarks.

选读评分暂不计算社区热度 43.8/100 · 原文依据待核验
HF 点赞 8 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 6 赞 按需选读语音识别评测 arXiv · HF 补抓 1 11-02
以人为中心、风险受限的财务文档识别评估:证据、关键错误和选择性自动化
Human-Centred, Risk-Constrained Evaluation of Financial Document Recognition: Evidence, Critical Errors, and Selective Automation

AI 摘要财务文档识别通常使用字符和单词错误率进行评估,尽管这些指标并不表示系统是否保留了人员和组织采取行动所依据的财务事实。本文开发了一个以人为本、风险约束的框架,用于评估作为证据恢复和决策支持的财务文件识别。它定义了与可见源区域相关的类型化财务事实,并将逐字转录、确定性标准化和业务解释分开。分层质量模型涵盖文本、本地化、布局、表格、字段、事实正确性、证据基础、不确定性、稳健性和操作性能。非补偿性验收门对关键字段错误使用单方面的不确定性界限,防止强大的总分掩盖数量、标识符、符号、周期或实体关联方面的失败。选择性自动化被表述为一个受约束的路由问题,该问题考虑了残余风险、人工审核能力和审核成本。该框架进一步规定了注释和裁决程序、防泄漏基准划分、统计估计、亚组分析和重现性卡。正式结果确定了补偿评分的局限性、零观察错误后的非零风险上限,以及用于将不确定案例路由至人工审核的损失敏感决策规则。

原文完整摘要

Financial document recognition is often assessed using character and word error rates, although these metrics do not express whether a system preserves the financial facts on which people and organisations act. This paper develops a human-centred, risk-constrained framework for evaluating financial document recognition as evidence recovery and decision support. It defines typed financial facts linked to visible source regions and separates verbatim transcription, deterministic normalization, and business interpretation. A layered quality model covers text, localization, layout, tables, fields, fact correctness, evidence grounding, uncertainty, robustness, and operational performance. Non-compensatory acceptance gates use one-sided uncertainty bounds for critical-field errors, preventing strong aggregate scores from masking failures in amounts, identifiers, signs, periods, or entity associations. Selective automation is formulated as a constrained routing problem that accounts for residual risk, human-review capacity, and review cost. The framework further specifies annotation and adjudication procedures, leakage-resistant benchmark partitions, statistical estimands, subgroup analyses, and a reproducibility card. Formal results establish the limitations of compensatory scoring, the non-zero upper risk bound after zero observed errors, and a loss sensitive decision rule for routing uncertain cases to human review. The contribution is theoretical and methodological; no new model, dataset, or empirical performance result is claimed.

选读评分暂不计算社区热度 38.8/100 · 原文依据待核验
HF 点赞 6 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 5 赞 待核查音频理解HF精选5赞 arXiv · HF 补抓 1 11-03
VeriSpoof:通过一名音频LLM超越真假
VeriSpoof: Beyond Real or Fake with One Audio LLM

AI 摘要语音深度伪造检测器会评估一段录音是否是合成的,但法医分析师还会询问哪个系统产生了该录音,录音是否共享来源,以及支持每个结论的证据是什么。我们提出了 VeriSpoof,一种音频语言模型,它将五项任务与共享权重统一起来:深度伪造检测、生成器归因(生成器、声学模型和声码器)、录音条件分析、合成跨度本地化和源验证。每个决定都有充分的理由支持,其陈述可以被独立验证。答案根据句子可能性进行评分,允许在没有单独头的情况下对检测和源验证进行阈值化。可以根据波形测量、跨度标签或发生器元数据检查基本原理陈述。反事实的例子训练决策遵循所陈述的证据。在 14 个 Speech-DF-Arena 测试集中,VeriSpoof-Plus 实现了 2.14% 的池 EER,在 28 个系统中排名第三,在开放权重系统中排名第一。

原文完整摘要

A speech deepfake detector estimates whether a recording is synthetic, but a forensic analyst also asks which system produced it, whether recordings share a source, and what evidence supports each conclusion. We present VeriSpoof, an audio language model that unifies five tasks with shared weights: deepfake detection, generator attribution (generator, acoustic model and vocoder), recording-condition analysis, synthesized-span localisation, and source verification. Each decision is supported by grounded rationales whose statements can be independently verified. Answers are scored by sentence likelihood, allowing detection and source verification to be thresholded without separate heads. Rationale statements can be checked against waveform measurements, span labels, or generator metadata. Counterfactual examples train decisions to follow the stated evidence. Across the 14 Speech-DF-Arena test sets, VeriSpoof-Plus achieves 2.14% pooled EER, ranking third of 28 systems and first among open-weight systems. VeriSpoof-Base, trained only on official training splits of eight corpora, achieves 4.43% EER, less than half that of the next open-weight detector. With the same weights, VeriSpoof-Plus verifies whether recordings from generators unseen in training share a source at 6.2% EER. Controlled studies show that the audio representation governs detection, the LLM governs recording comparison, and source supervision is necessary for neural-codec fakes. Statement-checkable rationales catch partial fakes missed by one-step answers (99.6% vs. 78.4% on PartialEdit) and determine decisions under edits unseen in training (99.5%). Training updates only 29.7M of 2.85B parameters, fitting a single 24 GB GPU with gradient checkpointing. We release both models, inference code, a demo, and VeriSpoof-Bench, the evaluation suite covering these questions.

选读评分暂不计算社区热度 35.7/100 · 原文依据待核验
HF 点赞 5 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
大语言模型
LARGE LANGUAGE MODELS
8 篇
arXiv HF 54 赞 HF精选54赞 arXiv · cs.AI 11-09
Sage-Taiyi:用于科学发现的元认知架构
Sage-Taiyi: A Metacognitive Architecture for Scientific Discovery

主要贡献针对传统科学AI缺少长程理解与跨分支线索整合的问题,提出受元认知启发的双层架构Sage-Taiyi,通过监控与控制动态调整研究目标与推理策略。

关键亮点在化学反应条件优化实验中,该系统将钴催化羰基化产率从微量提升至84%,将光催化烯丙基胺化产率从13%提升至69%。

原文完整摘要

We introduce Sage-Taiyi, a metacognition-inspired architecture that uses accumulated scientific understanding to guide what to investigate next and how to investigate it. Through explicit monitoring and control, the system revises its understanding of evidence, assumptions, and unresolved questions, then uses these assessments to adapt research targets and select reusable reasoning methods. On Taiyi-Bench, an AI co-scientist ideation benchmark comprising 265 tasks from 50 papers across ten disciplines, Sage-Taiyi ranks first on all eight metrics of historical rediscovery and open-ended ideation, achieving an Overall score of 54.0 compared with 47.9 for the strongest baseline, AI Scientist-v2. It also performs well on two external scientific ideation benchmarks. Five expert-guided collaborations further connect its proposals to experimental and computational validation across chemistry, materials science, and engineering. In chemistry, reaction-condition optimization raises the yield of cobalt-catalyzed carbonylation from trace amounts to 84% and photocatalytic allylic amination from 13% to 69%. These results support metacognitive regulation as an approach to scientific ideation and its progression toward practical validation.

选读评分 72.7/100社区热度 91.2/100 · 审读依据 45/100(编辑刻度)
HF 点赞 54 · 统计于 2026-11-11 UTC
公开信号覆盖有限
阅读依据与局限
原文依据
贡献依据

针对传统科学AI缺少长程理解与跨分支线索整合的问题,提出受元认知启发的双层架构Sage-Taiyi,通过监控与控制动态调整研究目标与推理策略。

We introduce Sage-Taiyi, a metacognition-inspired architecture that uses accumulated scientific understanding to guide what to investigate next and how to investigate it. Through explicit monitoring and control, the system revises its understanding of evidence, assumptions, and unresolved questions, then uses these assessments to adapt research targets and select reusable reasoning methods.
结果依据

在包含10个学科265个任务的Taiyi-Bench上,Sage-Taiyi在历史重现与开放构思等指标上均列首位,综合得分为54.0,高于强基线AI Scientist-v2的47.9。

On Taiyi-Bench, an AI co-scientist ideation benchmark comprising 265 tasks from 50 papers across ten disciplines, Sage-Taiyi ranks first on all eight metrics of historical rediscovery and open-ended ideation, achieving an Overall score of 54.0 compared with 47.9 for the strongest baseline, AI Scientist-v2.
结果依据

在化学反应条件优化实验中,该系统将钴催化羰基化产率从微量提升至84%,将光催化烯丙基胺化产率从13%提升至69%。

In chemistry, reaction-condition optimization raises the yield of cobalt-catalyzed carbonylation from trace amounts to 84% and photocatalytic allylic amination from 13% to 69%.
边界依据

在实际科学实验与仿真验证中,仍需领域专家人工参与候选方案的筛选与验证,尚未完全实现全闭环的无人工干预自主科研。

In our research collaborations, this loop connects Sage-Taiyi’s candidate solutions and search formulations to experiments and simulations, with domain experts participating in idea selection and validation.
局限与条件

基准评估主要依赖自建的Taiyi-Bench数据集,外部基准的具体对比数据因文本截断未完整展现;真实实验验证严重依赖专家参与指导(expert-guided),自主发现能力的纯独立性仍需进一步验证。

延伸读法

重点阅读第2节元认知监控与控制回路(Monitoring and Control)的设计,以及第3.1节在Taiyi-Bench上的评测设置;截断导致未见详细基准消融实验数值,需谨慎评估其通用泛化性。

原文节选自动核对 · 2026-11-11 · 原论文与实验表 ↗
自动核对论文 HTML 节选中的作者报告与原文引句;未独立复现。

解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 112 赞 音频相关 相关补充其他研究HF精选112赞 arXiv · cs.CV 11-05
VFlash:以完整视觉图元为单位并行解码,加速具身视觉规划
VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding

主要贡献具身规划需要输出框或轨迹。作者利用这些坐标的已知结构,一次生成整个图元,减少逐个坐标解码的等待。

关键亮点同一设备的 MolmoSpaces 测试中,整步耗时约从 3.55 秒降到 0.70 秒;提升并不保证迁移到所有空间预测任务。

原文完整摘要

Models for physical AI tasks, such as robotics and autonomous driving, need not reason solely in language. They can use visual plans--points, bounding boxes, and trajectories--to represent spatial goals and anticipate motion. However, autoregressive vision-language models generate these plans one coordinate token at a time, making richer predictions increasingly costly. We introduce VFlash, a method for fast, accurate visual planning through Flash Primitive Decoding. VFlash exploits the known structure of visual primitives to predict their coordinates jointly, using a lightweight drafter that generates an entire primitive in one forward pass. The layout adapts to the primitive's type, dimensionality, and length, supporting compact boxes and long, variable-length trajectories. Crucially, spatial accuracy need not require reproducing an autoregressive model's exact token sequence. VFlash therefore trains on annotated primitives and directly accepts structurally valid predictions without target-token agreement. Across the evaluated 2D and 3D robot trajectory tasks, VFlash consistently reduces prediction errors relative to autoregressive decoding. Preliminary single-rollout measurements indicate approximately 25x faster generation for 3D point motion forecasting. A world action model conditioned on VFlash plans achieves 70.2% average success across four MolmoSpaces task suites, compared with 62.6% for the baseline.

选读评分 88/100社区热度 100/100 · 审读依据 70/100(编辑刻度)
OpenAlex 引用 0 · 统计于 2026-11-11 UTC / HF 点赞 112 · 统计于 2026-11-11 UTC
公开信号覆盖有限 · 新预印本引用有明显收录与积累时滞;0次引用不表示质量差。
阅读依据与局限
原文依据

表7同一WAM下,AR与VFlash规划条件的平均成功率61.0%→70.2%;附录表11同设备Thor的MolmoSpaces步骤耗时3552.7→703.3ms,含视觉、解码和动作模块。

局限与条件

表5的WorldTrack FDE反而0.261→0.300m,PWT在三个数据集均下降;25倍只属单次rollout估计。下游仅一个训练/评测种子,延迟使用给定工具调用、定制TensorRT。官方README称目标和草稿权重尚待发布。

延伸读法

读完整图元的联合预测与直接接受规则,区分结构合法、空间准确和无损保持原模型分布;重点看同骨干解码对照。

原文审读 · 2026-11-10 · 原论文与实验表 ↗
核对v1全文表3、5、7、11及附录D–F,另核对官方代码README;仅评估作者报告,未独立复现。

解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 70 赞 HF精选70赞 arXiv · cs.CV 11-05
SplatAnything:面向任意场景前馈3DGS的高斯间距归一化
SplatAnything: Gaussian Spacing Normalization for Feed-forward 3DGS across Arbitrary Scenes

主要贡献提出了高斯间距归一化(GSNorm),通过统一不同场景下的高斯分布密度参考,解决了现有前馈 3DGS 方法在高斯空间目标设定上的模糊性问题。

原文完整摘要

We identify a key limitation of existing feed-forward 3DGS methods: Gaussian attributes are typically predicted in a radial-distance-normalized space that canonicalizes a global radial statistic of the reconstructed geometry, while the spacing between neighboring Gaussian centers can still vary substantially across scene scales and camera configurations. This mismatch induces systematic shifts in Gaussian-scale targets, leading to ambiguous supervision. To address this, we propose SplatAnything with Gaussian Spacing Normalization (GSNorm), which canonicalizes a robust scene-level statistic of Gaussian spacing to provide a more consistent spatial reference for Gaussian prediction. To rigorously assess our method, we further establish a systematic benchmark spanning diverse datasets, input sparsity levels, and challenging extrapolated viewpoints. Extensive experiments demonstrate that SplatAnything achieves state-of-the-art performance, with particularly strong gains under substantial variations in scene scale and viewpoint. Project page: https://zju3dv.github.io/SplatAnything

选读评分 70.2/100社区热度 97/100 · 审读依据 30/100(编辑刻度)
OpenAlex 引用 0 · 统计于 2026-11-11 UTC / HF 点赞 70 · 统计于 2026-11-11 UTC
公开信号覆盖有限 · 新预印本引用有明显收录与积累时滞;0次引用不表示质量差。
阅读依据与局限
原文依据
贡献依据

提出了高斯间距归一化(GSNorm),通过统一不同场景下的高斯分布密度参考,解决了现有前馈 3DGS 方法在高斯空间目标设定上的模糊性问题。

we propose SplatAnything with Gaussian Spacing Normalization (GSNorm), which canonicalizes a robust scene-level statistic of Gaussian spacing to provide a more consistent spatial reference for Gaussian prediction.
结果依据

当前结果引句未给出与指标直接对应的测量值;表号、年份、数据集数量和输入范围不能支持量化优劣判断。可作为方法或理论线索阅读,实验结果待核查。

Table 1: Quantitative comparison across seven benchmark datasets, averaged over 4–64 input views. The top-3 results are highlighted as first, second, and third.
原文依据
We evaluate on seven datasets: ScanNet (Dai et al., 2017), NRGBD (Azinović et al., 2022), DL3DV (Ling et al., 2024), Tanks and Temples (Knapitsch et al., 2017), Mip-NeRF 360 (Barron et al., 2022), ETH3D (Schops et al., 2017), and DTU (Jensen et al., 2014).
边界依据
PSNR does not always faithfully reflect perceptual rendering quality, as it can favor overly smooth predictions that achieve low pixel-wise errors while losing high-frequency details.
局限与条件

现有节选不足以完整核对实验结果与局限,需对照原文中的指标、对照方法和评测条件。

延伸读法

重点阅读 3.3 节 Gaussian Spacing Normalization 的定义及 Figure 2 对比;查看 4.2 和表 1 的跨数据集泛化性能,以及表 3 对不同归一化空间的消融实验。

原文节选自动核对 · 2026-11-11 · 原论文与实验表 ↗
自动核对论文 HTML 节选中的作者报告与原文引句;未独立复现。

解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 59 赞 HF精选59赞 arXiv · cs.CV 11-04
从像素到动作——走向原生视觉-语言-动作策略
From Pixels to Actions--Towards Native Vision-Language-Action Policies

AI 摘要提出无独立视觉编码器的NEO-VLA,直接由轻量卷积分块并与语言端到端联合计算,让动作专家利用不同深度的视觉演化特征,显著增强具身控制鲁棒性与精度。

原文完整摘要

Vision-language-action models are typically built on a simple premise: perception is first compressed by visual encoders, and action reasoning begins only afterwards. Yet manipulation often hinges on precisely the visual signals most vulnerable to this abstraction, e.g., local geometry, boundaries, depth, and subtle state changes. This raises a fundamental question: should action policies inherit a fixed visual endpoint, or directly access evolving visual computation? We introduce NEO-VLA, a structurally encoder-free vision-language-action framework. Images are tokenized by lightweight patch convolutional layers and evolve jointly with language throughout the backbone, allowing a flow-matching action expert to draw from instruction-conditioned visual representations at different depths. This simple change reveals a consistent pattern. Native architectures outperform encoder-based counterparts under controlled comparisons; full fine-tuning reduces but does not erase the gap, and additional scale alone cannot recover it. More strikingly, layer-wise probing shows that the action-critical signals often peak well before the final visual representation. Across diverse manipulation settings and distribution shifts, NEO-VLA consequently achieves stronger and more robust control. Together, these results suggest that embodied control benefits from access to visual representations across the computational hierarchy, rather than a fixed encoder output.

选读评分暂不计算社区热度 93.2/100 · 原文依据待核验
HF 点赞 59 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 54 赞 HF精选54赞 arXiv · cs.AI 11-07
WorldFoundry:迈向世界智能的统一基础设施
WorldFoundry: Towards Unified Infrastructure for World Intelligence

AI 摘要界定生成式世界模型标准并推出开源基础设施WorldFoundry,整合超270个模型与74个基准,规范多模态世界的运行时管理与可复现评估协议。

原文完整摘要

Visual generative models increasingly blur the line between synthesizing observations and simulating environments. Yet visual plausibility alone does not constitute successful world modeling: compelling outputs may lack persistent state, physical dynamics, or causally consistent responses to interactions. We define a generative world model as a predictive dynamical system that maintains a persistent, history-conditioned representation of an environment, updates that representation in response to actions or interventions, and generates temporally coherent trajectories that reflect outcomes under observed and counterfactual interventions. From this definition, we derive an intelligence-oriented framework spanning perceptual grounding, persistent state modeling, controllable transformation, dynamics-aware prediction, and closed-loop interaction. We present WorldFoundry, open-source infrastructure for reproducible inference and evaluation across video, 3D and 4D, embodied action, and interactive world systems. WorldFoundry unifies model and benchmark discovery, runtime and asset preparation, execution orchestration, artifact management, and interactive visualization, while modality-specific adapters preserve native inputs, execution semantics, output representations, and evaluation protocols. Explicit manifests, durable artifact contracts, and evidence-aware scorecards separate execution readiness from evaluative claims, making each claim traceable to its supporting artifacts. The catalog contains 270 model entries, 74 benchmarks, and 62 registered metric entries, with readiness and execution evidence recorded separately. WorldFoundry enables reproducible comparison of persistent, controllable dynamics across heterogeneous systems, advancing the field from perceptual synthesis toward measurable world intelligence.

选读评分暂不计算社区热度 91.2/100 · 原文依据待核验
HF 点赞 54 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 50 赞 HF精选50赞 arXiv · HF 补抓 1 11-06
迈向具身智能体时代
Toward the Era of Agentic Embodied Intelligence

AI 摘要提出A2-MEAS具身多智能体框架与A2-WLA动作模型,以代码为接口协同纠错与环境演化,在BEHAVIOR 2026等基准与真机长程任务中大幅提升了成功率与吞吐量。

原文完整摘要

Foundation models increasingly guide robot actions, yet sustained autonomy requires efficient control and failure recovery. We introduce A2-MEAS, an embodied multi-agent framework built around code as a scaling interface. Learned correction codes combine corrective language, spatial evidence, execution history, and action proposals. MetaBrain provides training supervision and runtime guidance. A correction encoder and adapter absorb this knowledge into policy weights during training, while fresh codes adapt behavior with frozen weights at deployment. The action model, A2-WLA, adds motion-aware history and a latent world model to a vision-language-action policy. Surprisingly, this simple design with action pretraining and task specialization reaches 0.5755 Q-score on the 50-task BEHAVIOR 2026 public subset before online correction, 2.21x the 2025 winner's reported 0.2605 across different benchmark editions and training configurations. On all 100 BEHAVIOR 2026 public tasks, A2-MEAS achieves 0.6411 Q-score and 45.40% task success. On RoboTwin 2.0, A2-WLA achieves 93.98% average success, rising to 95.05% with the complete system. Across 12 real-robot tasks in five household settings, A2-WLA achieves 57.92% average success versus 26.67% for pi0.5. In long-horizon pour-over coffee preparation, a history-conditioned adapter raises post-failure completion at two filter-handling steps from 14% to 94% and from 8% to 82%, compared with A2-WLA retries. Our training infrastructure delivers 427.1 samples per second, 4.03x the throughput of a pi0.5 reference implementation on matched hardware. We will release the system, models, training scripts, and infrastructure to support efficient embodied learning.

选读评分暂不计算社区热度 89.5/100 · 原文依据待核验
HF 点赞 50 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 41 赞 HF精选41赞 arXiv · cs.AI 11-05
PCBRouteAgent:LLM智能体离成为PCB布线工程师还有多远?
PCBRouteAgent: How Close Are LLM Agents to Becoming PCB Routing Engineers?

AI 摘要提出多模态PCB布线智能体PCBRouteAgent,将全局拓扑规划与局部底层执行解耦并引入结构化反馈重试,在PCBWorld-Bench真实板级测试集上取得领先的完全通过率。

原文完整摘要

Automating printed circuit board (PCB) routing requires coordinating board-level connectivity decisions with geometric execution under strict design rules. Although recent agents can interact with native routing tools, reliable routing on complex boards remains challenging. We present PCBRouteAgent, a multimodal PCB routing agent inspired by how human engineers coordinate global strategy with local execution. A Global Routing Planner combines board images and structured electrical and geometric information to specify connection topology, routing order, corridors, and layer transitions. A Detailed Routing Executor realizes these guides through KiCad's native routing engine and performs bounded local recovery. Unresolved failures are returned as structured feedback, enabling targeted guide revisions while preserving accepted routes. We evaluate PCBRouteAgent on 247 synthetic and real-world boards from four PCBWorld-Bench test splits. It achieves clean-pass rates of 100%, 94.9%, 100%, and 40% on D2, D3-A, D3-B, and D3-C, respectively. On the three real-world subsets, PCBRouteAgent outperforms the best evaluated baseline in clean-pass rate by 13.9, 36, and 10 percentage points, respectively.

选读评分暂不计算社区热度 85.1/100 · 原文依据待核验
HF 点赞 41 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 67 赞 HF精选67赞 arXiv · HF 补抓 1 11-03
Harness-S:利用孪生测试套件提升智能体泛化训练
Harness-S: Learning from Sibling Harnesses for Generalizable Agent Training

AI 摘要提出Harness-S框架,在基础执行系统失败时调用专用孪生工具套件进行挽救与经验回传,训练后策略可在原始环境下显著提升AppWorld等基准的泛化表现。

原文完整摘要

Harness evolution from a common base exhibits Locality, Complementarity, and Nonstationarity: variants repair different failures, and their utility changes as the policy learns. Rather than seeking a universally superior harness, we introduce Harness-S to selectively rescue failures of a base execution system through sibling harnesses and transfer the resulting capabilities into a single policy that remains effective under the original harness. Directional Harness Evolution develops specialized sibling harnesses along distinct repair directions, forming a reusable Sibling Harness Pool that remains fixed during policy training. Complementary Harness Rescue Training invokes this pool only when all initial attempts under the base harness fail. The same policy generates fresh rollouts under selected auxiliary harnesses, and these trajectories replace the failed group for reinforcement learning. An Adaptive Harness Router selects the Top-k variants using Harness Behavior Profiles and voting across multiple LLMs. Policy-aware profile re-anchoring refreshes this evidence as the policy learns. Across AppWorld, SWE-Gym, and DBBench, the trained policy substantially outperforms policy-only training when returned to the original base harness. Behavioral analyses and held-out cases support the transfer of harness-elicited behaviors into the policy itself. Reusing the router for Rank-1 inference provides additional gains at the same executor rollout count.

选读评分暂不计算社区热度 84.1/100 · 原文依据待核验
HF 点赞 67 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
视觉生成
VISION & GENERATION
6 篇
arXiv HF 95 赞 HF精选95赞 arXiv · HF 补抓 1 11-09
面向通用灵巧操作的异构触觉表征学习
Learning Heterogeneous Tactile Representation for General Dexterous Manipulation

AI 摘要开发触觉基座模型LingBot-Touch,统一了压阻、磁性和视触觉等多模态传感器表征;可即插即用地接入各类具身策略,有效提升跨平台灵巧操作性能。

原文完整摘要

Tactile sensing is an indispensable modality for contact-rich dexterous manipulation, a capability that hints at the ultimate frontiers of embodied intelligence. However, commercially available tactile sensors are still at a relatively early stage of development, with each type of sensor offering irreplaceable strengths alongside its own drawbacks. A key challenge is thus to free tactile understanding from sensor-specific physics, so that embodied models can effectively leverage heterogeneous tactile data. To this end, we develop LingBot-Touch, a tactile foundation model characterized by the following properties. (i) Our model yields a unified representation across different tactile sensors (i.e., piezoresistive, magnetic, and visuotactile sensors), and is easily extensible to new sensor types. (ii) The resulting tactile tokens are plug-and-play: they can be seamlessly integrated into policy models across paradigms, from diffusion policy to vision-language-action (VLA) models such as $π_{0.5}$ and LingBot-VLA, consistently enhancing manipulation dexterity. (iii) Extensive experiments, spanning simulation and real-robot deployments across multiple hardware platforms, demonstrate that our tactile representation substantially benefits complex manipulation tasks while maintaining strong computational efficiency. We believe the findings in this work demonstrate the potential of leveraging cross-sensor data to scale tactile learning, and offer encouraging insights for the design of future hardware and embodied models.

选读评分暂不计算社区热度 100/100 · 原文依据待核验
HF 点赞 95 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 47 赞 HF精选47赞 arXiv · cs.AI 11-05
WeLM-Image:迈向视觉智能的统一图像生成模型
WeLM-Image: A Unified Image Generation Model towards Visual Intelligence

AI 摘要推出统一文生图与编辑的WeLM-Image,采用混合Transformer与稀疏MoE架构支持单卡部署,在多项开源基准中取得领先,蒸馏版本可实现4.98秒快速推理。

原文完整摘要

We present \textbf{WeLM-Image}, a unified image foundation model that integrates multimodal understanding into text-to-image generation, instruction-guided editing, and multi-reference synthesis. Designed for single-GPU deployment in WeChat's large-scale consumer applications, the model processes text, reference images, and target latents as one interleaved sequence. A Mixture-of-Transformers (MoT) backbone combines shared attention with independent understanding and generation parameters to limit optimization interference. Equipping each path with Mixture-of-Experts (MoE) modules provides sparse capacity, with 31.7B stored parameters and approximately 5.4B generation parameters activated per target latent token. A generation-oriented data engine combines a knowledge-grounded visual vocabulary with large-scale visual clustering to balance semantic coverage and editing tasks, while training-time evaluation guides iterative data refinement. Bilingual annotations and verified editing supervision support progressive training up to native 1.5K resolution. We optimize generation and editing separately with rubric- and checklist-based rewards, then consolidate the specialized policies through noise-aware on-policy distillation. In the reported overall comparisons, the 1536-resolution model ranks first among the evaluated open-source models on PRISM-Bench, Qwen-Image-Bench, and UnicBench. MeanFlow-based few-step distillation yields WeLM-Image-Turbo, which generates a $1024\times1024$ image in 4.98\,s on a single NVIDIA H20 GPU using eight guidance-free steps.

选读评分暂不计算社区热度 88.1/100 · 原文依据待核验
HF 点赞 47 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 43 赞 HF精选43赞 arXiv · cs.AI 11-04
TailSteer:面向抗漂移多轮图像编辑的轨迹尾部引导
TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing

AI 摘要提出TailSteer后训练框架,在保持前期去噪动态的同时将内容保留校准集中在扩散轨迹尾部,无需成对数据即大幅缓解15至20轮连续编辑中的视觉累积漂移。

原文完整摘要

Strong single-turn editing performance does not guarantee reliable multi-turn interaction: as edited outputs are repeatedly reused, small unintended changes can accumulate into severe visual drift. This long-term drift is often mitigated through training on multi-turn data or cross-turn rollouts, potentially altering pretrained priors, or through specialized inference-time mechanisms that are difficult to scale to foundation models. We introduce TailSteer, a final-stage training framework that improves multi-turn robustness while retaining the generative and editing capabilities acquired through earlier training. TailSteer follows a simple principle: keep early denoising dynamics close to those of the base model and concentrate preservation corrections near the trajectory tail, where fine-grained deviations can be suppressed. These corrections are learned from the editor's own on-policy denoising rollouts, using unchanged source content as a preservation reference without requiring curated ground-truth editing pairs. Experiments across the FLUX, SenseNova, and Qwen families show that TailSteer substantially reduces cumulative drift over 15-20 editing turns while largely preserving base-model performance on extensive text-to-image and single-image editing benchmarks. These results demonstrate that long-horizon editing robustness can be unlocked in foundation models after TailSteer, rather than by relearning their existing capabilities.

选读评分暂不计算社区热度 86.1/100 · 原文依据待核验
HF 点赞 43 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 37 赞 数据资源其他研究HF精选37赞 arXiv · HF 补抓 1 10-27
GameVerse:面向长程交互式世界建模的分钟级游戏数据集
GameVerse: A Minute-Scale Gameplay Dataset for Long-Horizon Interactive World Modeling

AI 摘要构建分钟级游戏交互视频数据集GameVerse,涵盖1655小时长视频与3.49亿帧,提供稳定的时序相机轨迹和事件级标注,显著拓展了交互式世界模型的生成时域。

原文完整摘要

Recent advances in interactive world models have made it possible to generate controllable, dynamic environments from action inputs. Yet current models struggle to maintain coherence beyond roughly one minute of rollout, a limitation rooted not in model capacity but in the scarcity of long-horizon training data. Existing gameplay video datasets typically consist of clips under ten seconds, with captions that describe whole clips in coarse and undifferentiated text, which is insufficient for controllable long-horizon generation. We address this with GameVerse, a minute-scale gameplay video dataset purpose-built for long-horizon interactive world modeling. GameVerse contains 69.7K clips spanning 1,655 hours and 349.6 million frames across diverse first- and third-person gameplay, including 1,358 hours of continuous two-minute sequences, an order of magnitude longer than prior datasets. Clips pass through a unified pipeline of scene-consistent segmentation, quality filtering, camera pose estimation, and event-based caption annotation. Each clip is paired with a temporally stable camera trajectory that remains coherent across minutes, together with captions that separate static scene context from dynamic foreground events and align to event boundaries rather than fixed time windows. Comprehensive analysis shows that GameVerse surpasses existing public datasets in scale, diversity, and annotation quality. Experiments further demonstrate that training on GameVerse substantially extends the temporal horizon of interactive world models.

选读评分暂不计算社区热度 72.5/100 · 原文依据待核验
HF 点赞 37 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 20 赞 HF精选20赞 arXiv · cs.CV 11-06
Video-Coder:增强视频生成的代理编码
Video-Coder: Reinforcing Agentic Coding for Video Generation

AI 摘要节选近年来,视频生成在视觉质量和时间一致性方面取得了显着进步。然而,生成具有精确空间结构、连贯运动动力学和可控场景组成的视频仍然具有挑战性。在本文中,我们介绍了 Video-Coder,这是训练代码驱动的视频生成代理的首次尝试,它自主编写和执行代码来构建动态 3D 场景(视频草稿),为下游视频生成器提供结构和运动信号。为了支持这种范例,我们设计了一个专用的数据管道,并策划了两个高质量的数据集:Video-Coder-SFT-6k 和 Video-Coder-RL-2k,其中包含不同的提示和真实参考视频。我们进一步开发了 VideoCoder Harness,这是一个集成了代码执行、3D 场景渲染以及用于代理训练和推理的执行反馈的统一交互环境。然后,我们使用 SFT 训练 Video-Coder,然后利用具有双重奖励反馈的原生代理强化学习,其中结合了基于执行的奖励和基于视频的奖励。

原文完整摘要

Recent years have witnessed remarkable progress in video generation in terms of visual quality and temporal consistency. However, generating videos with precise spatial structure, coherent motion dynamics, and controllable scene composition remains challenging. In this paper, we introduce Video-Coder, the first attempt to train a code-driven video generation agent, which autonomously writes and executes code to construct a dynamic 3D scene (Draft Video) that provides structure and motion signals to downstream video generators. To support this paradigm, we design a dedicated data pipeline and curate two high-quality datasets, Video-Coder-SFT-6k and Video-Coder-RL-2k, which contain diverse prompts and ground-truth reference videos. We further develop the Video- Coder Harness, a unified interactive environment integrating code execution, 3D scene rendering, and execution feedback for agent training and inference. We then train Video-Coder with SFT fol- lowed by harness-native agentic reinforcement learning with dual reward feedback, which combines execution-based and video-based rewards. Additionally, we design an annealing training strategy that gradually reduces the execution reward over time, allowing the model to rely more on the video reward in the later training stages. Experiments show that Video-Coder achieves significant gains, improving Minimax-H3 by approximately 7 points on PhyGenBench and 24 points on VBench-2.0. We hope this work can serve as an open foundation for coding agents in video generation, and we fully open-source our data, models, and code

选读评分暂不计算社区热度 69.3/100 · 原文依据待核验
HF 点赞 20 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
工程进展
ENGINEERING ADVANCES
8 篇
arXiv HF 104 赞 HF精选104赞 arXiv · HF 补抓 1 11-03
从自主智能体到认知共生体:面向AI增强的人类智能
From Autonomous Agents to Cognitive Symbionts: Toward AI-Augmented Human Intelligence

主要贡献把个人 AI 的设计目标从替人完成任务,转向帮助人理解、记忆和决策。文章整理了系统何时介入、记住什么、怎样保留用户控制权的设计问题。

关键亮点作者提出一个值得单独评估的问题:撤去 AI 后,用户是否保留了学到的能力?这是一份研究议程,未提供新系统的对照实验。

原文完整摘要

For a decade, progress in artificial intelligence has been measured by how much a machine can do on its own. Large foundation models now write code and run multistep tasks, and personal agents act on a person's behalf. Yet people still forget what they once knew, miss what they are not looking at, fail to find the right words, and face hard choices without the benefit of their own history, because the machine that could help stands outside the situation. As AI moves into the physical world, attention has settled on one kind of intelligent individual, the embodied robot; we argue that the era of Physical AI holds a second kind of equal importance, the person augmented by AI. Alongside artificial general intelligence, which asks how intelligent a machine can be, stands AI-augmented human intelligence (AHI), which asks how much intelligence a machine can enable in a particular person. Realizing it calls for a new kind of system, a cognitive symbiont: a lifelong, embedded, real-time, private, low-friction, and proactive companion that senses what the person senses through external devices, keeps their context across years, models their situation and their mind, takes part in their thinking at the right moment, carries out everyday tasks with their context, and keeps learning the person as both change. We give the paradigm a conceptual core, the cognitive gap between what a person could bring to a situation and what they can hold in working memory, and organize its design space as a symbiosis loop of sensing, keeping, understanding, living alongside, acting for and thinking with the person, and growing, enclosed by a personal runtime and by trust. Because a symbiont changes what a person can do in front of others, it also raises risks of a new kind, from covert assistance in examinations to pressure on everyone to adopt it, and we treat their governance as part of the paradigm.

选读评分 67.7/100社区热度 92.8/100 · 审读依据 30/100(编辑刻度)
OpenAlex 引用 0 · 统计于 2026-11-11 UTC / HF 点赞 104 · 统计于 2026-11-11 UTC
公开信号覆盖有限 · 新预印本引用有明显收录与积累时滞;0次引用不表示质量差。
阅读依据与局限
原文依据

第1.4节明确不提出新算法;第17节提出个性化增益、协同和撤去AI后的能力保留等待验证指标。本文未报告新系统的对照实验。

局限与条件

概念图与未来方案不能作为性能证据;高社区关注不足以升级为今日方法精读。

延伸读法

关心个人AI时,选读共生循环、介入时机和第17节的评测设计。

原文审读 · 2026-11-10 · 原论文与实验表 ↗
核对v1第1.4、4.4、17节及全文结构;立场和研究议程,不是已验证系统。

解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 53 赞 HF精选53赞 arXiv · HF 补抓 1 11-02
P$^2$-MOPD:利用参数先验加速多教师在线策略蒸馏
P$^2$-MOPD: Accelerating Multi-Teacher On-Policy Distillation via Parameter Priors

AI 摘要提出P$^2$-MOPD方法,将多教师参数作为先验,并联合优化混合系数与可微学生模型参数,在多个领域下以一半的步数超越传统MOPD的最终平均恢复性能。

原文完整摘要

Multi-teacher on-policy distillation consolidates expert capabilities by supervising student-generated trajectories, whereas task arithmetic offers a training-free alternative through linear parameter combinations. We view the linear combination of student and expert parameters as a single differentiable model and propose P$^2$-MOPD, which jointly optimizes the mixing coefficients and the student weights under the same on-policy distillation objective. Unlike task arithmetic, which stays within the span of the frozen student and expert parameters for any choice of merging coefficients, P$^2$-MOPD keeps the student trainable, so the experts act as parameter priors without confining it to this span. Across four domains at 1.7B and 4B scales, P$^2$-MOPD achieves faster and more balanced recovery than MOPD from the same initialization, surpassing its final average recovery in half the training steps. At the end of training, our 1.7B model reaches 94.7% average recovery, versus 80.9% for MOPD.

选读评分暂不计算社区热度 79.5/100 · 原文依据待核验
HF 点赞 53 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 35 赞 HF精选35赞 arXiv · HF 补抓 1 11-03
Halley:光学人工智能数据中心网络的预测控制平面
Halley: A Predictive Control Plane for Optical AI Data Center Networks

AI 摘要前沿人工智能模型在人工智能数据中心、由专用网络连接的数万个加速器上进行训练,每个训练步骤都以所有加速器同时交换数据结束。在机架之间,该网络是光纤网络,从激光器到交换机,其四层中的每一层都运行固定或事后策略。共享外壳、冷却和电源的激光器可能会同时发生故障。在固定备用率下,无论池增长到多大,相关故障都可能限制池的可用性。在本文中,我们提出了一个名为 Halley 的综合预测控制平面框架,它读取每个资源的下一个状态并在故障发生之前采取行动。它有四个组件,每个组件都有正式的保证:LightReserve 调整激光池大小以提供覆盖范围,FoldFit 将切换时间安排在最佳值的 11/9$ 以内,ThermaLead 持有微环并进行一步控制,TriageGuard 首先保护最高风险的模块。 Halley 为每一层提供了一个预测控制器,在不确定时会遵循已部署的策略。

原文完整摘要

A frontier AI model is trained in an AI data center, on tens of thousands of accelerators joined by a dedicated network, and every training step ends with all of them exchanging data at once. Between racks, that network is optical, and each of its four layers, from lasers to switches, runs a fixed or after-the-fact policy. Lasers sharing an enclosure, cooling, and power can fail together. At a fixed spare ratio, correlated failure provably caps a pool's availability however large it grows. In this paper, we present a comprehensive predictive control plane framework, called Halley, that reads each resource's next state and acts before the failure occurs. It has four components, each carrying a formal guarantee: LightReserve that sizes the laser pool to provide a coverage bound, FoldFit that schedules the switch within $11/9$ of the optimal, ThermaLead that holds a microring with one-step-ahead control, and TriageGuard that protects the highest-risk modules first. Halley gives each layer a predictive controller that defers to the deployed policy when unsure. Composed from simulations at that point, effective goodput, the share of ideal throughput kept, rises from 65.2\% to 76.5\% if a window that exhausts its spares is lost. If only the dark channels' bandwidth is lost, it reaches 67.4\%. Per megawatt, that is up to 1.03--1.17 times the training; for the same training, up to 3.3--14.7\% less data center capacity. \textsf{Halley}'s fallback circuits are formally verified and are shown to achieve close timing on a commercial FPGA, and pass a 130~nm signoff.

选读评分暂不计算社区热度 71.4/100 · 原文依据待核验
HF 点赞 35 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 7 赞 HF精选7赞 arXiv · cs.AI 11-09
ProTEUS:闭环蛋白质进化的突变解决世界模型
ProTEUS: A mutation-resolved world model for closed-loop protein evolution

AI 摘要蛋白质工程需要在崎岖的适应性环境中航行,其中小的序列变化可能会产生很大的功能差异,但实验筛选只能对序列空间的一小部分进行采样。因此,一个核心挑战是在计算机中有效地遍历突变的大组合空间。我们介绍 ProTEUS,一种用于闭环蛋白质进化的突变解决世界模型。经过深度突变扫描分析的预训练,ProTEUS 使用 MutationFormer(一种突变偏向注意力架构)学习序列、进化和结构信息的联合表示。变体被表示为这个联合潜在空间中的状态,而突变定义了其功能后果被预测的动作。为了支持对许多突变体的探索,我们开发了一种快速的、物理约束的全原子预测器,它利用显式几何约束强制执行,在保证物理有效性的情况下实现速度比 AlphaFold3 提高 10 倍以上。最后,ProTEUS 通过闭环实验反馈完善其对蛋白质活性的预测和理解,以指导进化向所需的表型。 ProTEUS 在零样本和监督微调突变预测任务方面都超越了现有模型。

原文完整摘要

Protein engineering requires navigating rugged fitness landscapes, where small sequence changes can produce large functional differences, but experimental screening can only sample a small fraction of sequence space. Thus, a central challenge is to efficiently traverse the large combinatorial space of mutations in silico. We introduce ProTEUS, a mutation-resolved world model for closed-loop protein evolution. Pretrained on deep mutational scanning assays, ProTEUS learns a joint representation of sequence, evolutionary, and structural information using MutationFormer, a mutation-biased attention architecture. Variants are represented as states in this joint latent space, and mutations define actions whose functional consequences are predicted. To support exploration of many mutants, we developed a fast, physics-constrained all-atom predictor that utilizes explicit geometric constraint enforcement to achieve >10 fold increase in speed than AlphaFold3 with guaranteed physical validity. Lastly, ProTEUS refines its prediction and understanding of protein activity through closed loop experimental feedback to guide evolution toward a desired phenotype. ProTEUS surpasses established models in both zero-shot and supervised fine-tuning mutation prediction tasks. We experimentally demonstrate its utility in two closed-loop multi-objective engineering campaigns on aldehyde dehydrogenase and levansucrase, yielding variants with >10 fold higher activity than wild type. ProTEUS provides a world-model framework that connects virtual evaluation of mutational outcomes with experimental learning for efficient protein evolution.

选读评分暂不计算社区热度 47.3/100 · 原文依据待核验
HF 点赞 7 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 4 赞 HF精选4赞 arXiv · HF 补抓 1 11-10
ExRL:通过执行长度控制对长块策略进行样本高效的在线适应
ExRL: Sample-Efficient Online Adaptation of Long-Chunk Policies via Execution Length Control

AI 摘要预测长动作块(通常跨越数十个时间步)已成为功能日益强大的机器人策略的关键要素。在本文中,我们发现,由于要优化的动作块的高维性,用现有的强化学习(RL)方法来适应这些长块策略可能需要许多在线样本,这使得这种适应在交互数据收集成本高昂的现实场景中不切实际。我们的主要见解是将适应从优化操作转变为优化执行每个预测操作块的时间。这使得适应空间保持低维,同时其表现力随着块大小而增长。因此,我们引入了 Execution at the Right Length (ExRL),这是一种简单的方法,它使用轻量级适配器来增强基本策略,该适配器可以预测每个块的执行长度,并使用离策略 RL 算法进行训练。在模拟基准和现实世界的机器人任务中,ExRL 能够以最少的特定于任务的超参数调整来对各种长块策略进行样本高效的适应。

原文完整摘要

Predicting long action chunks, often spanning dozens of timesteps, has become a key ingredient in increasingly capable robot policies. In this paper, we find that adapting these long-chunk policies with existing reinforcement learning (RL) methods can require many online samples due to the high dimensionality of the action chunks being optimized, making such adaptation impractical in real-world scenarios where interaction data are costly to collect. Our key insight is to shift adaptation from optimizing actions to optimizing how long to execute each predicted action chunk. This keeps the adaptation space low-dimensional while its expressivity grows with the chunk size. We thus introduce Execution at the Right Length (ExRL), a simple approach which augments the base policy with a lightweight adapter that predicts the execution length of each chunk and is trained using off-policy RL algorithms. Across simulation benchmarks and real-world robotic tasks, ExRL enables sample-efficient adaptation of a diverse range of long-chunk policies with minimal task-specific hyperparameter tuning.

选读评分暂不计算社区热度 36.6/100 · 原文依据待核验
HF 点赞 4 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 5 赞 HF精选5赞 arXiv · HF 补抓 1 11-02
多层索引器:DeepSeek稀疏注意力中的重叠选择和注意力
Multi-layer Indexer: Overlapping Selection and Attention in DeepSeek Sparse Attention

AI 摘要稀疏注意力通过使注意力矩阵稀疏来降低长上下文推理的成本:每个查询仅关注序列的一个子集,由固定模式选择,或者在最近的生产LLM中,每个查询都学习。在 DeepSeek 稀疏注意力 (DSA)、DeepSeek-V3.2 和 GLM-5 系列的注意力中,每一层之前都有一个闪电索引器,该索引器对整个缓存进行评分,并保留 k=2048 个最高得分令牌供该层参与。在长上下文中,解码时间花在索引器扫描上,而不是它所提供的稀疏注意力上。但相邻层选择几乎相同的标记,因此层可以参与前一个索引器层的选择,而不是自己的选择。这消除了依赖性:每个索引器然后与其层的注意力同时运行。由此产生的多层索引器 (MLI) 不需要重新训练,也不需要新的权重。它的默认实现不改变内核,在 SGLang 的生产解码图中运行;可选的融合解码内核可在 DeepSeek-V3.2 上进一步加速。

原文完整摘要

Sparse attention cuts the cost of long-context inference by making the attention matrix sparse: each query attends only a subset of the sequence, chosen by a fixed pattern or, in recent production LLMs, learned per query. In DeepSeek Sparse Attention (DSA), the attention of DeepSeek-V3.2 and the GLM-5 family, every layer is preceded by a lightning indexer that scores the whole cache and keeps the k=2048 highest-scoring tokens for the layer to attend. At long context this indexer scan, not the sparse attention it feeds, is where the decode time goes. But adjacent layers select nearly the same tokens, so a layer can attend the selection of the previous indexer layer instead of its own. This removes the dependency: each indexer then runs concurrently with the attention of its layer. The resulting Multi-layer Indexer (MLI) needs no retraining and no new weights. Its default realization changes no kernel, running inside SGLang's production decode graph; an optional fused decode kernel accelerates it further on DeepSeek-V3.2. MLI composes with IndexCache (the cross-layer reuse GLM-5.2 ships as IndexShare): IndexCache drops the indexer from some layers, and MLI hides the scan on the rest. We serve DeepSeek-V3.2 and GLM-5 under IndexCache's protocol at retentions 1/2 to 1/32 (the fraction of layers that keep an indexer) and contexts 10K to 195K. At equal retention the composition decodes faster than IndexCache: up to 14.5% faster on DeepSeek-V3.2 and 9.8% on GLM-5 at 1/2, and 7.9% and 5.1% at 1/4, largest where IndexCache keeps the most indexers and growing with context. At retention 1/r it is faster still than IndexCache at 1/(2r) while keeping twice the fresh selections: at 128K it reaches 1.32x the unmodified model's decode throughput at 1/4, above IndexCache's 1.28x at 1/8. Its LongBench, RULER and LongBench v2 accuracy stays within a few percentage points of IndexCache's.

选读评分暂不计算社区热度 35.7/100 · 原文依据待核验
HF 点赞 5 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 2 赞 HF精选2赞 arXiv · cs.AI 11-10
市场调节的 JEPA:从不可预测的市场冲击中学习
Market-Conditioned JEPA: Learning from Unpredictable Market Shocks

AI 摘要金融时间序列的大部分变化是由整个市场的冲击驱动的,而这些冲击无法从资产自身的历史中预测。每项资产的自我监督学习将这种变化视为不可减少的噪音。在潜在因素模型下,我们表明,对已实现的市场因素进行条件预测使得资产的市场暴露对于最佳预测是必要的,同时减少了学习特定资产组件的噪音。基于这一见解,我们引入了市场条件 JEPA (MC-JEPA),这是一种针对金融时间序列的联合嵌入预测架构。在训练过程中,我们根据其他资产的未来目标嵌入为每项资产构建留一市场条件,并通过从资产自身表示派生的因子负载将其纳入其中。根据 11 年的分钟级中国 A 股数据,MC-JEPA 在回报、市场敞口、风险和流动性的九个目标上比单资产 JEPA 有所改善,其中在敞口、风险和流动性方面的收益最为强劲且具有统计显着性。它在所有流动性目标和两小时到五天的回报范围内实现了最佳 RankIC,优于时间序列基础模型和自我监督基线,并在历史回测中提供了最佳的投资组合表现。

原文完整摘要

Much of the variation in financial time series is driven by market-wide shocks that cannot be predicted from an asset's own history. Per-asset self-supervised learning treats this variation as irreducible noise. Under a latent factor model, we show that conditioning prediction on the realized market factor makes the asset's market exposure necessary for optimal prediction, while reducing the noise against which the asset-specific component is learned. Building on this insight, we introduce Market-Conditioned JEPA (MC-JEPA), a joint-embedding predictive architecture for financial time series. During training, we construct a leave-one-out market condition for each asset from the future target embeddings of other assets and incorporate it through factor loadings derived from the asset's own representation. On 11 years of minute-level Chinese A-share data, MC-JEPA improves over per-asset JEPA across nine targets spanning returns, market exposure, risk, and liquidity, with the strongest and most statistically significant gains in exposure, risk, and liquidity. It achieves the best RankIC on all liquidity targets and on return horizons from two hours to five days, outperforming time-series foundation models and self-supervised baselines, and delivers the best portfolio performance in a historical backtest. Ablations show that the return and exposure gains require the condition to be aligned with the realized market movement. After restoring the volatility scale removed by normalization, the predictor's factor loadings rank stocks by market beta nearly as well as a supervised probe, without labels. A synthetic factor-model study with known parameters shows that conditioning improves the recovery of both market exposure and the asset-specific component.

选读评分暂不计算社区热度 25/100 · 原文依据待核验
HF 点赞 2 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
arXiv HF 2 赞 HF精选2赞 arXiv · HF 补抓 1 10-30
学习通过匹配速度来进化
Learning to evolve by matching velocities

AI 摘要学习非线性动力系统的连续时间演化依赖于基于轨迹的目标,这需要在训练过程中模拟学习到的动力学并通过数值方案进行反向传播,其成本随着推出时间的推移而增长。我们表明,随着推出范围的增加,基于轨迹的目标会退化,从而阻碍基于梯度的优化,并且数值方案通过将学习的雅可比行列式的频谱限制在其绝对稳定区域,从而使学习的动力学产生偏差。为了克服这些限制,我们引入了速度匹配(VM),这是一种无需模拟的目标,依赖于分段线性插值和随机配置,并将采样步骤中的速度总体风险近似为二阶。我们开发了基于速度的学习的理论框架,引入了稳定性估计,可以根据速度误差控制轨迹误差,这使我们能够在深度神经网络对学习的速度场进行参数化时建立通用且连续时间的近似结果。

原文完整摘要

Learning the continuous-time evolution of nonlinear dynamical systems relies on trajectory-based objectives, which require simulating the learned dynamics during training and backpropagating through the numerical scheme, at a cost that grows with the rollout horizon. We show that trajectory-based objectives degenerate as the rollout horizon increases, hindering gradient-based optimization, and that the numerical scheme biases the learned dynamics by constraining the spectrum of the learned Jacobian to its absolute stability region. To overcome these limitations, we introduce Velocity Matching (VM), a simulation-free objective that relies on piecewise-linear interpolation and stochastic collocation, and approximates the velocity population risk to second order in the sampling step. We develop a theoretical framework for velocity-based learning, introducing stability estimates that control trajectory errors in terms of velocity errors, which enable us to establish universal and continuous-time approximation results when the learned velocity field is parameterized by deep neural networks. Building on a bias-variance decomposition of the VM objective, we show that its higher-order approximation of the velocity population risk yields a consistent minimizer; that it relates to the residual of an A-stable continuous-stage Runge-Kutta scheme, thus connecting VM to implicit integration without requiring any implicit solve; and that it implicitly matches the action of the learned Jacobian to that of the true one along the observed trajectories, without requiring access to the underlying velocity field or its Jacobian. Numerical experiments on nonlinear ordinary differential equations and semi-discretized time-dependent partial differential equations show that VM improves accuracy over trajectory-based objectives, while avoiding both the cost of simulation and the instabilities of long rollouts.

选读评分暂不计算社区热度 21.9/100 · 原文依据待核验
HF 点赞 2 · 统计于 2026-11-11 UTC
公开信号覆盖有限
解读尚未发布,可先读原文或收藏。 → 原文
← 返回简报