今日论文合集:CS.SD语音与音频 共 3 篇。

本文经arXiv每日学术速递授权转载,微信公众号:arXiv_Daily

[机构]信息由AI分析生成,可能存在错误,仅供参考,以论文实际显示为准


快速导航

1. 语音合成与声音生成 1 篇

2. 说话人识别、验证与分离 1 篇

3. 语音翻译与语音语言模型 1 篇


1. 语音合成与声音生成 | 1 篇

1. CoTTAGE: An Explainable Judge for Text-to-Audio Generation

CoTTAGE:一种可解释的文本到音频生成评判器

AI 总结:针对文本到音频生成自动评估的瓶颈,提出基于推理的CoTTAGE评估器,经1万份标注训练与强化学习优化,在六个基准上实现与人类判断的高相关性及可解释性,加速TTA开发。

链接:https://arxiv.org/abs/2611.17644

机构:National Taiwan University(台湾大学); Amazon AGI(亚马逊AGI)

作者:Yu-Xiang Lin, Yun-Man Hsu, Bo-Ru Lu, Kuan-Po Huang, Wenze Ren, Ming-To Chuang, Chun-Yi Kuan, Jiawei Du, Byeonggeun Kim, Qingming Tang, Chieh-Chi Kao, Ankur Gandhe, Chao Wang, Hung-yi Lee

英文摘要:Rapid progress in text-to-audio (TTA) generation demands reliable and explainable automatic evaluation. However, existing metrics fail to simultaneously deliver high correlation with human judgments and meaningful, audio-grounded explanations, forcing reliance on labor-intensive human evaluation that bottlenecks model development iteration. To address this, we propose CoTTAGE, a reasoning-based evaluator for text relevance (REL) and audio quality (OVL). Following a reason-then-predict paradigm, CoTTAGE first generates an audio-grounded rationale to diagnose errors before predicting scores. Supported by over 10K newly collected human OVL annotations, CoTTAGE is first trained via supervised fine-tuning and then refined with reinforcement learning using a Thurstone-based preference objective that converts sampled score distributions into pairwise preference probabilities and rewards agreement with rankings derived from human judgments. Across six benchmarks spanning REL and OVL, CoTTAGE achieves state-of-the-art correlation with human judgments while producing human-preferred explanations to accelerate TTA development.


2. 说话人识别、验证与分离 | 1 篇

2. eDIAR: Training-Free Open-Speaker Streaming Diarization for Long Meetings and Large Archives via e-means

eDIAR:基于e-means的无训练开源说话人流式 diarization 系统,用于长会议和大型档案

AI 总结:提出无训练的eDIAR系统,通过e-means聚类消除固定槽位说话人 diarizer 的说话人数量限制,在长会议等场景精度更高且成本不随会议增长。

链接:https://arxiv.org/abs/2611.18529

机构:KAIST AI(韩国科学技术院人工智能学院); Ewha W. University(梨花女子大学)

作者:Kyudan Jung, Jihwan Kim, Minwoo Lee, Eunji Shin, Jaegul Choo

英文摘要:Meetings last up to an hour, and nobody knows in advance how many people will speak. Neural diarizers with a fixed number of output slots, such as Streaming Sortformer and Nemotron-3, are accurate and run online, but they cannot name more speakers than they have slots. We remove this limit without retraining. The slot head keeps deciding who is active and when speech overlaps, and speaker embeddings are clustered inside a single slot, with the official e-means algorithm, only after every slot has been used. In the streaming system, re-clustering is confined to a bounded window, labels are revised for a few seconds, and identities are anchored to the slots of the head. The resulting system has no limit on the number of speakers and stays accurate when speakers outnumber the slots, where fixed-slot models break down. On meetings that grow to an hour it stays far more accurate than Streaming Sortformer, which accumulates errors, and its cost per update does not grow with the meeting. The same recipe turns the four-slot Streaming Sortformer into an open-speaker system. Across recordings, e-means makes it affordable to link the speakers of a large archive frame by frame, a task that arises when conversational corpora are prepared, and it reaches the clustering quality of Lloyd's $k$-means several times faster. The method needs little tuning, and e-means runs with its default recipe from a few hundred to more than a million embeddings.


3. 语音翻译与语音语言模型 | 1 篇

3. Any Channel Count, One Token Stream: Incorporating Spatial Audio Understanding and Reasoning into Large Audio-Language Models

任意通道数,单令牌流:将空间音频理解与推理融入大型音频语言模型

AI 总结:本研究提出SpheraAudio,可处理任意通道数音频并生成单令牌流,结合SMRoPE与三阶段训练,构建SpheraQA基准,在空间音频理解任务上达新性能标准,同时保留通用音频能力。

链接:https://arxiv.org/abs/2611.18112

机构:Alibaba Group(阿里巴巴集团); Zhejiang University(浙江大学)

作者:Yuhuan You, Wenxiang Guo, Zhifang Guo, Yuxuan Wang, Jin Xu

英文摘要:Audio phase relations encode source locations, yet existing large audio-language models (LALM) reduce audio to single-channel content to stabilise general audio understanding, leaving spatial information for direction, distance, and source-relation questions unused. We present SpheraAudio, which accepts recordings with any channel count -- mono, stereo, First-Order Ambisonics (FOA), or higher -- and maps them into a single token stream. A spatial encoder turns complex multichannel spectra into spatial tokens interleaved with audio tokens at corresponding temporal positions. Spatial Multimodal RoPE (SMRoPE) makes each token's modality identity and temporal slot visible to rotary attention without altering the language model's original RoPE. Training runs in three stages -- spatial-encoder pretraining, projector alignment, and joint supervised-and-reinforcement learning -- progressing from geometric supervision to language-based spatial decisions, with answers trained as explicit spatial chain-of-thought: step-by-step geometric reasoning over the heard scene. Current benchmarks tie questions to a fixed channel-count format and score answers without spatial reasoning evidence. We introduce SpheraQA, which spans mono, stereo, and FOA recordings and organises questions hierarchically from single-attribute perception through cross-source relations to multi-step reasoning, scored programmatically against simulated scene geometry and real-recording annotations with step-by-step solution references. Across SpheraQA and public spatial-audio benchmarks, SpheraAudio sets a new performance standard for spatial audio understanding. It supports high-precision localisation, tracking, and reasoning over static and moving sound sources while preserving strong general-audio capabilities. We will release code, SpheraQA, and evaluation metrics to support reproducibility.