Xmart青年论坛由上海交通大学跨媒体语言智能实验室（SJTU X-LANCE lab）创办，旨在邀请国内外优秀的青年学者分享其最新科研工作和成果，促进多元且深入的交流与合作。Xmart前沿讲座作为其中一个系列，是人工智能方向的重要选修课，面向有一定人工智能技术基础的高年级本科生开设。每次讲座邀请一位高水平、高影响力的专家介绍人工智能学术前沿、产业前沿或政策前沿。我们希望通过这些讲座，帮助学生了解当前人工智能基础技术、产业应用、国家政策等方面的发展趋势，开阔眼界，为未来的学术研究、职业规划奠定良好的基础。

Xmart•前沿讲座丨李锦宇：从口语语言模型到多模态大语言模型

形式：线上

时间：4月10日(周五) 10:00~12:00


报告嘉宾

李锦宇

Jinyu Li is currently the Partner Applied Science Manager at Microsoft in Redmond, WA, USA, where he oversees a scientific team focused on developing and advancing speech modeling algorithms and technologies. Dr. Li is an IEEE Fellow, for contributions to deep-learning-based speech technology innovation and commercialization. Dr. Li served as a member of the IEEE Speech and Language Processing Technical Committee from 2018 to 2023 and as Vice Chair starting in 2026. He was an Associate Editor for the IEEE/ACM Transactions on Audio, Speech and Language Processing from 2015 to 2020 and acted as Technical Program Chair for IEEE SLT in 2021 and 2026, as well as IEEE ASRU in 2023 and 2025. He is a Distinguished Industry Speaker of the IEEE Signal Processing Society in 2025. He also received the IEEE SPS Best Paper Award in 2025. Additionally, Dr. Li was honored as the Industrial Distinguished Leader at the Asia-Pacific Signal and Information Processing Association (APSIPA) in 2021 and received the APSIPA Sadaoki Furui Prize Paper Award in 2023.


报告摘要：Large Language Models (LLMs) have made a notable impact on natural language processing (NLP) and are beginning to shape the field of speech processing. This presentation explores how LLMs are influencing multimodal intelligence by tracing the evolution from spoken language models (SLMs) to multimodal LLMs (MLLMs), with examples from Microsoft's model development journey. The talk covers differences in model architectures, recent progress in speech generation and comprehension, and how speech and text are being integrated. Finally, it highlights the latest advancements aimed at enhancing the open-source Phi-4-multimodal model.

参加方式

①

直播将通过语音之家微信视频号进行直播

手机端、PC端可同步观看

👇👇👇

②

腾讯会议参加

会议号：761-514-612