窦维蓓

个人信息Personal Information

教授

教师英文名称:DOU Weibei

教师拼音名称:douweibei

办公地点:清华大学罗姆楼4-102

联系方式:Email: douwb@tsinghua.edu.cn; Tel: 010-62781703

学位:博士学位

毕业院校:电子科技大学学士、法国雷恩大学硕士、法国卡昂大学博士

学术论文

当前位置: 中文主页 >> 科学研究 >> 学术论文

MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels

点击次数:

影响因子:10.506

DOI码:10.1109/TAFFC.2019.2945322

发表刊物:IEEE Transactions on Affective Computing

刊物所在地:UNITED STATES

关键字:emotional speech, Mandarin, dataset, distal labels, proximal labels, tonal speech, emotion intensities

摘要:Emotion shapes all aspects of our interpersonal and intellectual experiences. Its automatic analysis has therefore many applications. In this paper, we propose an emotional tonal speech dataset, Mandarin Chinese Emotional Speech Dataset - Portrayed (MES-P), with both distal and proximal labels. In contrast with state of the art datasets which only focused on perceived emotions, MES-P includes not only perceived emotions (proximal labels) but also intended emotions (distal labels), to make it possible to study human emotional intelligence, i.e. emotion expression/understanding ability, and emotional misunderstandings in real life. Furthermore, MES-P also captures a main feature of tonal languages, and provides emotional speech samples matching the tonal distribution in real life Mandarin. MES-P dataset also features emotion intensity variations, by introducing both moderate and intense versions for joy, anger, and sadness, in addition to neutral. Ratings of the collected speech samples are made in valence-arousal space through continuous coordinate locations, resulting in an emotional distribution pattern in 2D VA space. High consistency between the speakers’ emotional intentions and the listeners’ perceptions is also proved by Cohen’s Kappa coefficients. Finally, extensive experiments are carried out as a baseline on MES-P for automatic emotion recognition and with comparison to human emotion intelligence.

合写作者:Ying Chen, Weibei Dou, Zhi Tao, Liming Chen, Yu Pan, Weibei Dou,Huiuwen Luo, Yunxiang Ge, Shuyu Yan, Quan Xu, Yuanyuan Tu, Yanqing Xiao, Qiong Wu, Zhuozhao Zheng, Hongliang Zhao

第一作者:Zhongzhe Xiao,Yueheng Wang

论文类型:期刊论文

通讯作者:Yu Pan, Weibei Dou

ISSN号:1949-3045

是否译文:

发表时间:2018-08-30