Depressive Tendency Recognition by Fusing Speech and Text Features: A Comparative Analysis

作者：Yimin He, Xiaoyong Lu, Jingyi Yuan, Tao Pan, Yafan Wang · 发表于：2022 13th International Symposium on Chinese Spoken Language Processing (ISCSLP) · 年份：2022 · DOI：10.1109/iscslp57327.2022.10038078 · 被引用次数：3 · 研究领域：Mental Health via Writing、Emotion and Mood Recognition、Sentiment Analysis and Opinion Mining

Depression will be accompanied by long-term depression, loss of interest, excessive guilt, and other states, seriously affecting people’s physical and mental health, causing certain harm to the individual family and society. Depressed people speak slowly, single tone, and the pause time is longer. At the same time, the expression of emotion is often accompanied by many negative words. Therefore, the combination of speech and text information using Gated Recurrent Neural Network for depression prediction, this fusion method from the signal layer to the language layer to analyze the data. It is more comprehensive than only use a single speech feature or text feature model. At the same time, the comparative analysis of different speech types, three kinds of emotional stimulus corpus, and gender was carried out. The multimodal system is more effective than a single modality, and speech type, emotional stimulus, and gender have certain effects on depressive recognition.