[Paper] Monitoring Emotion by Remote Measurement of Physiological Signals Using an RGB Camera

作者：Genki Okada, Taku Yonezawa, Kouki Kurita, Norimichi Tsumura · 发表于：ITE Transactions on Media Technology and Applications · 年份：2017 · DOI：10.3169/mta.6.131 · 被引用次数：18 · 研究领域：Non-Invasive Vital Sign Monitoring、Heart Rate Variability and Autonomic Control、EEG and Brain-Computer Interfaces

In this paper, we propose a method of emotion monitoring using physiological signals such as RR intervals and blood volumes obtained by analyzing hemoglobin concentrations from facial color images. Emotion monitoring has great potential in areas such as market research, safety, medical and robot systems. The most popular method of emotion monitoring uses physiological signals. However, it is difficult to apply the commonly used methods in practice because special instruments such as electrodes or laser speckle flowgraphy are required to obtain physiological signals. The proposed method uses a simple RGB camera. Using 27 features calculated from the physiological signals obtained from facial RGB images, we classified five emotional states, amusement, anger, disgust, sadness and surprise, with 94% accuracy.