“情绪面孔”和“情绪肢体语言”文互认知的神经电生理研究

发布时间：2018-07-05 11:26

本文选题：情绪认知研究 + 面孔识别　；参考：《上海交通大学》2012年硕士论文

【摘要】：人类的非语言性情绪认知主要依赖多渠道的信息感知来实现，包括面部表情、肢体姿势、身体动作、声音、甚至是生理信号。情绪肢体语言，和面孔表情，作为整个身体不可或缺的部分，，共同表达个体的情绪状态。随着“情绪肢体语言”研究的展开，以及研究界对于“面孔识别”和“肢体识别”神经机制的认识深入，情绪肢体语言和情绪面孔的交互认知研究也逐渐兴起。目前，“情绪肢体语言和面孔情绪交互作用”的研究结论集中在行为学结果和ERP早期成分(P1)的特征上，对其神经电生理机制的认知仍然不十分清晰。因此，本研究通过设计情绪认知实验，利用事件相关电位和脑地形图分析方法，探索面孔情绪和肢体情绪交互认知的神经电生理机制。研究内容包括： (1)、设计面部情绪和肢体情绪交互认知实验将四种面部表情(伤心、微伤心、开心、微开心)和两种肢体情绪(伤心、开心)刺激进行组合，设计面孔情绪识别任务的电生理认知实验 (2)、验证面部表情和肢体情绪交互影响作用的行为学结果从行为学的打分值、反应时间等结果角度，验证情绪肢体语言对面孔表情识别的影响。 (3)、探索面孔表情和肢体情绪交互作用的神经生理机制通过对ERP早(N1，N170)、晚期(P2，LPc)成分的分析，以及ERP差异波脑地形图分析，比较不同肢体语言对相同的面部情绪认知的影响，解释该交互影响作用的神经机制。本研究的结论包括： (1)、行为学结果表明，当搭配开心的肢体情绪时，被试对情绪面孔的打分值显得高一些，判断会偏向于“开心”，而搭配悲伤的肢体情绪时，判断会偏向于“悲伤”，证明肢体语言的存在影响了被试对面孔情绪的判断；并且，肢体情绪对面孔情绪判断的影响与面孔情绪程度相关，情绪越强烈，交互影响作用越小，情绪越模糊，交互影响作用越明显。 (2)、N170研究结果表明，被试对于开心的肢体语言更加敏感，当搭配开心的肢体语言时，情绪面孔将诱发幅值更大、潜伏期更短的N170成分。本研究提出了肢体语言对情绪面孔识别的影响与结构化处理特异的N170相关的可能性。 (3)、P2研究结果表明，相比悲伤的肢体情绪，面孔表情搭配开心的肢体情绪时，显著地激发幅值更大、潜伏期更短的P2成分，证明了P2是肢体、面孔情绪交互的一个标志成分。 (4)、差异波脑地形图结果显示，肢体情绪和面孔情绪的交互作用在额中央区的100 300ms时间窗内启动发生。这个结论与我们的预期比较一致，也与其他的研究结论一致。 (5)、我们在ERP波形的后期(300 800ms)，观察到了情绪一致/不一致效应，具体来说，悲伤开心、开心悲伤这两个“不一致”组合刺激比悲伤悲伤、开心开心的“一致”组合刺激，激活了更强的全脑活动。这个结果从一定程度上验证了之前的研究结论。该研究是对面孔、肢体双模态情绪认知研究的一次探索，在先前研究结论的基础上，提供了新的神经电生理机制证据。
[Abstract]:Human nonverbal emotion cognition is mainly dependent on multi-channel information perception, including facial expression, body posture, body movements, sound, even physiological signals. Emotional body language, and face expression, as an integral part of the whole body, together form individual emotional state. With the study of "emotional body language". As well as the understanding of "face recognition" and "limb recognition", the research on the interaction of emotional body language and emotional face is gradually rising. At present, the conclusion of "emotional body language and face mood interaction" is focused on the characteristics of behavioral and ERP early components (P1). The cognition of its electrophysiological mechanism is still not very clear.
Therefore, by designing emotional cognitive experiments and using event related potential and brain map analysis, the study explored the electrophysiological mechanism of the interactive cognition of face and limb emotions.
(1) design facial emotion and emotional interaction cognitive experiments.
The combination of four facial expressions (sad, sad, happy, micro happy) and two kinds of emotional (sad, happy) stimuli to design the electrophysiological cognitive experiment of face emotion recognition task
(2) behavioral results to verify the interactive effects of facial expressions and body emotions.
The influence of emotional body language on facial expression recognition is verified from the scores of behavioral scoring and reaction time.
(3) explore the neurophysiological mechanism of facial expression and emotional interaction.
By analyzing the components of ERP early (N1, N170), late (P2, LPc) and ERP differential wave brain topographic map, the influence of different body language on the same facial emotion cognition was compared and the neural mechanism of the interaction effect was explained.
The conclusions of this study include:
(1) the behavioral results show that when they match the happy body mood, the scores of the subjects appear to be higher, and the judgment tends to be "happy", and when they match the sad limbs, the judgment tends to be "sad", proving that the existence of body language affects the judgment of the face, and the emotion is opposite to the body. The influence of hole emotion judgment is related to the emotional level of the face. The stronger the emotion, the smaller the interaction effect. The more ambiguous the emotion is, the more obvious the interaction effect is.
(2) the results of the N170 study showed that the subjects were more sensitive to the happy limb language. When they matched the happy body language, the emotional face would induce greater amplitude and shorter N170 components in the incubation period. This study suggested the possibility of the influence of body language on the recognition of emotional face and the possibility of structural specific N170.
(3) the results of the P2 study showed that compared to the sad limb mood, the face expression with the happy limb emotion significantly stimulated the larger amplitude and the shorter P2 component in the incubation period, which proved that P2 was a symbol of the emotional interaction of the limbs and the faces.
(4) the results of differential wave brain topography showed that the interaction of limb and face mood started in the 100 300ms time window of the central area. This conclusion is in accordance with our expectations, and is consistent with other research conclusions.
(5) in the later period of the ERP waveform (300 800ms), we observed the emotional consistency / disagreement effect. Specifically, the two "inconsistent" combination stimuli, sad and happy, happy and sad, were more exciting than sad, happy and happy, and activated the stronger whole brain activity. This result proved to a certain extent the previous study. Conclusion.
This study is an exploration of the research on the dual modality emotional cognition of faces and limbs. Based on previous studies, it provides new evidence for electrophysiological mechanism.
【学位授予单位】：上海交通大学
【学位级别】：硕士
【学位授予年份】：2012
【分类号】：R338

【参考文献】