增强现实下面神经功能康复训练系统研发

发布时间：2018-11-23 14:38

【摘要】：面瘫是一种临床常见多发的面神经类疾病,也称面神经麻痹,患病后因为局部面神经功能障碍,发生面部表情肌群运动功能失调,主要症状表现为口眼歪斜,具体体现为额纹变浅并逐渐消失、眼睛用力闭合不全或无法闭合、睑裂增大、无法皱眉、眼泪自溢、口角斜向下垂、鼓腮向一侧漏气、咀嚼食物和说话困难、口角偏斜等。在出现严重情况时,感觉神经纤维可能会损伤,进而出现听觉功能障碍、面部肌肉麻木不适、味觉反应迟钝和唾液分泌功能障碍等,从而严重地影响面瘫患者面部表情的正常表达。生物反馈功能训练在于加强面部瘫痪肌肉的运动能力,减低亢奋肌的运动,并且提高面部肌群协调运动的能力,从而达到改善面肌功能的目的,生物反馈疗法能促进面神经重塑。基于生物反馈疗法的面神经功能康复训练是面瘫康复过程中不可或缺的一部分。本论文基于深圳市卫生计生系统科研项目,与深圳市第六人民医院合作,于2015年3月至2016年6月期间,共采集了175例表情视频数据(其中105例面瘫患者、70例正常人)。论文设计并开发了一个增强现实下的面神经功能康复训练系统,为面瘫等面神经功能患者在面肌功能训练时提供实时反馈,有助于面神经重塑,促进面神经功能康复。首先,通过网络摄像头获取人脸图像,并采用haar分类器检测人脸位置,使用intraface提取面部关键点;然后,根据关键点位置计算人脸不对称度,根据关键点的相对位移估算患者面部运动情况;最后,通过面部关键点估算人脸姿态并控制虚拟三维人脸模型的表情动作。论文基于生物反馈疗法,创新性地将增强现实技术与面神经功能康复训练相结合,完成了增强现实下面神经功能康复训练系统的设计。用虚拟三维人脸模型替换患者人脸作为直接反馈,人脸模型能实时与患者表情保持一致,此外,论文还提出了面部运动反馈和对称性反馈,将患者康复训练过程中关键部位的运动情况和面部整体不对称度反馈给患者。
[Abstract]:Facial paralysis is a common and common facial nerve disease, also known as facial paralysis, after the illness due to local facial nerve dysfunction, facial expression muscle group motor dysfunction, the main symptoms of the mouth and eye skew, The concrete manifestation is that the forehead lines become shallow and gradually disappear, the eyes are incompletely closed or unable to be closed, the eyelid fissure is enlarged, the eyebrow cannot be frowned, the tears overflow, the angle of mouth slanting to one side of the mouth, the gills are leaking out, the chewing of food and speaking is difficult, the angle of mouth is oblique, and so on. In severe cases, sensory nerve fibers may be damaged, resulting in hearing impairment, facial muscle numbness and discomfort, slow taste response and saliva secretion dysfunction, etc. Thus seriously affect the normal expression of facial expressions in patients with facial paralysis. The function training of biofeedback is to enhance the motor ability of facial paralysis muscles, reduce the movement of hyperstimulation, and improve the ability of coordination of facial muscles, so as to improve the function of facial muscles. Biofeedback therapy can promote facial nerve remodeling. The rehabilitation training of facial nerve function based on biofeedback therapy is an indispensable part of the rehabilitation process of facial paralysis. In this paper, 175 facial expression video data (105 facial paralysis patients and 70 normal persons) were collected from March 2015 to June 2016, in cooperation with the sixth people's Hospital of Shenzhen, based on the research project of Shenzhen Health and Family Planning system. In this paper, an augmented reality training system for facial nerve function rehabilitation is designed and developed, which provides real-time feedback for facial nerve function training for patients with facial paralysis and iso-facial nerve function. It is helpful for facial nerve remodeling and promoting facial nerve function rehabilitation. Firstly, the face image is obtained by the webcam, and the position of the face is detected by haar classifier, and the key points of the face are extracted by intraface. Then, the asymmetry degree of face is calculated according to the position of the key point, and the facial motion of the patient is estimated according to the relative displacement of the key point. Finally, the facial pose is estimated by the key point of the face and the facial expression movement of the virtual 3D face model is controlled. Based on biofeedback therapy, this paper innovatively combines augmented reality technology with facial nerve function rehabilitation training, and completes the design of neural function rehabilitation training system under augmented reality. The virtual 3D face model is used to replace the patient's face as direct feedback, and the facial model can keep consistent with the patient's expression in real time. In addition, the paper also proposes facial motion feedback and symmetry feedback. The movement of the key parts and the asymmetry of the face were fed back to the patients during the rehabilitation training.
【学位授予单位】：深圳大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：R745.12;TP391.41

【相似文献】