面向个人体验的人机交互技术研究与应用

发布时间：2018-04-28 11:12

本文选题：交互体验裸眼 + 3D评估　；参考：《西南科技大学》2017年硕士论文

【摘要】：人机交互技术(Human-Computer Interaction,简称HCI)指的是通过输入、输出设备实现人与计算机之间交换信息的技术。人机交互技术的研究从计算机问世以来经历了多次变革,完成了以计算机为中心到以人为中心的自然人机交互的转变,并将提升用户的个人体验作为新一代人机交互设计的重要目标。面向个人体验的人机交互设计是新一代人机交互技术的发展方向。论文总结了面向个人体验的人机交互技术以用户为中心、直接三维交互、满足用户交互意图、保护用户耐性的基本特性。以增强用户体验的人机交互为核心,提出一种面向个人体验的三维交互范式(CCOT),以摄像机视角(Camera)、角色控制(Controller)、交互目标对象(Objects)、交互载体工具(Tools)四项基本条件描述三维环境中自然的人机交互过程。论文研究的面向个人体验的人机交互技术主要包括以下方面:立体显示技术、手势交互技术、肢体交互技术。立体显示技术方面,针对透镜式裸眼3D立体显示技术存在评估困难、用户易眩晕的问题,提出一种基于断层图像重影宽度的裸眼3D图像评估方法——断层宽度测量法。通过单目摄像头模拟人眼在3D可视区域拍摄裸眼图像,以重影最严重的断层处图像宽度与清晰的甜点处图像宽度相对比值作为裸眼图像质量的定量评估。根据该方法测定了人眼接收断层图像的极限参数,并用于对立体图像合成过程的不同视点排列顺序进行设计评估,为提升裸眼3D显示的个人体验提供了合理的建议方案。手势交互技术方面,针对数据手套空间定位困难的问题,设计并实现了一种基于视觉信息融合的数据手套原型设备——Visual Glove,具备旋转姿态解算与映射、弯曲度检测与识别、三维空间定位的功能。采用分级的快速模板匹配方法实现弯曲度采集值到虚拟手关节位置的快速映射。针对霍夫变换识别圆的算法在实际应用场景实时性不足、准确度不高的缺点,通过引入特征校验的霍夫变换识别手套上的发光球位置,提升了小球识别与定位的速度和准确性。肢体交互技术方面,设计了姿势序列状态链的肢体动作识别方法,通过定义离散的姿势并以一定的时序关系组织,在动作发生过程同步识别动作姿势,取得良好的交互实时性。在定义姿势时只需考虑主要的动作关节点数据特征,具有良好的灵活性和自由性,有助于提升动作识别过程的个人体验。综合所研究的自然人机交互与显示多种技术,分析了各自的特点和适用场合。应用面向个人体验的裸眼3D设计方法和姿势序列的动作识别方法构建了裸眼3D互动体验系统,通过立体视觉展示和体感交互的结合提升了系统的吸引力及趣味性,具有良好的商业宣传应用潜力。手势交互的沉浸式虚拟实验系统基于头戴式VR显示技术和手势交互技术构建,通过沉浸式坏境中真实、自然的交互提升了虚拟仿真实验的用户体验,用户满意度评价较高。通过以上交互系统的实际体验验证了所研究的面向个人体验的人机交互技术具有良好的应用价值。
[Abstract]:Human-Computer Interaction (HCI) refers to the technology of exchanging information between people and computers through input and output devices. The study of human-computer interaction has undergone many changes since the advent of computer and completed the transformation of natural computer interaction centered on the computer and human centered. Improving the personal experience of the user is an important goal of the new generation of human-computer interaction design. The human-computer interaction design for personal experience is the development direction of the new generation of human-computer interaction technology. This paper summarizes the human-computer interaction technology oriented to personal experience, which is user centered, direct three-dimensional interaction, meets user interaction intention and protects user patience. At the core of human-computer interaction to enhance user experience, a three-dimensional interactive paradigm for personal experience (CCOT) is proposed to describe the natural human-computer interaction in a three-dimensional environment with four basic conditions: camera perspective (Camera), role control (Controller), interactive target object (Objects) and interactive carrier tool (Tools). The human-computer interaction technology for personal experience mainly includes the following aspects: stereoscopic display technology, gesture interaction technology, limb interaction technology and stereoscopic display technology, in view of the difficulty in evaluating the lens type naked eye 3D stereoscopic display technology and the user's easily vertigo, a kind of naked eye 3D image evaluation based on the width of the image of the fault image is proposed. Method of estimation - fault width measurement. The naked eye image is taken in the 3D visual area by a single eye camera, and the ratio of the image width to the clear dessert image width is quantified by the ratio of the image width of the most serious fault location to the clear dessert image width. The limit parameters of the eye reception fault image are determined by this method. It is also used to design and evaluate the sequence of different view points in the process of stereoscopic image synthesis. It provides a reasonable proposal for improving the personal experience of the naked eye 3D display. In the aspect of gesture interaction, a prototype device based on visual information fusion is designed and implemented to solve the problem of the difficulty of spatial positioning of the data glove. Visual Glove, with the function of rotating attitude calculation and mapping, bending degree detection and recognition, three-dimensional space positioning. Using a fast template matching method to realize the fast mapping of the curvature acquisition value to the virtual hand joint position. The algorithm of Hof transform recognition circle is insufficient in real time and the accuracy is not high in the actual application scene. By introducing the Hof transform to identify the position of the luminous sphere on the glove, the speed and accuracy of the recognition and positioning of the ball are improved. The limb movement recognition method is designed for the gesture sequence state chain. The course synchronously identifies the action posture and achieves good interactive real time. In defining the posture, it only needs to consider the characteristics of the main joint point data. It has good flexibility and freedom, and helps to improve the personal experience of the action recognition process. The naked eye 3D design method for personal experience and the action recognition method of the postural sequence are used to construct the naked eye 3D interactive experience system. Through the combination of stereoscopic visual display and the body sense interaction, the system's attraction and interest are improved, and it has good commercial publicity and potential. The immersive virtual experiment system of hand gesture interaction Based on the construction of head wearing VR display technology and gesture interaction technology, the user experience of virtual simulation experiment is improved by the real and natural interaction in the immersive environment. The user satisfaction evaluation is high. Through the actual experience of the above interactive system, it is proved that the human-computer interaction technology for personal experience is well applied. Value.

【学位授予单位】：西南科技大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP391.41;TP11

【相似文献】