连续交互空间下的混合手势交互模型

发布时间：2018-03-03 20:00

本文选题：人机交互　切入点：手势交互　出处：《软件学报》2017年08期 　论文类型：期刊论文

【摘要】：分析了触控交互技术在移动手持设备及可穿戴设备的应用现状及存在的问题.基于交互动作的时间连续性及空间连续性,提出了将触控交互动作的接触面轨迹与空间轨迹相结合,同时具有空中手势及触控手势的特性及优点的混合手势输入方法.基于连续交互空间的概念,将混合交互手势、空中手势、表面触控手势进行统一,建立了包括空中层、表面层、混合层的连续交互空间分层处理模型.给出了统一的信息数据定义及数转换流程.构建了通用性的手势识别框架,并对轨迹切分方法及手势分类识别方法进行了阐述.最后设计了应用实例,通过实验,对混合交互手势的可用性及连续空间分层处理模型的可行性进行了验证.实验结果表明,混合手势输入方式同时兼具了表面触控输入及空中手势输入的优点,在兼顾识别效率的同时,具有较好的空间自由度.
[Abstract]:This paper analyzes the current situation and problems of the application of tactile interaction technology in mobile handheld devices and wearable devices, based on the temporal continuity and spatial continuity of interactive action, In this paper, a hybrid gesture input method is proposed, which combines the contact surface track and space trajectory of tactile interactive action and has the characteristics and advantages of air gesture and touch gesture. Based on the concept of continuous interactive space, the hybrid interactive gesture is combined. The air gesture, the surface touch gesture are unified, and the air layer, the surface layer, is established. A hierarchical processing model of continuous interactive space in mixed layer is presented. The unified definition of information data and the flow of number conversion are given. A universal gesture recognition framework is constructed. Finally, an application example is designed to verify the usability of the hybrid interactive gesture and the feasibility of the continuous spatial hierarchical processing model. The hybrid gesture input mode has the advantages of both the surface touch input and the air gesture input. It has good spatial freedom while taking into account the recognition efficiency.
【作者单位】：人机交互北京市重点实验室(中国科学院软件研究所);中国科学院大学;桂林电子科技大学计算机与信息安全学院;
【基金】：国家重点研发计划(2016YFB1001402) 国家自然科学基金(61422212,61232013,61170182,61273269) 国家高技术研究发展计划(863)(2015AA020506,2015AA016305)~~
【分类号】：TP391.41

【相似文献】