基于智慧家庭Smart Home可配置资源的多模态人机交互的研究与实现

发布时间：2018-04-27 09:27

本文选题：智慧家庭 + 多模态人机交互　；参考：《东北大学》2012年硕士论文

【摘要】：随着计算机及其相关技术的发展和人们生活水平的不断提高,人们对计算机的要求不再是网上冲浪、办公、娱乐等,而是希望它能用于家庭生活的方方面面,例如：家电控制、室内环境控制等,因而家庭生活的智能化成为了家庭生活发展的必然趋势。目前,图形化界面人机交互方式是应用于人与计算机交互的主要方式,虽然这种方式已经达到对设备的有效控制,但是人们的感受作为评价交互方式优劣的重要因素没有考虑在内,对操作人员的素质要求也比较高,尤其是残障人士根本无法使用该系统,致使用户与计算机的交互过程中存在很大的局限。基于这些原因,本文提出了一种更适合用户与系统交互的方式,即多模态人机交互方式。针对智慧家庭系统,设计并实现了多模态的人机交互模块和智慧家庭系统的资源配置模块,其贡献点可以概括如下： (1)在配置界面显示上采用了XML技术,并扩展了XML和：XML Schema的传统用途,即在XML中增添界面显示元素,通过XML转换器把XML转换成界面元素,用于界面显示；通过：XML Schema转换器把XML Schema转换成XML元素模板,再通过XML转换器把XML元素模板转换成半界面元素。XML与XML Schema新的用途适用于智慧家庭资源配置,增加了界面显示的灵活性。 (2)设计了具有扩展能力的人机交互输入接口,并对其进行了多种实现,如：语音输入实现、电话语音输入实现、MSN输入实现、Gtalk输入实现、Skype输入实现和Google日历输入实现。人机交互输入接口方便了输入方式的扩展,流行IM输入和日历输入实现充分考虑用户的行为习惯,方便用户对计算机的控制。 (3)设计了具有扩展能力的人机交互输出接口,并对其进行了多种实现,如：文字转换语音输出实现、命令控制输出实现和视频输出实现。人机交互输出接口方便了输出方式的扩展。 (4)设计实现了智慧家庭的配置模块,主要包括系统信息资源、家庭用户资源、硬件资源的配置和软件资源的配置,硬件资源包括：房间、设备的配置；软件资源包括：浏览器、鼠标、新闻播报和控制设备指令的配置。配置模块为资源变更提供了较强的伸缩空间,方便了用户对家中资源的管理。
[Abstract]:With the development of computer and its related technology and the improvement of people's living standard, people's demand for computer is no longer surfing, office, entertainment and so on, but hoping that it can be used in all aspects of family life, such as: home appliance control, etc. Indoor environment control, so the intelligent family life has become an inevitable trend of family life development. At present, the graphical interface human-computer interaction is the main way to apply to human and computer interaction, although this way has achieved the effective control of the device, However, people's feelings are not taken into account as an important factor in evaluating the merits and demerits of interaction methods, and the quality of the operators is also quite high, especially for the disabled who simply cannot use the system. The interaction between the user and the computer is very limited. For these reasons, this paper proposes a more suitable way for user to interact with the system, that is, multimodal human-computer interaction. The multi-modal man-machine interaction module and the intelligent family system resource allocation module are designed and implemented for the intelligent family system. The contribution points can be summarized as follows: 1) using XML technology in configuration interface display, and extending the traditional use of XML and: XML Schema, that is, adding interface display element in XML, converting XML into interface element through XML converter for interface display; The XML Schema is converted into XML element template by the XML Schema converter, and the XML element template is converted into the half interface element by XML converter. The new uses of XML element template and XML Schema are suitable for the intelligent family resource configuration, which increases the flexibility of interface display. (2) the man-machine interactive input interface with extended capability is designed and implemented, such as voice input, telephone voice input, Google input and Google calendar input. The man-machine interactive input interface facilitates the expansion of the input mode. The popular IM input and calendar input implement fully consider the user's behavior habits and facilitate the user's control of the computer. 3) the man-machine interactive output interface with extended ability is designed and implemented, such as: text conversion speech output, command control output and video output. The man-machine interactive output interface facilitates the expansion of the output mode. 4) the configuration module of intelligent family is designed and implemented, including system information resource, home user resource, hardware resource configuration and software resource configuration, hardware resource including room, equipment configuration, software resource including browser, Mouse, news broadcast and control device command configuration. The configuration module provides a strong expansion space for resource change and facilitates the user to manage the resources at home.
【学位授予单位】：东北大学
【学位级别】：硕士
【学位授予年份】：2012
【分类号】：TP11;TP334.7

【参考文献】