海量数据查询优化算法的研究

发布时间：2018-01-04 23:28

本文关键词：海量数据查询优化算法的研究　出处：《长春工业大学》2015年硕士论文　论文类型：学位论文

【摘要】：随着计算机应用系统和网络技术不断的发展和完善,当前,越来越多的商业和政府部门都需要操作海量数据,如物流行业、水利部门、科研部门等这些部门处理的数据量通常都非常大。并且当前的数据包括报表、文字、声音、图像、等各种不同种类和层次的信息,这些数据有着巨大的价值。当数据库的数据量过大时,会出现系统效率低、消耗大等问题；另一方面数据里也有很多无用的冗余,设计人员需要在存储、管理、处理、优化等各个环节中加以处理,提取出所需要的信息。所以海量数据存储管理在各行业的信息化过程中越来越重要,受到了业内人士的广泛关注,因此对海量数据存储查询算法的研究就很必要。本文综述了海量数据管理技术的研究及应用现状,在介绍了数据库的存储优化数据管理的基础上,基于索引应用、top-k查询算法、SQL语句、页面分割等方面的一些优化算法和技术,提出了一整套综合性的优化方案,并给出了具体操作和实验数据,最后设计与实现了大型房产收费系统,收费系统在各个环节细致设计、全面优化。经实验测试后,可以明显看出房产收费系统的运行和查询速度有了明显的提高。由此可见,文中采用的优化文法对海量数据的查询优化是正确有效的。
[Abstract]:With the development of computer application system and network technology continues to improve and, at present, more and more commercial and government departments are required to operate the massive data, such as the logistics industry, water conservancy departments, scientific research departments and other departments of these data are usually very large. And the current data including statements, text, voice, image, etc. different types and levels of information, these data are of great value. When the database is too large, there will be low system efficiency, high consumption; on the other hand, there are a lot of data redundancy, designers need in the storage, management, processing, handling all aspects of optimization etc. and extract the needed information. So the information process of mass data storage and management in various industries are more and more important, has been widespread concern in the industry, so the massive data storage and query count The research is very necessary. This paper summarizes the research and application of massive data management technology, introduces the database storage optimization based on the management of data, based on the index application, Top-k query algorithm, SQL statement, and other aspects of page segmentation algorithm and some optimization techniques, puts forward a set of comprehensive optimization scheme, and gives the specific operation and experimental data, the design and Realization of the large real estate toll system, toll system in all aspects of the detailed design, comprehensive optimization. Through testing, can be clearly seen from the property fee system operation and query speed has been significantly improved. Thus, the query optimization of grammar optimization of massive data is correct and effective.

【学位授予单位】：长春工业大学
【学位级别】：硕士
【学位授予年份】：2015
【分类号】：TP311.13

【参考文献】