Gzip-U：针对维吾尔语文本的压缩算法研究

发布时间：2018-02-01 19:28

本文关键词： 移动互联网维吾尔语数据压缩 Gzip　出处：《新疆大学》2017年硕士论文　论文类型：学位论文

【摘要】：移动互联网的发展引导着终端设备承载的信息量的与日俱增,移动用户分享的数据量的增长与4G网络的普及量密切相关。消极方面来说,移动互联网的发展对网络数据的影响和有限的带宽成为数据传输的瓶颈。在海量数据的处理中数据压缩算法逐渐受到重视。数据压缩是在不影响得知有效信息的前提下,缩小数据占用空间,以便通信更快更节省资源。本文首先概述数据压缩在大数据时代中的重要意义,陈述了数据压缩的基本概念和方法来证实压缩的重要性。从数据压缩的历史探讨逐步引入属于无损压缩的文本压缩的基本思路和几个压缩算法。其次详尽分析维吾尔文字母在Unicode编码上的分布情况,根据维吾尔文的文本压缩现状更进一步提出了对维吾尔文本的压缩方法。为了方便理解提供的客户端开发中的部分核心代码,事先简单介绍Xcode开发环境,开发语言的特性,开发模式等基础知识。最后利用Http协议上的Gzip编码,核心内容用试验的方法对维吾尔语文本提出一种改进压缩算法,命名为:Gzip-U。其主要思想是首先把词语中的每个字母分解成独立字符后转换成Unicode表中的编码类型再与前缀06比较(维吾尔文文本06区),如果包含前缀为06那先去掉前缀再把整个数据类型拼接成数组。而有些符号因为与英文的符号编码一样,不能套一个流程编码和解码。论文最后在同样的数据上的实验表明,在Unicode编码中,与Gzip相比Gzip-U算法更有效,压缩比也提高3倍。
[Abstract]:The development of mobile Internet leads to the increasing amount of information carried by terminal devices. The increase of the amount of data shared by mobile users is closely related to the popularity of 4G networks. The influence of the development of the mobile internet on the network data and the limited bandwidth become the bottleneck of the data transmission. In the processing of the massive data, the data compression algorithm is paid more and more attention. The data compression does not affect the availability of information. On the premise. This paper first summarizes the significance of data compression in the big data era. This paper describes the basic concepts and methods of data compression to prove the importance of compression. From the history of data compression, the paper discusses the basic idea and several compression algorithms of text compression which belongs to lossless compression step by step. Secondly, the dimension is analyzed in detail. The distribution of my letters in Unicode codes. According to the current situation of Uygur text compression, this paper further proposes a compression method of Uighur text. In order to understand the client development provided in part of the core code. A brief introduction of the Xcode development environment, the characteristics of the development language, development patterns and other basic knowledge. Finally, the use of Gzip code on the Http protocol. This paper presents an improved compression algorithm for Uygur language text by experimental method. The main idea is to decompose each letter in a word into separate characters, then convert it to the encoding type in the Unicode table and compare it with the prefix 06. Uygur text 06). If it contains a prefix of 06, remove the prefix before splicing the entire data type into an array. Some symbols are encoded as symbols in English. Finally, experiments on the same data show that the Gzip-U algorithm is more efficient and the compression ratio is three times higher than that of Gzip in Unicode coding.
【学位授予单位】：新疆大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP391.1

【参考文献】