基于Lucene的数字版权资源库的构建与应用研究

发布时间：2019-03-18 17:00

【摘要】：随着互联网的飞速发展,信息的存储与传播方式发生了巨大的变化。由于数字资源的易扩散和易传播性,数字资源给人们带来极大便利的同时,也给数字版权管理工作带来了前所未有的挑战。首先,数字版权资源依靠传统的存储方式,不能有效解决日益增长的数字资源的存储问题。其次,对于海量的数字作品如何从中快速搜索有用的信息变的越来越困难。因此构建一个对数字作品具有海量存储和快速搜索功能的数字版权资源库是必要的。本文采用Hadoop框架下的HDFS分布式文件系统,解决数字作品的海量存储问题；在数字版权资源库的快速搜索方面,先采用Lucene全文检索技术对版权元数据信息创建索引,并对索引文件进行搜索；然后采用Elasticsearch分布式搜索技术对Luc ene的索引文件进行分片存储和分布式搜索；最后本搜索引擎为用户提供友好的操作功能：数字作品管理,数字版权管理,资源库索引,资源库搜索等。本文的难点和创新点如下：分析了数字版权资源的特征,设计了易于扩展、高度容错、支持海量数据集的云存储方案；研究Lucene技术,设计了数字版权资源元数据全文检索方案；采用Elasticsearch对资源库的索引文件进行分片处理,实现了数字版权资源库的分布式索引和分布式搜索。本文主要成果是运用HDFS分布式文件系统实现数字版权资源的海量存储,采用Lucene全文检索和Elasticsearch索引分片技术对版权资源库进行分布式索引和快速检索。最终构建了一个高效的、分布式的数字版权资源库,保证海量数字作品的安全可靠存储,促进数字版权产业的资源整合,减少数字作品的传播成本,为数字作品版权信息的登记、备案、搜索和检测提供底层支撑。
[Abstract]:With the rapid development of the Internet, the storage and dissemination of information has undergone tremendous changes. Due to the easy diffusion and dissemination of digital resources, digital resources not only bring great convenience to people, but also bring unprecedented challenges to digital rights management. First of all, digital copyright resources rely on the traditional storage mode, can not effectively solve the growing number of digital resources storage problems. Secondly, it is more and more difficult to quickly search for useful information from the mass of digital works. Therefore, it is necessary to construct a digital copyright database which has the function of mass storage and fast search for digital works. In this paper, the HDFS distributed file system under the framework of Hadoop is used to solve the problem of mass storage of digital works. In the aspect of fast search of digital copyright database, firstly, Lucene full-text retrieval technology is used to create index of copyright metadata information and search index file. Then the Elasticsearch distributed search technology is used to store and distribute the index files of Luc ene. Finally, the search engine provides user-friendly operation functions: digital work management, digital rights management, database index, database search and so on. The difficulties and innovations of this paper are as follows: firstly, this paper analyzes the characteristics of digital copyright resources, designs a cloud storage scheme which is easy to expand, highly fault-tolerant and supports massive data sets, studies Lucene technology, designs a full-text retrieval scheme of digital copyright resources metadata, and designs a full-text retrieval scheme of digital copyright resources metadata. The index file of digital copyright database is partitioned by Elasticsearch, and the distributed index and distributed search of digital copyright database are realized. The main achievement of this paper is to use HDFS distributed file system to realize the mass storage of digital copyright resources. Lucene full-text retrieval and Elasticsearch index slicing technology are used for distributed indexing and fast retrieval of copyright resources. Finally, an efficient and distributed digital copyright resource database is constructed, which ensures the safe and reliable storage of massive digital works, promotes the integration of resources in digital copyright industry, and reduces the transmission cost of digital works. Provides low-level support for registration, filing, search and detection of copyright information for digital works.
【学位授予单位】：北方工业大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP391.3

【相似文献】