基于用户收益的归并比较评测方法研究

发布时间：2018-01-25 14:38

本文关键词： 搜索引擎归并比较评测点击用户收益　出处：《北京大学》2013年硕士论文　论文类型：学位论文

【摘要】：归并比较评测方法是一种有效的比较两个搜索引擎结果质量优劣的评测方法。本文对在这类方法中考虑用户收益的方式进行了深入的研究，主要贡献包括以下三个方面： 1）本文提出了基于点击收益的归并比较评测方法。这类方法通过定义文档收益，将文档的排序位置引入打分函数中，从而改善了已有方法对位置信息利用不够充分的问题，提高了比较结果的准确率和效率。在提出的新方法中，Softmax形式的基于点击收益的平衡归并法能够很好地替代已有方法中的最优方法，减少计算代价而不损失准确率和效率。 2）本文提出了基于收益比的归并比较评测方法。这类方法利用理想收益来衡量列表在归并函数中的贡献，使用收益比的打分函数，通过归一化列表的点击收益，消除了两个列表贡献不同造成的偏向问题。实验证明，使用收益比的打分函数有效地提高了概率归并法的准确率和收敛效率，并放宽了归并比较评测方法中比较函数对归并函数的限制，，使得归并函数可以更加灵活。 3）本文提出了序列化归并法。这种方法的归并函数利用文档在两个列表中的文档收益进行归并，它还可以利用用户点击数据很好地改善归并文档列表质量。这种方法为以后的归并比较评测方法研究提供了另一种很好的思路和方向。
[Abstract]:Merging comparative evaluation method is an effective evaluation method to compare the quality of two search engine results. This paper makes a deep research on the way of considering the user's income in this kind of method. The main contributions include the following three areas: 1) this paper proposes a method of comparison and evaluation based on click-benefit, which introduces the sorting position of documents into the scoring function by defining the income of the document. Thus, the problem of insufficient use of location information by existing methods is improved, and the accuracy and efficiency of comparison results are improved. In the proposed new method. The Softmax based equilibrium merging method based on click-benefit can replace the optimal method of the existing methods and reduce the computational cost without loss of accuracy and efficiency. 2) this paper presents a comparison and evaluation method based on income ratio, which uses the ideal income to measure the contribution of the list in the merge function, and uses the scoring function of the income ratio. Through the click income of normalized list, the bias problem caused by the difference of contribution between the two lists is eliminated. The experiment proves that the accuracy and convergence efficiency of probability merging method are improved effectively by using the scoring function of income ratio. The restrictions of comparison function on merging function in comparison and evaluation method are relaxed, so that the merging function can be more flexible. 3) A serialization and merging method is proposed in this paper. The merging function of this method takes advantage of the document income in two lists to merge. It can also improve the list quality of merged documents by using user click-through data. This method provides another good way of thinking and direction for the later research on comparison and evaluation of merging documents.
【学位授予单位】：北京大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP301.6;TP391.3

【相似文献】