基于爬虫的用户迁徙网络的设计与实现

发布时间：2018-03-13 23:10

本文选题：用户迁徙网络　切入点：网络爬虫　出处：《科技通报》2013年09期 　论文类型：期刊论文

【摘要】：在传统的互联网中,往往是由节点表示网站,节点之间的边表示两个网站之间有物理链接。由于直观的反应了网络状态,这种网络模型得到了广泛的应用。但当研究一些基于网络的高级应用如探讨用户访问网络、在各网站间的分布情况时,传统的互联网有其局限性。本文尝试研究不同网站之间的共同用户如何进行"网络迁徙"。我们使用爬虫搜集网络中的信息,构建了一个"用户迁徙"网络:网络中的节点代表网站,两个节点之间有边表示在一段时间内这两个网站有相同的用户访问,节点之间的权值代表了一段时间内可能访问这两个网站的共同用户的数量。这种用户迁徙网络不仅可以使我们了解互联网中用户的兴趣分布,而且还可以作为研究平台广泛应用于搜索或者网络广告投放研究等方面。
[Abstract]:In the traditional Internet, the site is often represented by nodes, and the edges between nodes indicate that there is a physical link between the two websites. This kind of network model has been widely used. However, when studying some advanced applications based on network, such as discussing the distribution of users' access to the network, The traditional Internet has its limitations. This paper attempts to study how common users of different websites can "migrate on the web". We use crawlers to gather information from the web. A "user migration" network is constructed: the nodes in the network represent websites, and the edges between the two nodes indicate that the two sites have the same user access for a period of time. The weights between nodes represent the number of common users who may visit the two sites for a period of time. This user migration network not only allows us to understand the distribution of users' interests in the Internet. And also can be widely used as a research platform in search or network advertising research and other aspects.
【作者单位】：郑州升达经贸管理学院;
【基金】：河南省教育厅科学技术研究重点项目(12B520071) 郑州市科技发展计划项目(攻关计划)
【分类号】：TP393.02

【相似文献】