DSphere: A source-centric approach to crawling, indexing and searching the world wide web

被引：0

作者：

Bamba, Bhuvan ^{[1
]}

Liu, Ling ^{[1
]}

Caverlee, James ^{[1
]}

Padliya, Vaibhav ^{[1
]}

Srivatsa, Mudhakar ^{[1
]}

Bansal, Tushar ^{[1
]}

Palekar, Mahesh ^{[1
]}

Patrao, Joseph ^{[1
]}

Li, Suiyang ^{[1
]}

Singh, Aameek ^{[1
]}

机构：

[1] Georgia Inst Technol, Coll Comp, Atlanta, GA 30332 USA

来源：

2007 IEEE 23RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING, VOLS 1-3 | 2007年

关键词：

D O I：

暂无

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

We describe DSPHERE1 - a decentralized system for crawling, indexing, searching and ranking of documents in the World Wide Web. Unlike most of the existing search technologies that depend heavily on a page-centric view of the Web, we advocate a source-centric view of the Web and propose a decentralized architecture for crawling, indexing and searching the Web in a distributed source-specific fashion. A fully decentralized crawler is developed to crawl the World Wide Web where each peer is assigned the responsibility of crawling a specific set of documents referred to as a source collection. Link analysis techniques are used for ranking documents. Traditional link analysis techniques suffer from problems like slow refresh rate and vulnerabilities to Web Spam. We propose a source-based link analysis approach, which computes fast and accurate ranking scores for all crawled documents.

引用

页码：1490 / +

页数：2

共 50 条

[31] Guide to searching and researching on the Internet and the World Wide Web.
Rowan, DC
LIBRARY JOURNAL, 1999, 124 (06) : 135 - 135
[32] Searching the World Wide Web: an evaluation of available tools and methodologies
Jenkins, C
Jackson, M
Burden, P
Wallis, J
INFORMATION AND SOFTWARE TECHNOLOGY, 1998, 39 (14-15) : 985 - 994
[33] Prospective indexing for enhanced retrieval of medical documents on the World Wide Web
Schell, CL
Rathe, RJ
JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 1997, : 1000 - 1000
[34] Creatures of the Web: Spiders, robots, wanderers, and other search engines crawling the World Wide Web.
Chadwick, SS
ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 1996, 211 : 54 - CINF
[35] Effective searching in the World Wide Web: search engines and search techniques
Teuteberg, F
WIRTSCHAFTSINFORMATIK, 1997, 39 (04): : 373 - &
[36] Using the informant for searching for analytical chemistry information on the World Wide Web
Heller, SR
TRAC-TRENDS IN ANALYTICAL CHEMISTRY, 1997, 16 (04) : 174 - 180
[37] Tagging of and searching: Search retrieval effectiveness folksonomies on the World Wide Web
Morrison, P. Jason
INFORMATION PROCESSING & MANAGEMENT, 2008, 44 (04) : 1562 - 1579
[38] Searching the World Wide Web - Search engines, subject directories, and more
Gold, HE
14TH ANNUAL COMPUTERS IN LIBRARIES '99 PROCEEDINGS: IN COOPERATION WITH THE SPECIAL LIBRARIES ASSOCIATION, 1999, : 53 - 58
[39] World Wide Web CBIR Searching Using Query by Approximate Shapes
Deniziak, Roman Stanislaw
Michno, Tomasz
DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE, 2019, 801 : 85 - 93
[40] The World Wide Web: a growing source of electrophysiologic evidence
H.-D. Esperer
Herzschrittmachertherapie und Elektrophysiologie, 1999, 10 (3): : 151 - 153

← 1 2 3 4 5 →