SMARTCRAWLER: A PERSONALIZED WEB SEARCH FOR RELEVANT WEB PAGES

被引:0
|
作者
Wardekar, Arati Anilrao [1 ]
Gupta, Poonam [1 ]
机构
[1] GH Raisoni Coll Engn & Management, Pune 412207, Maharashtra, India
关键词
Web Crawler; Inner web; URL Feature selection; IP; Site frequency; Two-stage crawler; Site Ranking; Personalized web search;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
On web we can see that web pages are not indexed by crawling in speed, it was developed many crawlers to efficiently locate inner web interfaces, due to the large amount of resources in the network and the dynamic nature of the deep web, the better result is a challenging problem. To solve this problem, we propose a two-stage framework, mainly SmartCrawler, to relevantly finding a deep web. Smart-crawler gets the seed from the seed database. First stage, Smart Crawler performs the "reverse search" that matches the user's query in the URLs. In the second step, the "Incremental Site Prioritize" is perform in which the content of the query in the form matches. Then, according to frequency matching, sort relevant and irrelevant pages and rank this page. High-ranking pages are displayed on the results page. Our proposed crawler efficiently recovers deep interfaces from large databases and achieves a higher result than other developed crawlers. We have propose a comprehensive and customized search to improve performance by considering how long we keep the log file. Before viewing the query before entering the query in the search box that is the focus, enter the search box.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Personalized generation of a complex structure of web pages
    Trausan-Matu, S
    TOWARD THE VIRTUAL UNIVERSITY: INTERNATIONAL ONLINE PERSPECTIVES, 2003, : 253 - 262
  • [2] Personalized web search with clusters
    Meng, XN
    Chen, ZX
    IC'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTERNET COMPUTING, VOLS 1 AND 2, 2003, : 46 - 52
  • [3] Proactive Web design: Increasing the retrievability of Web pages by search engines
    Schweibenz, W
    INFORMATION-WISSENSCHAFT UND PRAXIS, 1999, 50 (07): : 389 - 396
  • [4] ASYMPTOTIC ANALYSIS FOR PERSONALIZED WEB SEARCH
    Volkovich, Yana
    Litvak, Nelly
    ADVANCES IN APPLIED PROBABILITY, 2010, 42 (02) : 577 - 604
  • [5] Evaluating the Effectiveness of Personalized Web Search
    Dou, Zhicheng
    Song, Ruihua
    Wen, Ji-Rong
    Yuan, Xiaojie
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2009, 21 (08) : 1178 - 1190
  • [6] Personalized Web Search with Location Preferences
    Leung, Kenneth Wai-Ting
    Lee, Dik Lun
    Lee, Wang-Chien
    26TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING ICDE 2010, 2010, : 701 - 712
  • [7] PERSONALIZED SEMANTIC MATCHING FOR WEB SEARCH
    Jing, Kunlei
    Hao, Fei
    Zhang, Xizi
    Zhou, Yu
    2023 IEEE 39TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS, ICDEW, 2023, : 205 - 210
  • [8] Social Tagging for Personalized Web Search
    Biancalana, Claudio
    AI (ASTERISK) IA 2009: EMERGENT PERSPECTIVES IN ARTIFICIAL INTELLIGENCE, 2009, 5883 : 232 - 242
  • [9] Community Aware Personalized Web Search
    Shafiq, Omair
    Alhajj, Reda
    Rokne, Jon G.
    2010 INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM 2010), 2010, : 351 - 355
  • [10] A Novel Personalized Web Search Model
    ZHU Zhengyu
    WuhanUniversityJournalofNaturalSciences, 2007, (05) : 897 - 901