Based-on Vector Space Model Research and Implementation of Web Filtering

This paper proposes a new information filtering method and implements it,which applies two-level filtering strategy and combines filtering technology based on URL and content filtering. It only executes content filtering when the requested URL isn't in white URL lists and black URL lists,and updates URL lists according to content filtering step's resulan this way,it has both real-time characteristic of URL filtering and comprehensive characteristic of content filtering. The web page filtering system captures HTTP packets by using Winsock 2 SPLextracts web pages content by applying the new proposed method and represents text by vector space modallt proposes a two-stage filtering arithmetic based on vector space modal and realizes it's system. Experimental results show that the system has good filtering accuracy and performance.