A synthetic intelligent system for web information mining

Facing the ocean of information on Internet, people always get too much information to select and to digest, so it's hard for them to find the necessary information and knowledge. Based on Web mining and intelligent agent technologies, WMS03, a domain-oriented Web information mining model is presented in this paper. WMS03, a synthetic intelligent system can help users to mine information and knowledge on the Web quickly and effectively. First, the user can provide some pages or text documents or keywords or URLs as preference guidance for collecting information. WMS03 uses Machine Learning algorithms to extract features from this initiative information and to automatically learn the user's interests in special domains. Second, using intelligent agents, the system searches relevant information and monitors changes on the Web sites. Third, WMS03 uses expert systems with heuristic knowledge to cluster and filter information. Fourth, using neural networks and intelligent agents, WMS03 mines information and knowledge, and recommends new information to the user automatically.