A Focused Crawler with Ontology-Supported Website Models for Information Agents

This paper advocated the use of ontology-supported website models to provide a semantic level solution for an information agent so that it can provide fast, precise, and stable query results. Based on the technique, a focused crawler, namely, OntoCrawler, was developed, which can benefit both user requests and domain semantics. Equipped with this technique, we have developed an ontology-supported information agent shell in Scholar domain which manifests the following interesting features: ontology-supported construction of website models, website models-supported website model expansion, website models-supported webpage retrieval, high-level outcomes of information recommendation, and accordingly proved the feasibility of the related techniques proposed in this paper.