Research on the Information Collection and Data Mining of Small and Micro Enterprises Based on Big Data

In this paper, we integration of Extraction Transformation Loading technology and Web Crawler technology into one, put technological idea of ETL technology into the Web Crawler technology, Making information extraction and information processing combined into one module. Then, through the system planning and system analysis, we developed and designed the small and micro information enterprise system using page parsing technology, Java technology, database technology. In this system, we analyse the structural characteristic and syntax structure pattern of multiple target web pages first, obtain the extract rule of the information to be extracted, and then extract the matching information from the web using this rule. Finally, save the effective information to the database or exported to the Excel file. This system provides an effective method and technical support for small and micro enterprises.