Application For Analyzing Online Product Information By Web Content Mining

With a tremendous information growth in worldwide wed and increases in adoption of internet by many business and individuals, Internet has turned into a data source which contains information required by many E-businesses and other. Internet has a vast collection of data but it is not easy to extract the information which you need from the abundant data available in the Internet. The process of exacting patterns from data is referred as data mining. Data mining is used to fetch information (of what we want) from the abundant data. Web based data mining is the application of data mining techniques to discover patterns from the web. By web mining we can automatically discover and extract information from web documents and services. Web mining can be broadly defined as finding, fetching and analysis of useful information from the Internet. Web mining is classified into three types based on the way you fetch the data from the internet.

Web structure mining: Web mining here is done based on the relationship between Web pages linked by information or direct link connection. This structure data is discoverable by the provision of web structure schema through database techniques for Web pages. Web structure mining aims at developing techniques to take advantage of the collective judgment of web page .

Web usage mining: This type of web mining allows for the collection of Web access information for Web pages. Web usage mining is known as Web log mining and click stream analysis , it focuses on techniques to study the user behavior when navigating the web.

Web content mining: It refers to the discovery of useful information from web contents, including text, image, audio, video, etc. Web content mining describes the discovery of useful information from the content of web pages or Web documents.

In this project we built a web based data mining application (using opensource technologies) which is based on web content mining concept. This project is mainly divided into three phases. First phase is related to data extraction from web. Second phase deals with data transformation and loading. And tabular,bar,pie chart reports (as per the client required dimensions) are generated in Final phase.