Search

In this paper, we present our study on building a Web graph for the Malaysian Web based on the crawling of Malaysian Web sites. Given the constructed Web graph, interesting characteristics have been studied, such as the in-degree, out-degree, the distribution of power law, bow-tie structure and the strongly-connected components (SCCs). Besides, more important insight could be obtained from analyzing the hyperlinks among the hosts. Similar to Web graph, host graph serves as an informative source for enhancing crawling and searching methodologies, predicting Web growth and for Web sociology study. To date, Web or host graphs have been built for the global web and other nations. Hence, being a subset of the global Web, it would also be interesting to compare the characteristics of Malaysian host graph with the global web and other nations'. This research outputs a Malaysian Web graph, a Malaysian host graph and studies on the characteristics of these graphs. The graphs portray characteristics that are consistent with the graphs created for other nations. There are irregularities to the graphs where it is discussed at length to justify to anomalies.

Due to the rapid increase of information in the World Wide Web, there exists an explosion of information on the Web that may overwhelm the common Web user. The Web user may find it quicker or more efficient to browse the Web by reading summaries of Web sites. This paper proposes WebSum to compress Web site content into a summary. WebSum is an enhancement of the SumBasic algorithm, that was mainly used for multi-document summarization. In the case of Web sites, we find that several Web characteristics such as title and keywords can be used to extract sentences that may represent the overall topic of the Web site. Initial results show that WebSum is able to reveal sentences relate to the concept of the Web site. WebSum is then evaluated against the original algorithm of SumBasic.