International Journal of Computer Science & Engineering Technology

ISSN : 2229-3345

Open Access
Open Access

ABSTRACT

Title : Improvement of performance of web crawlers for efficient web searching and crawling
Authors : Dr.P.Jaganathan, S.Jaiganesh, P.Babu
Keywords : web crawler, best-first, breadth-first, pagerank, shark-search, HITS, precision, recall, accuracy and F- measures
Issue Date : April 2013
Abstract :
The effectiveness of a crawler directly affects the efficiency of the searching quality of the web search engines. As the crawler interacts with billions of hosts or servers over a period of weeks or months, the issues of validity, flexibility and manageability are of major importance. Also crawler could retrieve some other information, which may be of unimportant to the search from the HTML files as it is parsing them to get the new URLs. In this paper, an attempt has been made to improve the performance of the web crawler by analyzing certain features of several algorithms such as best-first, breadth-first, pagerank, shark search and HITS. For this, various performance parameters such as precision, recall, accuracy and F-Score are taken into consideration. Based on the output parameters, an analysis is made for the improvement of web crawler towards web searching.
Page(s) : 311-318
ISSN : 2229-3345
Source : Vol. 4, Issue.4

Copyright © 2010-2024 IJCSET KEJA Publications