Open Access Open Access  Restricted Access Subscription Access

Performance Evaluation of Desktop Search Engines Using Information Retrieval Systems Approaches

Shah Khusro,
Shaukat Ali,
Iftikhar Alam,
Irfan Ullah,


Effective and easy access to stored information is a fundamental computer users' need. Advancements in storage technology and ubiquity of digital gadgets enabled users to generate tons of information. Ultimately, raise the demand for efficient schemes to search and retrieve the stored information. Desktop search engines (DSEs) are developed for helping users in finding information on their desktops quickly and easily. However, the availability of several DSEs troubled users in their selections for making their entire experience of using personal computers less frustrating. This paper introduces a novel systematic approach for performances evaluations of DSEs by leveraging the scientific methods from information retrieval systems. The proposed methodology is based on Cranfield approach consisting of setting several null hypotheses (H_0), developing of static documents and queries collections, and using scientific measures for relevancy measurements. Statistical analysis is performed to confirm significance of the hypotheses and measurements. Copernic and Google are selected as case tools for executing and confirm validity of the methodology. The methodology is generic and can be applied for performances evaluations of any DSE. Results obtained from the test exercises indicated that the methodology can provide detailed, accurate, and useful information for performance evaluation of any DSE.


Desktop search; Information retrieval; Recall; Precision

Citation Format:
Shah Khusro, Shaukat Ali, Iftikhar Alam, Irfan Ullah, "Performance Evaluation of Desktop Search Engines Using Information Retrieval Systems Approaches," Journal of Internet Technology, vol. 18, no. 5 , pp. 1043-1055, Sep. 2017.

Full Text:



  • There are currently no refbacks.

Published by Executive Committee, Taiwan Academic Network, Ministry of Education, Taipei, Taiwan, R.O.C
JIT Editorial Office, Library and Information Center, National Dong Hwa University
No. 1, Sec. 2, Da Hsueh Rd. Shoufeng, Hualien 97401, Taiwan, R.O.C.
Tel: +886-3-931-7017  E-mail: