|
|
|
                                          
|
Return to Session I: Opening session
Although information retrieval research has always been concerned with improving the effectiveness of search, in some applications, such as information analysis, a more specific requirement exists for high accuracy retrieval. This means that achieving high precision in the top document ranks is paramount. In this paper we present work aimed at achieving high accuracy in ad-hoc document retrieval by incorporating approaches from question answering(QA). We focus on getting the first relevant result as high as possible in the ranked list and argue that traditional precision and recall are not appropriate measures for evaluatin this task. We instead use the mean reciprocal rank(MRR) of the first relevant result. We evaluate three different methods for modifying queries to achieve high accuracy. The experiments done on TREC data provide support for the approach of using MRR and incorporating QA techniques for getting high accuracy in ad-hoc retrieval task.
@inproceedings{1008996, author = {Chirag Shah and W. Bruce Croft}, title = {Evaluating high accuracy retrieval techniques}, booktitle = {SIGIR '04: Proceedings of the 27th annual international conference on Research and development in information retrieval}, year = {2004}, isbn = {1-58113-881-4}, pages = {2--9}, location = {Sheffield, United Kingdom}, doi = {http://doi.acm.org/10.1145/1008992.1008996}, publisher = {ACM Press}, }  ©2005 Association for Computing Machinery |
