|
|
|
                                          
|
Return to Session Va: Language models
Most previous work on the recently developed language-modeling approach to information retrieval focuses on document-specific characteristics, and therefore does not take into account the structure of the surrounding corpus. We propose a novel algorithmic framework in which information provided by document-based language models is enhanced by the incorporation of information drawn from clusters of similar documents. Using this framework, we develop a suite of new algorithms. Even the simplest typically outperforms the standard language-modeling approach in precision and recall, and our new interpolation algorithm posts statistically significant improvements for both metrics over all three corpora tested.
@inproceedings{1009027, author = {Oren Kurland and Lillian Lee}, title = {Corpus structure, language models, and ad hoc information retrieval}, booktitle = {SIGIR '04: Proceedings of the 27th annual international conference on Research and development in information retrieval}, year = {2004}, isbn = {1-58113-881-4}, pages = {194--201}, location = {Sheffield, United Kingdom}, doi = {http://doi.acm.org/10.1145/1008992.1009027}, publisher = {ACM Press}, }  ©2005 Association for Computing Machinery |
