Article detail · 2010
Expected browsing utility for web search evaluation
- Year
- 2010
- Type
- conference-paper
Abstract
OpenAlex · English
Most information retrieval evaluation metrics are designed to measure the satisfaction of the user given the results returned by a search engine. In order to evaluate user satisfaction, most of these metrics have underlying user models, which aim at modeling how users interact with search engine results. Hence, the quality of an evaluation metric is a direct function of the quality of its underlying user model. This paper proposes EBU, a new evaluation metric that uses a sophisticated user model tuned by observations over many thousands of real search sessions. We compare EBU with a number of state of the art evaluation metrics and show that it is more correlated with real user behavior captured by clicks.
Topics
Citations
OpenAlex cited_by_count. Not a WoS or Scopus citation count; those sources have no separate column here.
90 citations
OpenAlex cited_by_count (cache / database)
6 publications in the local catalog that cite this work (OpenAlex reference match; not the full global list).
- Simulating simple user behavior for system effectiveness evaluation 2011
- Incorporating variability in user behavior into systems based evaluation 2012
- Report on the SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation (MUBE 2013) 2013
- Chapter 5 Evaluating Web Retrieval Effectiveness 2012
- IR Evaluation 2015
- IR Evaluation 2015