Foundations and Trends in Information Retrieval.
A curated collection of essential papers and publications in user simulation.
Open-source frameworks and libraries for building user simulation models.
Step-by-step guides to help you get started with user simulation techniques.
Upcoming workshops, conferences, and seminars focused on user simulation.
Research Domains
Interdisciplinary Community
A central hub for an interdisciplinary community—bridging IR, dialogue systems, user modeling, ML, and economics—to advance robust, human-centric AI via simulation.
Information Retrieval
Dialogue Systems
Recommender Systems
Economics
Key Resource
Featured Publication
Authors
Publication
Pages 1-261
Year: 2024
User Simulation for Evaluating Information Access Systems
Abstract
Information access systems, such as search engines, recommender systems, and conversational assistants, have become integral to our daily lives as they help us satisfy our information needs. However, evaluating the effectiveness of these systems presents a long-standing and complex scientific challenge.
This monograph focuses on providing a thorough understanding of user simulation techniques designed specifically for evaluation purposes. We systematically review the major research progress in user simulation, covering frameworks, models, and algorithms for simulating user interactions with search engines, recommender systems, and conversational assistants.