Welcome to the User Simulation Community

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system, enabling researchers to model and analyze user behaviour, generate synthetic data for training, and evaluate interactive AI systems (such as search engines, recommender systems, and conversational assistants) in a controlled and reproducible manner. User simulation has profound implications for diverse fields and plays a vital role in the pursuit of Artificial General Intelligence. [read more here]

This website aims to be a central hub for the user simulation community, fostering collaboration, knowledge sharing, and progress in this exciting field.

Resources

• FnTIR book “User Simulation for Evaluating Information Access Systems” (Balog and Zhai, 2024)
• Annotated bibliography of papers on Conversational Information Access
• Simulation toolkits
• Tutorials

Events

• SIGIR 2024 workshop on Simulations for Information Access (Sim4IA) - report
• SIGIR 2011 workshop on Simulation for IR Evaluation (Sim4IR) - report

Join the Mailing List

Stay connected with the user simulation community by joining our mailing list: [email protected].