Toolkits

This page is maintained by Nolwenn Bernard and Krisztian Balog. We welcome suggestions via email.

Search Engines

Toolkit	Paper	Summary
cwl_eval	Azzopardi et al., SIGIR 2019	Implements various metrics within the C/W/L framework regarding the predicted user interactions with the ranked list of search results.
SimIIR	Maxwell and Azzopardi, SIGIR 2016	Framework for simulating users based on the Complex Searcher Model, including the actions of querying, snippet examination, relevance assessment, and stopping.
SimIIR 2.0	Zerhoudi et al., CIKM 2022	Extends the original SimIIR framework by adding a dynamic query generator, introducing user types with distinct search behaviors, and using Markov models for stopping and query generation decisions based on these user types.
SimIIR 3.0	Azzopardi et al., SIGIR-AP 2024	Extends SimIIR 2.0 with a conversational search workflow, Markovian users, cognitive states, and LLM-based components.

Recommendation

To be populated

Conversational Information Access

To be populated