OSIRRC 2019
The Open-Source IR Replicability Challenge

Workshop website: https://osirrc.github.io/osirrc2019/

OSIRRC 2019 aims to address the replicability challenge for ad hoc document retrieval. That is, how can we make it easy for others to replicate our results? Trivially, replicability ensures repeatability, and is a stepping stone toward reproducibility. Our vision is to build Docker-based infrastructure for replicating results on standard ad hoc test collections (newswire, web, etc.). Participants in OSIRRC 2019 will help build consensus on the Docker specifications and contribute Docker images that conform to the agreed-upon specifications.

We are soliciting two kinds of contributions from the community:

Organizers

Ryan Clancy
University of Waterloo
Canada
Nicola Ferro
University of Padua
Italy
Claudia Hauff
TU DELFT
The Netherlands
Jimmy Lin
University of Waterloo
Canada
Tetsuya Sakai
Waseda University
Japan
Ze Zhong Wu
University of Waterloo
Canada

Important Dates

Docker images due submission deadline Fri, Jun 14, 2019
Position papers and Docker papers submission deadline Fri, Jun 14, 2019
Position and Docker papers notifications Fri, Jun 28, 2019
Camera Ready Fri, Jul 5, 2019
Workshop day July 25, 2019