Call for Resource Papers
The annual SIGIR conference is the major international forum for the presentation of new research results, and the demonstration of new systems and techniques, in the broad field of information retrieval (IR). The 44th ACM SIGIR conference, to be held online on July 11 to 15, 2021, welcomes contributions related to any aspect of information retrieval and access, including theories, foundations, algorithms, evaluation, analysis and applications. The conference and program chairs invite those working in areas related to IR to submit high-impact original papers for review.
This year we have a special track for resource papers, separate from regular full and short papers. The conference and resource paper chairs invite those working in areas related to IR to submit original resource papers, which will be presented as posters at the conference. Submissions will be peer reviewed, and accepted resource papers will be published in the conference proceedings.
Time zone: Anywhere on Earth (AoE)
Resource paper abstracts due: Tue, Feb 23, 2021
Resource papers due: Tue, Mar 2, 2021
Resource paper notifications: Wed, Apr 14, 2021
What is a resource?
The Resources Track seeks submissions from both academia and industry that describe resources available to the community, the process and methodology of building those resources, and/or the lessons learned. Resources include, but are not restricted to:
- test collections for information retrieval and access tasks;
- documentation of designs and protocols of evaluation tasks (e.g., novel task designs implemented at evaluation forums);
- labelled datasets for machine learning;
- software tools and services for information retrieval and access; and
- software tools and services for evaluating and analyzing information retrieval and access systems.
Authors should be aware that the resource paper track will use a set of review criteria that is different from the regular full and short papers. This is outlined below.
- What is new about this resource?
- Does the resource represent an incremental advance or something more dramatic?
- Is the resource available to the reviewer at the time of review?
- Are there discrepancies between what is described and what is available?
- If the resource is data collected from people, do appropriate human subjects control board procedures appear to have been followed?
- Is the resource well documented? What level of expertise do you expect is required to make use of the resource?
- Are there tutorials or examples? Do they resemble actual uses or are they toy examples?
- If the resource is data, are appropriate tools provided for loading that data?
- If the resource is data, are the provenance (source, preprocessing, cleaning, aggregation) stages clearly documented?
- What IR research activity is enabled by the availability of this resource?
- Does the resource advance a well-established research area or a brand new one?
- Do you expect that this resource will be useful for a long time, or will it need to be curated or updated? If the latter, is that planned?
- How large is the (anticipated) research user community? Will that grow or shrink in the next few years?
Resource papers must describe original work that has not been previously published, not accepted for publication elsewhere, and not simultaneously submitted or currently under review in another journal or conference.
Submissions of resource research papers must be in English, in PDF format, and be at most 6 pages (including figures) in length + unrestricted space for references, in the current ACM two-column conference format. Suitable LaTeX, Word, and Overleaf templates are available from the ACM Website (use the“sigconf” proceedings template).
Submissions should be submitted electronically via EasyChair (resource paper track):
At least one author of each accepted paper is required to register for, and present the work at the conference.
The resource paper review process is single-blind, which means that reviewers are aware of the names and affiliations of paper authors. Therefore, unlike other paper tracks in SIGIR 2021, there is no need to hide author information in the submission. Authors should carefully go through ACM’s authorship policy before submitting a paper. Submissions which violate the preprint policy, length, or formatting requirements or are plagiarized are subject to desk-rejection by the chairs. It is also NOT permitted to double submit the content to both resource track and other track(s) of SIGIR 2021 (e.g. a resource paper for building Dataset A and a full paper containing the construction process of Dataset A in the experiment section).
To support identification of reviewers with conflicts of interest, the full author list must be specified at submission time. Authors should note that changes to the author list after the submission deadline are not allowed without permission from the PC Chairs.
Resource Paper Chairs
- Yiqun Liu, Tsinghua University, P.R.C.
- Ian Soboroff, NIST, U.S.A.
For further information, please contact the SIGIR 2021 Resource Paper Co-chairs by email to sigir2021-resource AT easychair DOT org.