Call for Resource Papers

The annual SIGIR conference is the major international forum for the presentation of new research results, and the demonstration of new systems and techniques, in the broad field of information retrieval (IR). The 44th ACM SIGIR conference, to be held online on July 11 to 15, 2021, welcomes contributions related to any aspect of information retrieval and access, including theories, foundations, algorithms, evaluation, analysis and applications. The conference and program chairs invite those working in areas related to IR to submit high-impact original papers for review.

This year we have a special track for resource papers, separate from regular full and short papers. The conference and resource paper chairs invite those working in areas related to IR to submit original resource papers, which will be presented as posters at the conference. Submissions will be peer reviewed, and accepted resource papers will be published in the conference proceedings. 

Important Dates

Time zone: Anywhere on Earth (AoE)

Resource paper abstracts due: Tue, Feb 23, 2021

Resource papers due: Tue, Mar 2, 2021

Resource paper notifications: Wed, Apr 14, 2021

What is a resource?

The Resources Track seeks submissions from both academia and industry that describe resources available to the community, the process and methodology of building those resources, and/or the lessons learned. Resources include, but are not restricted to:

  • test collections for information retrieval and access tasks;
  • documentation of designs and protocols of evaluation tasks (e.g., novel task designs implemented at evaluation forums);
  • labelled datasets for machine learning;
  • software tools and services for information retrieval and access; and
  • software tools and services for evaluating and analyzing information retrieval and access systems.

Review Criteria

Authors should be aware that the resource paper track will use a set of review criteria that is different from the regular full and short papers. This is outlined below.

Novelty

  • What is new about this resource?
  • Does the resource represent an incremental advance or something more dramatic?

Availability

  • Is the resource available to the reviewer at the time of review?
  • Are there discrepancies between what is described and what is available?
  • Are the licensing/terms of use sufficiently open as to allow most academic and industry researchers access to the resource?
  • If the resource is data collected from people, do appropriate human subjects control board procedures appear to have been followed?

Utility

  • Is the resource well documented? What level of expertise do you expect is required to make use of the resource?
  • Are there tutorials or examples? Do they resemble actual uses or are they toy examples?
  • If the resource is data, are appropriate tools provided for loading that data?
  • If the resource is data, are the provenance (source, preprocessing, cleaning, aggregation) stages clearly documented?

Predicted impact

  • What IR research activity is enabled by the availability of this resource?
  • Does the resource advance a well-established research area or a brand new one?
  • Do you expect that this resource will be useful for a long time, or will it need to be curated or updated? If the latter, is that planned?
  • How large is the (anticipated) research user community? Will that grow or shrink in the next few years?

Submission Guidelines

Resource papers must describe original work that has not been previously published, not accepted for publication elsewhere, and not simultaneously submitted or currently under review in another journal or conference.

Submissions of resource research papers must be in English, in PDF format, and be at most 6 pages (including figures) in length + unrestricted space for references, in the current ACM two-column conference format. Suitable LaTeX, Word, and Overleaf templates are available from the ACM Website (use the“sigconf” proceedings template). 

Submissions should be submitted electronically via EasyChair (resource paper track):

https://easychair.org/conferences?conf=sigir2021

At least one author of each accepted paper is required to register for, and present the work at the conference. 

Submission Policy

The resource paper review process is single-blind, which means that reviewers are aware of the names and affiliations of paper authors. Therefore, unlike other paper tracks in SIGIR 2021, there is no need to hide author information in the submission. Authors should carefully go through ACM’s authorship policy before submitting a paper. Submissions which violate the preprint policy, length, or formatting requirements or are plagiarized are subject to desk-rejection by the chairs. It is also NOT permitted to double submit the content to both resource track and other track(s) of SIGIR 2021 (e.g. a resource paper for building Dataset A and a full paper containing the construction process of Dataset A in the experiment section).

To support identification of reviewers with conflicts of interest, the full author list must be specified at submission time. Authors should note that changes to the author list after the submission deadline are not allowed without permission from the PC Chairs. 

Resource Paper Chairs

  • Yiqun Liu, Tsinghua University, P.R.C.
  • Ian Soboroff, NIST, U.S.A.

Contact

For further information, please contact the SIGIR 2021 Resource Paper Co-chairs by email to sigir2021-resource AT easychair DOT org.

Scroll to Top