{"id":787,"date":"2022-10-13T09:13:18","date_gmt":"2022-10-13T09:13:18","guid":{"rendered":"https:\/\/sigir.org\/sigir2023\/?page_id=787"},"modified":"2022-11-24T05:32:15","modified_gmt":"2022-11-24T05:32:15","slug":"checklist-to-strengthen-an-ir-paper","status":"publish","type":"page","link":"https:\/\/sigir.org\/sigir2023\/submit\/call-for-full-papers\/checklist-to-strengthen-an-ir-paper\/","title":{"rendered":"Checklist to Strengthen an IR Paper"},"content":{"rendered":"<div id='full_slider_1'  class='avia-fullwidth-slider main_color avia-shadow   avia-builder-el-0  el_before_av_section  avia-builder-el-first   container_wrap sidebar_right'  >\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-5xuyn7-423b6e13da94db73c91b63a630ff47e4\">\n#top #wrap_all .avia-slideshow .av-slideshow-caption.av-5xuyn7-423b6e13da94db73c91b63a630ff47e4__0 .avia-caption-title{\nfont-size:45px;\n}\n#top .avia-slideshow .av-slideshow-caption.av-5xuyn7-423b6e13da94db73c91b63a630ff47e4__0 .avia-caption-content{\nfont-size:25px;\n}\n#top .avia-slideshow .av-slideshow-caption.av-5xuyn7-423b6e13da94db73c91b63a630ff47e4__0 .avia-caption-content p{\nfont-size:25px;\n}\n\n@media only screen and (max-width: 479px){ \n#top #wrap_all .avia-slideshow .av-slideshow-caption.av-5xuyn7-423b6e13da94db73c91b63a630ff47e4__0 .avia-caption-title{\nfont-size:30px;\n}\n}\n<\/style>\n<div  class='avia-slideshow av-5xuyn7-423b6e13da94db73c91b63a630ff47e4 av-control-default avia-slideshow-featured av_slideshow_full avia-slide-slider av-default-height-applied   avia-slideshow-1'  data-size='featured'  data-lightbox_size='large'  data-animation='slide'  data-conditional_play=''  data-ids='834'  data-video_counter='0'  data-autoplay='false'  data-bg_slider='false'  data-slide_height=''  data-handle='av_slideshow_full'  data-interval='5'  data-class=''  data-extra_class=' '  data-el_id=''  data-css_id=''  data-scroll_down=''  data-control_layout='av-control-default'  data-custom_markup=''  data-perma_caption=''  data-autoplay_stopper=''  data-image_attachment=''  data-min_height='200px'  data-lazy_loading='disabled'  data-default-height='28.666666666667'  data-stretch=''  data-src=''  data-position='top left'  data-repeat='no-repeat'  data-attach='scroll'  data-img_scrset=''  data-av-desktop-hide=''  data-av-medium-hide=''  data-av-small-hide=''  data-av-mini-hide=''  data-id=''  data-custom_class=''  data-template_class=''  data-av_uid='av-5xuyn7'  data-sc_version='1.0'  data-heading_tag=''  data-heading_class=''  data-min_width='698px'   itemprop=\"image\" itemscope=\"itemscope\" itemtype=\"https:\/\/schema.org\/ImageObject\" ><ul class='avia-slideshow-inner ' style='padding-bottom: 28.666666666667%;'><li  class='avia-slideshow-slide av-5xuyn7-423b6e13da94db73c91b63a630ff47e4__0  av-single-slide slide-1 ' ><div data-rel='slideshow-1' class='avia-slide-wrap '   ><div class='av-slideshow-caption av-5xuyn7-423b6e13da94db73c91b63a630ff47e4__0 caption_fullwidth caption_center'><div class=\"container caption_container\"><div class=\"slideshow_caption\"><div class=\"slideshow_inner_caption\"><div class=\"slideshow_align_caption\"><h2 class='avia-caption-title '  itemprop=\"name\" >Checklist to Strengthen an IR Paper<\/h2><\/div><\/div><\/div><\/div><\/div><img decoding=\"async\" class=\"wp-image-834 avia-img-lazy-loading-not-834\"  src=\"https:\/\/sigir.org\/sigir2023\/wp-content\/uploads\/2022\/10\/banner_05-1500x430.jpg\" width=\"1500\" height=\"430\" title='banner_05' alt=''  itemprop=\"thumbnailUrl\"  style='min-height:200px; min-width:698px; ' \/><div class='av-section-color-overlay' style='opacity: 0.3; background-color: #000000; '><\/div><\/div><\/li><\/ul><\/div><\/div>\n<div id='av_section_1'  class='avia-section av-jr803-823cbbc4ac5121530b48160b8794da92 main_color avia-section-default avia-no-border-styling  avia-builder-el-1  el_after_av_slideshow_full  avia-builder-el-last  avia-bg-style-scroll container_wrap sidebar_right'  ><div class='container av-section-cont-open' ><div class='template-page content  av-content-small alpha units'><div class='post-entry post-entry-type-page post-entry-787'><div class='entry-content-wrapper clearfix'>\n<div class='flex_column_table av-5dvz5n-2454cd8b13b12a6d04dfe3e29f6db9dc sc-av_three_fourth av-equal-height-column-flextable'>\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-5dvz5n-2454cd8b13b12a6d04dfe3e29f6db9dc\">\n.flex_column.av-5dvz5n-2454cd8b13b12a6d04dfe3e29f6db9dc{\nwidth:74.5%;\nmargin-left:0;\npadding:0 40px 0 40px;\n}\n#top .flex_column_table.av-equal-height-column-flextable.av-5dvz5n-2454cd8b13b12a6d04dfe3e29f6db9dc .av-flex-placeholder{\nwidth:2%;\n}\n<\/style>\n<div class='flex_column av-5dvz5n-2454cd8b13b12a6d04dfe3e29f6db9dc av_three_fourth  avia-builder-el-2  el_before_av_one_fourth  avia-builder-el-first  first flex_column_table_cell av-equal-height-column av-align-middle '   ><style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-57l7kr-2e34569d59bfc6d605d23a19b06ef6d5\">\n#top .av_textblock_section.av-57l7kr-2e34569d59bfc6d605d23a19b06ef6d5 .avia_textblock{\nfont-size:35px;\ncolor:#116fb7;\n}\n<\/style>\n<section  class='av_textblock_section av-57l7kr-2e34569d59bfc6d605d23a19b06ef6d5'  itemscope=\"itemscope\" itemtype=\"https:\/\/schema.org\/CreativeWork\" ><div class='avia_textblock text_justify av_inherit_color'  itemprop=\"text\" ><p>Things that strengthen an IR paper:<br \/>\nrecommendations from the Program Chairs<\/p>\n<\/div><\/section><\/div><div class='av-flex-placeholder'><\/div>\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-1vbg3-8891381f586ded0c6e469cfbcca25659\">\n.flex_column.av-1vbg3-8891381f586ded0c6e469cfbcca25659{\nwidth:23.5%;\nmargin-left:0;\n}\n#top .flex_column_table.av-equal-height-column-flextable.av-1vbg3-8891381f586ded0c6e469cfbcca25659 .av-flex-placeholder{\nwidth:2%;\n}\n<\/style>\n<div class='flex_column av-1vbg3-8891381f586ded0c6e469cfbcca25659 av_one_fourth  avia-builder-el-4  el_after_av_three_fourth  el_before_av_one_full  flex_column_table_cell av-equal-height-column av-align-middle '   ><style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-l96uihgh-ddf29aaadad5d9413685d62537ed993b\">\n.avia-image-container.av-l96uihgh-ddf29aaadad5d9413685d62537ed993b .av-image-caption-overlay-center{\ncolor:#ffffff;\n}\n<\/style>\n<div  class='avia-image-container av-l96uihgh-ddf29aaadad5d9413685d62537ed993b av-styling- avia-align-center  avia-builder-el-5  avia-builder-el-no-sibling '  itemprop=\"image\" itemscope=\"itemscope\" itemtype=\"https:\/\/schema.org\/ImageObject\" ><div class=\"avia-image-container-inner\"><div class=\"avia-image-overlay-wrap\"><img decoding=\"async\" class='wp-image-599 avia-img-lazy-loading-not-599 avia_image' src=\"https:\/\/sigir.org\/sigir2023\/wp-content\/uploads\/2019\/07\/SIGIR_LOGO_\u7576\u7db2\u7ad9tag\u5716\u793a.jpg\" alt='' title='SIGIR_LOGO_\u7576\u7db2\u7ad9tag\u5716\u793a'  height=\"571\" width=\"800\"  itemprop=\"thumbnailUrl\" srcset=\"https:\/\/sigir.org\/sigir2023\/wp-content\/uploads\/2019\/07\/SIGIR_LOGO_\u7576\u7db2\u7ad9tag\u5716\u793a.jpg 800w, https:\/\/sigir.org\/sigir2023\/wp-content\/uploads\/2019\/07\/SIGIR_LOGO_\u7576\u7db2\u7ad9tag\u5716\u793a-300x214.jpg 300w, https:\/\/sigir.org\/sigir2023\/wp-content\/uploads\/2019\/07\/SIGIR_LOGO_\u7576\u7db2\u7ad9tag\u5716\u793a-768x548.jpg 768w, https:\/\/sigir.org\/sigir2023\/wp-content\/uploads\/2019\/07\/SIGIR_LOGO_\u7576\u7db2\u7ad9tag\u5716\u793a-260x185.jpg 260w, https:\/\/sigir.org\/sigir2023\/wp-content\/uploads\/2019\/07\/SIGIR_LOGO_\u7576\u7db2\u7ad9tag\u5716\u793a-705x503.jpg 705w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/><\/div><\/div><\/div><\/div><\/div><!--close column table wrapper. Autoclose: 1 -->\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-53qnx7-b257e1bb62f14f2cc33db4e014224b26\">\n.flex_column.av-53qnx7-b257e1bb62f14f2cc33db4e014224b26{\npadding:0 40px 0 40px;\n}\n<\/style>\n<div class='flex_column av-53qnx7-b257e1bb62f14f2cc33db4e014224b26 av_one_full  avia-builder-el-6  el_after_av_one_fourth  el_before_av_one_full  first flex_column_div column-top-margin'   ><p>\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-l96ukend-262508c35464666b05b656b684564601\">\n#top .av-special-heading.av-l96ukend-262508c35464666b05b656b684564601{\nmargin:0px 0px 0px 0px;\npadding-bottom:10px;\n}\nbody .av-special-heading.av-l96ukend-262508c35464666b05b656b684564601 .av-special-heading-tag .heading-char{\nfont-size:25px;\n}\n.av-special-heading.av-l96ukend-262508c35464666b05b656b684564601 .av-subheading{\nfont-size:15px;\n}\n<\/style>\n<div  class='av-special-heading av-l96ukend-262508c35464666b05b656b684564601 av-special-heading-h3 blockquote modern-quote  avia-builder-el-7  el_before_av_hr  avia-builder-el-first  av-linked-heading'><h3 class='av-special-heading-tag'  itemprop=\"headline\"  >Presentation<\/h3><div class=\"special-heading-border\"><div class=\"special-heading-inner-border\"><\/div><\/div><\/div><br \/>\n\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-gvpx7-8c49dfcf244f56bc866b3834150c932b\">\n#top .hr.av-gvpx7-8c49dfcf244f56bc866b3834150c932b{\nmargin-top:0px;\nmargin-bottom:10px;\n}\n.hr.av-gvpx7-8c49dfcf244f56bc866b3834150c932b .hr-inner{\nwidth:100%;\nborder-color:#e1e1e1;\n}\n<\/style>\n<div  class='hr av-gvpx7-8c49dfcf244f56bc866b3834150c932b hr-custom  avia-builder-el-8  el_after_av_heading  el_before_av_textblock  hr-left hr-icon-no'><span class='hr-inner inner-border-av-border-fat'><span class=\"hr-inner-style\"><\/span><\/span><\/div><br \/>\n<section  class='av_textblock_section av-4m3z5n-68c530b213b72b53af95553019813f75'  itemscope=\"itemscope\" itemtype=\"https:\/\/schema.org\/CreativeWork\" ><div class='avia_textblock text_justify'  itemprop=\"text\" ><ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>The paper\u2019s motivation and the potential impact of the addressed problem are discussed.<\/li>\n<li>The paper\u2019s original contributions (i.e. the delta over prior art) are clearly stated.<\/li>\n<li>The paper\u2019s claims are properly scoped and supported.<\/li>\n<li>The paper clearly describes what was done and what was not.<\/li>\n<li>The choices made in each step of the research are justified (the why\u2019s).<\/li>\n<li>The results are presented effectively in appropriate format.<\/li>\n<li>Good discussion accompanies the results.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/div><\/section><\/p><\/div>\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-gi4q3-a07b740d6f9aa6ae3d6f0dbbac775944\">\n.flex_column.av-gi4q3-a07b740d6f9aa6ae3d6f0dbbac775944{\npadding:0 40px 0 40px;\n}\n<\/style>\n<div class='flex_column av-gi4q3-a07b740d6f9aa6ae3d6f0dbbac775944 av_one_full  avia-builder-el-10  el_after_av_one_full  avia-builder-el-last  first flex_column_div column-top-margin'   ><p>\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-l96ul5s9-336cc9611fbada9458770e61ae60f789\">\n#top .av-special-heading.av-l96ul5s9-336cc9611fbada9458770e61ae60f789{\nmargin:0px 0px 0px 0px;\npadding-bottom:10px;\n}\nbody .av-special-heading.av-l96ul5s9-336cc9611fbada9458770e61ae60f789 .av-special-heading-tag .heading-char{\nfont-size:25px;\n}\n.av-special-heading.av-l96ul5s9-336cc9611fbada9458770e61ae60f789 .av-subheading{\nfont-size:15px;\n}\n<\/style>\n<div  class='av-special-heading av-l96ul5s9-336cc9611fbada9458770e61ae60f789 av-special-heading-h3 blockquote modern-quote  avia-builder-el-11  el_before_av_hr  avia-builder-el-first  av-linked-heading'><h3 class='av-special-heading-tag'  itemprop=\"headline\"  >Experimentation (if applicable)<\/h3><div class=\"special-heading-border\"><div class=\"special-heading-inner-border\"><\/div><\/div><\/div><br \/>\n\n<style type=\"text\/css\" data-created_by=\"avia_inline_auto\" id=\"style-css-av-av_hr-76a03d5f2aa46ad13693c4e14006b2c4\">\n#top .hr.av-av_hr-76a03d5f2aa46ad13693c4e14006b2c4{\nmargin-top:0px;\nmargin-bottom:10px;\n}\n.hr.av-av_hr-76a03d5f2aa46ad13693c4e14006b2c4 .hr-inner{\nwidth:100%;\nborder-color:#e1e1e1;\n}\n<\/style>\n<div  class='hr av-av_hr-76a03d5f2aa46ad13693c4e14006b2c4 hr-custom  avia-builder-el-12  el_after_av_heading  el_before_av_textblock  hr-left hr-icon-no'><span class='hr-inner inner-border-av-border-fat'><span class=\"hr-inner-style\"><\/span><\/span><\/div><br \/>\n<section  class='av_textblock_section av-l96ulwyu-3daba6f257bed7878f07ad463b8312fa'  itemscope=\"itemscope\" itemtype=\"https:\/\/schema.org\/CreativeWork\" ><div class='avia_textblock text_justify'  itemprop=\"text\" ><ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>The experimental design and its scale are appropriate.<\/li>\n<li>In comparative studies, appropriate baselines are used.<\/li>\n<li>The experimental results are reliable and generalizable.<\/li>\n<li>The evaluation methods employed are in line with the research questions.<\/li>\n<li>Statistical analysis is performed and reported appropriately.<\/li>\n<li>Sufficient details (with data and code where appropriate) are provided to help other researchers assess and reproduce the experiments.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/div><\/section><\/p><\/div><\/div><\/div><\/div><!-- close content main div --><\/div><\/div><div id='after_section_1'  class='main_color av_default_container_wrap container_wrap sidebar_right'  ><div class='container av-section-cont-open' ><div class='template-page content  av-content-small alpha units'><div class='post-entry post-entry-type-page post-entry-787'><div class='entry-content-wrapper clearfix'>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":4,"featured_media":0,"parent":1107,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-787","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/pages\/787","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/comments?post=787"}],"version-history":[{"count":6,"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/pages\/787\/revisions"}],"predecessor-version":[{"id":973,"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/pages\/787\/revisions\/973"}],"up":[{"embeddable":true,"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/pages\/1107"}],"wp:attachment":[{"href":"https:\/\/sigir.org\/sigir2023\/wp-json\/wp\/v2\/media?parent=787"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}