Responsive image

Artifacts Track - Call for Papers

Goal and Scope

    The ICSME 2018 artifacts track exists to promote, celebrate, and catalog excellent examples of research artifacts in software engineering. These artifacts are reusable units of research that can be used to support other research endeavors.

    Artifacts of interest include (but are not limited to) the following:

  • Software, which are implementations of systems or algorithms potentially useful in other studies.
  • Data repositories, which are data (e.g., logging data, system traces, survey raw data, etc.) that can be used for multiple software engineering approaches.
  • One additional proceedings page for the associated paper, to be used to describe the artifact
  • Frameworks, which are tools and services illustrating new approaches to software engineering that could be used by other researchers in different contexts.

    This list is not exhaustive, but if your proposed artifact is not on this list, please email the chairs before submitting. For artifacts that are executable tools, you may also consider submitting to the ICSME 2018 tool demonstrations track.

    ICSME 2018 allows two types of artifact submissions:

    Evaluation artifacts: For artifacts related to a research track paper accepted at ICSME 2018. Authors of accepted artifacts of this type will enjoy the following benefits:

  • Recognition on the conference website
  • A one-page paper in the proceedings describing the artifact
  • The opportunity to present the artifact in a dedicated artifacts session at the conference (in addition to the presentation for the associated research track paper)

    Independent artifacts: For artifacts related to a paper published previously or unrelated to any paper published so far. Authors of accepted artifacts of this type will enjoy the following benefits:

  • A one-page paper in the proceedings describing the artifact
  • The opportunity to present the artifact in a dedicated artifacts session at the conference

    Both types of submissions have the same submission instructions and packaging guidelines and will be evaluated by the same PC using the same evaluation criteria.

Evaluation

    All submissions that meet the submission criteria (see below), fit the scope of the conference, and comply with the IEEE plagiarism policy and procedures will be reviewed by three members of the artifacts track program committee. Submissions will be evaluated as accepted or rejected.

    Artifacts will be scored using the following scorecard:

    Insightful

  1. Timely (i.e., addresses a problem that is most current and most pressing)?
  2. Makes researchers "smarter" in some way (e.g., identifies and fills some significant gap in prior work)?

    Useful

  1. Serves a useful purpose?
  2. Serves a purpose that would otherwise be tedious, prolonged, awkward, or impossible?
  3. Cost-effective?

    Usable

  • Easy to understand?
  • Accompanied by tutorial notes?
  • Artifacts need not be executable but if so, are they:
    • Easy to download, install, or execute?
    • Available in a virtual machine image?
    • Available online?
    • Supported by configuration management tools to permit easy updates?

Submission

    Submissions should be made by the deadline via EasyChair. Submissions should follow the conference format, be limited to a single page, and contain:

  • Names, affiliations, and email addresses for the authors.
  • A description of the artifact.
  • A URL to download the artifact. This could also be a URL to a GitHub repository.

    To hide the identity of the reviewers from the authors, the artifact track chairs will download the artifact and distribute it to the reviewers. The authors should also make an effort not to learn the identity of the reviewers, e.g., through logging.

Artifact Packaging Guidelines

    High-quality packaging of an artifact is as important as the quality of the artifact itself. Please keep in mind that the committee members will have limited time to review each artifact. The following requirements for the artifact are meant to expedite the review process:

  • Create a single zip archive, containing a README text file with instructions (how to use the artifact, how to reproduce the results presented in the ICSME'18 research paper, if the artifact is associated to one), the ICSME'18 research paper (if applicable), and the artifact itself. Additionally, you may submit a video with a demo and/or instructions.
  • In case you want to submit a running setup of your artifact, please provide an installation script to simplify the reviewing process. If the artifact requires a non-standard environment (e.g., specific OS, many external dependencies) we encourage you to create a virtual machine using Virtual box (www.virtualbox.org).Please use only such system images that are compatible with Virtual box.
  • If obtaining all the results takes a significant amount of time, please also include a script to reproduce only a subset of the results.

Important Dates

    Paper submission: Monday, June 18th, 2018 at 23:59 AoE (Anywhere on Earth, UTC-12)

    Author notification: Friday, July 6th, 2018

    Camera ready: Sunday, July 15th, 2018

    Early Bird Registration: Sunday, July 15th, 2018