This page contains the information about the submission procedure.

The IO500 list is released during ISC and SC. See our call for submissions. Submissions to the upcoming list can be made all year. However, to be included in the next release, we must receive the submission until the deadline listed in our call for submissions.

There are two options to submit to the IO500, we prefer the online form:

1) Use our online form. You have to receive a one-time token (please check your SPAM folder if you did not receive the initial response 5 minutes later).

2) If you experience any problems with the online form; send an email with attachments:

• The (potentially) adapted io500.sh
• The output directory of the benchmark (variable io500_result_dir in io500.sh)
• If possible, please mention which system is covered of the CDCL or provide system information such that we can add the system to the CDCL!

We will reply to you, to confirm reception and any question that may arise.

Until the release of the list, the submission committee will handle all submitted data confidentially. That means that we will not disclose any submitted data to individuals/companies, or institutions.

We will publish all data submitted, so by submitting the information you give us the right to publish the uploaded data.

Submissions will be visible immediately to the IO500 Committee which currently is comprised of John Bent, Andreas Dilger, Julian Kunkel, Jay Lofstead, and George Markomanolis. If there is sensitivity about early visibility to your results being seen by any of the committee members, please feel free to email results privately to a subset of the committee (i.e. do not use the official submission tools if you have privacy concerns).

Starting with the SC'18 list, releases include the name of the submitter (or team) to give them the credit they deserve to execute the benchmark; this can be opted out.

With the online form, the submitter is able to individually opt-out or embargo (delay) the release of certain information: 1) The name of the submitter/team (anonymous submission) 2) Specific information that would indicate the system; e.g., the file system, the name of the site, supercomputer …

After an embargo period the specific information is revealed and updated automatically in the subsequent list following the end of the embargo period. The period is either 3 years, or after the machine is decommissioned (the embargo period is asked in the online form).

Fetching, compiling, and running the IO500 Benchmarks is surprisingly straightforward. Although tuning can be challenging. Instructions for the former can be found in our github repo. Help with the latter can be found in our various communication channels.