This is an old revision of the document!
The following rules should ensure a fair comparison of the IO-500 results between systems and configurations. They serve to reduce mistakes and improve accuracy.
For ISC20, submission of test runs should use new C-Application io500 which automatically runs both the new C version and the existing bash version (following the rules for SC-19) to ensure the consistency of results between the two implementations. An exception to this rule is possible for submitters who have a legitimate reason by requesting an exception from the committee via comittee@io500.org.
Details are provided in the https://github.com/VI4IO/io500-app/blob/master/README-ISC20.txt file. For the ISC20 list, we will use the results from whichever of the two runs had the higher overall score assuming there are no abnormalities found in our analysis across all submissions. Assuming no abnormalities are found, for future lists we will require only one run.
Please send any requests for changes to these rules or clarifying questions to our mailing list.
<html> <!–
Please send any requests for changes to these rules or clarifying questions to our mailing list.
Inside the io500.sh script you can make the modifications as indicated by the script, in particular these are:
Please email the mailing list or the steering board for any clarifications. –> </html>