[IPOL discuss] Ten Simple Rules for Reproducible Computational Research

Nicolas Limare nicolas.limare at cmla.ens-cachan.fr
Wed Oct 30 05:59:59 CET 2013


Ten Simple Rules for Reproducible Computational Research
by Geir Kjetil Sandve, Anton Nekrutenko, James Taylor and Eivind Hovig
-> http://dx.doi.org/10.1371/journal.pcbi.1003285

The background of this article is biology, but I think the 10 rules
given here make sense for our community too. The rules are:

Rule  1: For Every Result, Keep Track of How It Was Produced
Rule  2: Avoid Manual Data Manipulation Steps
Rule  3: Archive the Exact Versions of All External Programs Used
Rule  4: Version Control All Custom Scripts
Rule  5: Record All Intermediate Results, When Possible in
         Standardized Formats 
Rule  6: For Analyses That Include Randomness, Note Underlying Random
         Seeds
Rule  7: Always Store Raw Data behind Plots
Rule  8: Generate Hierarchical Analysis Output, Allowing Layers of
         Increasing Detail to Be Inspected
Rule  9: Connect Textual Statements to Underlying Results
Rule 10: Provide Public Access to Scripts, Runs, and Results

They somehow complement the rules implied by IPOL. Rules 1, 2, 4, 5,
6, 7 would also helo IPOL authors when they are asked to correct a
figure or explain an image inserted in an article. Rule 10 is very
close to what IPOL provides.

All the best,

-- 
Nicolas LIMARE
http://nicolas.limare.net/                         pgp:0xFA423F4F
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: Digital signature
URL: <https://tools.ipol.im/mailman/archive/discuss/attachments/20131030/c28542f3/attachment.pgp>


More information about the discuss mailing list