Reproducible computing

rules

• https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1003285

1. Rule 1: For Every Result, Keep Track of How It Was Produced
2. Rule 2: Avoid Manual Data Manipulation Steps
3. Rule 3: Archive the Exact Versions of All External Programs Used
4. Rule 4: Version Control All Custom Scripts
5. Rule 5: Record All Intermediate Results, When Possible in Standardized Formats
6. Rule 6: For Analyses That Include Randomness, Note Underlying Random Seeds
7. Rule 7: Always Store Raw Data behind Plots
8. Rule 8: Generate Hierarchical Analysis Output, Allowing Layers of Increasing Detail to Be Inspected
9. Rule 9: Connect Textual Statements to Underlying Results
10. Rule 10: Provide Public Access to Scripts, Runs, and Results