New publication: The Cost of Reproducibility in Artificial Intelligence
Very happy to announce our latest paper “The Cost of Reproducibility in Artificial Intelligence” has been published in Patterns! You can read the paper here (Its open access!)
Highlights
• We analyze 918 AI publications between 2022 and 2024 for their reproducibility
• Papers published at ML conferences are overall easiest to reproduce
• Award-winning papers are not easier to reproduce than “regular” papers
• We find a dark pattern of 6.72% of URLs to code repositories being broken
Big thank you to my co-authors Holger and Odd Erik (my supervisors) as well as my coworkers who sacrificed a substantial amount of their time to help me build this papers’ data set!



