New publication: The Cost of Reproducibility in Artificial Intelligence
Very happy to announce our latest paper « The Cost of Reproducibility in Artificial Intelligence » has been published in Patterns! You can read the paper here (Its open access!)
Highlights
• We analyze 918 AI publications between 2022 and 2024 for their reproducibility
• Papers published at ML conferences are overall easiest to reproduce
• Award-winning papers are not easier to reproduce than “regular” papers
• We find a dark pattern of 6.72% of URLs to code repositories being broken
Big thank you to my co-authors Holger and Odd Erik (my supervisors) as well as my coworkers who sacrificed a substantial amount of their time to help me build this papers’ data set!



