Published May 16, 2019

Can We Trust Scientific Discoveries Made Using Machine Learning? with Genevera Allen - TWiML...

Genevera Allen delves into the challenges of reproducibility in scientific discoveries reliant on machine learning, illustrating key issues through cancer genomics examples, and highlights the importance of generalizability and open-source tools in ensuring robust, applicable research findings.
Episode Highlights
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) logo

Popular Clips

Episode Highlights

  • Biomedical Use Cases

    raises critical questions about the reliability of machine learning in biomedical research. She highlights the complexity of large datasets in fields like genomics and neuroscience, where traditional statistical methods fall short. Genevera emphasizes the need for reproducibility in discoveries made using machine learning, questioning if these findings are truly reliable 1.

    There's a lot of research directions in this area, and perhaps today I can highlight a couple of those and perhaps spark some ideas for other machine learning researchers.

    ---

    The discussion also touches on the challenges of conditional inference, a technique that requires decomposing test statistics to avoid overfitting, which is currently limited in its application across diverse datasets 2.

       

    Open Source Education

    Open source tools are revolutionizing machine learning, but stresses the importance of proper education in their application. She argues that while these tools democratize access, the real challenge lies in educating users on robust application principles 3.

    The problem isn't necessarily that the machine learning techniques are bad or not correct, and it's not at all. The machine learning techniques are great. It's often in how they're applied.

    ---

    questions whether the current push for democratization might be premature, given the complexities involved in applying these techniques effectively 4.

Related Episodes