The Changelog avatar

Dexa/The Changelog

Learn more
Published Feb 16, 2018

Moore's Law and High Performance Computing

Dive into the evolution of high-performance computing with Todd Gamblin, as he examines Moore's Law's lasting impact, the critical applications in scientific advancements, and the transformative role of open source software in supercomputing.
Episode Highlights
The Changelog logo

Topics covered

Popular Clips

Episode Highlights

  • Open Source Role

    Open source software plays a crucial role in high-performance computing at Lawrence Livermore National Laboratory. highlights that open source is preferred for most infrastructure, including resource managers and file systems like Luster 1. The lab's custom Linux distribution, Toss, exemplifies their commitment to open source, enabling efficient deployment across machines. notes the importance of community involvement in sustaining open source projects, emphasizing the need for more contributors to ensure longevity 2.

    We require that as part of the contract and so they work with us and they make sure that our software and other software that we care about from the Doe and elsewhere actually works on the machine.

    ---

    The integration of open source not only enhances collaboration but also drives performance improvements in supercomputing environments.

       

    Community Collaboration

    Collaboration with the open source community is integral to the success of high-performance computing projects. explains that despite some bureaucratic hurdles, Livermore has effectively integrated open source into its operations since the late 1990s 3. This collaboration allows for the sharing of resources and expertise across different labs, enhancing the development of scientific computing tools. points out that while the interaction model differs from large infrastructure projects like Kubernetes, the focus remains on solving specific scientific problems.

    There is a release process that you have to go through that's kind of cumbersome. But once you do it, like we did for SPAC, the package manager I work on, you can work out in the open on that as long as you stay within a certain project scope.

    ---

    The open source ecosystem at Livermore not only supports internal projects but also benefits from contributions developed by other labs, fostering a dynamic exchange of knowledge and innovation.

Related Episodes