Author Cade Metz Talks About His New Book "Genius Makers" - Ep. 138

Google Acquisition

The acquisition of DeepMind by Google marked a pivotal moment in AI history. Cade Metz recounts the story of Jeff Hinton and his students moving into Google, highlighting the significance of their work on AlexNet, a groundbreaking image recognition paper 1. This event symbolized the mainstream acceptance of neural networks and the growing interest from major tech companies.

It's about people like Hinton, who had this idea for decades being snapped up into these companies when their idea started to work.

--- Cade Metz

Metz also aims to clarify the reality of AI advancements, emphasizing the hype and misconceptions surrounding the field 2.

   

Key Projects

DeepMind's major projects have significantly advanced AI technology. Cade Metz discusses the company's achievements, including solving the protein folding problem and the release of OpenAI's GPT-3 3. These milestones demonstrate the rapid progress in AI and the ongoing challenges in addressing ethical questions.

These technologies are continuing to progress at an incredibly fast rate and the questions that they raise have not been solved.

--- Cade Metz

Metz highlights the importance of understanding the societal impact of these advancements and the need for continuous scrutiny.

   

Reinforcement Learning

DeepMind's approach to reinforcement learning has revolutionized robotics and AI. Cade Metz explains how Peter Abeel influenced Hinton's perspective on reinforcement learning, showcasing its potential in self-driving cars and other robotics applications 4. This method involves systems learning through extreme trial and error, requiring significant computing power.

Even Jeff Hinton comes around to this idea because he realizes that the amount of processing power needed to drive this, which is extensive, is now available.

--- Cade Metz

The story of the "arm farm" at Google illustrates the practical challenges and breakthroughs in this field.

   

DeepMind and Hinton

Jeff Hinton's contributions to DeepMind are central to the narrative of AI's evolution. Cade Metz details Hinton's journey from the early days of AI, emphasizing his resilience and belief in neural networks despite widespread skepticism 5. Hinton's work laid the foundation for many of DeepMind's successes.

He consistently believed in and worked on this one idea called a neural network. It's a mathematical system built in the image, loosely in the image of the brain.

--- Cade Metz

The story of Hinton and his students moving into Google underscores the transformative impact of their research on the tech industry 1.