Vladlen Koltun — The Power of Simulation and Abstraction

Topics covered
Popular Clips
Episode Highlights
Intelligent Systems
Vladlen Koltun, Chief Scientist for Intelligent Systems at Intel, prefers the term "intelligent systems" over "AI" due to its broader scope and less historical baggage. He argues that while AI has a long history of overpromising and underdelivering, intelligent systems encompass both artificial and natural intelligence, focusing on understanding and inducing intelligence in systems. This perspective allows for a more neutral and comprehensive approach to studying intelligence.
We want to understand the nature of intelligence. We are concerned with intelligence, understanding it and producing it, inducing it in systems that we create.
---
This shift in terminology reflects a desire to explore intelligence beyond artificial constructs, aiming to integrate insights from natural intelligence as well 1.
Embodied Intelligence
Embodied intelligence, as discussed by Vladlen, involves training intelligent agents to interact with their environment in a spatially aware manner, similar to humans and animals. He emphasizes the importance of understanding essential features of spatial intelligence without simulating every physical complexity. This approach aims to develop systems that can navigate and interact with their surroundings effectively.
We can also understand the essence of embodied intelligence without worrying about... how to grasp wet, slippery pebbles and how to pour coffee from a particular type of container.
---
By focusing on core aspects of intelligence, researchers can make significant progress in creating systems capable of functioning in real-world environments 2 3.
Robotics Challenges
The challenges in robotics, as highlighted by Vladlen, stem from the need for systems to learn through interaction with their environment. Unlike perception tasks, robotics requires real-time engagement, which complicates the learning process. He compares this to the development of a toddler, where learning is slow and requires a robust system capable of handling failures.
To learn to act, you need to actually act. To act, you need to act in an environment.
---
Vladlen suggests that identifying essential skills and using model systems, similar to neuroscience's use of squids, can aid in overcoming these challenges 4.
Related Episodes


Drago Anguelov — Robustness, Safety, and Scalability at Waymo
Answers 383 questions

Nicolas Koumchatzky — Machine Learning in Production for Self-Driving Cars
Answers 383 questions

Reinventing AI Agents with Imbue CEO Kanjun Qiu
Answers 383 questions

Pieter Abbeel — Robotics, Startups, and Robotics Startups
Answers 383 questions

Wojciech Zaremba — What Could Make AI Conscious?
Answers 383 questions

The Power of AI in Search with You.com's Richard Socher
Answers 383 questions

Emily M. Bender — Language Models and Linguistics
Answers 383 questions

Luis Ceze — Accelerating Machine Learning Systems
Answers 383 questions

Autonomous Mobile Robot Deployment: Interview with Jean Marc Alkazzi at idealworks
Answers 383 questions

Tim & Heinrich — Democraticizing Reinforcement Learning Research
Answers 383 questions

Angela & Danielle — Designing ML Models for Millions of Consumer Robots
Answers 383 questions

Shaping the World of Robotics with Chelsea Finn
Answers 383 questions

Josh Tobin — Productionizing ML Models
Answers 383 questions

Mircea Neagovici — Robotic Process Automation (RPA) and ML
Answers 383 questions

Transforming Search with Perplexity AI’s CTO Denis Yarats
Answers 383 questions













