#82 - Dr. JOSCHA BACH - Digital Physics, DL and Consciousness [UNPLUGGED]

AI Funding

AI funding is experiencing a significant shift, with more money being allocated to various paradigms than ever before. Joscha Bach highlights that despite the dominance of certain paradigms, the absolute funding for all approaches has increased, allowing for broader exploration in AI research 1. He notes that the current focus on successful industrial applications creates a bubble, but market forces and academic curiosity are driving the search for alternatives.

The absolute amount of funds that goes into any kind of paradigm that you want to work on is greater than ever.

--- Joscha Bach

This trend suggests a healthy environment for innovation, even if it seems concentrated in specific areas 1.

   

DL Challenges

Deep learning faces notable limitations, particularly in tasks requiring long-term planning and symbolic reasoning. Joscha Bach argues that while deep learning excels in many areas, it struggles with tasks like the Net H challenge, where symbolic solutions currently outperform 2. He suggests that integrating discrete machine learning could address these gaps by combining deep learning's strengths with symbolic reasoning 3.

The current winner of this is a symbolic solution. And this symbolic solution that Gary Marcus gives us proof that symbolic methods are still ahead of deep learning things in a single case.

--- Joscha Bach

This hybrid approach could enhance AI's ability to handle complex, real-world problems more effectively 2.

   

AI Creativity

AI's role in creative tasks is expanding, with models like Dali transforming how we interact with technology. Tim Scarfe notes that these models distill creativity into a process where the only limit is human imagination 4. He emphasizes the potential for AI to revolutionize creative professions, though challenges remain in areas like coding and information retrieval 5.

Creativity itself has now become this Uber efficient and externalized process.

--- Tim Scarfe

The future of AI in creativity promises to enrich human experiences, offering new tools for artistic expression and problem-solving 4.