Empirical theories

Empirical Theories in Various Fields

1. Deep Learning Research

   • Preetum Nakkiran discusses the concept of empirical theory in deep learning, treating it as an object in the natural world. He highlights the importance of understanding the structure of the relationship between input design choices and the resulting trained model, similar to how inputs affect outputs in any system in nature 1.

2. Economic Theories

   • Nassim Nicholas Taleb criticizes the over-reliance on theoretical models in fields like economics and finance. He argues for a pragmatic approach based on empirical evidence and trial-and-error, citing historical and contemporary examples where empirical methods outperformed theoretical ones 2.

3. Theory of Mind in AI

   • Tomer Ullman explains the "theory of mind," which refers to attributing mental states to other entities. He insists this is an empirical fact demonstrated through consistent behavior from infancy, though there is ongoing debate about the underlying cognitive processes 3.
     • 

       1

       Empirical Theory

       00:18:07
     • 

       2

       Challenging Economic Theories

       00:43:36
     • 

       3

       Developing Theory of Mind

       00:07:18
     • 

       4

       Theory vs. Empirical Research

       00:58:09
     • 

       5

       Empirical Research Doubts

       01:08:57
     • 

       6

       Science and Reality

       02:40:54
       
     • 

       7

       Empirical Research in Education

       00:46:50

4. Role of Theory in Deep Learning

   • Greg Yang discusses the balance between theoretical and empirical research in deep learning. He notes that while empirical research can be quick and efficient, theoretical insights are essential in high-cost areas like large-scale AI training, where thorough planning is crucial 4.

5. Skepticism Towards Empirical Research

   • Rob Wiblin and Russ Roberts express skepticism about empirical research, noting its limitations. They highlight the problems with data reliability and the influence of researchers' biases, comparing it with the limitations of theoretical and common-sense approaches 5.

6. Science: Discovery vs. Invention

   • Sean Carroll emphasizes that theories in science are human inventions created to explain empirical facts. Theories are not discovered but crafted to account for observed data, highlighting the inventive aspect of scientific work 6.

7. Empirical Research in Education

   • Daniel Willingham talks about the empirical work in education and its challenges. He notes that while there is significant high-quality research, it often struggles to influence education policy and practice due to institutional and methodological constraints 7.

These insights demonstrate the importance and application of empirical theories across different disciplines, showcasing both their strengths and limitations.