Published Nov 13, 2023

Program Aided Language Models

Explore cutting-edge advancements in language models with PhD students Aman Madaan and Shuyan Zhou, as they delve into the innovative PAL model improving math accuracy and the COCOGEN methodology's impact on structured common sense generation. Discover how these technologies leverage Python code for problem-solving, offering groundbreaking solutions in language model optimization.

Episode Highlights

Topics covered

Questions from this episode

How does AI transform the learning process?
Asked by 50 people

Episode Highlights

Related Episodes

Which Programming Language is ChatGPT Best At
Answers 383 questions
AI Platforms
Answers 383 questions
Deploying LLMs
Answers 383 questions
I LLM and You Can Too
Answers 383 questions
LLMs for Evil
Answers 383 questions
Automated Peer Review
Answers 383 questions
NLP for Developers
Answers 383 questions
The Limits of NLP
Answers 383 questions
GraphText
Answers 383 questions
Process Mining with LLMs
Answers 383 questions
arXiv Publication Patterns
Answers 383 questions
Emergent Deception in LLMs
Answers 383 questions
ELMo
Answers 383 questions
Do LLMs Make Ethical Choices
Answers 383 questions
Graph Databases and AI
Answers 383 questions

Dexa/Kyle Polich

Program Aided Language Models

Topics covered

Popular Clips

Future of Math

Language Models and Program Writing

Training Language Models with Code

Program Aided Language Models

Limits and Surprising Failures

Graph Generation with COCOGEN

Improving Code Accuracy

Tweaking Prompts for Better Performance

Python's Power

Advancements in Code Generation

AI Math Accuracy

Questions from this episode

How does AI transform the learning process?

Episode Highlights

Language Model Advances

COCOGEN and Graphs

Program Aided Language (PAL)

Related Episodes

Which Programming Language is ChatGPT Best At

AI Platforms

Deploying LLMs

I LLM and You Can Too

LLMs for Evil

Automated Peer Review

NLP for Developers

The Limits of NLP

GraphText

Process Mining with LLMs

arXiv Publication Patterns

Emergent Deception in LLMs

ELMo

Do LLMs Make Ethical Choices

Graph Databases and AI

Program Aided Language Models

Topics covered

Popular Clips

Questions from this episode

Episode Highlights

Language Model AdvancesAman Madaan and Shuyan Zhou, PhD students at Carnegie Mellon University, discuss their research on improving large language models (LLMs) with the PAL model. They explore the challenges LLMs face in mathematical tasks and the advancements in code generation.

Language Model Advances

COCOGEN and GraphsThe COCOGEN methodology revolutionizes structured common sense generation by using Python classes for graph representation. This approach has laid the groundwork for advancements in Program Aided Language Models, enhancing their ability to solve complex tasks.

COCOGEN and Graphs

Program Aided Language (PAL)

Related Episodes