Dexa/This Week in ML & AI

Medical Language Models

James discusses the innovative approach of pre-training language models on natural text, followed by fine-tuning them with medical tweets. He also highlights ongoing research that leverages larger models trained on extensive medical and scientific literature, aiming to enhance understanding in the healthcare domain.

In this clip
From this podcast
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Is ChatGPT Getting Worse? with James Zou - 645
Related Questions
- How are large language models (LLMs) trained?
- How are Large Language Models (LLMs) fine-tuned post-training in the episodes Is ChatGPT Getting Worse? with James Zou - 645 and Medical Language Models?