Parameter Efficient Fine-Tuning
Lora represents a groundbreaking approach to fine-tuning large language models, enabling the adjustment of a mere fraction of parameters while maintaining efficiency. This method not only speeds up training significantly but also helps prevent catastrophic forgetting, allowing models to learn new tasks without losing previously acquired knowledge. The conversation highlights the irony of referring to models with billions of parameters as "small" and the ongoing evolution of model sizes in AI.In this clip
From this podcast
Super Data Science: ML & AI Podcast with Jon Krohn
797: Deep Learning Classics and Trends — with Dr. Rosanne Liu
Related Questions