Web Scraping Challenges
Diarmuid discusses the hurdles faced when venturing into web scraping, especially for those without a programming background. Key challenges include writing effective yet not necessarily efficient code, navigating ambiguous terms of service, and ensuring reliable data collection from frequently updated sources. He emphasizes the need for a balance between functionality and performance, particularly in the realm of social sciences.In this clip
From this podcast
Software Engineering Radio - the podcast for professional software developers
Episode 503: Diarmuid McDonnell on Web Scraping
Related Questions