Web Scraping Challenges

Diarmuid shares his journey into web scraping, sparked by a desire to explore the governance of Australian nonprofits. He encountered significant hurdles, including IP blocking, which led him to implement strategic pauses in his scraping process. His experience highlights the scarcity of APIs in nonprofit studies, pushing him to rely on web scraping as a vital research tool.