Published Mar 1, 2017

Recode Decode: Brewster Kahle, chairman, The Internet Archive

Explore the future of AI and digital preservation with Brewster Kahle, who delves into the ethical responsibilities of AI development, the mission of the Internet Archive to safeguard all human knowledge, and the challenges of archiving in the digital age.
Episode Highlights
Decoder with Nilay Patel logo

Popular Clips

Episode Highlights

  • Copyright Challenges

    Brewster Kahle, chairman of the Internet Archive, highlights the challenges libraries face due to copyright laws and access restrictions. He explains that while libraries traditionally buy and lend books, the transition to ebooks presents new hurdles, such as restrictive licensing terms. Kahle emphasizes the importance of maintaining access to long-form narratives, whether in print or digital form, and ensuring authors are compensated.

    Most of what's in a library is copyrighted materials. And we've always worked with publishers. What we do is buy and lend. So we buy what we can in books. We buy what we can and then we scan what we have to.

    ---

    The Internet Archive has digitized millions of books, including those still under copyright, to make them accessible through lending systems similar to traditional libraries. This approach aims to balance the need for public access with the rights of authors and publishers 1 2.

       

    Platform Barriers

    The Internet Archive faces significant barriers from social media and digital platforms due to proprietary constraints. Kahle discusses how platforms like Facebook and Instagram limit access to their content, complicating efforts to archive digital history. Despite these challenges, the Archive employs special crawlers and collaborates with librarians to capture as much content as possible.

    We thought it was going to be a very easy thing, easy, democratic. Anybody could go and be a player, but now we have these large platforms that really control our lives.

    ---

    Kahle notes that capitalism often wins over cultural preservation, making it difficult to secure cooperation from tech giants. The Archive continues to adapt, striving to preserve a comprehensive record of our digital age 3 4.

       

    Archiving Innovations

    Innovations in archiving are crucial for preserving digital content, with the Wayback Machine being a key tool developed by the Internet Archive. Kahle describes how this tool captures the ephemeral nature of web pages, which often change or disappear within 100 days. The Wayback Machine allows users to search and access historical web content, preserving a digital chronicle of our time.

    We started by archiving the world wide Web, the most ephemeral of media. A web page lasts about 100 days before it's either changed or deleted.

    ---

    Kahle also discusses the potential of a decentralized web to enhance privacy and reliability, ensuring that digital content remains accessible and secure for future generations 5 6.

Related Episodes