Peter highlights the critical mistake of not allocating a sufficiently large address space in system design, adding it to the list of complex challenges in computer science. He emphasizes the importance of standards in networking, noting that successful internetworking relies on established protocols rather than proprietary solutions. The best administration is one that minimizes the need for oversight, driven by adherence to these standards.