Peter discusses the excitement of discovering OSGI's benefits, emphasizing the control it offers developers over their software. However, he warns of challenges when integrating third-party libraries and the complexities of modularizing legacy code, which can lead to significant difficulties if not approached carefully. The conversation highlights the importance of understanding existing plugin systems and the potential pitfalls of assuming modularity in large codebases.