Performance goals at large organizations like IBM are formally defined, involving extensive discussions among performance, development, and sales teams. Both client-side and back-end metrics, such as response times and memory footprint, are crucial. Understanding the entire application stack is essential for performance engineers to navigate the complexities and challenges of software performance effectively.