The discussion highlights the importance of defining expected and unexpected errors during migrations, particularly when transitioning to Kubernetes. When errors arise at the infrastructure level, rolling back to a previous system may be the safest option, while application-level issues can often be addressed with fixes. Understanding the implications of errors and having a system designed to track operations can significantly ease the rollback process.