Episode 461 Michael Ashburne and Maxwell Huffman on Quality Assurance

Manual vs Automation

The debate between manual and automated testing in quality assurance is nuanced. Michael Ashburne explains that while automation is appealing, it is not suitable for new features due to their evolving nature. Manual testing allows testers to use their judgment and adapt to changes, providing valuable insights that automated tests might miss 1. Maxwell Huffman adds that automation requires mature test cases and stable features, as it can only confirm if a test passes or fails 1.

You can't automate new feature testing. It has to be an aspect of the product that's mature, not changing from build to build.

--- Michael Ashburne

This highlights the importance of balancing both approaches to achieve comprehensive testing coverage.

   

Exploratory Testing

Exploratory testing plays a crucial role in uncovering defects that automated tests may overlook. Michael Ashburne emphasizes the importance of using judgment and creativity in exploratory testing to discover unexpected issues 2. Maxwell Huffman notes that exploratory testing can reveal critical defects, such as overheating components, that automated tests might miss 3.

Exploratory tests are always where you turn up the weirdest combination of things.

--- Michael Ashburne

This approach ensures a more thorough examination of the software, providing insights that enhance the overall quality assurance process.