You've out-sourced your testing. The new outfit is cheaper and quality hasn't suffered. So it's been a success, right?
That depends. Are you measuring everything? Transactions can have secondary and important consequences, as China discovered.
In our current world of test design we like to focus heavily on following a specified pattern by which we will create our tests. In a perfect world, we would be able to follow the rules we have set. However, in real life working environments you will occasionally find that there is no good solution that fits. This blog considers 8 ‘golden rules’ including if, why and when we break our own rules.