The Risks of Discounted Qualitative Studies
“The discerning usability analyst should employ a mix of both qualitative and quantitative methods when discovering usability problems. The risks of relying heavily on a qualitative approach can lead to a severe misdiagnosis especially when usability problems are difficult to detect. This article is a response to Nielsen’s ‘The Risk of Quantitative Studies’ and shows how the problems voters had with the ‘butterfly-ballot’ in the Florida 2000 election would not have been detected with popular discounted qualitative methods. The problems with relying on one-size-fits all usability guidelines such as ‘testing with only five users’ and the inherent bias of pay-for-hire guru’s are also discussed.” (Jeff Sauro – measuring usability)