DISQUS

Lyle · 4 years ago

I think having fewer distractions during testing can be a Good Thing. Granted, it may falsely set the application up to succeed or to do better than it might in the real world. But even given that kind of benefit, most applications will have many problems uncovered during testing.

In your hypothetical example, you have to question whether the reason the app earned undeservedly high marks was due to a lack of interruptions or due to some other issues with the usability testing methods applied. For example: Were the tasks too simple and not representative of real world tasks? Were the evaluators truly representative of the user base? Did the facilitator ask any leading questions? etc...

Of course, your theory about distractions might be right for the hypothetical situation...and you could use other UCD methods to validate or reinforce that theory. For example, you might use a little ethnographic field study with tech support and managers and observe them using this application and others to determine if distractions were the cause of user errors that didn't turn up when there were no distractions.

P.S. Glad to see you blogging!

Vance · 2 years ago

Why are you rerunning old articles? I look forward to your posts, but keep seeing these old ones come up.