UIEtips Article: Usability Testing. Oh, The Things You Can Learn.
February 27th, 2007
UIEtips 2/27/07: Usability Testing. Oh The Things You Can Learn.
In 1988, UIE started with the goal of conducting usability tests for clients. For many years, we made quite a good business of this.
Now, it feels like we do our best to convince people they should be conducting tests on their own, even those folks who want to pay us. Don’t get me wrong: we love to conduct usability tests. We think they are great fun and we learn something every time.
That’s just it. We learn things the clients should be learning themselves. In a typical project, if we’re lucky, we might communicate half of what we learn about the client’s users, designs, and team members back to the client. In our minds, that’s too much waste of important information, left in our minds and not integrated into the thinking of the client.
In this week’s UIEtips, I catalogue some of the things a team learns when they put together their own usability tests, starting with recruiting and ending with the analysis. Of course, in a short article, I couldn’t cover everything, but I think I nailed the important stuff nobody ever talks about.
Do you conduct your own usability tests? Have you learned important things from your tests? We’d love to hear your insights. Leave a comment and join the discussion below.
[If you're thinking about conducting your own usability tests, you'll definitealy want to take part in Friday's UIE Virtual Seminar, Demystifying Usability Tests: Learning the Basics, by Christine Perfetti. It's the perfect way to introduce testing to your team. Space is limited so sign up today ]
February 27th, 2007 at 12:03 pm
I just conducted my first usability test - mostly to verify what usability problems I thought existed with our current site before starting to redesign it, but also to communicate to management our current issues with the site. While I can definitely improve how I conduct a usability test, I still got lots of great information - particularly how our site is used. I was surprised to find that those I considered to have more computer and Internet experience had a more difficult time and took longer to complete tasks than those I considered to have less experience.
I would like to have at least two more usability tests as the redesign progresses, but at a wider scale than what I did with the first test. I’ll just have to figure out how to best get the right people for testing while keeping costs at a minimum.
I also want to add that Rolf Molich’s “Advanced Methods for Usability Testing” at UI11 was very helpful for me in this process!
February 28th, 2007 at 7:44 pm
Jared: You’ve discovered what I also discovered, but on a larger scale. Usability testing is but one of at least 5 distinct areas of Design Research. I learned about the signficance of these 5 areas and the need not only to do them yourself, but also to collect the results and share them, with commentary as a corporate asset, while at a major semiconductor manufacturer, which outsourced a lot of these activities. When I went under the covers of these ‘automated’ services, I discovered that most of what was being tracked was useless, or had errors in the tracking.
All of these various methods feed one another. The less expensive methods should be used to point to deeper research that then justifies the investment in more expensive methods.
Part of the challenge to this and other activities is that they are not inherently part of most organizations and there is no one who would otherwise champion them for strategic funding. They’re stuck in a no-mans-land between IT and Marketing — never mind the implications as Enterprise 2.0 starts kicking up.
There is a tremendous need for new roles and new organizational structures to support them. Until we get those parts of the stories told, the actitives will continue to just fall on the floor (or get shipped out to service providers).
March 3rd, 2007 at 10:56 pm
Good reading!
Sometimes it would be nice to be able to download a MP3 of the article so I can listen to the article on my iPod.
Also gives the article some personality from the author. Be a nice addition perhaps the next phase of content publishing on the web - vlogs
We may do the same one day with our articles.
March 6th, 2007 at 8:53 pm
Often a useful side effect of testing results is user comments about aspects of your product/design that you’re not specifically testing. In this way, usability testing provides feedback that helps people within your organisation to see your business through fresh eyes - those of your customers. Thus, apart from all its other benefits, usability testing is a great way to get close to your customers.