With a Cre8asite Usabilty forum, and a forum that focuses upon how Web pages look on different types of browsers, including mobile devices (I’m a big fan of both forums), I was excited when I came across a new paper from Google which looks at usabilty testing of mobile devices.
I’ve recently written about a patent application from Google that discusses software that could enable people to search Google without using a browser, and Aaron, at soloseo, followed up with some of his experiences searching on a phone. I’m curious if others are enjoying the experience.
Google’s paper, Towards the Perfect Infrastructure for Usability Testing on Mobile Devices (PDF), describes some of the processes that they’ve set up to explore the user experience. The abstract for the paper:
In this paper, we describe various setups that allow usability professionals to conduct effective user studies on mobile devices. We describe the factors relevant when building a solution for mobile device observation and the various designs we worked with in the Google user experience research environment as we iterated to meet changing study needs. We highlight several systems that can successfully be used in an industry environment, including a novel setup that is fully portable, can be used in a usability lab as well as in the field, accommodates a large variety of different mobile devices, and allows for live observation by product teams around the world.
Some of the issues around testing mobile devices identified in the paper:
1. Mobile devices come in a lot of different sizes, shapes, and brands with different user interfaces and operating systems.
2. The devices may have very different input systems, from scroll wheels, to custom menu buttons, to styluses.
3. Testing needs to accomodate people holding their phones or PDAs in a natural manner.
4. Since context is important, and phones are mobile, testing needs to be portable.
If you’re a fan of the television show Mythbusters, this report has a similar feel to it, with the creation of different ways to watch people interact with their phones - some more successfully than others. There are pictures in the report of some of the stuff that they came up with, such as cameras that mount directly on peoples’ phones.
I searched for some blogs that focus upon mobile devices, and discuss usability, and came up with the following list. If you know some others, please let me know.
- Gotomobile
- Mike Rowehl: This is Mobility
- Mobile Phone Development
- Windows Mobile Team Blog
- Staygolinks
If you use your phone on the Web, what do you use it for, and how has the experience been?



That’s a very interesting article, Bill. Reliable testing of any kind for mobile devices is a huge challenge — but very much well worth pursuing! Thanks for bringing this to our attention!
Comment by Joe Dolson — March 27, 2007 @ 9:49 am
Thanks, Joe.
I’m glad that they included pictures in the article. It added something to it, seeing little camera’s clamped to mobile phones. Still seems intrusive enought to alter the way folks are interacting with their phones.
Comment by Bill Slawski — March 27, 2007 @ 2:30 pm
That’s some thought-provoking work, Bill. Thanks for the mention. I’m becoming intrigued by the whole Interactive Voice Response (IVR) topic, which seems to be a way to improve the usability of mobile devices enormously. Microsoft is currently buying TellMe Networks and that is an interesting pointer to how things may go.
Comment by Barry Welford — March 27, 2007 @ 10:04 pm
I’ve been involved in planning the menu for an IVR system, Barry. When you have multiple offices or organizations behind the IVR system, it can get interesting deciding which menu choices to offer, and how they are organized - as much political as it is based upon usability considerations.
But it does provide a lot of positive benefits if done correctly. It will be interesting to see where Microsoft takes it.
Comment by Bill Slawski — March 27, 2007 @ 11:02 pm