by July 6th, 2011on
At UPA 2011, Michael Rawlins, Lori Hawkins, and Jeff Sauro presented about Keystroke Level Modeling (KLM), a tool for estimating the actual movements and the time to perform each step that a particular UI design requires for users to complete a given task. KLM offers a way to analyze the time on task required by a design rather than attempting to empirically test time on task, which is difficult to do meaningfully with tight project time frames, limited numbers of participants, and the constrained interactions of many usability test situations. Furthermore, evaluating time on task during a typical usability test (without extra considerations) can usually only return meaningful data when the goals of the product focus on the first experience a user has, such as with a website or kiosks user interfaces. Time on task data from usability testing becomes less meaningful when evaluating applications where use over time must be considered, even when efficiency is a key usability goal. Since KLM can analyze the optimal possible time on task rather than the initial experience, it can provide a more accurate measure the success of a design where efficiency is key to success in a tool that will be used repeatedly over time.
The presenters also noted that, because it offers early indicators of the potential success of a design, KLM is useful for evaluating design direction with stakeholders. The consistent measurements provide reliable metrics to help stakeholders evaluate a design against established business and usability goals. Read the rest of this post »