INUIT: The Interface Usability Instrument

INUIT LogoAs one of the building blocks of my PhD thesis, I have developed a novel instrument for measuring the usability of web interfaces, which is simply called Inuit—the Interface Usability Instrument1. This was necessary because a usability instrument that is suited for the automatic methods for Search Interaction Optimization I have developed in my PhD project must fulfill three particular requirements, which are not met by any existing instruments:

(R1) A minimal number of items.
(R2) Items with the right level of abstraction for meaningful correlations with user interactions recorded on the client.
(R3) Items that can be applied to a web interface in terms of a stand-alone webpage.

The Instrument

Inuit has been designed and developed in a two-step process: First, over 250 rules for good usability from established guidelines and checklists were reviewed to identify a set of common underlying factors (or items) according to R2. From these underlying factors, a “structure” of usability based on ISO 9241-11 was created, which was then shown to 9 dedicated usability experts in the second step. The experts—all of which were working in the e-commerce industry—reviewed the given “structure” and proposed changes according to their perception of web interface usability. Finally, seven items have been identified:

  1. Informativeness
  2. Understandability
  3. Confusion
  4. Distraction
  5. Readability
  6. Information Density
  7. Reachability

These items can be translated to, e.g., the following yes/no questions for use in a questionnaire for determining the usability of a webpage:

  1. Did you find the content you were looking for?
  2. Could you easily understand the provided content?
  3. Were you confused while using the webpage?
  4. Were you distracted by elements of the webpage?
  5. Did typography & layout add to readability?
  6. Was there too much information presented on too little space?
  7. Was your desired content easily and quickly reachable (concerning time & distance)?

Conclusions

A confirmatory factor analysis based on a user study with 81 participants has proven that our instrument reasonably well reflects real-world perceptions of web interface usability. Inuit was first introduced at the workshop “Methodological Approaches to Human–Machine Interaction”, which was held as part of the 2013 Mensch & Computer conference. The corresponding paper is named Towards Metric-based Usability Evaluation of Online Web Interfaces (full-text here). The final version of the instrument has been presented at this year’s International Conference on Design, User Experience and Usability (DUXU), which has been held in Los Angeles. The full research paper is titled Inuit: The Interface Usability Instrument and available via Springer (full-text here).

Future Work

In the future, I intend to transfer Inuit into the context of my current work. That is, I intend to use it for evaluating the web interface of HoloBuilder, which enables users to create 3D content for the web, in contrast to the usual 2D content that is consumed nowadays. It will be particularly interesting to see whether both, 2D and 3D web interfaces can be meaningfully evaluated using the same minimal instrument. Furthermore, Inuit will be applied in the context of the research on evidence-based computing that is happening at the VSR research group at Technische Universität Chemnitz.

P.S.: Thanks a lot to Viet Nguyen for the awesome Inuit logo! 🙂

1 Please note the small caps!

Advertisements

Umfrage: Suchmaschinen – Wahrnehmung, Nutzung & Erwartungen

Suchmaschinen: Wahrnehmung, Nutzung & ErwartungenFür meine Doktorarbeit in Human-Computer Interaction führe ich momentan eine Umfrage zur Nutzung von Suchmaschinen durch. Es geht mir in dieser Umfrage vor allem darum, herauszufinden, wie ihr Suchmaschinen wahrnehmt und welche Erwartungen ihr an sie habt. Besonderer Fokus liegt auch auf der Nutzung mit Smartphones, Tablets und anderen Geräten, wie z. B. einer Nintendo Wii U oder PlayStation 4 (ja, man kann mit Spielekonsolen mittlerweile ins Internet gehen!).

Die Umfrage dauert (teilweise abhängig von euren Antworten) nur ca. 15–20 Minuten. Da ich meine Dissertation in Kooperation mit der Unister GmbH schreibe, bekommt außerdem jeder Teilnehmer einen Reisegutschein im Wert von 50 € für ab-in-den-urlaub.de. An dieser Stelle vielen Dank an meinen Industriepartner 🙂

Bitte nehmt rege an meiner Umfrage teil (siehe unten) und verbreitet sie auch ein bisschen weiter (insbesondere, wenn ihr selbst keine Zeit zur Teilnahme habt). So könnt ihr einen wichtigen Beitrag zu meiner Forschung und Doktorarbeit leisten! Vielen Dank 🙂

(Umfrage in neuem Tab öffnen: https://docs.google.com/forms/d/14ViXK-Cl7liQmaR3K_KmJtt_4LK11Thy1pRz9dWJvGw/viewform?usp=send_form)