A Cost-Effective Usability Evaluation Progression for Novel Interactive Systems
Deborah Hix, Joseph L. Gabbard, J. Edward Swan II, Mark A. Livingston, Tobias H. Höllerer, Simon J. Julier, Yohan Baillot, and Dennis Brown. A Cost-Effective Usability Evaluation Progression for Novel Interactive Systems. In Hawaii International Conference on System Sciences (HICSS-37), January 2004.
Download
Abstract
This paper reports on user interface design and evaluation for a mobile, outdoor, augmented reality (AR) application. This novel system, called the Battlefield Augmented Reality System (BARS), supports information presentation and entry for situation awareness in an urban war fighting setting. To our knowledge, this is the first time extensive use of usability engineering has been systematically applied to development of a real-world AR system. Our BARS team has applied a cost-effective progression of usability engineering activities from the very beginning of BARS development. We discuss how we first applied cycles of structured expert evaluations to BARS user interface development, employing user interface mockups representing occluded (non-visible) objects. Then we discuss how results of these evaluations informed our subsequent user-based statistical evaluations and formative evaluations, and present these evaluations and their outcomes. Finally, we discuss how and why this sequence of types of evaluation is cost-effective.
BibTeX
@InProceedings{HICSS04-uep,
author = {Deborah Hix and Joseph L. Gabbard and J. Edward {Swan~II} and
Mark A. Livingston and Tobias H. H\"{o}llerer and Simon J. Julier
and Yohan Baillot and Dennis Brown},
title = {A Cost-Effective Usability Evaluation Progression for Novel Interactive Systems},
booktitle = {Hawaii International Conference on System Sciences (HICSS-37)},
location = {Waikoloa, Hawaii, USA},
date = {January 5--8},
month = {January},
year = 2004,
abstract = {
This paper reports on user interface design and evaluation for a mobile,
outdoor, augmented reality (AR) application. This novel system, called the
Battlefield Augmented Reality System (BARS), supports information presentation
and entry for situation awareness in an urban war fighting setting. To our
knowledge, this is the first time extensive use of usability engineering has
been systematically applied to development of a real-world AR system.
Our BARS team has applied a cost-effective progression of usability engineering
activities from the very beginning of BARS development. We discuss how we first
applied cycles of structured expert evaluations to BARS user interface
development, employing user interface mockups representing occluded
(non-visible) objects. Then we discuss how results of these evaluations informed
our subsequent user-based statistical evaluations and formative evaluations, and
present these evaluations and their outcomes. Finally, we discuss how and why
this sequence of types of evaluation is cost-effective.
},
}