International Journal of Information Technology & Computer Science ( IJITCS )
One of the current problems for Human-Computer Interaction is the limitation of methods to functionally evaluate usability in 3D virtual world applications. This paper describes a hybrid usability evaluation method which we use to conduct an expert review of the user interface of a 3D virtual world application in Second Life. With the walkthrough highlighting ‘in-world’ task-based problems and heuristics focusing on the user interface, the hybrid method was very effective in capturing usability problems. We therefore conclude that using a hybrid method for usability evaluation in 3D virtual world applications may be more effective than using a single-perspective method.
: Usability; Virtual Worlds; User Interface; Interaction
- L. Dybkjaer, N. Bernsen, and W. Minker, “New challenges in usability evaluation – beyond task-oriented spoken dialogue systems,” Proc. of ICSLP, vol. 3, pp. 2261 – 2264, October 2004.
- J. Heim, A. Karahasanovic, and P. Brandtzaeg, “Capturing user requirements and feedback for Web 2.0 applications by a norm-based questionnaire,” Proc. of NordiCHI, pp. 25 – 32, October 2008.
- J. Nielsen, and R. Molich, “Heuristic evaluation of user interfaces,” Proc. of CHI, pp. 249 – 256, April 1990.
- C. Wharton, J. Rieman, C. Lewis, and P. Polson, The cognitive walkthrough method: a practitioner’s guide. NY: John Wiley & Sons, 1994.
- H. Sayers, “Desktop virtual environments: a study of navigation and age,” Interacting with Computers, vol. 16, pp. 939 – 956, May 2004.
- S. Burigat, and L. Chittaro, “Navigation in 3D virtual environments: effects of user experience and location-pointing navigation aids,” Int. J. Human-Computer Studies, vol. 65, pp. 945 – 958, July 2007.
- S. Minocha, and C. Hardy, “Designing navigation and wayfinding in 3D virtual learning spaces,” Proc. of OzCHI, pp. 211 – 220, November 2011.
- D. Bowman, J. Gabbard, and D. Hix, “A survey of usability evaluation in virtual environments: classification and comparison of methods,” Presence: Teleoperators and Virtual Environments, vol. 11, pp. 404 – 424, August 2002.
- A. Sutcliffe, B. Gault, T. Fernando, and K. Tan, “Investigating interaction in CAVE virtual environments,” T. Computer-Human Interaction, vol. 13, pp. 235 – 267, June 2006.
- K. Hinckley, R. Pausch, J. Goble, and N. Kassell, “A survey of design issues in spatial input,” Proc. of UIST, pp. 213 – 222, November1994.
- R. Stuart, The design of virtual environments. NY: McGraw-Hill, 1996.
- D. Bowman, D, Koller, and L. Hughes, “A methodology for the evaluation of travel techniques for immersive virtual environments,” Virtual Reality: Journal of the Virtual Reality Society, vol. 3, pp. 120 – 131, June 1998.
- M. Salzman, C. Dede, and R. Loftin, “Usability and learning in education virtual realities,” Proc. of Human Factors and Ergonomics Society, vol. 39, pp. 486 – 490, October 1995.
- J. Gabbard, “A taxonomy of usability characteristics in virtual environments,” Dept. of Computer Science and Applications, Virginia Polytechnic Institute, unpublished.
- J. Gabbard, D. Hix, and E. Swan, “User centered design and evaluation of virtual environments,” Computer Graphics and Applications, vol. 19, pp. 51 – 59, December 1999.
- R. Kalawasky, “VRUSE – a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems,” Applied Ergonomoics, vol. 30, pp. 11 – 25, July 1999.
- K. Kaur, N. Maiden, and A. Sutcliffe, “Interacting with virtual environments: an evaluation of a model of interaction,” Interacting with Computers, vol. 11, pp. 403 – 426, April 1999.
- . Hix, J. Swan, L. Gabbard, M. McGee, J. Durbin, and T. King, “User-centered design and evaluation of a real-time battlefield visualization virtual environment,” Proc. of Virtual Reality, pp. 96 – 103, March 1999.
- A. Sutcliffe, Multimedia and Virtual Reality: Designing multisensory user interfaces. NJ: Lawrence Erlbaum Associates, 2003.
- D. Holley, M. Hobbs, P. Howlett, and W. Sawyerr, “‘The chaotic science lab’ supporting trainee science teachers – a cross departmental project,” Dept. of Computing and Technology, Anglia Ruskin University, unpublished.
- A. Sutcliffe, and K. Kaur, “Evaluating the usability of virtual reality user interfaces,” Behavior & Information technology, vol. 19, pp. 415 – 426, November 2000.
- C. Rusu, R. Munoz, S. Roncagliolo, S. Rudloff, V. Rusu, and A. Figueroa, “Usability heuristics for virtual worlds” Proc. of AFIN, pp. 16 – 19, August 2011.
- R. Munoz, T. Barcelos, and V. Chalegre, “Defining and validating virtual worlds usability heuristics,” Proc. of ITNG, pp. 690 – 695, April 2012.
- T. Heino, D. Cliburn, S. Rilea, J. Cooper, and V. Tachkov, “Limitations of signs as navigation aids in virtual worlds,” Proc. of HICSS, pp. 1 – 10, January 2010.
- E. Vilar, F. Rebelo, and P. Noriega, “Indoor human wayfinding performance using vertical and horizontal signage in virtual reality,” Human Factors and Ergonomics in Manufacturing & Service Industries, vol. 0, pp. 1 – 15, May 2012.