Pre-Design Empiricism for Information Visualization: Scenarios, Methods, and Challenges

Matthew Brehmer, Sheelagh Carpendale, Bongshin Lee, and Melanie Tory


Abstract | Paper | Talk |

Abstract

Empirical study can inform visualization design, both directly and indirectly. Pre-design empirical methods can be used to characterize work practices and their associated problems in a specific domain, directly motivating design choices during the subsequent development of a specific application or technique. They can also be used to understand how individuals, existing tools, data, and contextual factors interact, indirectly informing later research in our community. Contexts for empirical study vary and practitioners should carefully consider finding the most appropriate methods for any given situation. This paper discusses some of the challenges associated with conducting pre-design studies by way of four illustrative scenarios, highlighting methods as well as the challenges unique to the visualization domain. We encourage researchers and practitioners to conduct more pre- design empirical studies and describe in greater detail their use of empirical methods for informing design.

Paper

Pre-Design Empiricism for Information Visualization: Scenarios, Methods, and Challenges
In Proceedings of the ACM Workshop on Beyond Time And Errors: Novel Evaluation Methods For Visualization (BELIV), Paris, France, November 10, 2014, p. 147-151.
→ [Pre-Print PDF] [BibTeX]

Talk

This paper was presented on Monday, Nov. 10, in the "Experience Reports" session of BELIV 2014.

Slides (7 MB PDF)
Slides (13 MB Keynote)
Video (9 MB MP4)
Matthew Brehmer
Last modified: Nov 26, 2014.