Home
Schedule
Assignments
Topics in Information Processing - Field Research: CPSC 530b
UBC Computer Science - Winter 2009

NOTE: The schedule is not fully finalized.

This is an advanced readings course in Human-Computer Interaction Field Research. Every student is expected to answer questions about each paper before the class. Those questions will be used to guide the discussion that takes place in class.

There is no official textbook for this course. All readings will be available online. 
 
# Date Topics and Readings Deliverables
1 Friday, Jan. 23rd

 

NECTAR Session 1:
  • Part A: Introducing Qualitative Research and Placing it in Its Intellectual Context
  • Part B: Planning the Research Strategy

1. Tony Salvador, Genevieve Bell, and Ken Anderson. Design Ethnography. Design Management Journal, Fall, 1999, pp 35 – 41 (NECTAR readings)

2. Alan Cooper About Face 3: The Essentials of Interaction Design, Wiley Publishing, Inc., Indianapolis, 2007. Chapter 4 (49-73) Qualitative Research (overview). (NECTAR readings)

3. Ron Weber Editor’s Comments: The Rhetoric of Positivism Versus Interpretivism: A Personal View, MIS Quarterly, Vol. 28 No. 1, pp. iii-xii, March 2004 Theoretical. Challenges the distinction between positivism and interpretivism.(NECTAR readings)


2 Thursday, Jan 29th
Approaches to Understanding User Behaviour: What are the tradeoffs?

4. McGrath, J. (1994). Methodology matters: Doing research in the behavioural and social sciences. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).(web) Pay particular attention to the sections on field and respondent strategies and classes of measures.

5. Kellar, Melanie, Hawkey, Kirstie, Inkpen, Kori M. & Watters, Carolyn (2008). Challenges of Capturing Natural Web-Based User Behaviors. International Journal of Human-Computer Interaction, 24 (4), 385-409.(pdf)

6. Neale, D. C. and Carroll, J. M. 1999. Multi-faceted evaluation for complex, distributed activities. In Proceedings of the 1999 Conference on Computer Support For Collaborative Learning (Palo Alto, California, December 12 - 15, 1999). C. M. Hoadley and J. Roschelle, Eds. Computer Support for Collaborative Learning. International Society of the Learning Sciences, 53. (acm )


Research critiques assigned.

Marking scheme

NECTAR assignment on focus due

3 Thursday, Feb 5

NECTAR Session 2: Data Gathering - What Makes for Credible and Interpretable Field Data

7. Roy Suddaby What Grounded Theory is Not, Academy of Management Journal, 2006, Vol 49, No. 4, 633-642 Theoretical. Brief overview of grounded theory concepts, critique of common errors in its practice. (NECTAR readings)

8. * Sally Jo Cunningham, Chrish Knowles, Nina Reeves An Ethnographic Study of Technical Support Workers: Why we didn’t build a tech support digital library, JCDL ’01, June, 2001, Roanoake, Virginia (ACM 1-58113-345-6/01/0006) Case example. Starts by explaining why digital library seems like a natural for tech support workers, goes on to show how contextual understanding of the dynamics of their work and use of info resources shoots that idea down. Field research, leading to abandonment of the product concept. (acm)

9. * Beth Kolko, Emma Rose, Erica Johnson Communication as Information-Seeking: The case for mobile social software for developing regions., WWW 2007, Banff, Alberta, CA (ACM 978-1-59593-654-7/07/0005) Case example. Evaluates relative role of internet and mobile phones in Central Asia, makes case for “social software” development for mobile platforms. Although not main focus of research, an interesting aspect is their effort to assess real levels of internet access. Mixes qualitative, quantitative, surveys and on-the ground observation. Reflects what we call a “contextual scan”. (acm)

10. [Recommended] Michael Quinn Patton. Qualitative Research and Evaluation Methods, Sage Publications, Thousand Oaks, CA 2002. Chapter 2 (NECTAR readings)

10. [Recommended during class by Kelly]

  • De Millo, R. A., Lipton, R. J., and Perlis, A. J. 1979. Social processes and proofs of theorems and programs. Commun. ACM 22, 5 (May. 1979), 271-280. (DOI)
  • Dijkstra's response: Dijkstra, E. W., DeMillo, R. A., Lipton, R. J., and Perlis, A. J. 1978. On a political pamphlet from the middle ages. SIGSOFT Softw. Eng. Notes 3, 2 (Apr. 1978), 14-16. DOI
  • The author's response: DeMillo, R. A., Lipton, R. J., and Perlis, A. J. 1978. Response from R. A. DeMillo, R. J. Lipton, A. J. Perlis. SIGSOFT Softw. Eng. Notes 3, 2 (Apr. 1978), 16-17. DOI

Research critique 1 due.

NECTAR assignment 2 out (data types/draft protocol)

4 Thursday, Feb 12

 

Best papers and best paper nominees: examples from CHI and CSCW of good field research and good reporting

11. * Szentgyorgyi, C., Terry, M., and Lank, E. 2008. Renegade gaming: practices surrounding social use of the Nintendo DS handheld gaming system. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 1463-1472. (acm ) Best Paper Nominee; interviews & observation

12. * Le Dantec, C. A. and Edwards, W. K. 2008. Designs on dignity: perceptions of technology among the homeless. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 627-636. (acm ) Best Paper; photo elicitation & interviews

13. * Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., and Saarikko, P. 2008. It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 1285-1294. (acm ) Best Paper Nominee; log data, video analysis, interviews

14. * McCarthy, J. F., Congleton, B., and Harper, F. M. 2008. The context, content & community collage: sharing personal digital media in the physical workplace. In Proceedings of the ACM 2008 Conference on Computer Supported Cooperative Work (San Diego, CA, USA, November 08 - 12, 2008). CSCW '08. ACM, New York, NY, 97-106.(acm ) Best Paper Nominee; survey, observations, interviews

Research critique 2 due.

Course project out

.. Thursday, Feb 19

Reading week: no class 

Email Kirstie with a description of your planned course project
.. Monday, February 23

.. 

NECTAR protocol assignment due
5 Thursday, Feb 26

NECTAR Session 3: Observation, Interviewing, Contextual Inquiry

15. Hugh Beyer and Karen Holtzblatt Contextual Design: Defining Customer Centered Systems, Morgan Kaufmann, San Francisco, 1998, Chapters 2-6 (pages 29-123) Overview of contextual inquiry. (NECTAR readings )

NECTAR assignment 3 out (conduct data collection, write up visit report)
6 Thursday, March 5

NECTAR Session 4: Field Usability Evaluations

16. Susan Dray, David Siegel, Even Feldman, Maria Potenza Why do Version 1.0 and Not Release It? Conducting Field Trials of the Tablet PC, interactions, 9(2), march/april 2002 (doi ) Business case. Discusses advantages of naturalistic field trial for new technology, contrasts with limitations of usability testing. Field trial, some discussion of hybrid methodology (how to combine training with evaluation).

17. David A. Siegel, Bill Reid, Susan M. Dray IT Security: Protecting Organizations in Spite of Themselves, interactions, 13(3), May-June 2006 (doi ) Case example. Examines organizational dynamics and practices re: corporate security as they affect adoption of technology based tools and practices. Interview, artifact walkthroughs, etc, but article focuses on findings re contextual dynamics.

Read a selection from:

18. * Bonnie Nardi, Diane J. Schiano, Michelle Gumbrecht Blogging as Social Activity, or, Would You Let 900 Million People Read Your Diary, CSCW 2004, Chicago, IL, USA. (ACM 1-58113-810-5/04/0011) (doi) Case example, with brief discussion of Activity Theory. Ethnographic study of blogging, leading to recommendations for features for blogging tools. Interesting question is whether and how the rich info re: emotional meaning of blogging translated into practical recommendations. Interviews and text analysis of Blog posts.

19. Lisa Reichenbach and Amy Maish Larger Than Life: Bodily and Social Transitions within Type 2 Diabetes. EPIC 2006, pp. 5-18 American Anthropology Association (anthrosource.net )

20. * William S. Stubblefield and Karen S. Rogers The Social Life of Engineering Authorizations, DIS 2000, pp 9-19. (ACM ACM 1-58113-219-0/00/0008) (doi) Case example. Fieldwork with engineers led to changes in design of web-based tool for creating and managing engineering authorizations. Interviews, focus groups, prototypes and participatory design.

21. Jesper Simonsen and Finn Kensing Using Ethnography in Contextual Design, CACM, July 1997, Vol. 40, No. 7 (doi) Case example. Tries to show how ethnographic work had significant impacts on development of software tools for A “Film Board,” a public funding agency within an “unnamed” ministry of cultural affairs (authors are Danish).

22. * Melissa Cefkin, Jakita Owensby Thomas, and Jeanette Blomberg The implications of Enterprise-wide pipeline management tools for organizational relations and exchanges, Group ’07, 2007, Sanibel Island, FL, USA (ACM 978-1-59593-845-9/07/0011) (doi) Case example. In-depth analysis of CRM practices and processes in multiple divisions of a company, suggesting a typology of key dimension of difference involving fundamentally different usage dynamics for CRM tools.

Research critique 3 due.

Ethics and consent forms - make sure you have completed the TCPS tutorial BEFORE conducting your research

7 Thursday, March 12th

Issues Conducting Field Research in the Workplace

23. N. G. Vinson, and J. A. Singer, “A Practical Guide to Ethical Research Involving Humans,” in F. Shull, J. A. Singer, and D. Sjoberg (Eds.), Guide to Advanced Empirical Software Engineering, Springer, 2008, pp.229-256. (Springer ) Good overview of ethical issues of recruitment in the workplace with some practical solutions.

24. Tang, J. C., Liu, S. B., Muller, M., Lin, J., and Drews, C. 2006. Unobtrusive but invasive: using screen recording to collect field data on computer-mediated interaction. In Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work (Banff, Alberta, Canada, November 04 - 08, 2006). CSCW '06. ACM, New York, NY, 479-482. (acm ) Privacy issues - participants and their colleagues.

25. * McLachlan, P., Munzner, T., Koutsofios, E., and North, S. 2008. LiveRAC: interactive visual exploration of system management time-series data. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 1483-1492. (acm ) Best Paper Nominee, Recruiting busy participants.

Research critique 4 due.
.. Wednesday, March 18

..

NECTAR raw visit report due
8 Thursday, March 19

NECTAR Session 5: Analysis: distilling and Archiving Raw Data

26. Michael Quinn Patton. Qualitative Research and Evaluation Methods, Sage Publications, Thousand Oaks, CA 2002. Chapter 8 (pp. 452-494) (NECTAR readings)

27. A Michael Huberman and Matthew B. Miles The Qualitative Researcher’s Companion

First draft of course project is due
.. Wednesday, March 25

..

NECTAR coded report due
9 Thursday, March 26
NECTAR Session 6: Analysis: Affinities, Clustering, Dimensions

28. Bob Gephart Qualitative Research and the Academy of Management Journal, Academy of Management Journal 2004, Vol 47, No 4 454-462. (NECTAR readings) Theoretical. Discussion of what makes for credible, rigorous qualitative work.

29. A Michael Huberman and Matthew B. Miles The Qualitative Researcher’s Companion Chapter 8. (NECTAR readings)

Feedback on first draft of course project will be returned
10 Thursday, April 2

NECTAR Session 7: Wrap-up Topics

30. Alan Cooper About Face 3: The Essentials of Interaction Design, Wiley Publishing, Inc., Indianapolis, 2007.

31. [Recommended] Robin Beers and Pamela Whitney From Ethnographic Insight to User-centered design tools. EPIC 2006, pp. 144- 154, American Anthropology Association (anthrosource.net)

32. [Recommended] Rachel Jones Experience models: Where ethnography and design meet. EPIC 2006, pp. 81-93 American Anthropology Association. (anthrosource.net)

33. [Recommended] Suzanne Thomas and Tony Salvador Skillful Strategy, Artful Navigation, and Necessary Wrangling, EPIC 2006, pp. 109-124. American Anthropology Association (anthrosource.net)

Research critique 5 due.
11 April 9th

CHI conference week

11 Wednesday, April 16th

Project presentations begin at noon, followed by celebratory snacking

  • Presentations: 15 minutes max + 5-10 minutes of questions
  1. Pooya Jaferian
  2. Evgeny Maksakov
  3. Sara Motiee
  4. Jennifer Fernquist
  5. Russ MacKenzie
Final draft of course project is due in KAIS 4044 by 2pm, Friday, April 17th.