ISBN: 9781627057592 print
ISBN: 9781627057608 ebook
DOI 10.2200/S00706ED1V01Y201602HCI034
A Publication in the Morgan & Claypool Publishers series
SYNTHESIS LECTURES ON HUMAN-CENTERED INFORMATICS #34
Series Editors: John M. Carroll, Penn State University
Series ISSN 1946-7680 Print 1946-7699 Electronic
Qualitative HCI Research:
Going Behind the Scenes
Ann Blandford
University College London
Dominic Furniss
University College London
Stephann Makri
City University London
SYNTHESIS LECTURES ON HUMAN-CENTERED INFORMATICS #34
ABSTRACT
Human–Computer Interaction (HCI) addresses problems of interaction design: understanding user needs to inform design, delivering novel designs that meet user needs, and evaluating new and existing designs to determine their success in meeting user needs. Qualitative methods have an essential role to play in this enterprise, particularly in understanding user needs and behaviours and evaluating situated use of technology. Qualitative methods allow HCI researchers to ask questions where the answers are more complex and interesting than “true” or “false,” and may also be unexpected. In this lecture, we draw on the analogy of making a documentary film to discuss important issues in qualitative HCI research: historically, films were presented as finished products, giving the viewer little insight into the production process; more recently, there has been a trend to go behind the scenes to expose some of the painstaking work that went into creating the final cut. Similarly, in qualitative research, the essential work behind the scenes is rarely discussed. There are many “how to” guides for particular methods, but few texts that start with the purpose of a study and then discuss the important details of how to select a suitable method, how to adapt it to fit the study context, or how to deal with unexpected challenges that arise. We address this gap by presenting a repertoire of qualitative techniques for understanding user needs, practices and experiences with technology for the purpose of informing design. We also discuss practical considerations such as tactics for recruiting participants and ways of getting started when faced with a pile of interview transcripts. Our particular focus is on semi-structured qualitative studies, which occupy a space between ethnography and surveys—typically involving observations, interviews and similar methods for data gathering, and methods of analysis based on systematic coding of data. Just as a documentary team faces challenges that often go unreported when arranging expeditions or interviews and gathering and editing footage within time and budget constraints, so the qualitative research team faces challenges in obtaining ethical clearance, recruiting participants, analysing data, choosing how and what to report, etc. We present illustrative examples drawn from prior experience to bring to life the purpose, planning and practical considerations of doing qualitative studies for interaction design. We include takeaway checklists for planning, conducting, reporting and evaluating semi-structured qualitative studies.
KEYWORDS
qualitative methods, QDA, grounded theory, Thematic Analysis, Ethnography, Observational studies, interview studies
Contents
1.1 An Overview of Qualitative Approaches and Methods in HCI
1.2 The Space of Interpretive Qualitative Studies in HCI
2.1 So, You’ve Got this Great Idea or Burning Question
2.3 Being Realistic: Resources and Constraints
2.4 Ethics and Informed Consent
2.5 Accommodating Researcher Biases and Pre-existing Theory when Planning a Study
2.6 Summary and Checklist: Planning a Study
3.1 Approaches to Sampling
3.2 Sampling in Practice: Recruiting Participants
3.3 Sampling in Practice: Negotiating Access
3.4 How Many Participants?
3.5 Summary and Checklist: Recruiting Participants
4.1 The Role of the Researcher
4.2 Observation
4.3 Think-Aloud
4.4 Semi-structured Interviews
4.5 Focus Groups
4.6 Diary Studies and Autoethnography
4.7 Working with Existing Sources
4.8 Summary and Checklist: Data Gathering
5.1 From Buckets to Causal Narratives: Different Approaches to Coding and Analysing Data
5.2 A Pragmatic Approach to Analysis
5.3 Tools for Qualitative Data Analysis
5.4 Thematic Analysis
5.5 Illustrative Example
5.6 Top-down Approaches to Analysis
5.7 Summary and Checklist: Analysing Data