Is a Picture Worth a Thousand Words? Member Checking Using the Sketchnoting Approach
DOI:
https://doi.org/10.17169/fqs-26.2.4224Keywords:
quality criteria, process-oriented view of validity, validation, member checking, sketchnoting, visual thinking, multimodalityAbstract
The question of validity is particularly important in the context of qualitative research. There have been numerous attempts to establish or reformulate criteria for validity and procedures for increasing validity. Member checking is one example. Although member checks are frequently integrated into qualitative studies, researchers do not always describe and explain them in detail in the corresponding reports.
In this paper, I would like to contribute to the research on conducting member checks by presenting and discussing the approach of sketchnoting. I argue that there is potential (both in theory and practice) in using this means of communication: Relevant problems that might occur in the context of member checking are addressed, and the gap between transactional and transformational validity approaches is bridged. From the perspective of a process-oriented view of validity, a reflective process for participants and researchers is supported.
Downloads
References
Becker, Howard S. (2002). Visual evidence: A seventh man, the specified generalization, and the work of the reader. Visual Studies, 17(1), 3-11.
Bloor, Michael (1997). Techniques of validation in qualitative research: A critical commentary. In Robert Dingwall & Gale E. Miller (Eds.), Context and method in qualitative research (pp.38-50). London: Sage.
Boehm, Gottfried (1994). Was ist ein Bild?, München: Fink.
Bohnsack, Ralf (2003). Qualitative Methoden der Bildinterpretation. Zeitschrift für Erziehungswissenschaft, 6(2), 239-256.
Brear, Michelle (2019). Process and outcomes of a recursive, dialogic member checking approach: A project ethnography. Qualitative Health Research, 29(7), 944-957.
Breuer, Franz & Reichertz, Jo (2001). Standards of social research. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 2(3), Art. 24. https://doi.org/10.17169/fqs-2.3.919 [Accessed: January 16, 2025].
Buchbinder, Eli (2011). Beyond checking: Experiences of the validation interview. Qualitative Social Work, 10(1), 106-122.
Bundesministerium für Bildung und Forschung (BMBF) (2019). Förderrichtlinien zur Durchführung des Bundeswettbewerbs "Zukunft gestalten – Innovationen für eine exzellente berufliche Bildung (InnoVET)". Bundesanzeiger, 17. Oktober, https://www.bmbf.de/bmbf/shareddocs/bekanntmachungen/de/2019/01/2217_bekanntmachung.html [Accessed: January 16, 2025].
Bundesministerium für Bildung und Forschung (BMBF) (2021). Exzellenz fördern. Berufsbildung stärken: Wie die InnoVET-Projekte die berufliche Bildung in Deutschland voranbringen. Bonn: BMBF, https://www.inno-vet.de/SharedDocs/Publikationen/de/innovet/Exzellenz_foerdern_Berufsbildung_staerken.pdf?__blob=publicationFile&v=6 [Accessed: January 16, 2025].
Candela, Amber G. (2019). Exploring the function of member checking. The Qualitative Report, 24(3), 619-628, https://doi.org/10.46743/2160-3715/2019.3726 [Accessed: January 16, 2025].
Carlson, Julie A. (2010). Avoiding traps in member checking. The Qualitative Report, 15(5), 1102-1113, https://doi.org/10.46743/2160-3715/2010.1332 [Accessed: January 16, 2025].
Chase, Elizabeth (2017). Enhanced member checks: Reflections and insights from a participant-researcher collaboration. The Qualitative Report, 22(10), 2689-2703, https://doi.org/10.46743/2160-3715/2017.2957 [Accessed: January 16, 2025].
Cho, Jeasik & Trent, Allen (2006). Validity in qualitative research revisited. Qualitative Research, 6(3), 319-340.
Chua, Mel & Adams, Robin S. (2014). Using realtime transcription to do member-checking during interviews. IEEE Frontiers in Education Conference (FIE) Proceedings, 1-3, https://ieeexplore.ieee.org/document/7044251 [Accessed: January 16, 2025].
Creswell, John W. (2005 [2002]). Educational research: Planning, conducting, and evaluating quantitative and qualitative Research. Upper Saddle River, NJ: Pearson.
Creswell, John W. & Miller, Dana L. (2000). Determining validity in qualitative inquiry. Theory into Practice, 39(3), 124-130.
Daniel-Söltenfuß, Desiree; Kremer, H.-Hugo & Kückmann, Marie-Ann (2022). Innovations- und Transferprozesse in der beruflichen Bildung als Forschungs- und Entwicklungsgegenstand: Verständnisse, Praktiken und Gestaltung, Zeitschrift für Berufs- und Wirtschaftspädagogik, 118(4), 684-686.
Daniel-Söltenfuß, Desiree; Kremer, H.-Hugo & Kückmann, Marie-Ann (2024). Go with the flow?! Transferverständnisse und -strategien als Grundlage der Gestaltung von Transferprozessen im Kontext des InnoVET-Programms. In Kristina Kögler, H.-Hugo Kremer & Volkmar Herkner (Eds.), Jahrbuch der berufs- und wirtschaftspädagogischen Forschung 2024 (pp.182-197). Opladen: Verlag Barbara Budrich, https://doi.org/10.3224/84743054 [Accessed: January 16, 2025].
Danner, Helmut (2006 [1979]). Methoden geisteswissenschaftlicher Pädagogik. München: Ernst Reinhardt Verlag.
Doelker, Christian (2002 [1997]). Ein Bild ist mehr als ein Bild: Visuelle Kompetenz in der Multimedia-Gesellschaft. Stuttgart: Klett-Cotta.
Doyle, Susanna (2007). Member checking with older women: A framework for negotiating meaning. Health Care for Women International, 28(10), 888-908.
Flick, Uwe (2018 [2007]). Managing quality in qualitative research. London: Sage.
Flick, Uwe (2020). Gütekriterien qualitativer Forschung. In Günter Mey & Katja Mruck (Eds.), Handbuch Qualitative Forschung in der Psychologie (Vol. 2, pp.247-263). Wiesbaden: Springer VS.
Forbat, Liz & Henderson, Jeanette (2005). Theoretical and practical reflections on sharing transcripts with participants. Qualitative Health Research, 15(8), 1114-1128.
Gansemer-Topf, Ann M.; Paepcke-Hjeltness, Verena; Russell, Ann E. & Schiltz, James (2021). "Drawing" your own conclusions: Sketchnoting as a pedagogical tool for teaching ecology. Innovative Higher Education, 46, 303-319.
Hammersley, Martyn & Atkinson, Paul (1995 [1983]). Ethnography: Principles in practice. London: Routledge.
Harper, Douglas (1988). Visual sociology: Expanding sociological vision. The American Sociologist, 19, 54-70.
Harper, Douglas (2002). Talking about pictures: A case for photo elicitation. Visual Studies, 17(1), 13-26.
Harper, Douglas (2005 [1994]), What's new visually? In Norman K. Denzin & Yvonna S. Lincoln (Eds.), The SAGE handbook of qualitative research (Vol. 3, pp.747-762). London: Sage.
Hegel, Georg Wilhelm Friederich (1952 [1807]). Phänomenologie des Geistes. Berlin: Akademie-Verlag.
Holzwarth, Peter (2019). Visuelle Methoden. In Ingo Bosse, Jan-René Schluchter & Isabel Zorn (Eds.), Handbuch Inklusion und Medienbildung (pp.376-382). Weinheim: Beltz Juventa.
Huber, Andreas (2001). Die Angst des Wissenschaftlers vor der Ästhetik: Zu Jo Reichertz: Zur Gültigkeit von Qualitativer Sozialforschung. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 2(2), Art. 1, https://doi.org/10.17169/fqs-2.2.961 [Accessed: January 16, 2025].
Jörissen, Benjamin (2011). "Medienbildung": Begriffsverständnisse und -reichweiten. In Heinz Moser, Petra Grell & Horst Niesyto (Eds.), Medienbildung und Medienkompetenz: Beiträge zu Schlüsselbegriffen der Medienpädagogik (pp.211-235). München: kopaed, https://doi.org/10.21240/mpaed/20/2011.09.20.X [Accessed: January 16, 2025].
Jörissen, Benjamin (2014). Medialität und Subjektivation: Strukturale Medienbildung unter besonderer Berücksichtigung einer Historischen Anthropologie des Subjekts. Habilitation, Fakultät für Geistes-, Sozial- und Erziehungswissenschaften, Otto-von-Guericke-Universität Magdeburg, Germany, https://d-nb.info/1054639035/34 [Accessed: January 16, 2025].
Kant, Immanuel (1966 [1791]). Kritik der reinen Vernunft. Darmstadt: Wissenschaftliche Buchgesellschaft.
Kiener, Urs & Schanne, Michael (2001). Kontextualisierung, Autorität, Kommunikation: Ein Beitrag zur FQS-Debatte über Qualitätskriterien in der interpretativen Sozialforschung. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 2(2), Art. 2, https://doi.org/10.17169/fqs-2.2.962 [Accessed: January 16, 2025].
Koelsch, Lori E. (2013). Reconceptualizing the member check interview. International Journal of Qualitative Methods, 12, 168-179, https://doi.org/10.1177/160940691301200105 [Accessed: January 16, 2025].
Kuckartz, Udo & Rädiker, Stefan (2022). Qualitative Inhaltsanalyse: Methoden, Praxis, Computerunterstützung. Weinheim: Beltz Juventa.
Kückmann, Marie-Ann (2023a). Worth a Thousands Words?! Kommunikative Validierung mittels Sketchnoting als neuer Impuls im Kontext der Diskussion über die Qualität qualitativer Sozialforschung. Poster, Anniversary conference, Sektion Methoden der qualitativen Sozialforschung, Deutsche Gesellschaft für Soziologie, June 22-23, Mainz, Germany, https://soziologie.de/sektionen/methoden-der-qualitativen-sozialforschung/veranstaltungen/jubilaeumstagung-in-mainz-2023 [Accessed: January 16, 2025].
Kückmann, Marie-Ann (2023b). "Ich sehe was, was du nicht siehst ..." Zu den Potenzialen von Sketchnoting im Kontext Inklusiver Medienbildung. MedienPädagogik, 20, 619-647, https://doi.org/10.21240/mpaed/jb20/2023.09.23.X [Accessed: January 16, 2025].
Kückmann, Marie-Ann & Kundisch, Heike (2021). Denken mit dem Stift?! – Digitale Visualisierungsprozesse als Zugang zu komplexen wirtschafts- und berufspädagogischen Themenfeldern. bwp@ Berufs- und Wirtschaftspädagogik – online, 40, 1-28, https://www.bwpat.de/ausgabe40/kueckmann_kundisch_bwpat40.pdf [Accessed: January 16, 2025].
Lamnek, Siegfried (2010 [1988]). Qualitative Sozialforschung. Weinheim: Beltz.
Lankshear, Colin & Knobel, Michele (2004). A handbook for teacher research. New York, NY: Open University Press.
Lather, Patti A. (1995). The validity of angels: Interpretive and textual strategies in researching the lives of women with HIV/AIDS. Qualitative Inquiry, 1(1), 41-68.
Laucken, Uwe (2002). Quality criteria as instruments for political control of sciences. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 3(1), Art. 6, https://doi.org/10.17169/fqs-3.1.888 [Accessed: January 16, 2025].
Lincoln, Yvonna S. & Guba, Egon G. (1985). Naturalistic inquiry. Beverly Hills, CA: Sage.
Lobinger, Katharina. (2012). Visuelle Kommunikationsforschung. Wiesbaden: Springer VS.
Maybee, Julie E. (2020 [2016]). Hegel's dialectics. In Edward N. Zalta (Ed.), The Stanford encyclopedia of philosophy, https://plato.stanford.edu/archives/win2020/entries/hegel-dialectics/ [Accessed: January 16, 2025].
Mey, Günter & Dietrich, Marc (2016). From text to image: Shaping a visual grounded theory methodology. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 17(2), Art. 2, https://doi.org/10.17169/fqs-17.2.2535 [Accessed: January 16, 2025].
Misoch, Sabrina (2019 [2015]). Qualitative Interviews. Berlin: de Gruyter.
Mitchell, W.J. Thomas (1986). Iconology. Image, text, ideology. Chicago, IL: The University of Chicago Press.
Mruck, Katja & Mey, Günter (2000). Germany. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 1(1), Art. 4, https://doi.org/10.17169/fqs-1.1.1114 [Accessed: January 16, 2025].
Nicklich, Manuel; Röbenack, Silke; Sauer, Stefan; Schreyer, Jasmin & Tihlarik, Amelie (2023). Qualitative social research at a distance: Potentials and challenges of virtual interviews. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 24(1), Art. 15, https://doi.org/10.17169/fqs-24.1.4010 [Accessed: January 16, 2025].
Paepcke-Hjeltness, Verena; Mina, Mani & Cyamani, Aziza (2017). Sketchnoting: A new approach to developing visual communication ability, improving critical thinking and creative confidence for engineering and design students. Conference Paper, 2017 IEEE Frontiers in Education Conference (FIE), October 18-21. Indianapolis, USA.
Peirce, Charles S. (1983 [1903]). Phänomen und Logik der Zeichen. Frankfurt/M.: Suhrkamp.
Pink, Sarah (2012). Advances in visual methodology. London: Sage.
Pink, Sarah (2021 [2001]). Doing visual ethnography. London: Sage.
Reichertz, Jo (2000). Zur Gültigkeit von Qualitativer Sozialforschung. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 1(2), Art. 32, https://doi.org/10.17169/fqs-1.2.1101 [Accessed: January 16, 2025].
Reichertz, Jo (2013). Gemeinsam Interpretieren: Die Gruppeninterpretation als kommunikativer Prozess. Wiesbaden: Springer VS.
Reichertz, Jo (2016). Qualitative und interpretative Sozialforschung: Eine Einladung. Wiesbaden: Springer VS.
Reichertz, Jo (2017). Neues in der qualitativen und interpretativen Sozialforschung?. Zeitschrift für Qualitative Forschung, 18(1), 71-89, https://doi.org/10.3224/zqf.v18i1.06 [Accessed: January 16, 2025].
Reichertz, Jo (2019). Method police or quality assurance? Two patterns of interpretation in the struggle for supremacy in qualitative social research. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 20(1), Art. 3, https://doi.org/10.17169/fqs-20.1.3205 [Accessed: January 16, 2025].
Reichertz, Jo (2021). Limits of interpretation or interpretation at the limits: Perspectives from hermeneutics on the re-figuration of space and cross-cultural comparison. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 22(2), Art. 18, https://doi.org/10.17169/fqs-22.2.3737 [Accessed: January 16, 2025].
Reilly, Rosemary C. (2013). Found poems, member checking and crises of representation. The Qualitative Report, 18(15), 1-18, https://doi.org/10.46743/2160-3715/2013.1534 [Accessed: January 16, 2025].
Rohde, Mike (2020). What are Sketchnotes?. Blog, https://rohdesign.com/sketchnotes [Accessed: January 16, 2025].
Rose, Gillian (2014). On the relation between "visual research methods" and contemporary visual culture. The Sociological Review, 62(1), 24-46.
Schneijderberg, Christian (2023). Conventions of quality criteria of empirical social research. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 24(3), Art. 1. https://doi.org/10.17169/fqs-24.3.3994 [Accessed: January 16, 2025].
Schwabl, Franziska (2020). Inszenierungen im digitalen Bild: Eine Rekonstruktion der Selfie-Praktiken Jugendlicher mittels der dokumentarischen Bildinterpretation. Detmold: Eusl.
Seale, Clive (1999). The quality of qualitative research. Thousand Oaks, CA: Sage.
Simpson, Amber & Quigley, Cassie F. (2016). Member checking process with adolescent students: Not just reading a transcript. The Qualitative Report, 21(2), 376-392, https://doi.org/10.46743/2160-3715/2016.2386 [Accessed: January 16, 2025].
Steinke, Ines (1999). Kriterien qualitativer Forschung: Ansätze zur Bewertung qualitativ-empirischer Sozialforschung. Weinheim: Juventa.
Steinke, Ines (2003). Gütekriterien qualitativer Forschung. In Uwe Flick, Ernst von Kardorff & Ines Steinke (Eds.), Qualitative Forschung. Ein Handbuch (pp.319-331). Reinbek: Rowohlt.
Steinke, Ines (2004). Quality criteria in qualitative research. In Uwe Flick, Ernst von Kardorff & Ines Steinke (Eds.), A companion to qualitative research (pp.184-190). London: Sage.
Stige, Brynjulf; Malterud, Kirsti & Midtgarden, Torjus (2009). Toward an agenda for evaluation of qualitative research. Qualitative Health Research, 19(10), 1504-1516.
Stiles, William B. (1993). Quality-control in qualitative research. Clinical Psychology Review, 13(6), 593-618.
Stöckl, Hartmut (2004). In between modes: Language and image in printed media. In Eija Ventola, Cassily Charles & Martin Kaltenbacher (Eds.), Perspectives on multimodality (pp.9-30). Amsterdam: John Benjamins.
Stöckl, Hartmut (2009). The language-image-text: Theoretical and analytical inroads into semiotic complexity. Arbeiten aus Anglistik und Amerikanistik, 34(2), 203-226.
Stöckl, Hartmut (2011). Sprache-Bild-Texte lesen: Bausteine zur Methodik einer Grundkompetenz. In Hajo Diekmannshenke, Michael Klemm & Hartmut Stöckl (Eds.), Bildlinguistik. Theorien – Methoden – Fallbeispiele (pp.43-70). Berlin: Erich Schmidt.
Strübing, Jörg; Hirschauer, Stefan; Ayaß, Ruth; Krähnke, Uwe & Scheffer, Thomas (2018). Gütekriterien qualitativer Sozialforschung: Ein Diskussionsanstoß. Zeitschrift für Soziologie, 47(2), 83-100, https://doi.org/10.1515/zfsoz-2018-1006 [Accessed: January 16, 2025].
Tracy, Sarah J. (2010). Qualitative quality: Eight "big-tent" criteria for excellent qualitative research. Qualitative Inquiry, 16(10), 837-851.
Welsh, Elaine (2002). Dealing with data: Using NVivo in the qualitative data analysis process. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 3(2), Art. 26, https://doi.org/10.17169/fqs-3.2.865 [Accessed: January 16, 2025].
Whittemore, Robin; Chase, Susan K. & Mandle, Carol Lynn (2001). Validity in qualitative research. Qualitative Health Research, 11(4), 522-537.
Witzel, Andreas (2000). The problem-centered Interview. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 1(1), Art. 22, https://doi.org/10.17169/fqs-1.1.1132 [Accessed: March 10, 2025].
Zhao, Pengfei; Li, Peiwei; Ross, Karen & Dennis, Barbara (2016). Methodological tool or methodology? Beyond instrumentality and efficiency with qualitative data analysis software. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 17(2), Art. 16, https://doi.org/10.17169/fqs-17.2.2597 [Accessed: January 16, 2025].
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Marie-Ann Kückmann
This work is licensed under a Creative Commons Attribution 4.0 International License.
