header image

Volume 23, No. 1, Art. 21 – January 2022

Making Room for Zoom in Focus Group Methods: Opportunities and Challenges for Novice Researchers (During and Beyond COVID-19)

Michelle M. Falter, Aaron A. Arenas; Gordon W. Maples; Chelsea T. Smith; Lisa J. Lamb; Michael G. Anderson; Elizabeth M. Uzzell; Laura E. Jacobs; Xavier L. Cason; Tiara A.N. Griffis; Megan Polzin & Nada Z. Wafa

Abstract: As the COVID-19 pandemic swept through the world, it forced many people to adapt to an online-based routine, including qualitative researchers looking for alternative ways to collect meaningful data. While focus groups are traditionally conducted in-person, advances with online videoconferencing applications present a new method to collect data, however, few studies have explored this. In this article we present 12 doctoral students' experiences with conducting focus groups using the videoconferencing application Zoom during a qualitative methods course on interviewing methods. Through this self-study qualitative analysis, participants reflected on the opportunities and challenges experienced as both moderators and participants using Zoom including: preparation, rapport, incorporating other digital tools, and internet connectivity. In conclusion, doing focus groups online using Zoom was a positive experience overall and comparable to in-person focus groups for collecting qualitative data, despite the introduction of technology. More research on participant recruitment, new technology, Zoom's security features, and Zoom's use outside of a pandemic should be further explored.

Key words: Zoom; focus group; online; qualitative research; videoconferencing; synchronous; online focus group; interviewing; qualitative methods

Table of Contents

1. Background

2. Literature Review

2.1 Utilizing an online research environment

2.2 Synchronous vs. asynchronous formats

2.3 Zoom as a research tool

3. Self-Study Research Methods in Relation to Zoom-Based Techniques for OFGs

3.1 Using a "meta-moderator"

3.2 Moderator preparation

3.3 Research reflexivity: Moderator and meta-moderator debriefing experiences

4. Lessons Learned from the Participant Perspective

4.1 What worked

4.2 Challenges

5. Lessons Learned from the Moderator Perspective

5.1 What worked

5.2 Challenges

6. Implications for Future Practice

6.1 Participant implications

6.2 Moderator implications

7. Limitations

8. Conclusion

Notes

References

Authors

Citation

 

1. Background

During the Spring of 2020, the COVID-19 pandemic became an unprecedented and unpredictable situation where many people were forced to adapt to a new method of communicating. Events typically held in-person were either canceled or transitioned entirely to a virtual setting. Notable is the sudden transition educators had to make, particularly moving classes to an online delivery method. Institutions were tasked with providing guidelines and support for online learning, while faculty, staff, and students had to adapt to a new method of teaching and learning at a moment's notice. Also affected were researchers who, before the pandemic, may have had plans on conducting qualitative research in-person but were forced to reschedule interviews and adapt to new data collection methods virtually. Arguably, collecting data virtually for most scholars was new territory, particularly when it might have been more optimal to meet participants in-person to build better rapport or conduct in-person observations to capture details of various events. While virtual methods of qualitative data collection, such as online interviews or online focus groups, have previously been used, it may not have been the primary form of qualitative data collection chosen. Given this sudden change to the class environment and newly emerging method of virtual qualitative research, it was an opportunity to explore an online form of data collection to expand on the methodological research that currently exists. [1]

For this article, the experiences of 12 graduate/doctoral students and one course instructor in an advanced qualitative methods course on interviewing at the beginning of the COVID-19 pandemic in the Spring of 2020 are highlighted. The course was offered through a U.S. higher education institution's College of Education where the students and instructor were from different program areas including STEM (Science, Technology, Engineering, and Math) education, literacy education, higher education policy, and educational psychology. One of the projects for the course was to conduct an in-person focus group session; however, the COVID-19 pandemic caused the project to be suddenly moved online. A year before COVID-19, the institution had purchased a Zoom license for faculty and students' use, but not all faculty and students had used it prior to transitioning online. Michelle, the course instructor, had been using it regularly and thought it had the potential to work well for online focus groups because of its breakout room and recording features. Yet, none of the students, nor the instructor, had ever conducted an online focus group, and the class had varying levels of expertise with using Zoom. Because of the immense growth in the use of Zoom, and a need for creative solutions to research in these unparalleled times, additional research that evaluates the utility of Zoom as a virtual tool for qualitative data collection can help scholars make thoughtful decisions about the suitability of the platform for their use. Additionally, while there is much research on focus group methodologies, additional research is needed that primarily focuses on online synchronous video-based focus groups. [2]

In this article, we share a self-study qualitative analysis of class perceptions and experiences of using Zoom for conducting focus groups from both participant and moderator perspectives; we believe these perspectives could add to the growing literature around online focus groups from/for both novice and experienced qualitative researchers. We begin with an overview of the existing literature on online focus groups and discuss what is already known about synchronous video usage (Section 2). After that, we introduce the particular Zoom-based focus group methods we employed and how we analyzed our experience through self-study during the start of the COVID-19 crisis (Section 3). We then present our findings in the form of lessons learned, both challenges and successes, from the perspective of both participants and moderators (Section 4-5). Our analysis concludes with a discussion of implications of our experience (Section 6), limitations of this experience (Section 7) and concluding thoughts (Section 8). As the potential for video conferencing software, like Zoom, is assessed, the hope is that this article adds to the growing scholarship around alternative methods for qualitative data collection in an ever-expanding digital world and opportunities for qualitative methods instructors to provide similar opportunities for expanding novice researcher practices with online focus groups. Regardless of whether scholars will need to remain socially distant while conducting research, this article provides practical recommendations for future use. [3]

2. Literature Review

Current literature around online focus groups highlights opportunities and challenges for researchers to collect useful qualitative data. Past studies have utilized online environments to conduct qualitative focus group interviews and highlighted the key comparison points between synchronous and asynchronous—whether the focus group has all participants present concurrently (synchronous) or not (asynchronous)—formats for data collection. Recent methodological studies have specifically focused on the use of technologically advanced, synchronous audiovisual platforms—such as Zoom and Microsoft Teams—as research tools for hosting online focus groups. [4]

2.1 Utilizing an online research environment

Much of the scholarship on online focus groups (OFGs)—a term used for any form of focus group that is not physically in-person—compares traditional, in-person focus groups to a variety of online, virtual, or alternative platforms such as videoconferences, chat rooms, or messenger applications (ABRAMS, WANG, SONG & GALINDO-GONZALEZ, 2015; DEAKIN & WAKEFIELD, 2014; HAY-GIBSON, 2009; JANGHORBAN, ROUDSARI & TAHGIPOUR, 2014; JOWETT, PEEL & SHAW, 2011; KITE & PHONGSAVAN, 2017; LIAMPUTTONG, 2011; LOBE, 2017; STEWART & SHAMDASANI, 2017; UNDERHILL & OMSTEAD, 2003). For instance, researchers' recommendations for OFGs based on how they differ from in-person focus groups suggest maintaining smaller group sizes to prevent chaos (ABRAMS & GAISER, 2017; FOX, MORRIS & RUMSEY, 2007; LOBE, 2017); conducting trial runs to test fickle technology (FORRESTAL, D'ANGELO & VOGEL, 2015; TUTTAS, 2015); and making deliberate efforts to build rapport with participants beforehand, given the interpersonal limitations in the OFG itself (HAY-GIBSON, 2009; HEWSON, VOGEL & LAURENT, 2016). [5]

Many researchers have presumed several benefits of OFGs over in-person groups, such as: saving costs (DEAKIN & WAKEFIELD, 2014; HALLIDAY, MILL, JOHNSON & LEE, 2021; HAY-GIBSON, 2009; KENNY, 2005; KITE & PHONGSAVAN, 2017; LIAMPUTTONG, 2011; LOBE, 2017; RIVAZ, SHOKROLLAHI & EBADI, 2019), greater participant access (HALLIDAY et al., 2021; HAY-GIBSON, 2009; KENNY, 2005; KITE & PHONGSAVAN, 2017; LIAMPUTTONG, 2011; LIJADI & VAN SCHALKWYK, 2015; RIVAZ et al., 2019), and better engaged participants (LIAMPUTTONG, 2011; REID & REID, 2005). However, it is possible that some of these benefits—notably cost savings—are less pronounced than expected, due to the costs that can be associated with required technology and fees for their management (RUPERT, POEHLMAN, HAYES, RAY & MOULTRIE, 2017). Scholarship before the 2010s pre-dated audiovisual OFGs through platforms like Zoom, and thus researchers assumed that all OFGs must sacrifice data collection on participants' non-verbal cues and body language (HAY-GIBSON, 2009; JOWETT et al., 2011; KITE & PHONGSAVAN, 2017). [6]

However, the advancement of technology in subsequent years has allowed for adequate collection of this data in OFGs. The recency of these technological advances leaves room for new empirical studies about the use of audiovisual platforms for conducting focus group studies. The studies published before 2020 rarely explored the pragmatic methodological concerns of a single platform beyond Skype (ABRAMS et al., 2015; ARCHIBALD, AMBAGTSHEER, CASEY & LAWLESS, 2019; DEAKIN & WAKEFILED, 2014; HAY-GIBSON, 2009; HEWSON et al., 2016; JANGHORBAN et al., 2014; LOBE, 2017). But a new wave of scholarship has specifically focused on Zoom, which rapidly rose in popularity during the COVID-19 pandemic (ARCHIBALD et al., 2019; GRAY, WONG-WYLIE, REMPEL & COOK, 2020; GREENSPAN, GORDON, WHITCOMB & LAUTERBACH, 2021; HALLIDAY et al., 2021; SANTHOSH, ROJAS & LYONS, 2021). Additionally, some researchers focused on supplemental collaborative tools that can be utilized effectively in tandem with audiovisual OFGs, such as online word clouds and Padlet (McNAUGHT & LAM, 2010; SIU & ZHOU, 2017). [7]

2.2 Synchronous vs. asynchronous formats

OFGs fall under one of two classifications: synchronous or asynchronous. Synchronous OFGs are real-time conversations that happen through a virtual platform, whereas asynchronous OFGs are typically communications that occur over days or weeks, through media such as e-mail or online forums (ABRAMS & GAISER, 2017; BROWN, REVETTE, DE FERRANTI, FONTENOT & GOODING, 2021; MUÑOZ, 2007). Most researchers have either explicitly or implicitly focused on asynchronous means of conducting OFGs (IM & CHEE, 2006; KENNY, 2005; KITE & PHONGSAVAN, 2017; McCOYD & KERSON, 2006; MURRAY, 1997; RANIERI, KENNEDY, WALMSLEY, THORBURN & McKAY, 2019; TUTTAS, 2015; WILLIAMS, CLAUSEN, ROBERTSON, PEACOCK & McPHERSON, 2012). In the earlier scholarship on OFGs, authors' use of "synchronous" and "asynchronous" terminology did not exist—asynchronous means were the only ones available—nor could the possibility of synchronous OFGs have been anticipated (MURRAY, 1997). [8]

Even after the distinction between asynchronous and synchronous OFGs were outlined in the literature (BURTON & BRUENING, 2003), the synchronous means of conducting OFGs were for many years often only text-based, such as chat rooms and instant messenger applications (ABRAMS et al., 2015; JOWETT et al., 2011; LIAMPUTTONG, 2011; LIJADI & VAN SCHALWYK, 2015; LYNCH et al., 2017; THRUL, BELOHLAVEK, KAUR & RAMO, 2017). Because of this, authors of studies on synchronous OFGs prior to 2020 either briefly mentioned or did not discuss online video conferencing services that included high-quality video and audio and advanced functions like screen-sharing and breakout rooms (JOWETT et al., 2011; LIAMPUTTONG, 2011; LIJADI & VAN SCHALWYK, 2015; TURNEY & POCKNEE, 2005; WILLIAMS et al., 2012). Since 2020, more studies have been published specifically on advanced audiovisual synchronous OFG platforms, such as Microsoft Teams and the increasingly popular Zoom (GRAY et al., 2020; GREENSPAN et al., 2021; HALLIDAY et al., 2021; MENARY et al., 2021; SANTHOSH et al., 2021). Researchers have outlined key limitations of both synchronous and asynchronous text-based OFGs, including their inability to capture non-verbal cues, tone of voice, facial expressions, participant body language, and even the lack of spontaneity in participant responses, all of which are remedied by using audiovisual OFGs (BROWN et al., 2021; GREENSPAN et al., 2021; JOWETT et al., 2011; KITE & PHONGSAVAN, 2017). [9]

One of the few studies that offered guidance specifically relevant to Zoom prior to 2020 is TUTTAS (2015), where the author included the note that a literature search at the time "yielded no published studies in which synchronous audiovisual-recorded focus groups were carried out in the social space of a web conference" (p.123). Among TUTTAS' practical lessons learned for using web conferencing for focus group studies were the importance of active moderation to account for technological problems like failed video or dropped connections, the need to mute background noise by participants and researchers to improve recording quality, the effectiveness of mock focus group sessions to train moderators on the required technology, and the need to ensure participants have the required materials and knowledge to participate using the medium, all of which have been reiterated by subsequent scholars (BROWN et al., 2021; GRAY et al., 2020; GREENSPAN et al., 2021; HALLIDAY et al., 2021). More recent authors have offered additional practical Zoom-based recommendations, such as having a researcher designated to provide technical support to participants (ibid.), encouraging participants to keep their cameras on whenever the internet connection allows (MARQUES et al., 2021; HALLIDAY et al., 2021), and the strong recommendation to have multiple scholars act as moderators to keep sessions running smoothly (BROWN et al., 2021; MARQUES et al., 2021; HALLIDAY et al., 2021; MENARY et al., 2021; SANTHOSH et al., 2021). [10]

2.3 Zoom as a research tool

Early researchers have discussed the use of chat rooms (JOWETT et al., 2011; UNDERHILL & OMSTEAD, 2003) and Voice over Internet Protocol (VoIP) (BERTRAND & BOURDEAU, 2010; HAY-GIBSON, 2009) as primary methods of synchronous communication. However, these formats lack methods for seeing participants through video. With the recent rise of videoconferencing software such as Skype (DEAKIN & WAKEFIELD, 2014; JANGHORBAN et al., 2014; LOBE, 2017), Cisco WebEx (LOBE, 2017), and Google Hangouts/Meets (ABRAMS, WANG, SONG & GALINDO-GONZALEZ, 2015; LOBE, 2017), research on the use of synchronous video have added to the existing literature of online interviews and focus groups. [11]

As COVID-19 spread throughout the world, higher educational institutions relied on synchronous online communication to continue class instruction (DILL, FISHER, McMURTIE & SUPIANO, 2020). One software that gained popularity during this time was Zoom. According to KIM (2017), Zoom had been used in "over 6,900 educational institutions, including 90% of the top U.S. universities" (n.p.) even prior to the COVID-19 pandemic. Zoom offered users a flexible tool to conduct online meetings in an environment with security options and provides functions such as "meeting setup, user management, conference recordings, chat transcripts, and voice mail recordings."1) Zoom also provided two versions of their software. Under the free version, users could conduct online meetings for up to 40 minutes with fewer than 100 people present, create breakout rooms for small group interactions, share screens, and record sessions that can be uploaded to Zoom's cloud storage and accessed later for viewing2). The paid version presented these same benefits, but included upgrades to cloud storage, an increased meeting duration, and personal meeting IDs2. While the paid version offered more flexibility with time and storage, the features for both versions, seemingly, created opportunities for collecting qualitative research data. [12]

Zoom's increase in popularity has also presented security challenges with its software and these issues highlight possible ethical concerns and risks to participants when conducting qualitative interviews. Hackers began to log into random meeting rooms and cause disruptions. This phenomenon, known as "Zoombombing," caused interruptions ranging from playful appearances and celebrity drop-ins (KRAGEN, 2020; LEVITSKY, 2020) to offensive occurrences highlighting racism, antisemitism, or other obscene acts (MATHIAS, 2020; REDDEN, 2020); this led to New York City's Department of Education banning Zoom (MUSUMECI, 2020) and the U.S. Department of Homeland Security issuing a report noting Zoom's potential susceptibility to foreign spies and hackers (MARGOLIN, 2020). Proactively, Zoom provided guidelines on password protected rooms and recordings3) and acquired a security company to increase encryption (CARSON, 2020), which has curtailed most of these earlier issues. For example, SANTHOSH et al. (2021) utilized the waiting room feature and "lock meeting" option to prevent such events from occurring in their own research. It is important to note, however, that these online security concerns are not specific to the Zoom platform (FOX et al., 2007; LOBE, 2017). [13]

While few researchers have assessed Zoom as an online interviewing tool, in one key study, ARCHIBALD et al. (2019) collected data from participants about their Zoom interview experiences. Advantages that participants mentioned were "rapport, convenience, and simplicity and user-friendliness" (p.4), while disadvantages to Zoom centered around connectivity issues and video quality, which support the findings of both past and subsequent researchers' studies (BROWN et al., 2021; FORRESTAL et al., 2015; TUTTAS, 2015). Interestingly, ARCHIBALD et al. (2019, p.3) found that 69% of their participants preferred Zoom as a method of conducting interviews compared to other options, including in-person. This finding supports DEAKIN and WAKEFIELD's (2014) study using Skype, where they suggested that online synchronous videoconferencing should be "considered as a favoured choice in interviewing methodology" (p.604). HALLIDAY et al. (2021) found that 67% of their focus group participants had prior experience with the Zoom platform before participating in their focus group, indicating a growing familiarity with this specific platform for synchronous videoconferencing (p.4). [14]

The intention for this article is to further explore the use of Zoom as a platform for collecting qualitative data, a rising topic in contemporary methodological research. Currently, only a handful of researchers discuss the use of Zoom for OFGs, and they have not specifically focused on soliciting feedback from both participants and facilitators to assess the experience with the platform (ARCHIBALD et al., 2019; HALLIDAY et al., 2021). We present a reflection on the experiences of both participants and facilitators of a Zoom-based OFG during a doctoral qualitative methods course and identify several challenges in the process. [15]

3. Self-Study Research Methods in Relation to Zoom-Based Techniques for OFGs

For this study, we used self-study research, a tenet of qualitative action research. Self-study research is a methodology used most often for educators and educator development (McNIFF, 2010; PITHOUSE, MITCHELL & WEBER, 2009). Self-study research has been cited as a means to enhance educator [research] self-reflexivity to increase development and challenge traditional notions of research and practice (PITHOUSE et al., 2009). The researchers for this study included 15 PhD (graduate) students and 1 professor, although only 12 of the students decided to co-author this article. As a whole, this research team was especially attentive to any issues of bias in order to avoid compromising the quality and validity of the work. [16]

For this self-study, seven Zoom-based online focus groups took place during a two hour and forty-five-minute class period. We define focus groups, generally, based on KITZINGER and BARBOUR's (1999) definition in which participants are focused on discussing a specific activity or topic and make "explicit use of group interaction to generate data” and "researchers encourage participants to talk to one another; asking questions, exchanging anecdotes, and commenting on each others' experiences and points of view” (p.4). This contrasts to other types of focus groups that are used for marketing, politics, polling, or emancipatory purposes (ROULSTON, 2013). Six of the seven focus groups had two moderators with five to six participants and were given 30 minutes to conduct the focus group session. The seventh focus group had three moderators with the remainder of the class as participants and were given 35 minutes to conduct the session (see Figure 1). Moderator teams were chosen in advance with each team choosing a topic for discussion. The focus group topics included: Coronavirus, religion and politics, opinions of oatmeal raisin cookies, attending academic conferences, graduate advisor/advisee relationships, the application and recruitment process for doctoral programs, and pre-k education.



Figure 1: Focus group topics and rounds [17]

3.1 Using a "meta-moderator"

In order for the focus groups to run smoothly, Michelle, the course instructor, took on the role of what is being called a "meta-moderator"—a moderator of the other moderators. This choice was two-fold: 1. it allowed for the moderators and participants to concentrate on their focus group interviews while Michelle took care of any technology and logistical issues, and 2. it allowed for multiple focus groups to occur simultaneously. [18]

As part of the meta-moderator duty, Michelle took on preparation tasks before the OFGs occurred and support tasks during the OFGs. Before the day of the OFGs, the meta-moderator did the following tasks:

During the Zoom session, the meta-moderator gave moderators the ability to record and share their screens, and she acted as a timekeeper. Additionally, because focus groups were running concurrently, the meta-moderator moved participants into the appropriate breakout rooms and helped individuals return to Zoom or their breakout room if they lost their internet connection. [20]

3.2 Moderator preparation

While Michelle took on a meta-moderator role, the graduate students took on moderator roles with the focus group sessions. Prior to conducting the focus groups, moderator teams were tasked with creating a protocol that included a statement of consent and discussion questions related to their topic (ROULSTON, 2013). In addition, moderators determined what techniques could be useful to establish rapport and facilitate discussions among their online focus group participants. For example, pairs discussed whether they should begin with an icebreaker to create a familiar, relaxed environment, or whether they should utilize the mute and hand raising features on Zoom to facilitate streamlined discussions. With focus groups moving to Zoom, moderators also discussed how they would integrate other forms of technology, such as Padlet or WordCloud, as substitutes for in-person techniques, such as large easel pads and markers, for recording participant thoughts. [21]

Moderator teams also determined what role each person would employ during the focus group session. As each team had at least two moderators, two roles emerged: a facilitator and a scribe. The facilitator guided the discussion and focused on maintaining group dynamics among participants while the scribe was primarily responsible for taking notes and keeping time during the discussion. These roles were either shared, rotated, or separated, depending on individual preference and comfort level. [22]

Because Zoom was not normally used for class sessions prior to COVID-19, one group of moderators felt it was important to become more familiar with the Zoom software to reduce the possibility of user error during the focus group session. They conducted a mock focus group prior to the day of the class and recorded the session to test Zoom's capabilities. Testing technology is an important step in moderator preparation, particularly when using unfamiliar equipment or software (BROWN et al., 2021; FORRESTAL et al., 2015; GRAY et al., 2020; HALLIDAY et al., 2021; SANTHOSH et al., 2021). [23]

3.3 Research reflexivity: Moderator and meta-moderator debriefing experiences

One week after the focus group sessions, the class and instructor held a debrief session of the Zoom-based OFG to share experiences and reflections as both participants and as moderators, specifically to note the drawbacks and advantages of the Zoom platform. As McMAHON and WINCH (2018) discussed, debriefing is a systematic form of data analysis when working on collaborative research. They wrote that debriefings

"enhance the adaptable, thoughtful and empathetic-yet-questioning nature of qualitative research among data collection teams (thereby improving both the quality of data collected and the capacity of those collecting the data), to correct course in the event of unknowable changes, insights or challenges in a given context, and to quickly share emerging data with stakeholders in programmatic, policy and academic spheres" (p.5). [24]

Self- debriefings, through the form of reflection papers, were also submitted describing the different experiences as moderators and any observations made about the focus group session. These were used and discussed as part of the systematic debriefing process. Combining self-debrief with a group-debrief is optimal (VERKUYL et al., 2019), especially in self-study research. The following sections examine the lessons learned from both perspectives of ourselves as participants and us as moderators. We also outline the themes that emerged from the systematic debriefing around conducting focus groups on Zoom. [25]

4. Lessons Learned from the Participant Perspective

Regardless of focus group topic, much was learned about the process of conducting focus groups from being a participant. This section highlights both the perceived challenges and successes of the focus groups from the participant perspective. The lessons gleaned can help researchers better understand and empathize with participants as they use the Zoom videoconferencing platform as a data collection tool. [26]

4.1 What worked

Several elements were found to be successful which we hope could be recreated in future OFG research studies. These included: building rapport and ensuring a comfortable and respectful environment between facilitators and participants, providing opportunities for all participants to both speak and reflect, and utilizing different engaging tools to further solicit active participation in the OFGs. [27]

4.1.1 Ensuring comfort

Rapport established among participants during in-person class meetings translated to the Zoom-based OFGs. This existing rapport, combined with the informal setting and respectful interactions during the OFGs, contributed to a communal atmosphere. Being able to attend the focus group from home created an informal environment that worked well in the virtual setting. However, despite knowing one another previously, one OFG began with introductions, which provided participants with a feeling of commonality. This is similar to what GRAY et al. (2020) found with their study, noting that participants felt valued and more comfortable when being able to connect with interviewers face-to-face virtually. [28]

Respectful interactions were also helpful to ensure comfort among participants during the OFG. These included turn-taking, raising hands when sharing, and waiting for others to finish their thoughts before speaking. The moderators' organization contributed towards these kinds of interactions because there were very few interruptions. The hand raising feature was also used effectively because moderators called on participants in the order in which they raised their hands. One classmate summarized her thoughts as a participant by stating that, "it was a very comfortable environment and setting. I felt heard, respected, and we all gave the time (and space) needed for everyone to share." This comfortable environment was created by the moderators beginning with ground rules, providing guidelines and transparency. This reflection was different from a study done by GREENSPAN et al. (2021), where a few of their participants dominated the conversation. This suggests that a more organized layout utilizing tools such as hand raising could help resolve issues of conversation domination or interruptions. [29]

4.1.2 Active participation

Various techniques found to be helpful were used to encourage participation: the selection of relevant topics, providing opportunities to speak and time for reflection, and utilizing multiple user-friendly response modalities to be beneficial. Because participants chose the topic of the OFG, many of the discussions engaged in were relevant to the graduate students' experience. This made it easy for us to participate in each OFG, and supports the conclusions of ROULSTON (2013), who stated "if working with groups who are well-known to each other ... group members are [more] willing to freely discuss topics of interest" (p.39). Even if participants are not known to each other, they can still engage with the OFG, if familiar with the topic. Recruiting experts and those familiar with the topic will help facilitate full participation. [30]

Participants were provided with ample opportunities to speak and participate in the discussion. The use of other online learning tools provided alternative and anonymous methods to contribute to the OFGs. Two groups began with a question that allowed participants to respond on another digital platform, including Padlet and WordCloud, giving everyone a chance to contribute simultaneously. Figures 2 and 3 display responses to prompts from two focus groups, each using a different response modality: WordCloud (Figure 2) and Padlet (Figure 3). YouTube clips, and other shared documents, were also helpful in keeping conversation going and acted as a springboard for other conversations. Much like MENARY et al. (2021) and their experience with using a whiteboard tool on Microsoft Teams, the ability to incorporate these tools into a video conferencing software may optimize the online focus group experience. Aside from the occasional issue (buffering, broken link, etc.), participants felt the use of these tools, as well as the usability of Zoom itself, gave all of us the opportunity to fully engage.



Figure 2: Word cloud



Figure 3: Padlet [31]

4.2 Challenges

Participating in an OFG involves a handful of notable challenges, including the occasional difficulty in sustaining engagement with other participants and maintaining focus during discussion, despite outside distractions. These issues were noted by a number of the focus group participants, along with occasional technical difficulties which causes varying levels of frustration and disruption. [32]

4.2.1 Conversational flow and focus

Four participants expressed challenges in the conversational flow as a function of the online setting. It was difficult to engage in dialogue and emotionally invest in the conversation because the platform, while providing access, also created a barrier. Compared to the natural flow of an in-person focus group, about half of the participants found conversations awkward online. Others had difficulty entering the conversation because they did not want to cut someone off. As previously noted, participants were not always able to stay focused during the Zoom session, in some instances gazing off into their surroundings. One participant stated, "I don't feel my attention was what it would have been if we were in a different space." Some of these observations may be natural consequences of holding the focus group online, but others may be addressed through establishing clearer session expectations. [33]

4.2.2 Technical difficulties

Three participants experienced technical difficulties related to severed connections or slow internet speeds. This is consistent with ARCHIBALD et al. (2019), who found that a majority of participants in their study expressed some technical difficulty with Zoom, related either to unfamiliarity with the platform or hardware incompatibilities. One participant lost the internet connection several times during the OFG sessions, resulting in minor interruptions and, likely, lost data. [34]

5. Lessons Learned from the Moderator Perspective

In addition to serving as participants, the assignment gave the PhD students in the qualitative research interviewing course the first-hand experience of facilitating focus groups as well. As moderators, there were a range of experiences, showcasing both successful strategies and notable challenges for the platform. The lessons learned through our self-study debriefing provide helpful considerations for researchers using videoconferencing tools for a data collection, especially Zoom. [35]

5.1 What worked

There were many positive aspects of facilitating an OFG, which hinged on the preparation moderators made, establishing rapport, the use of a meta-moderator, and the features of Zoom. Preparation for the focus groups included preparing questions, acknowledging foreseen obstacles, and defining moderator roles. Maintaining rapport that had begun in prior class periods was useful in having focused discussions. [36]

5.1.1 Preparing and defining roles

Moderators were well prepared and thought-out potential challenges such as participants interrupting one another, awkward silences, or one participant dominating the conversation. Roles were chosen based on the strengths and preferences of the moderators. When not acting as the facilitator, the co-moderator became the scribe, which allowed the facilitator to be an engaged listener. At the end of four of the focus groups, the scribe took over to ask a few clarifying questions to participants based on the notes kept during the session. One scribe created a matrix with all participants' names and took notes on which questions they responded to. This helped the moderators track who was participating in the discussion and allowed the scribe to note non-verbal cues like nodding and hand gestures. The scribe concluded the focus group session by asking if participants had anything else they would like to add (ROULSTON, 2013, p.45) or if they had any questions about the research study. As noted by MARQUES et al. (2021), the utilization of dual moderators maximizes the capacity each has to solve logistical and technological issues, while still paying attention to the data shared by participants. For this experience, the preparation and division of labor helped many moderators to feel satisfied with the results of their sessions. [37]

5.1.2 Continuing rapport

Similar to the participant perspective, having an established rapport was important to a successful moderating experience. Given that part of the semester had been spent in class together, participants had already established some form of rapport. Although the semester began in person, rapport in an online focus group can be developed by a protocol of using actual names, rather than an e-mail or nickname identifier, and allowing all participants to introduce themselves and speak freely as they would in person. In one focus group, the moderator felt comfortable actively calling on participants whom he knew had different experiences than those who voluntarily shared information (RUBIN & RUBIN, 2012). Moderators also used follow-up questions and probes rooted in specific participant responses. This helped to ensure that everyone contributed to the conversation, making it more well-rounded and inclusive. One moderator used transition statements and made a point of asking if anyone had anything to add before moving on to the next question (ROULSTON, 2013). Moderators were very comfortable with silence, and this wait time gave the participants time to think and reflect between questions before moving on. [38]

Another set of moderators noted that they achieved a relaxed and friendly atmosphere within their OFG session by using an informal tone of voice and the occasional joke. ROULSTON (2013) suggested one way to continue rapport throughout the session is to use continuers, so about half of the moderators would smile, nod and say, "mhm" and "ahh" while the participants were sharing their experiences. To get rapid feedback from the participants, the moderators used techniques such as having participants give a thumbs up or other nonverbal cue. Because of the rapport built within class and continued in the OFG, moderators felt that participants took turns answering each question and played off each other's answers to agree with or refute responses. [39]

5.1.3 Optimizing Zoom's features

There are several features unique to Zoom that aided in the success of the OFG experience. One positive feature of Zoom was the private chat. Within the chat the notetakers were able to message the primary moderators about specific probes they could use without it detracting from the conversation. The raise hand and react features helped moderators record consent, tally votes, and keep participants from talking over each other. Discussions were held in "gallery view," so the feeling of a focus group seated in a circle was recreated. The ability to see each other's facial expressions and hear the tone of voice from others gave the feeling of being together. Additionally, Zoom allows for screen sharing, so moderators were able to share, for example, results of the WordCloud with participants. Finally, the recording feature allowed moderators to individually review the focus group, especially reviewing facial expressions and body language, making it easier for the moderators to reflect on the experience. [40]

5.1.4 Utilizing a meta-moderator

As described previously, Michelle took on several responsibilities as a "meta-moderator" to help set up Zoom's technology and security features in order to ensure a seamless transition to conducting focus groups. Doing so allowed the moderators more time to craft discussion questions and focus on the content of the conversations. This also suggested that having a dedicated individual responsible for logistics and technology could prove helpful for facilitators and scribes who are focused on collecting data and understanding participant experiences to react appropriately in the online focus group (BROWN et al., 2021; MARQUES et al., 2021; SANTHOSH et al., 2021). It is clear that focus groups would not have run as smoothly without this additional support. [41]

5.2 Challenges

Along with the positive lessons learned, there were also challenges moderating focus groups. Upon reflection of the experience, class members reported challenges in the areas of environmental distractions, internet connectivity, using Zoom on a mobile device, and Zoom features. [42]

5.2.1 Environmental distractions

One barrier encountered as moderators was environmental distractions. Traditionally, focus groups meet outside the home in an environment with minimal distractions, but due to COVID-19 and the stay-at-home order in our state (North Carolina, USA), this was not a feasible task. Managing a focus group online where both the moderator and participants are at home poses issues such as interruptions, home privacy issues, and unreliable internet connections. [43]

For example, while serving as the notetaker, one moderator spoke of the challenge of interruptions from her children. Before the session, the children had been settled in another room and the door was closed for privacy. During the focus group, two of the children entered the room, causing the moderator to juggle muting the sound, note taking, and attending to the kids. Another moderator reported a similar interruption, but from the dog. The barking was loud enough to hinder the ability to hear an answer given by a participant. Consistent with a similar issue from GREENSPAN et al. (2021), having these distractions could affect participant responses or moderator reactions, thus impeding the data collection process. [44]

5.2.2 Internet connectivity

Another challenge encountered were issues surrounding internet connection. Internet connectivity problems plagued both moderators and participants during the focus group sessions. During one focus group session, one moderator lost connection while facilitating, and upon reentering the session, the conversation had already shifted to another question. Missing a part of the conversation impacted the moderator's ability to properly track the discussion and ask effective follow-up questions and probes. Every institution has its own protocol for connectivity issues and knowing that internet connections can often experience outages, participants should agree on the protocol prior to, or at the beginning of, the meeting. In our experience, the person losing the connection attempted to reconnect and joined us as soon as possible. The focus group discussion was also recorded so that participants could view any missed content later. [45]

Class members also reported that when there was a conversation lull, it was unclear if the participants were ready to move on or if their connection was lagging or frozen. During one focus group, two participants had connectivity issues while giving consent, which led to a delay in the start of the discussion portion of the session. Connectivity issues also impacted the ability of participants to contribute to the discussion. Two moderators faced the issue of a participant losing connection in the middle of sharing an opinion. When the participant was able to rejoin, the discussion had moved on, leaving the participant unable to finish sharing. In reflection, the moderators realized that they should have circled back to the participant, giving the participant an opportunity to complete the thought. By moving on, moderators missed the opportunity to gain adequate representation from all participants, particularly in the online environment (FOX et al., 2007). [46]

5.2.3 Zoom's limitations

Although the chat aspect was useful for private communication between co-moderators, three class members reported issues using the feature on mobile devices. When using a smartphone, the user does not have a gallery view of participants or easy access to the chat. As a moderator, this poses an issue as participants could miss incoming messages when focusing on the video conversation. One moderator noted that when planning a focus group, it is important to account for the mobile features. Together as co-moderators, they found that their participants using smartphones had difficulty accessing the link provided in the chat. The time spent on troubleshooting took away from the conversation, which could have been avoided if it had been planned for in advance. [47]

In addition to trouble accessing the chat feature from a mobile device, five moderators noted it was difficult to use the chat in conjunction with other Zoom features simultaneously. One moderator wanted to share a link to an outside website in the chat with participants; however, being in screen share mode made the transition to the chat feature problematic. In order to utilize more than one aspect at a time, the moderator had to be tech savvy and quickly move between windows. This maneuvering can be difficult if your attention is focused on the participants and the conversation. [48]

Furthermore, when moderating a focus group in Zoom, it was essential to be aware of the mute feature available on Zoom. A classmate reported asking a probing question but was unknowingly on mute and thus unheard. Unfortunately, the conversation had shifted before being able to ask the probe again. [49]

6. Implications for Future Practice

The onset of COVID-19 provided us an opportunity for exploring newer research media. As scholars navigate what may be the "new normal" way to virtually engage participants through OFGs, the qualitative research community has an opportunity for innovative and conversely more accessible data collection practices. In reflecting on the challenges and possibilities the class faced doing a Zoom-based OFG, technology, comfort, and accessibility became key aspects for both moderators and participants to interrogate the process. In this section, implications and considerations are highlighted for qualitative researchers who want to use Zoom as a data collection tool. [50]

6.1 Participant implications

For participants, it is important to understand that there are dynamics that can affect people in different ways when it comes to conducting OFGs. Regarding accessibility, not all participants may be able to maintain viable communication using internet services due to their locality and familiarity with online communication (BROWN et al., 2021; DEAKIN & WAKEFIELD, 2014; GREENSPAN et al., 2021). In contrast, for those who are geographically dispersed, using online means to communicate would be helpful as it allows for them to be accessible from a distance (DEAKIN & WAKEFIELD, 2014; HALLIDAY et al., 2021). Moderators can help participants by giving them guidance about how to best prepare for an OFG on Zoom (GREENSPAN et al., 2021; HALLIDAY et al., 2021). This would include discussion of noise levels and eliminating possible distractions and finding a quiet space with strong Internet connection. Additionally, before an online focus group discussion begins, giving participants an opportunity to practice through a tutorial or attend a Q/A about Zoom's features would potentially alleviate some of the anxiety around using a newer technology. [51]

It is also important to note that technology may be a barrier for some participants. Fear of technology could be more of a problem for individuals over age 30 than for individuals who are younger (REZABEK, 2000). In some cases, the qualities of the internet have the potential of changing the dynamics of communication (ibid.) and not always in positive ways. There tends to be less inhibition online and respondents are often more direct in stating their opinions and less likely to edit their thoughts (SWEET, 2001). [52]

6.2 Moderator implications

For moderators, the accessibility of an adequate device and keyboard skills are aspects of Zoom-based OFGs that are the most essential elements for this data collection method. First, one must ensure the moderator's access to high-speed reliable internet and working technology, along with moderately good keyboarding skills for record-keeping. Within this study, the moderator responsibilities of question-asker and note-taker were split among two or three people, so this was not an issue. However, for solo moderators, commissioning an assistant or another researcher (BROWN et al., 2021; MARQUES et al., 2021; SWEET, 2001) to help with notetaking and record-keeping would be optimal. Attempting to do both while also paying attention to the Zoom technology can be challenging to juggle. [53]

With the onset of using technology to conduct research, maintaining engagement with participants is also an important factor for moderators to consider. Even with a virtual medium, researchers want participants to feel comfortable participating. Thus it is suggested that moderators design a protocol with opportunities to build rapport and ensure transparency with participants about the research process (BROWN et al., 2021; MARQUES et al., 2021; REZABEK, 2000) in an online, potentially new, setting. Furthermore, the ability to read body language, facial expressions, balanced participation and other social cues through synchronous OFGs is a skill the moderator should hone in on (EASTON, EASTON & BELCH, 2003; EDMUNDS, 1999; REZABEK, 2000) before facilitating a focus group discussion virtually. [54]

7. Limitations

The experiences discussed in this article were limited to a particular type of focus group, on a particular type of technology, with a specific group of people, during the unusual time of the COVID-19 pandemic. Therefore, acknowledging a few limitations that were beyond researcher control are particularly important to note. Most focus groups are a combination of diverse participants and collaborating researchers coming together to discuss a predetermined topic. Participants engaged in a Zoom-based OFG as practice for a specific course on interviewing; therefore, the number of participants and schedule for the focus group were predetermined. Thus, for the experience described, it is not possible to comment on recruiting techniques for OFGs, nor how to arrange a common meeting time among OFG participants. Additionally, it is not possible to comment on challenges that might arise due to a greater diversity in participants' identities, access, and familiarity with technology. Within this particular course, all members were fairly adept at using Zoom technology, had known each other, which made rapport-building easier, and had reasonably fast internet connections. [55]

Concurrently, OFGs were conducted during the early part of the COVID-19 pandemic in early April 2020, just as the stay-at-home orders were put in place throughout much of the United States. During that time, participants were logged in remotely from their homes, sometimes with children, pets, and other family members present, so unanticipated interruptions occasionally occurred. Due to these conditions, it is not possible to comment on how different OFGs on Zoom might be outside of a pandemic. For OFGs under other circumstances, participants might instead be logging in from a more appropriate environment, without the same distractions and challenges that occurred during the experience described in this article. [56]

Several questions remain that would be appropriate for further research. First, as technology regularly advances, continued research and testing for the most updated technology or videoconferencing software for OFGs is necessary. Furthermore, research on security protocols to compete with the ongoing threats to Internet usage and ensure private and uninterrupted OFGs is warranted. Since Zoom sessions can be viewed in either speaker or gallery view, it would be interesting to analyze how these screen viewing options affect the participation in, and also the analysis of, synchronous OFGs, and how this affects people's abilities to read social cues, for example. Finally, researchers may want to conduct further study of synchronous OFGs and in-person focus groups to discover how the data collected in these differing focus group types compare, looking particularly at the quality and trustworthiness of the data collected. [57]

8. Conclusion

This article provides a snapshot of a self-study in which we used Zoom for online focus groups from the perspective of one doctoral level qualitative research method class as we transitioned from in-person to online learning during the COVID-19 shutdown. Overall, Zoom worked well for the online focus group purposes, although this experience did not have the opportunity to explore other online videoconferencing software that may have had unique and equally helpful features. Despite not being completely free of connection problems or various idiosyncrasies, all participants had a sufficient level of technical ability to make the Zoom-based OFG participation successful. [58]

Although OFGs are not new, technology keeps rapidly changing and newer software and applications make doing focus groups online and in digital spaces easier. What was possible even ten years ago (namely text-based, mostly asynchronous OFGs) has evolved exponentially to include both video and audio done simultaneously, thus making OFGs comparable to in-person ones. From the class experiences with Zoom, necessitated by COVID-19, participants learned that ensuring comfort and active participation through different online learning tools are key. From the moderator perspective, preparation, rapport building, and utilizing Zoom's features made the OFGs successful. Areas that challenged us in both roles included how to: maintain conversation flow and focus; deal with environmental distractions and technological difficulties such as internet connectivity; and navigate the difference between the mobile and desktop versions of Zoom. [59]

Sometimes, life is given lemons, as was the case in the Spring 2020 semester and beyond. However, what was learned from the experience with COVID-19 is that qualitative researchers need to be flexible (GRUBER, EBERL, LIND & BOOMGAARDEN, 2020). Lemonade may not have been made, but the experience described in this article, ultimately, took a challenging event and turned it into a teaching and learning moment. The hope is that this experience can serve as not only a guide for other qualitative researchers looking to do online focus groups, but also as a model for other qualitative methods instructors to collaborate, problem-solve, and hopefully impact the field through shared inquiry. [60]

Notes

1) Zoom security guide, https://zoom.us/docs/doc/Zoom-Security-White-Paper.pdf [Accessed: December 9, 2021]. <back>

2) Zoom plans and pricing, https://zoom.us/pricing [Accessed: December 9, 2021]. <back>

3) Security at Zoom, https://zoom.us/security [Accessed: December 9, 2021]. <back>

References

Abrams, Katie & Gaiser, Ted J. (2017). Online focus groups. In Nigel Fielding, Raymond Lee & Grant Blank (Eds), The Sage handbook of online research methods (pp.435-439). Thousand Oaks, CA: Sage.

Abrams, Katie; Wang, Zongyuan; Song, Yoo Jin & Galindo-Gonzalez, Sebastian (2015). Data richness trade-offs between face-to-face, online audiovisual, and online text-only focus groups. Social Science Computer Review, 33(1), 80-96.

Archibald, Mandy M.; Ambagtsheer, Rachel C.; Casey, Mavourneen G. & Lawless, Michael (2019). Using Zoom videoconferencing for qualitative data collection: Perceptions and experiences of researchers and participants. International Journal of Qualitative Methods, 18(1), 1-8, https://doi.org/10.1177/1609406919874596 [Accessed: December 9, 2021].

Bertrand, Catherine & Bourdeau, Laurent (2010). Research interviews by Skype: A new data collection method. In José Esteves (Ed.), Proceedings from the 9th European Conference on Research Methods, Madrid, Spain, June, 24-25 2010 (pp.70-79). Cambridge, MA: Academic Publishing.

Brown, Courtney A.; Revette, Anna C.; de Ferranti, Sarah D.; Fontenot, Holly B. & Gooding, Holly C. (2021). Conducting web-based focus groups with adolescents and young adults. International Journal of Qualitative Methods, 20(1), 1-8, https://doi.org/10.1177/1609406921996872 [Accessed: December 9, 2021].

Burton, Laura J. & Bruening, Jennifer E. (2003). Technology and method intersect in the online focus group. Quest, 55(4), 315-327, https://doi.org/10.1080/00336297.2003.10491807 [Accessed: December 9, 2021].

Carson, Erin (2020). Zoom eyes security boost, acquiring secure messaging platform Keybase. Cnet, May 7, https://www.cnet.com/news/zoom-acquires-secure-messaging-platform-keybase-to-help-bolster-security/ [Accessed: December 9, 2021].

Deakin, Hannah & Wakefield, Kelly (2014). Skype interviewing: Reflections of two PhD researchers. Qualitative Research, 14(5), 603-616.

Dill, Emma; Fisher, Karin; McMurtrie, Beth & Supiano, Beckie (2020). As coronavirus spreads, the decision to move classes online is the first step. What comes next?. The Chronicle of Higher Education, March 6, https://www.chronicle.com/article/As-Coronavirus-Spreads-the/248200 [Accessed: December 9, 2021].

Easton, George; Easton, Annette & Belch, Michael (2003). An experimental investigation of electronic focus groups. Information & Management, 40(8), 717-727.

Edmunds, Holly (1999). The focus group research handbook. Lincolnwood, IL: NTC Business Books / Contemporary Publishing.

Forrestal, Sarah G.; D'Angelo, Angela V. & Vogel, Lisa K. (2015). Considerations for and lessons learned from online, synchronous focus groups. Survey Practice, 8(3), 1-9.

Fox, Fiona E.; Morris, Marianne & Rumsey, Nichola (2007). Doing synchronous online focus groups with young people: Methodological reflections. Qualitative Health Research, 17(4), 539-547.

Gray, Lia M.; Wong-Wylie, Gina; Rempel, Gwen R. & Cook, Karen (2020). Expanding qualitative research interviewing strategies: Zoom video communications. The Qualitative Report, 25(5), 1292-1301, https://nsuworks.nova.edu/tqr/vol25/iss5/9/ [Accessed: December 9, 2021].

Greenspan, Scott B.; Gordon, Kelsey L.; Whitcomb, Sara A. & Lauterbach, Alexandra A. (2021). Use of video conferencing to facilitate focus groups for qualitative data collection. American Journal of Qualitative Research, 5(1), 85-93, https://doi.org/10.29333/ajqr/10813 [Accessed: December 9, 2021].

Gruber, Maria; Eberl, Jacob Moritz; Lind, Fabienne & Boomgaarden, Hajo G. (2020). Qualitative interviews with irregular migrants in times of COVID-19: Recourse to remote interview techniques as a possible methodological adjustment. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 22(1), Art. 7, https://doi.org/10.17169/fqs-22.1.3563 [Accessed: December 9, 2021].

Halliday, Matthew; Mill, Deanna; Johnson, Jacinta & Lee, Kenneth (2021). Let's talk virtual! Online focus group facilitation for the modern researcher. Research in Social and Administrative Pharmacy, 17(12), 2145-2150.

Hay-Gibson, Naomi V. (2009). Interviews via VoIP: Benefits and disadvantages with a PhD study of SMEs. Library and Information Research, 33(105), 39-50, https://doi.org/10.29173/lirg111 [Accessed: December 9, 2021].

Hewson, Claire; Vogel, Carl & Laurent, Diana (2016). Internet research methods. Thousand Oaks, CA: Sage.

Im, Eun-Ok & Chee, Wonshik (2006). An online forum as a qualitative research method: Practical issues. Nursing Research, 55(4), 267-273, https://pubmed.ncbi.nlm.nih.gov/16849979/ [Accessed: December 9, 2021].

Janghorban, Roksana; Roudsari, Robab L. & Tahgipour, Ali (2014). Skype interviewing: The new generation of online synchronous interview in qualitative research. International Journal of Qualitative Studies on Health and Well-being, 9(1), 1-4.

Jowett, Adam; Peel, Elizabeth & Shaw, Rachel (2011). Online interviewing in psychology: Reflections on the process. Qualitative Research in Psychology, 8(4), 354-369.

Kenny, Amanda J. (2005). Interaction in cyberspace: an online focus group. Journal of Advanced Nursing, 49(4), 414-422.

Kim, Joshua (2017). Zoom is hot in higher ed. Inside Higher Education, October 22, https://www.insidehighered.com/blogs/technology-and-learning/zoom-hot-higher-ed [Accessed: December 9, 2021].

Kite, James & Phongsavan, Philayrath (2017). Insights for conducting real-time focus groups online using a web conferencing service. F1000Research, 6(122), https://f1000research.com/articles/6-122/v1 [Accessed: December 9, 2021].

Kitzinger, Jenny & Barbour, Rosaline (1999). Introduction: The challenge and promise of focus groups. In Rosaline Barbour & Jenny Kitzinger (Eds.), Developing focus group research: Politics, theory and practice (pp.1-20). London: Sage.

Kragen, Pam (2020). Pigs, goats and an alpaca are "zoom bombing" meetings from Ramona ranch during coronavirus lockdown. The Los Angeles Times, April 28, https://www.latimes.com/california/story/2020-04-28/pigs-goats-and-an-alpaca-are-zoom-bombing-meetings-from-ramona-ranch [Accessed: December 9, 2021].

Levitsky, Allison (2020). A Palo Alto-based software company gets "Zoombombed"—by Conan. Silicon Valley Business Journal, April 23, https://www.bizjournals.com/sanjose/news/2020/04/23/conan-o-brien-tibco-software-zoombomb.html [Accessed: December 9, 2021].

Liamputtong, Pranee (2011). Focus group methodology: Principle and practice. Thousand Oaks, CA: Sage.

Lijadi, Anastasia A. & Van Schalkwyk, Gertina J. (2015). Online Facebook focus group research of hard-to-reach participants. International Journal of Qualitative Methods, 14(5), 1-9, https://doi.org/10.1177/1609406915621383 [Accessed: December 9, 2021].

Lobe, Bojana (2017). Best practices for synchronous online focus groups. In Barbour, Rosaline & Morgan, David (Eds.), A new era in focus group research: Challenges, innovation and practice (pp.227-250). London: Palgrave Macmillan.

Lynch, Molly M.; Amoozegar, Jacqueline B.; McClure, Emily M.; Squiers, Linda B.; Broussard, Cheryl S.; Lind, Jennifer N.; Polen Kara N.; Frey, Meghan T.; Gilboa, Suzanne M. & Biermann, Janis (2017). Improving safe use of medications during pregnancy: The roles of patients, physicians, and pharmacists. Qualitative Health Research, 27(13), 2071-2080.

Margolin, Josh (2020). Intel report warns Zoom could be vulnerable to foreign surveillance. ABC News, April 28, https://abcnews.go.com/International/intel-report-warns-zoom-vulnerable-foreign-surveillance/story?id=70376203 [Accessed: December 9, 2021].

Marques, Isabel C. Dos Santos; Theiss, Lauren M.; Johnson, Cynthia Y.; McLin, Elise; Ruf, Beth A.; Vickers, Selwyn M.; Fouad, Mona N.; Scarinci, Isabel C. & Chu, Daniel I. (2021). Implementation of virtual focus groups for qualitative data collection in a global pandemic. American Journal of Surgery, 221(5), 918-922.

Mathias, Christopher (2020). Anti-semitic trolls disrupt jewish university's gathering on zoom. HuffPost, April 1, https://www.huffpost.com/entry/nazi-zoombombing-jewish-yeshiva-university_n_5e84f704c5b692780506d519 [Accessed: December 9, 2021].

McCoyd, Judith L.M. & Kerson, Toba S. (2006). Conducting intensive interviews using email: A serendipitous comparative opportunity. Qualitative Social Work, 5(3), 389-406.

McMahon, Shannon A. & Winch, Peter J. (2018). Systematic debriefing after qualitative encounters: an essential analysis step in applied qualitative research. BMJ Global Health3(5), e000837, https://gh.bmj.com/content/3/5/e000837 [Accessed: December 9, 2021].

McNaught, Carmel & Lam, Paul (2010). Using Wordle as a supplementary research tool. The Qualitative Report, 15(3), 630-643, http://www.nova.edu/ssss/QR/QR15-3/mcnaught.pdf [Accessed: December 9, 2021].

McNiff, Jean (2010). What is action research?. In Jean McNiff (Ed.), You and your action research (4th ed., pp.9-28). New York, NY: Routledge

Menary, Jonathan; Stetkiewicz, Stacia; Nair, Abhishek; Jorasch, Petra; Nanda, Amrit K.; Guichaoua, Adrien; Rufino, Mariana; Fischer, Arnout R.H. & Davies, Jessica A.C. (2021). Going virtual: adapting in-person interactive focus groups to the online environment. Emerald Open Research3(6), 1-14, https://doi.org/10.35241/emeraldopenres.14163.1 [Accessed: December 9, 2021].

Muñoz, Rubén Arriazu (2007). On new means or new forms of investigation. A methodological proposal for online social investigation through a virtual forum. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research8(3), Art. 37, https://doi.org/10.17169/fqs-8.3.275 [Accessed: December 9, 2021].

Murray, Peter J. (1997). Using virtual focus groups in qualitative research. Qualitative Health Research, 7(4), 542-549.

Musumeci, Natalie (2020). DOE bans schools using Zoom for remote learning amid security concerns. New York Post, April 6, https://nypost.com/2020/04/06/doe-pulls-plug-on-schools-using-zoom-amid-security-concerns/. [Accessed: December 9, 2021].

Pithouse, Kathleen; Mitchell, Claudia & Weber, Sandra (2009). Self‐study in teaching and teacher development: A call to action. Educational Action Research, 17(1), 43-62.

Ranieri, Veronica; Kennedy, Ellis; Walmsley, Martine; Thorburn, Doug & McKay, Kathy (2019). Rare but heard: Using asynchronous virtual focus groups, interviews and roundtable discussions to create a personalised psychological intervention for primary sclerosing cholangitis: A protocol. BMJ Open, 9(10), https://bmjopen.bmj.com/content/9/10/e031417 [Accessed: December 9, 2021].

Redden, Elizabeth (2020). "Zoombombing" attacks disrupt classes. Inside Higher Education, March 26, https://www.insidehighered.com/news/2020/03/26/zoombombers-disrupt-online-classes-racist-pornographic-content. [Accessed: December 9, 2021].

Reid, Donna J. & Reid, Fraser J. M. (2005). Online focus groups: An in-depth comparison of computer-mediated and conventional focus group discussions. International Journal of Market Research, 47(2), 131-162.

Rezabek, Roger J. (2000). Online focus groups: Electronic discussion for research. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 1(1), Art. 18, https://doi.org/10.17169/fqs-1.1.1128 [Accessed: December 9, 2021].

Rivaz, Mozhgan; Shokrollahi, Paymaneh & Ebadi, Abbas (2019). Online focus group discussions: An attractive approach to data collection for qualitative health research. Journal of Nursing Practice Today, 6(1), 1-3, https://npt.tums.ac.ir/index.php/npt/article/view/423 [Accessed: December 9, 2021].

Roulston, Kathy (2013). Reflective interviewing: A guide to theory & practice. Thousand Oaks, CA: Sage.

Rubin, Herbert J. & Rubin, Irene S. (2012). Qualitative interviewing: The art of hearing data. Thousand Oaks, CA: Sage.

Rupert, Douglas J.; Poehlman, Jon A.; Hayes, Jennifer J.; Ray, Sarah E. & Moultrie, Rebecca R. (2017). Virtual versus in-person focus groups: Comparison of costs, recruitment, and participant logistics. Journal of Internet Medical Research, 19(3), 1-19, https://www.jmir.org/2017/3/e80/ [Accessed: December 9, 2021].

Santhosh, Lekshmi; Rojas, Juan C. & Lyons, Patrick G. (2021). Zooming into focus groups: Strategies for qualitative research in the era of social distancing. ATS Scholar, https://www.atsjournals.org/doi/full/10.34197/ats-scholar.2020-0127PS [Accessed: December 9, 2021].

Siu, Grace & Zhou, Laura (2017). A case study of using Padlet to capture insights in class. 8th International Conference on Language, Education and Innovation, London, UK, October 16-17, 2017, http://icsai.org/procarch/8iclei/8iclei-046.pdf [Accessed: December 9, 2021].

Stewart, David W. & Shamdasani, Prem (2017). Online focus groups. Journal of Advertising, 46(1), 48-60.

Sweet, Casey (2001). Designing and conducting virtual focus groups. Qualitative Market Research, 4(3), 130-135.

Thrul, Johannes; Belohlavek, Alina; Kaur, Manpreet & Ramo, Danielle E. (2017). Conducting online focus groups on Facebook to inform health behavior change interventions: Two case studies and lessons learned. Internet Inventions, 9, 106-111.

Turney, Lyn & Pocknee, Catherine (2005). Virtual focus groups: New frontiers in research. International Journal of Qualitative Methods, 4(2), 32-43, https://doi.org/10.1177/160940690500400203 [Accessed: December 9, 2021].

Tuttas, Carol A. (2015). Lessons learned using web conference technology for online focus group interviews. Qualitative Health Research, 25(1), 122-133.

Underhill, Christina & Omstead, Murrey G. (2003). An experimental comparison of computer-mediated and face-to-face focus groups. Social Science Computer Review, 21(4), 506-512.

Verkuyl, Margaret; Hughes, Michelle; Atack, Lynda; McCulloch, Tara; Lapum, Jennifer L.; Romaniuk, Daria & St-Amant, Oona (2019). Comparison of self-debriefing alone or in combination with group debrief. Clinical Simulation in Nursing37, 32-39.

Williams, Sara; Clausen, Maria G.; Robertson, Ann; Peacock, Susi & McPherson, Kerri (2012). Methodological reflections on the use of asynchronous online focus groups in health research. International Journal of Qualitative Methods, 11(4), 368-383, https://doi.org/10.1177/160940691201100405 [Accessed: December 9, 2021].

Authors

Michelle M. FALTER is an assistant professor of English education and educational equity in the Department of Teacher Education and Learning Sciences at North Carolina State University and also teaches qualitative research methods courses. Her research interests include dialogical and critical pedagogies, English teacher education, young adult literature, and emotion in the teaching of literature and writing in the secondary classroom.

Contact:

Michelle M. Falter

North Carolina State University
Department of Teacher Education and Learning Sciences
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: mfalter@ncsu.edu
URL: https://ced.ncsu.edu/people/mfalter/

 

Aaron A. ARENAS is a PhD student in education leadership, policy, and human development at North Carolina State University. His research interests include higher education governance, organizational theory, and diversity in college leadership.

Contact:

Aaron A. Arenas

North Carolina State University
Department of Education Leadership, Policy, and Human Development
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: aarenas@ncsu.edu

 

Gordon W. MAPLES is a PhD student in education leadership, policy, and human development at North Carolina State University with a focus on higher education.

Contact:

Gordon W. Maples

North Carolina State University
Department of Education Leadership, Policy, and Human Development
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: gwmaple2@ncsu.edu

 

Chelsea T. SMITH is a PhD candidate in education leadership, policy, and human development at North Carolina State University with a concentration in higher education administration. Her interests include diversity in STEM education and social justice education.

Contact:

Chelsea T. Smith

North Carolina State University
Department of Education Leadership, Policy, and Human Development
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: ctsmit22@ncsu.edu

 

Lisa J. LAMB is a PhD candidate in teacher education and learning sciences at North Carolina State University with a specialization in social studies education. She is a 26-year veteran educator.

Contact:

Lisa J. Lamb

North Carolina State University
Department of Teacher Education and Learning Sciences
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: ljlamb@ncsu.edu

 

Michael G. ANDERSON is a PhD candidate in English education at North Carolina State University and a high school English teacher who is interested in critical and visual literacies.

Contact:

Michael G. Anderson

North Carolina State University
Department of Teacher Education and Learning Sciences
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: mgander3@ncsu.edu

 

Elizabeth M. UZZELL is a PhD student and graduate research assistant in educational evaluation and policy analysis at North Carolina State University.

Contact:

Elizabeth M. Uzzell

North Carolina State University
Department of Education Leadership, Policy, and Human Development
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: emuzzell@ncsu.edu

 

Laura E. JACOBS is a PhD candidate in Teacher Education and Learning Sciences with a focus on Literacy and English Education at North Carolina State University.

Contact:

Laura E. Jacobs

North Carolina State University
Department of Teacher Education and Learning Sciences
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: lejacobs@ncsu.edu

 

Xavier L. CASON is a PhD student in education leadership, policy, and human development at North Carolina State University and director of Community Schools and School Transformation for the Durham Public School Foundation.

Contact:

Xavier L. Cason

North Carolina State University
Department of Education Leadership, Policy, and Human Development
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: xlcason@ncsu.edu

 

Tiara A.N. GRIFFIS is a PhD student in educational psychology in the Department of Teacher Education and Learning Sciences and is currently working as a high school counselor and psychotherapist.

Contact:

Tiara A.N. Griffis

North Carolina State University
Department of Teacher Education and Learning Sciences
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: tabroadd@ncsu.edu

 

Megan POLZIN is a PhD student in science education at North Carolina State University and a middle school science teacher, interested in epistemic cognition and informal science education.

Contact:

Megan Polzin

North Carolina State University
Department of STEM Education
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: mapolzin@ncsu.edu

 

Nada Z. WAFA is a PhD candidate and graduate research assistant in teacher education and learning sciences at North Carolina State University with a focus on social studies education.

Contact:

Nada Z. Wafa

North Carolina State University
Department of Teacher Education and Learning Sciences
2310 Stinson Dr, Raleigh, NC, USA, 27695

E-mail: nzwafa@ncsu.edu

Citation

Falter, Michelle M.; Arenas, Aaron A.; Maples, Gordon W.; Smith, Chelsea T.; Lamb, Lisa J.; Anderson, Michael G.; Uzzell, Elizabeth M.; Jacobs, Laura E.; Cason, Xavier L.; Griffis, Tiara A.N.; Polzin, Megan & Wafa, Nada Z. (2022). Making room for Zoom in focus group methods: Opportunities and challenges for novice researchers (during and beyond COVID-19) [60 paragraphs]. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 23(1), Art. 21, http://dx.doi.org/10.17169/fqs-23.1.3768.

Forum Qualitative Sozialforschung / Forum: Qualitative Social Research (FQS)

ISSN 1438-5627

Creative Common License

Creative Commons Attribution 4.0 International License