The first stage of the predesign phase involved consultation meetings with researchers at the University of Tasmania (UTAS) who have experience in MOOC design and development. The aim was to understand the requirements related to the initial development concept for a stroke prevention MOOC. These researchers were emailed an invitation to participate in informal in-person consultation meetings on July 20 and August 13, 2020. The purpose of these meetings was to gain insights into their experience in designing health MOOCs for the community.

We then explored community perspectives on how a MOOC could support primary stroke prevention. Participants were recruited via convenience sampling of Menzies Institute for Medical Research (MIMR) Cardiovascular Research Flagship Community Reference Group (CRG). CRG members were invited via email to participate in an in-person half-day workshop at MIMR in March 2022. The workshop was facilitated by the MIMR Cardiovascular Research Flagship lead (SLG, female, PhD), a cardiovascular epidemiologist with experience in conducting qualitative research. The workshop focused on the perceived usefulness of a stroke prevention MOOC, topics for inclusion, preferred delivery modes, and strategies to engage learners. The Cardiovascular Research Flagship program manager (CF, female, Master of Environment [MEnv]) synthesized findings from this stage to consolidate insights from the meeting and workshop, guiding the initial design concept for the MOOC. This involved reading and interpreting the field notes from both sessions.

Based on the needs identified during the first stage, we developed a single pilot module to present the initial concept for the proposed Preventing Stroke MOOC. The module was drafted using existing evidence and resources, with content modeled from the Stroke Foundation’s StrokeSafe Speaker program.

Materials for the module included videos featuring experts (eg, epidemiologists and cardiologists) and people with lived experience (eg, survivors of stroke), who were invited to share their insights and stories. Experts from the research team’s network were invited to participate in video recordings, where they discussed stroke and risk factors from clinical, research, and public health perspectives. Invitations were sent to CRG members with lived experience of stroke to participate in video recordings to share their experiences of living with and managing stroke. Each video participant drafted their own script, which the research team then reviewed and refined together with them as needed. The filming took place in person in Hobart, Tasmania. The final draft of the module and video transcripts were reviewed by other members of the local research team and refined through iterative revisions until consensus was reached. The pilot module was developed in collaboration with the UTAS Digital Futures team, who supported page design, video uploads, and graphics integration. The pilot module was uploaded to the UTAS MOOC platform with restricted access.

Snowballing methods were used to recruit participants for user testing. Email invitations were circulated via the Stroke Foundation Lived Experience Council (formerly the Consumer Council). The Lived Experience Council is a board subcommittee within Stroke Foundation that provides insights into strategy and operations. Participants who agreed to take part were emailed a link to access the module. While working through the module, they were asked to reflect on the usefulness of topics, aspects they found engaging, any technical difficulties, and suggestions for informing future modules. To obtain feedback on the pilot module, we conducted 3 focus groups between March 3 and 23, 2022. The focus groups followed a semistructured guide (Multimedia Appendix 1). All sessions were facilitated by the flagship program manager (CF) and attended by the flagship lead (SLG), who took notes and responded to participant queries as needed. One researcher (AG) reviewed focus group transcripts and field notes to summarize participants’ feedback on the pilot module.

The Preventing Stroke MOOC was part of the Love Your Brain project, which also involved co-designing a text message system [24]. Participants included two separate groups: (1) community members and (2) health knowledge experts involved in health education or promotion. Recruitment occurred between April and May 2023. Community members were approached using recruitment flyers distributed by email to consumer reference groups (eg, MIMR CRG and Stroke Foundation) and newsletters (eg, Heart Foundation consumer newsletter). Health knowledge experts were recruited through emails circulated within the research team’s professional networks, including research collaborators and clinicians (eg, nurses, stroke neurologists, physiotherapists, and occupational therapists). Focus group methods, including facilitation approach, discussion guide, and analysis, are described in detail elsewhere and are freely accessible [24]. A total of 16 focus groups were conducted as part of the larger study (14 co-design focus groups and 2 user-testing focus groups), of which 12 co-design focus groups were relevant to the MOOC and are reported in this phase [24]. In brief, separate sessions were held remotely via Zoom (Zoom Communications, Inc) for each participant group to mitigate power imbalances. Discussion topics included prompt questions framed around primary stroke prevention (see Multimedia Appendix 2 for the question list used in each focus group). Over 4 months (June-September 2023), participants worked together with the research team to inform design decisions for the MOOC, including content, level of detail, presentation format, delivery modes, and engagement strategies [24].

Findings from the co-design focus groups, existing guidelines on primary stroke prevention, and evidence from the literature informed the development of the MOOC. Video materials were developed for the modules, incorporating lived experience stories and insights from subject area experts. Some community members who participated in the co-design focus groups were invited to take part in filming. Subject area experts (eg, epidemiologists, cardiologists, neurologists, and paramedics) were recruited through the research team’s professional networks. Video scripts were drafted by speakers and reviewed by the research team before final review and approval by the speaker. Overall, 2 types of video styles were used based on findings from the co-design process, including direct-to-camera recordings and hand-drawn animations. Direct-to-camera videos featured speakers delivering short, scripted segments on topics relevant to their expertise. Animated videos were produced in collaboration with Russ Animates Ltd. A transcript of each video was available to download as a PDF to ensure accessibility.

Interactive features, including gamified activities such as flashcards and crosswords, were developed to ensure the content was engaging. End-of-module quizzes were created for each module, and links to additional resources were selected by the research team and subject area experts to complement the topics. Once the content and materials were finalized, they underwent iterative review and refinement in collaboration with subject area experts. The Digital Futures team of education technologists at UTAS supported the design of the MOOC platform. The content was uploaded to the MOOC page hosted by UTAS with restricted access. The entire development process took place over a 9-month period (May 2023-February 2024).

Invitations to participate in user testing of the MOOC were sent to the same participants who took part in the focus groups during the co-design phase. Additional participants were invited through the research team’s professional networks to provide broader perspectives. Participants who agreed to participate in user testing received a welcome email containing a link to access the MOOC and were given 8 weeks to engage with the course.

Feedback was collected through separate focus groups with the community and health expert groups remotely via Zoom in March 2024. The data collection method followed the same process as that used for the co-design focus groups [24]. The sessions focused on exploring users’ experiences with the MOOC, including overall perceptions of the course, features they found useful, challenges encountered, and suggestions for improvement. In addition, 3 health knowledge experts who had not participated in the co-design phase were provided access to the MOOC and asked to review the course and provide written feedback via email regarding content, usability, and suggestions for improvement. The research team reviewed the feedback and identified areas for improvement. These were discussed in team meetings and shared with the UTAS Digital Futures team, with revisions made to the MOOC where feasible, technically possible, and within budget.

Transcripts from the user testing focus group were analyzed manually in Microsoft Word. One researcher (AG) reviewed and summarized participants’ feedback using a deductive approach [28]. Feedback from the community member focus group and email feedback from health knowledge experts were organized according to the main categories of the user-testing discussion guide (eg, general impressions, useful features, challenges encountered, and suggestions for improvement) and grouped under a single overarching theme reflecting overall feedback on the MOOC. The process involved frequent discussion with one of the focus group facilitators (SB, male, Research Fellow, PhD), and findings were reviewed and confirmed by the research team.

We conducted qualitative content analysis to retrospectively evaluate the co-design process and determine whether participants’ input from the co-design phase was incorporated into the final MOOC design [28,29]. The analysis followed 3 steps.

In the first step, one researcher (AG) engaged with the MOOC platform as a mock participant and worked through each module. The MOOC was treated as qualitative data, and all module content was reviewed in detail. As each module was completed, key design features of the course were identified and described (eg, whether learning objectives were present, the structure of modules, topics covered, the number and type of learning activities, and the media formats used). These descriptions were used to characterize how the MOOC was designed. Word counts were calculated for each module, including video transcripts, using Microsoft Word, and readability was assessed using the Flesch Reading Ease score [30].

In the second step, 12 transcripts from co-design focus groups involving 22 participants were imported into the NVivo software (version 15; Lumivero). The analysis began with a close reading of the transcripts. Meaning units were identified inductively as words, sentences, or short passages conveying a single idea related to the MOOC [28,29]. These meaning units were then interpreted to understand participants’ suggestions in relation to the MOOC design. An initial subset of transcripts was analyzed first to explore how participants’ suggestions were being interpreted. These interpretations were discussed with 2 researchers (SB and SLG), who were involved in the co-design facilitation, to ensure the analysis was credible and meaningful within the context of the co-design process. The remaining transcripts were then analyzed, with ongoing discussion with SB and SLG. This involved revisiting selected excerpts, considering alternative interpretations, and refining the understanding of participants’ suggestions.

In the final step, we undertook triangulation by comparing findings from the MOOC and the co-design focus groups to examine whether and how participants’ suggestions were reflected in the final MOOC design [31]. To support this comparison, we drew on design elements adapted from the Analysis, Design, Development, Implementation, and Evaluation (ADDIE) instructional design model [32], which outlines key aspects of course design, comprising learning objectives, structure, content, exercise, assessment, and media selection. Features identified in the MOOC were organized in relation to these design elements (Multimedia Appendix 3), and participants’ suggestions were subsequently examined alongside corresponding MOOC features for each design element. The number of meaning units identified in the second step was summarized descriptively by design element during this process to support transparency in reporting the distribution of participants’ suggestions. An example of the analytic process is provided in Multimedia Appendix 4.

Trustworthiness of the analysis was supported through strategies aligned with criteria for qualitative content analysis, including credibility, dependability, and confirmability [33]. Credibility was supported through ongoing discussions of interpretations with researchers who were involved in the co-design facilitation and contributed to interpreting the data. Dependability was supported through clear documentation of the data analysis process. Confirmability was supported by revisiting the transcripts and discussing interpretations to ensure they were grounded in the data. The analysis was primarily conducted by a researcher (AG) who was not involved in the co-design process, which helped reduce the influence of prior assumptions when interpreting participants’ suggestions and how they were reflected in the MOOC. In this context, interrater reliability was not considered appropriate for the approach taken, as the aim was interpretive understanding, with interpretations discussed with the research team [34,35].

Two researchers involved in the design and development of the Preventing Dementia MOOC and the Understanding Multiple Sclerosis MOOC attended separate consultation meetings with the research team. Together, they recommended the following to guide the development of a successful MOOC: (1) engage stakeholders early in the design process, (2) plan for development costs, and (3) provide feedback to learners.

A total of 3 CRG members participated in the half-day workshop. They emphasized the importance of personalizing content to make it relevant and engaging for learners. Key elements recommended for inclusion were personalized stroke risk assessments and interactive features such as quizzes and discussion boards. Participants highlighted that the MOOC content should follow a structure similar to the StrokeSafe Speaker program, feature stories from people with lived experience of stroke, and include multimodal delivery through a combination of videos, graphics, and text to accommodate different learning styles.

The pilot module comprised 9 pages and covered topics that broadly followed the StrokeSafe Speaker program, including an introduction to stroke, living with stroke, stroke as a medical emergency, stroke statistics, understanding stroke risk, and managing stroke risk. The module featured 4 videos, with 2 presented by experts (a cardiovascular epidemiologist and a general practitioner) and 2 by people with lived experience of stroke. Additional materials included an end-of-module quiz, a discussion board, links to further resources, and a glossary.

A total of 9 participants were recruited for user testing of the pilot module. One participant opted out due to COVID-19. Participants were from Tasmania, New South Wales, Victoria, and Western Australia. Overall, 2 focus groups were held remotely via Zoom (n=6 participants), and 1 focus group was conducted in person at MIMR (n=2 participants). Each session lasted approximately 30 to 60 minutes.

All participants reported using a laptop or desktop computer to complete the pilot module. Overall, feedback was positive regarding the structure of the content, the topics covered, and the materials included. Participants described the module as engaging and easy to follow, indicating that it could be a useful tool for the general public. They further expressed that videos from people with lived experience of stroke had a particularly strong impact. Participants suggested that the full MOOC should include subtitles in the videos to improve accessibility. They also suggested that additional optional mini-modules could be incorporated, such as dedicated sections covering aphasia and childhood stroke.

In total, 22 purposively selected participants participated in at least 1 focus group (n=12 community members and n=10 health knowledge experts). Among the community members participating, 58% (7/12) were female, 58% (7/12) were aged <65 years, 75% (9/12) were stroke survivors, and 25% (3/12) had no personal history of stroke. Health knowledge experts were predominantly female (8/10, 80%), aged >35 years (6/10, 60%), and comprised equal proportions of researchers (5/10, 50%) and clinicians (5/10, 50%). Comprehensive thematic analysis of the co-design focus groups can be found in our previous publication [24]. In summary, specific to the MOOC, participants in the focus groups suggested including topics on stroke signs, risk factors, and the impact of stroke [24]. They emphasized ensuring the accuracy and credibility of information, the use of plain language, multimedia delivery formats, personalization through self-paced modules and topic choice based on learners’ risk factors, incorporating interactive elements, stories from people with lived experience of stroke, accessibility across major devices, and inclusive design [24]. They also specifically mentioned the benefit in using well-recognized evidence-based resources, including topics from the StrokeSafe Speaker program, to guide the structure of the MOOC content [24].

In total, 16 modules were designed, with 7 core modules and 9 optional mini-modules (Figure 2). The seven core content modules were (1) Introduction, (2) What is stroke, (3) Stroke numbers, (4) Stroke signs, (5) Risk factors for stroke, (6) Action plan, and (7) Completion. Optional mini-modules were designed to support personalization. These included 5 mini-modules focused on biomedical risk factors (blood pressure, cholesterol, atrial fibrillation, overweight and obesity, and blood sugar) and 4 mini-modules focused on lifestyle-related risk factors (smoking, diet and alcohol, exercise, and sleep). Participants were encouraged to complete at least 1 mini-module from each section. Participants received a certificate in the final module once they completed the course. A total of 60 individual videos were filmed with subject area experts (n=13) and individuals with lived experience of stroke or carers (n=8). We also developed 6 interactive activities such as flashcards and crosswords, 14 end-of-module quizzes, 110 graphics or infographics, and 129 hyperlinks to additional resources integrated into relevant modules.

A total of 6 community members who had participated in the co-design focus groups undertook user testing of the MOOC. Health knowledge experts who participated in the co-design focus groups did not respond to the MOOC user testing invitation. Additional feedback was obtained via email from 3 health knowledge experts who had not been involved in the co-design phase. The focus group with community members was conducted online on March 13, 2024, and lasted approximately 60 minutes.

Overarching feedback from participants indicated that the MOOC was user-friendly, engaging, and well-structured. Participants also reported that the interactive features were useful and that the personalized risk assessment and videos provided impact. Participants noted a few technical issues, including difficulties accessing the MOOC via mobile phones and tablets.

Suggestions for improvement included defining key terms, maintaining consistent terminology throughout the content, and providing clear signposting, such as bolding keywords to support understanding and comprehension. Two participants noted that, from a disability perspective, graphics using similar colors may pose challenges for individuals with vision impairment or color blindness. They recommended high-contrast colors to improve visual accessibility. In collaboration with the Digital Futures team at UTAS, strategic modifications were made. These included technical updates to support compatibility across all major devices, refinement of wording for consistency, use of bold text for keywords, clear signposting, and use of high-contrast colors in graphics.

Following review and documentation of the MOOC, the content covered a total of 81 topics, and multiple-choice questions (MCQs) were included in 14 modules (Multimedia Appendix 3). Data from co-design focus group transcripts (step 2) were analyzed to identify participants’ suggestions related to MOOC design, with 223 meaning units identified across the 12 transcripts. Triangulation of findings from step 1 and 2 involved examining how these suggestions were reflected in the MOOC. This comparison was conducted across the adapted design elements, with illustrative quotes presented in Tables 1-4. The findings are presented below, organized according to these elements.

Two meaning units relating to learning objectives were identified. Participants emphasized the importance of setting clear expectations and guidelines at the beginning of the course.

In the final MOOC, learning objectives were clearly stated on the landing page of all relevant core modules except Module 7, which served as a completion module and did not require learning objectives. Four of 9 mini-modules did not include learning objectives. This inconsistency may pose challenges in engagement and clarity for learners starting those modules.

There were 11 meaning units relating to the structure of the MOOC. Participants discussed having a logical sequence for the MOOC modules and topics. They expressed a preference for delivering content in a sequence of concepts beginning with foundational concepts and building upon them, followed by optional modules that learners can tailor depending on their perceived relevance.

The MOOC adopted a logical, linear structure across modules and within module topics. Core Module 5 on risk factors and Core Module 6 about action plans incorporated mini-modules that allowed learners to select topics relevant to them. The overall structure of the MOOC reflected the design discussed during the co-design sessions, supporting a logical learning structure and personalization.

Content was most frequently discussed, with a total of 127 meaning units reflecting participants’ suggestions relating to content. Participants identified key content topics to include in the MOOC, such as types of stroke, statistics, signs and symptoms, and risk factors for stroke. They suggested contextualizing information to support comprehension and highlighting the relevance of the content to learners through personalization and lived experience stories. Participants also recommended presenting content in an aphasia-friendly format, using plain language, and aligning with health literacy principles.

The MOOC incorporated content topics suggested by participants (Multimedia Appendix 3 for a list of content covered in the MOOC). Content across all modules was presented in simple language, supported by detailed explanations and examples provided through text and videos to foster understanding. Where technical terms were used in the content, they were bolded and detailed in a glossary section. The glossary consisted of 113 terms with simple definitions. The word count of modules ranged from 1688 to 4640 words, and readability scores ranged from 49 to 69 (equivalent to Australian Grade 8 to 12). The average readability score across modules was 60.7 (out of 100), with higher scores indicating easier readability. Seven of 16 modules scored below 60, with one mini-module (Cholesterol) scoring below 50, indicating that the content was relatively complex and may have included more technical language. Inconsistencies in readability scores may limit comprehension for learners with lower literacy. While an aphasia-friendly format or toggle was recommended, the MOOC did not include this feature.

A total of 7 meaning units relating to exercises were identified. Participants suggested incorporating short and engaging interactive activities to enhance learner engagement.

Six interactive activities were included across all relevant core modules, including gamified crosswords, flashcards, and a cardiovascular risk assessment with tailored feedback. These features were not present in the mini-modules.

Overall, 3 meaning units relating to assessment were identified. Rather than including formal assessments in the MOOC, participants preferred quizzes at the end of modules to allow learners to check their understanding without added pressure.

The MOOC included 14 end-of-module quizzes across all relevant core modules and optional mini-modules, with an average of 3 questions per quiz.

A total of 73 meaning units relating to media selection were identified. Participants recommended using a diverse range of formats to deliver information. These included simple infographics, diagrams, short videos with minimal distractions, videos featuring both people with lived experience and health experts, and hyperlinks to additional resources.

The MOOC incorporated a mix of media across all modules, including graphics, infographics, videos, transcripts, and hyperlinks. It included 30 videos featuring subject area experts (eg, epidemiologists, neurologists, cardiologists, paramedics, and dietitians), 28 videos featuring individuals with lived experience of stroke and carers, and 2 hand-drawn animated videos. Videos were concise, with an average duration of 1 minute and 47 seconds. While most suggestions were incorporated into the MOOC, the absence of multilingual options or features limited its accessibility to people from culturally and linguistically diverse (CALD) backgrounds. Notably, this was already identified as the next step in the broader project after evidence is established for this MOOC.