Abstract
Background: High-quality professional development can help teachers build the skills and confidence needed to implement evidence-based practices, such as classroom physical activity breaks. While in-person training is often preferred, virtual asynchronous training offers a flexible alternative for teachers. However, its effectiveness may be limited by design and usability challenges.
Objective: The aim of this study was to conduct a usability assessment of the Interrupting Prolonged Sitting with Activity (InPACT) virtual teacher training modules, using a human-centered design (HCD) approach to align the training with end-user preferences and needs.
Methods: The InPACT professional development program includes nine modules delivered through an online platform (Qualtrics XM). A usability assessment was conducted using (1) structured online surveys with elementary school teachers who had completed the modules, (2) a heuristic evaluation based on the Jakob Nielsen 10 usability heuristics, and (3) a competitive analysis of three learning management systems (Moodle, Teachable, and Thinkific) to identify platform strengths, limitations, and insights. Findings and recommendations were compiled to inform module improvements.
Results: Eleven teachers completed the survey. They reported that the modules were easy to use, the content was informative and relevant, and they valued the interactive and practical components. Areas for improvement included enhancing content engagement and increasing technical flexibility. The heuristic evaluation identified 14 usability issues across nine of the Nielsen heuristics (eg, navigation difficulties and text-heavy pages). The competitive analysis highlighted features that enhance user experience, such as progress tracking, estimated completion times, interactive elements, and feedback on quiz answers.
Conclusions: Usability assessments grounded in an HCD approach can enhance virtual training for educators, improving the uptake and implementation of evidence-based practices, such as classroom physical activity breaks. Five overarching recommendations emerged as follows: (1) removing video time constraints, (2) implementing accurate progress bars, (3) incorporating active learning or retention activities, (4) creating consistent and actionable end pages, and (5) ensuring consistency in titles and references to physical materials. Building on preliminary positive data from revised modules, future research should evaluate the impact of HCD revisions on teacher self-efficacy, training completion, and fidelity of program implementation.
doi:10.2196/83427
Keywords
Introduction
Physical activity plays a vital role in promoting child and adolescent health by improving cognition, bone health, fitness, and overall health, while also reducing the risk of anxiety and depression []. However, most children and adolescents in the United States do not meet the Physical Activity Guidelines for Americans, which recommend at least 60 minutes of moderate-to-vigorous physical activity daily to attain the greatest health benefits []. National surveillance data show that only 42% of children aged 6 to 11 years meet this recommendation [], with participation declining sharply during adolescence [] and rates being even lower for youth residing in resource-limited communities []. This shortfall increases the risk of obesity and related chronic conditions [,], highlighting the need to improve youth physical activity engagement.
Schools offer a critical and equitable setting to help close the physical activity gap among children and adolescents [,]. Among school-based strategies, classroom-based physical activity interventions have emerged as effective and feasible approaches for increasing students’ daily activity levels, particularly in resource-limited settings [,]. These interventions provide structured opportunities for all children to engage in regular exercise by integrating short bouts of movement into the school day. Compared to physical education and after-school sports programs, they are less resource-intensive and easier to implement, making them well-suited for schools with limited staff, space, or funding [,].
Recognized as an evidence-based practice by the Community Preventive Services Task Force in 2021, classroom physical activity interventions typically involve teachers incorporating 1 to 5 activity breaks per day, each lasting 4 to 10 minutes []. Core implementation components include dedicated time, adequate classroom space, and access to age-appropriate videos and exercise resources. A systematic review and meta-analysis by the Task Force, which included 22 studies (11 using direct observation), found that physical activity breaks significantly increased students’ activity levels during school hours and improved time-on-task by a median of 26.2 minutes []. These findings provide strong evidence that classroom physical activity interventions can simultaneously promote physical activity and enhance classroom engagement.
Despite the well-established benefits, national data show that fewer than half of US elementary teachers incorporate these breaks regularly [,], underscoring the need to better understand barriers and facilitators to their implementation. While many teachers recognize these benefits—such as increased student focus, enjoyment, and a more positive classroom climate—they often experience a lack of confidence, uncertainty about how to integrate activity without disrupting instruction, and the belief that physical activity is not aligned with academic goals [-]. Key individual-level factors that influence implementation include teachers’ knowledge, attitudes, self-efficacy, and perceptions of social norms [-]. Educators who feel confident in their ability to use physical activity, value its role in learning, and perceive support from peers and administrators are more likely to use activity breaks consistently [-]. Strengthening these individual factors is critical to expanding the reach and sustainability of classroom physical activity.
To overcome these barriers—particularly teachers’ lack of confidence and uncertainty about how to integrate activity without disrupting learning—high-quality professional development is essential []. For physical activity integration to become routine, teachers need concrete, classroom-ready strategies that align with existing instructional practices []. The Interrupting Prolonged Sitting with Activity (InPACT) intervention addresses this need by providing a skills-based professional development program designed to support direct translation to classroom practice []. Through structured training, InPACT equips educators with the tools and strategies needed to integrate physical activity in ways that are feasible within daily classroom routines.
Grounded in the Guskey [] model of teacher change, which emphasizes practice as a precursor to belief change, the InPACT approach prioritizes the adoption of new classroom behaviors before targeting shifts in attitudes or perceptions. As teachers observe improvements in student focus, classroom climate, and learning, these practice-based successes reinforce the feasibility and value of integrating movement into the school day, thereby supporting subsequent changes in beliefs and acceptability.
The educational strategies embedded within the InPACT training were intentionally selected to reflect adult learning principles and evidence-based models of effective teacher professional development [,]. These strategies include practical, classroom-ready examples, active skill-building, structured reflection, and explicit connections between training content and teachers’ daily instructional practices. The training was co-created with the University of Michigan School of Education’s Instructional and Program Design Coordinator, ensuring alignment with evidence-based pedagogy and responsiveness to teacher-identified needs [].
The InPACT professional development program consists of 9 interactive training modules that can be delivered either in-person or asynchronously via an online learning platform (Qualtrics XM). In person, the modules are delivered by a trained InPACT professional using a Microsoft PowerPoint presentation, with interactive opportunities for hands-on activities, modeling of classroom activity breaks, and group discussions. In-person InPACT training sessions typically last 6 to 8 hours. The virtual format consists of asynchronous modules combining text, videos, images, and interactive exercises, with each module taking approximately 45 to 60 minutes to complete. Teachers are encouraged to complete all modules within a 4- to 6-week period to support continuity and application to classroom practice. Participants engage in guided self-reflection activities and complete premodule and postmodule assessments to track learning progress. provides a description of each training module.
| Module | Title | Description |
| 1 | Evidence base for classroom physical activity | Introduces the evidence supporting classroom physical activity and its benefits for health, well-being, and academic performance. |
| 2 | Overview of InPACT | Explains how to incorporate short movement breaks (InPACT) into the school day. |
| 3 | Optimizing classroom layouts | Guides teachers in creating safe and functional spaces for movement in the classroom. |
| 4 | Classroom management during activity breaks | Focuses on maintaining structure and engagement during physical activity breaks. |
| 5 | Integrating physical activity with academic content | Helps teachers align movement with learning goals to support academic achievement. |
| 6 | Selecting exercise videos and assessing intensity | Covers selecting appropriate videos and assessing student intensity levels to meet physical activity goals. |
| 7 | Motivational techniques and gamification | Introduces strategies like gamification to enhance and sustain student engagement. |
| 8 | Inclusive adaptation of physical activity | Provides strategies to adapt activities to ensure accessibility and inclusion for all students. |
| 9 | Safety guidelines | Emphasizes safety considerations and offers best practices for injury prevention and safety planning. |
After developing this content-rich program, we sought to understand teachers’ preferences for how these modules could best be delivered. Findings from a group of general education teachers (n=35, teaching experience ranging from 2 to 27 years; mean 14.8, SD 7.4) highlighted the importance of offering flexible training options for classroom physical activity implementation. While nearly two-thirds of teachers expressed a preference for in-person professional development, a substantial portion—approximately one-third—preferred a virtual, asynchronous training option. These teachers cited competing demands, stress, and logistical challenges (such as preparing substitute teacher plans) as barriers to in-person participation (Friday et al, PhD, unpublished data, 2021). Providing autonomy in training modality—allowing educators to select either virtual or in-person formats—could therefore enhance participation and reduce perceived burden, particularly if training is integrated into existing professional development sessions.
Offering virtual training may increase accessibility for teachers facing time constraints and logistical challenges. However, it also introduces a new set of considerations—particularly regarding the usability of the digital learning environment. Ensuring that these online modules are accessible, understandable, and engaging is essential to addressing the very barriers—such as stress and overload—that teachers have identified.
Teachers’ ability to benefit from online modules depends on the usability and design quality of the digital learning environment []. Usability is defined as “a quality attribute assessing how easy user interfaces are to use, focusing on 5 core components: learnability, efficiency, memorability, error handling, and satisfaction” []. Research shows that poorly designed websites can hinder engagement, leading to frustration and high dropout rates []. Conversely, user-friendly platforms can promote greater interaction and retention []. To address this, we conducted a usability assessment of the InPACT virtual teacher training modules to evaluate how accessible, understandable, and engaging they are for classroom educators. Ultimately, improving the usability of the InPACT virtual modules can empower more educators to confidently and sustainably implement physical activity breaks, regardless of the training format they choose.
Methods
Overview
This study used a mixed methods approach grounded in a human-centered design (HCD) framework to evaluate the usability and delivery of the InPACT virtual teacher training modules, with an emphasis on understanding the end-user needs, constraints, and contexts prior to large-scale implementation, consistent with established HCD models for digital health interventions []. Within the HCD lifecycle, this study focused on formative inspiration and ideation stages to inform iterative refinement of the training modules, operationalized through complementary methods, including a structured online survey of teachers, a heuristic usability evaluation, and a competitive analysis of learning management systems (LMSs). HCD served as the overarching, iterative, and participatory framework, integrating principles from user-centered design, which prioritizes usability and functionality from the end-user perspective, and user experience (UX) design, which focuses on optimizing the quality of users’ interactions with a system. Together, these principles informed design decisions related to the structure, usability, and delivery of the virtual modules. Later stages of HCD, including implementation and outcome evaluation, were beyond the scope of this study and are the focus of ongoing and future work.
Recruitment
Elementary school teachers who had completed at least one InPACT virtual module were recruited for this study. Principals in Michigan schools currently implementing InPACT provided the contact information of teachers who participated in the training. Eligibility was determined through these principal-provided contact lists. Eligible teachers were invited via email to participate in the research, with a link to a structured online survey. Participants could opt out at any time.
Structured Online Survey
A structured online survey was administered to evaluate teachers’ experiences with the InPACT intervention. Developed by the research team, the survey included both closed-ended and open-ended items to capture quantitative indicators of module use and qualitative feedback on UX. The first section gathered demographic information, such as the grade level taught and years of teaching experience. The second section assessed teachers’ experiences with the InPACT modules, including challenges encountered, clarity of module content, perceived strengths and weaknesses, preferred format of the program guide (ie, the written version of the modules; physical book vs digital pdf), use of supplementary links, suggested improvements, and frequency of classroom activity implementation following training.
All participants completed the same set of structured questions, designed to take approximately 15 to 20 minutes. Responses were collected anonymously and analyzed by the research team. Participants were offered the chance to enter a US $25 gift card raffle as an incentive for completing the survey. The full survey instrument, including all closed-ended and open-ended items, is provided in .
Heuristic Evaluation
A heuristic evaluation was conducted to assess the usability of the InPACT virtual teacher training modules. The evaluation team consisted of 5 evaluators with diverse academic backgrounds and varying levels of expertise in UX design. UX design is defined as “the process of designing digital or physical products with a focus on optimizing users’ overall experience, including usability, accessibility, and satisfaction” []. Some evaluators had completed formal coursework in UX design, while others contributed complementary perspectives, including spatial and visual design and applied analytics. All evaluators had prior hands-on experience conducting usability evaluations through Michigan Open UX, the University of Michigan’s student organization focused on applied UX research and practice.
Heuristic evaluation is a cost-effective usability inspection method in which evaluators assess an interface against established usability principles, or heuristics, to identify potential design issues [,]. This evaluation was guided by the Jakob Nielsen 10 usability heuristics [], which are grounded in cognitive psychology and human-computer interaction principles. Each evaluator independently completed the virtual training modules and documented any usability issues encountered. Identified issues were mapped to the relevant heuristic and assigned a severity rating ranging from 0 (“no usability problem”) to 4 (“usability catastrophe”).
Competitive Analysis
A competitive analysis was conducted using a FigJam board (Figma, Inc) to generate strategic insights into potential alternative LMS platforms that could support the scalability and long-term delivery of the InPACT training program. As the program continues to expand, evaluating LMS options beyond its current Qualtrics-based delivery is essential for optimizing UX and infrastructure sustainability.
Three LMS platforms were selected for evaluation: Moodle (version 5.0), Teachable (version 3.3.0), and Thinkific (version 1.17). These platforms were selected based on their relevance to professional education delivery, scalability potential, and cost considerations. Each platform was evaluated through hands-on exploration from both the lecturer and learner perspectives. From the lecturer’s perspective, evaluators examined features related to course creation, content uploading, learner analytics, and collaboration among multiple contributors. From the learner’s perspective, the evaluation focused on progress tracking, feedback mechanisms, navigation, and alignment with usability heuristics such as visibility of system status (eg, progress bars and activity feedback) and user control and freedom (eg, back and exit buttons). Additional features relevant to both perspectives—including media integration, retention activities, and search or filtering capabilities—were also assessed.
The competitive analysis aimed to (1) identify LMS platforms that may better support InPACT’s future delivery needs and (2) inform potential enhancements to the current system by identifying effective design features used in other platforms. The analysis was conducted iteratively, recognizing the evolving nature of LMS technologies and prioritizing transferable insights over the selection of a single replacement platform.
Data Analysis
Closed-ended survey items on the online survey (eg, yes or no responses and categorical frequency ratings) were summarized using descriptive statistics to characterize teacher demographics, module use, and perceived frequency of classroom activity implementation. Open-ended survey responses (eg, “What are some positives of the modules? Negatives?”, “If there is something you could change about the modules, what would it be?”, and “Is there anything else you’d like to add?”) generated free-text responses that were treated as qualitative data and analyzed using thematic analysis. All free-text responses were independently reviewed by members of the evaluation team to identify recurring patterns related to usability, content clarity, engagement, and technical functionality. An iterative process was used to group similar responses, refine theme definitions, and reach consensus on final themes. Representative quotes were selected to illustrate each theme and provide contextual depth to the findings. To protect participant confidentiality, pseudonyms were used for all quotes presented.
Data from the heuristic evaluation were analyzed by compiling all usability issues identified by individual evaluators and categorizing them according to the Jakob Nielsen 10 usability heuristics. Severity scores were determined through group discussion and consensus and were used to prioritize design recommendations.
Competitive analysis data were analyzed through a structured cross-platform comparison of LMS features relevant to usability and instructional design, including course creation, UX, and interactivity. Cross-platform patterns were synthesized to identify design features that could inform the optimization of the InPACT teacher training modules.
Overall, data analysis integrated descriptive quantitative summaries with qualitative thematic analysis and usability-focused evaluative techniques.
Ethical Considerations
This study was approved by the institutional review board of the University of Michigan (HUM00192745). Prior to each interview, all participants provided verbal informed consent. Each participant was assigned a unique numerical identifier, and pseudonymized transcripts and personal data were stored separately on a secure Childhood Disparities Research Laboratory U-Drive, accessible only to authorized research team members. Participants received a US $25 gift card as compensation for their time.
Results
Structured Online Survey
A convenience sample of 11 schoolteachers (grade levels: kindergarten through 5th grade; teaching experience range: 3‐28 years; mean 18.0, SD 8.9) completed the structured online survey. Overall, teachers reported minimal technical or content-related barriers when completing the InPACT teacher training modules. Only 1 teacher reported experiencing technical issues, and no teachers reported confusion with the module content.
Use of supplemental materials varied across respondents. Approximately half of the teachers reported using a written program guide (PDF or physical version of the modules) alongside the online training, whereas the remaining teachers relied exclusively on the digital modules. Engagement with embedded supplementary links was mixed: 4 teachers reported frequent use, while others reported occasional use (n=5) or no use (n=2), often noting that the core module content was sufficient without additional resources.
Following the completion of the training, all teachers reported incorporating activity breaks into their classrooms, with most reporting doing so very often (n=8) and others somewhat often (n=3). Taken together, these findings indicate that the InPACT teacher training modules were clear, functional, and feasible to implement, with few reported barriers and flexible options for engaging with written materials and supplemental content.
presents the themes derived from teachers’ open-ended survey responses, along with illustrative quotes drawn directly from participants’ free-text comments. Five major themes emerged from the thematic analysis of open-ended survey responses. The first theme concerned ease of use and accessibility. Most teachers reported that the modules were easy to navigate and understand, both in terms of the platform interface and the clarity of the content. The flexibility to complete the modules at one’s own pace was particularly appreciated, as many teachers noted they were unable to finish a module in a single sitting.
Theme 1: ease of use and accessibility
- “I thought they were very easy and useful.” [P5, Janice Marquez]
- “Easy access.” [P7, Jose Jackson]
- “They were easy to follow and understand.” [P11, Lucy Johnson]
Theme 2: content utility
- “I’ve been using what I learned for years now.” [P12, Lauren Smith]
- “It had a lot of useful information.” [P3, Isabel Kim]
- “I have been using many activity breaks throughout my day and noticing significant improvement in student’s engagement, focus, but mostly happiness.” [P12, Lauren Smith]
Theme 3: interactive and applied learning
- “Examples that got us up and moving as we completed the modules.” [P4, Farrah Bandow]
- “More interactive activities/links.” [P3, Isabel Kim]
Theme 4: engagement and presentation
- “It was not presented in a very engaging way.” [P3, Isabel Kim]
- “I would be more concise and shorten them up.” [P13, Rhonda Barrales]
- “The video was hard to read.” [P2, Emily Canton]
Theme 5: technical flexibility
- “You had to wait before the module let you move forward.” [P11, Lucy Johnson]
- “The delay for the videos was sometimes longer than necessary so you had to wait before the module let you move forward.” [P10, Sarah Lee]
The second theme focused on the perceived utility of the content. Content utility is defined as how effectively content fulfills a user’s specific need, goal, or task, resulting in user satisfaction []. Participants described the modules as informative and relevant, highlighting their value as a resource for both learning new strategies and reinforcing prior knowledge. Specific content areas, such as classroom management techniques and safety considerations, were frequently cited as especially useful.
The third theme pertained to the interactive and applied nature of the learning experience. Teachers expressed appreciation for the modules’ interactive components and noted the practical application of the material in their classroom settings. They valued being able to convey information to students and implement the strategies directly in their teaching practice.
The fourth theme addressed engagement and presentation. While participants acknowledged the usefulness of the content, some indicated that the modules were overly dense and lacked engaging delivery. Suggestions for improvement included making the modules more concise and enhancing the presentation style to increase user engagement.
Finally, the fifth theme related to technical flexibility. A few participants reported technical issues, such as difficulties with video readability and excessive delays during video progression. To improve the overall UX, teachers recommended shortening the content and providing greater control over video playback, including options to skip or speed up sections as needed.
Heuristic Evaluation
presents the results of the heuristic evaluation conducted on the InPACT teacher training modules. A total of 14 usability issues across 9 of the Nielsen 10 heuristics were identified. For the heuristic of help and documentation, the training received a score of 2, indicating minor usability problems. For 6 heuristics—visibility of system status, match between the system and the real world, consistency and standards, recognition rather than recall, aesthetic and minimalist design, and help users recognize, diagnose, and recover from errors—the training received a score of 3, indicating major usability problems. Finally, the heuristics of user control and freedom and error prevention were rated with a severity score of 4, representing usability catastrophes. The heuristic of flexibility and efficiency of use—which emphasizes allowing both novice and expert users to interact effectively with a system, for example, by providing shortcuts or customizable features that make frequent actions faster—was not evaluated, as novice end users were not included in this evaluation.
| Heuristic | Violation | Recommendation | Severity |
| 1. Visibility of system status |
|
| 3 |
| 2. Match between the system and the real world |
|
| 3 |
| 3. User control and freedom |
|
| 4 |
| 4. Consistency and standards |
|
| 3 |
| 5. Error prevention |
|
| 4 |
| 6. Recognition rather than recall |
|
| 3 |
| 7. Flexibility and efficiency of use |
|
| N/A |
| 8. Aesthetic and minimalist design |
|
| 3 |
| 9. Help users recognize, diagnose, and recover from errors |
|
| 3 |
| 10. Help and documentation |
|
| 2 |
aN/A: not applicable.
Competitive Analysis
highlights the strengths and limitations across the three evaluated LMS platforms. Moodle demonstrated strong capabilities for course creation and content organization, including support for multimedia integration, multiple courses per module, and clear navigation features, though it lacked consistent progress indicators, time estimates, and a dedicated “next” button. Teachable offered a responsive design across devices, collaborative course-building features, analytics, and interactive activities, but some aspects of content presentation were confusing, and students could bypass quizzes. Thinkific provided intuitive course creation, clear progress tracking, interactive quizzes with feedback, and helpful media labeling, but the course title occupied excessive screen space, limiting navigation efficiency. Collectively, these findings highlight the relative advantages and trade-offs of each platform, offering guidance for selecting or refining LMS solutions to optimize usability, learner engagement, and module scalability for the InPACT teacher training program.
| LMS name | Course creation | User experience | Interactivity |
| Moodle |
|
|
|
| Teachable |
|
|
|
| Thinkific |
|
|
|
aLMS: learning management system.
bThe plus sign (+) denotes observed strengths.
cThe minus sign (–) denotes observed weaknesses.
dAI: artificial intelligence.
Discussion
Principal Results
Given the barriers teachers face in integrating physical activity into classroom routines—particularly related to confidence, stress, and limited time—the purpose of this study was to apply a HCD approach to evaluate and enhance the usability of the InPACT virtual teacher training modules. Using mixed methods—including a structured online survey, heuristic evaluation, and competitive analysis—we assessed teachers’ training experiences and identified key usability challenges and opportunities for improvement. Results from the structured survey revealed strong support for the modules’ content and structure, including perceived usefulness, flexibility, and applicability. However, teachers also noted that the modules could benefit from improved pacing, greater interactivity, and enhanced video controls. The heuristic evaluation uncovered 14 usability issues across 9 of the Nielsen 10 heuristics, including multiple major usability problems and a severity score of 4 (“usability catastrophe”) for user control and freedom. These findings pointed to critical design flaws that may hinder user engagement and reduce the likelihood of training completion. The competitive analysis compared three LMS platforms (Moodle, Teachable, and Thinkific) and highlighted key platform features—such as course creation flexibility, learner feedback mechanisms, and collaborative design tools—that could inform future iterations of the InPACT platform. Taken together, these results suggest that while the InPACT training modules are content-rich and well-aligned with teacher needs, several design and delivery improvements are needed to enhance usability, improve training uptake, and support the sustainable adoption of classroom physical activity practices.
Although this study focused primarily on individual-level factors related to teacher engagement with the training modules, the implementation of classroom-based physical activity interventions is influenced by multiple, interacting levels of context. At the inner setting level, factors such as administrative support, school culture, time constraints, and competing instructional priorities can directly shape teachers’ ability to apply training content in daily practice [,]. At the outer setting level, district policies, professional development requirements, and broader accountability pressures may further enable or constrain implementation [,]. Prior work in low-resource school settings has shown that even well-designed, evidence-based interventions may experience reduced fidelity or sustainment when organizational and system-level conditions are not aligned with implementation demands [-]. As demonstrated by Hasson et al [], addressing these multilevel influences through leadership engagement, district partnerships, and adaptive implementation strategies is critical for translating individual-level training gains into sustained practice. Future efforts to scale teacher training modules should therefore incorporate complementary strategies that target school- and district-level barriers alongside individual professional development.
Comparison With Prior Work
Prior research underscores the critical role of professional development in the successful implementation of school-based health programs []. Teachers are more likely to adopt and sustain new interventions when they receive training that is accessible, practical, and tailored to their classroom needs []. In the context of physical activity programming, effective professional development has been linked to improvements in teacher confidence, fidelity of program delivery, and student engagement [,,]. Accordingly, the InPACT virtual teacher training modules were designed to serve as a central implementation strategy [].
However, usability challenges identified in this evaluation suggest that the training modules fell short of best practices for online professional development. Using the Nielsen usability heuristic framework, the evaluation revealed 3 primary issues: lack of user control and freedom, inconsistency and lack of standards, and insufficient recognition rather than recall. Teachers described frustration with not being able to pause or skip segments of the training videos, which reflects poor user control and freedom. This limitation is especially problematic for time-constrained educators [], who may prefer to pace their training across multiple sittings. Inconsistencies in video labeling and navigation—such as unclear module titles and nonuniform layouts—violated established design standards, making it harder for users to locate content, which can contribute to cognitive overload []. Finally, the training platform required users to remember previously viewed content with limited visual cues to support recall. This reflects insufficient recognition rather than recall, a heuristic that emphasizes reducing memory load by making options, actions, and information visible so that users can recognize what to do instead of relying on memory. Without visual scaffolding, such as clear navigation menus or progress indicators, the cognitive burden increases, and learnability suffers [].
These usability shortcomings contrast with best practices from prior studies, which demonstrate that professional development resources should be easy to navigate, chunked into digestible segments, and provide clear cues to help users orient themselves within the training []. Addressing these issues is critical to improving the training experience for teachers and, in turn, increasing the implementation fidelity of classroom physical activity programming in schools.
Recommendations for Enhancement of the InPACT Virtual Teacher Training Modules
A major usability barrier identified during the evaluation was teacher frustration with video replay requirements, particularly when navigating backward in a module. To address this issue, the evaluation team recommended removing the time-based Boolean constraint on embedded videos. Specifically, they proposed using JavaScript event listeners integrated with the YouTube application programming interface to track video play or pause actions and determine when a sufficient portion of the video has been viewed. This would allow users to resume or advance through content without having to rewatch full segments. In cases where this solution was not feasible within the current Qualtrics platform, the team recommended displaying clear notifications indicating that videos must be viewed in full before proceeding.
Additional enhancements were proposed to improve time management and overall UX. Teachers noted that the existing page-based progress bar was misleading, making it difficult to anticipate the time commitment. To improve clarity, the evaluation team proposed a content-based progress bar with labeled topic nodes, or alternatively, the inclusion of manual page indicators and estimated completion times.
To promote engagement and retention, the team suggested reducing dense text and incorporating visual aids and interactive components such as collapsible content sections, quizzes with feedback, real-world case studies, and downloadable action plans. These enhancements were aimed at strengthening active learning and implementation fidelity. Navigation improvements were also prioritized. Teachers expressed difficulty tracking progress across modules, so a standardized end-of-module message with clear next steps (eg, “To continue to the next module, click here”) was recommended. Inconsistencies in how modules referenced the companion program guide led to confusion, prompting a recommendation to standardize these references and clearly indicate when guide components are optional.
To implement these enhancements and support scalability, we partnered with Michigan Virtual, a statewide leader in accessible professional learning []. Michigan Virtual committed to redesigning and developing the revised modules using their Brightspace LMS, ensuring compliance with Web Content Accessibility Guidelines and Americans with Disabilities Act standards. Their instructional designers identified necessary content updates, helped revise training materials, and provided technical support. Michigan Virtual also offered to host the updated modules on its Professional Learning Portal, manage State Continuing Education Clock Hours processing, and share educator completion data with the InPACT team. This partnership is expected to ensure a high-quality, accessible, and scalable professional development experience for educators statewide.
Preliminary data from the revised InPACT teacher training modules hosted on Michigan Virtual indicate strong early uptake, engagement, and performance during the first eight months following release. As of April 7, 2026, 2061 educators have enrolled in the training with 1138 participants earning certificates of completion, reflecting substantially greater reach and completion volume than the prior Qualtrics-hosted training (35 teachers over a 3-year period). Knowledge acquisition was assessed using standardized postmodule quizzes embedded within each training module. Across these module quizzes, participants demonstrated high mastery of content, with an average score of 90.6% (SD 2.7%), and required relatively few attempts to achieve passing scores (mean 1.5, SD 0.2 attempts per module). Collectively, these preliminary findings suggest that the revised training—coupled with a more accessible delivery platform—has markedly improved scalability, engagement, and learning outcomes.
Partnerships played a central role in guiding the enhancements to the InPACT teacher training modules. Engaging a diverse set of collaborators—including classroom teachers, instructional designers, accessibility specialists, and statewide professional learning organizations—was essential for identifying usability challenges, prioritizing improvements, and ensuring that module revisions were both practical and scalable. These partnerships enabled the co-development of solutions that enhanced navigation, interactivity, and accessibility, while ensuring alignment with accessibility and disability standards. For teams with limited budgets, leveraging existing relationships, focusing on high-impact usability improvements, and incorporating low-cost accessibility strategies—such as consistent page structure, clear labeling, and visual scaffolding—can help maximize impact. Additionally, integrating clear data visualization and feedback mechanisms, alongside ongoing communication and iterative feedback with end users, is recommended to promote engagement, learning retention, and sustainable implementation of virtual professional development programs.
Strengths and Limitations
This study has several notable strengths. First, we used a mixed methods usability evaluation that incorporated both end-user feedback and expert recommendations to guide improvements to the InPACT teacher training modules. Second, the evaluation was conducted by a multidisciplinary team with expertise in instructional design, educational technology, and human-computer interaction. Finally, our collaborative and HCD approach fostered partnerships between teachers, evaluators, and implementation support organizations, enabling the co-development of a more accessible, engaging, and scalable professional learning experience for educators across Michigan.
Limitations of this study also warrant consideration. First, teacher feedback was based on self-report and retrospective recall, which may be subject to recall bias or social desirability bias and may not fully capture real-time usability challenges encountered during module completion. Although self-report data are commonly used in early-stage usability and implementation research to efficiently gather end-user perspectives, these methods may overlook nuanced interaction patterns, moment-to-moment frustration points, or navigation errors that occur during actual use []. Future usability evaluations that integrate observational and system-level data with teacher self-reports will be critical for identifying real-time barriers and optimizing training engagement and completion.
Second, the participant sample consisted primarily of teachers who were already implementing the InPACT program. While this was appropriate for the study’s aim of evaluating the usability of existing training modules, these participants may have had greater familiarity with the program content and underlying concepts than educators new to InPACT. Future evaluations should include educators unfamiliar with InPACT to examine initial usability, onboarding experiences, and barriers faced by first-time users.
Third, this study did not assess whether the usability improvements applied in the revised modules translated into changes in teacher self-efficacy, adoption of classroom activities, or fidelity of implementation. Future research is needed to determine whether usability-informed redesigns of the InPACT teacher training modules lead to measurable improvements in teacher self-efficacy, training completion, adoption, and implementation fidelity.
Conclusions
Most teachers in the United States do not implement classroom physical activity breaks with the frequency or fidelity recommended to improve student health and academic outcomes [,]. Virtual training modules offer a scalable approach to build teacher capacity, but their effectiveness depends not only on high-quality content but also on user-centered design and usability. In this study, a combination of heuristic evaluation, competitive analysis, and end-user surveys was used to identify and address barriers to teacher engagement with the InPACT virtual teacher training modules. Key recommendations focused on improving navigation, video accessibility, and visual appeal to reduce user frustration and enhance the learning experience. Applying an HCD approach enabled collaboration between evaluators, developers, and end users to optimize virtual training for broader adoption. Future work should examine whether these HCD-informed revisions lead to measurable improvements in teacher self-efficacy, training completion, classroom physical activity program adoption, implementation fidelity, and student outcomes.
Acknowledgments
The authors would like to thank Rongyu Shen, Sanvika Inturi, Shannon Lee, and the University of Michigan School of Information client engagement team for their helpful assistance throughout the research process. The authors are also grateful to the study participants for their involvement. Finally, the authors appreciate the Michigan Virtual team for making subsequent improvements. ChatGPT (GPT-3.5/4.0) was used to edit the grammar and sentence structure of the manuscript. The results are presented clearly, honestly, and without fabrication, falsification, or inappropriate data manipulation.
Funding
The Michigan Health Endowment Fund provided funding for this study (grant G-2404-154026).
Data Availability
Data are available upon request by sending an email to the corresponding author.
Authors' Contributions
REH wrote the manuscript and oversaw data collection for the project. AS and AL developed the Qualtrics virtual training modules and implemented updates. TT and LM conducted the teacher interviews, heuristic evaluation, and competitive analysis. All authors reviewed the final manuscript.
Conflicts of Interest
None declared.
References
- Piercy KL, Troiano RP, Ballard RM, et al. The physical activity guidelines for Americans. JAMA. Nov 20, 2018;320(19):2020-2028. [CrossRef] [Medline]
- Carlson JA, Moon M, Steel C, et al. Results from the 2024 United States report card on physical activity for children and youth. J Phys Act Health. 2025;23(3):293-300. [CrossRef] [Medline]
- Nader PR, Bradley RH, Houts RM, McRitchie SL, O’Brien M. Moderate-to-vigorous physical activity from ages 9 to 15 years. JAMA. Jul 16, 2008;300(3):295-305. [CrossRef] [Medline]
- Richmond TK, Hayward RA, Gahagan S, Field AE, Heisler M. Can school income and racial/ethnic composition explain the racial/ethnic disparity in adolescent physical activity participation? Pediatrics. Jun 2006;117(6):2158-2166. [CrossRef] [Medline]
- Lieb DC, Snow RE, DeBoer MD. Socioeconomic factors in the development of childhood obesity and diabetes. Clin Sports Med. Jul 2009;28(3):349-378. [CrossRef] [Medline]
- Wyszyńska J, Ring-Dimitriou S, Thivel D, et al. Physical activity in the prevention of childhood obesity: the position of the European childhood obesity group and the European academy of pediatrics. Front Pediatr. 2020;8:535705. [CrossRef] [Medline]
- Committee on Physical Activity and Physical Education in the School Environment, Food and Nutrition Board, Institute of Medicine. Kohl HW IIICook HD, editors. Educating the Student Body: Taking Physical Activity and Physical Education to School. National Academies Press; 2013. [CrossRef] [Medline]
- Pulling Kuhn A, Stoepker P, Dauenhauer B, Carson RL. A systematic review of multi-component Comprehensive School Physical Activity Program (CSPAP) interventions. Am J Health Promot. Nov 2021;35(8):1129-1149. [CrossRef] [Medline]
- Bassett DR, Fitzhugh EC, Heath GW, et al. Estimated energy expenditures for school-based policies and active living. Am J Prev Med. Feb 2013;44(2):108-113. [CrossRef] [Medline]
- Masini A, Marini S, Gori D, Leoni E, Rochira A, Dallolio L. Evaluation of school-based interventions of active breaks in primary schools: a systematic review and meta-analysis. J Sci Med Sport. Apr 2020;23(4):377-384. [CrossRef] [Medline]
- Hoff DL, Mitchell SN. Should our students pay to play extracurricular activities? Educ Digest. 2007;72(6):27-34. URL: https://eric.ed.gov/?id=EJ769465 [Accessed 2026-03-27]
- Zdroik J, Veliz P. The influence of pay-to-play fees on participation in interscholastic sports: a school-level analysis of Michigan’s public schools. J Phys Act Health. Dec 2016;13(12):1317-1324. [CrossRef] [Medline]
- Physical activity: classroom-based physically active lesson interventions. Community Preventive Services Task Force (CPSTF) & Centers for Disease Control and Prevention (U.S); 2021. URL: https://stacks.cdc.gov/view/cdc/168558 [Accessed 2026-03-27]
- Densley B, Calvert HG, Boedeker P, Turner L. Implementation of physical activity in US elementary schools: the role of administrative support, financial resources, and champions. Int J Environ Res Public Health. Apr 23, 2021;18(9):4476. [CrossRef] [Medline]
- Turner L, Chaloupka FJ. Reach and implementation of physical activity breaks and active lessons in elementary school classrooms. Health Educ Behav. Jun 2017;44(3):370-375. [CrossRef] [Medline]
- Dinkel D, Schaffer C, Snyder K, Lee JM. They just need to move: teachers’ perception of classroom physical activity breaks. Teach Teach Educ.. Apr 2017;63:186-195. [CrossRef]
- Huberty J, Dinkel D, Coleman J, Beighle A, Apenteng B. The role of schools in children’s physical activity participation: staff perceptions. Health Educ Res. Dec 2012;27(6):986-995. [CrossRef] [Medline]
- McLoughlin GM, Calvert HG, Turner L. Individual and contextual factors associated with classroom teachers’ intentions to implement classroom physical activity. Int J Environ Res Public Health. Feb 18, 2023;20(4):3646. [CrossRef] [Medline]
- McMullen J, Kulinna P, Cothran D. Chapter 5 physical activity opportunities during the school day: classroom teachers’ perceptions of using activity breaks in the classroom. J Teach Phys Educ. 2014;33(4):511-527. [CrossRef]
- Michael RD, Webster CA, Egan CA, et al. Facilitators and barriers to movement integration in elementary classrooms: a systematic review. Res Q Exerc Sport. Jun 2019;90(2):151-162. [CrossRef] [Medline]
- Webster CA, Zarrett N, Cook BS, Egan C, Nesbitt D, Weaver RG. Movement integration in elementary classrooms: teacher perceptions and implications for program planning. Eval Program Plann. Apr 2017;61:134-143. [CrossRef] [Medline]
- Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. Apr 24, 2012;7:37. [CrossRef] [Medline]
- Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. Aug 7, 2009;4:50. [CrossRef] [Medline]
- Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. Apr 23, 2011;6:42. [CrossRef] [Medline]
- Bartholomew JB, Jowers EM. Physically active academic lessons in elementary children. Prev Med. Jun 2011;52 Suppl 1(Suppl):S51-S54. [CrossRef] [Medline]
- Carlson JA, Engelberg JK, Cain KL, et al. Contextual factors related to implementation of classroom physical activity breaks. Transl Behav Med. Sep 2017;7(3):581-592. [CrossRef] [Medline]
- Walker TJ, Craig DW, Robertson MC, Szeszulski J, Fernandez ME. The relation between individual-level factors and the implementation of classroom-based physical activity approaches among elementary school teachers. Transl Behav Med. Apr 7, 2021;11(3):745-753. [CrossRef] [Medline]
- Guskey TR. Professional development and teacher change. Teach Teach (Theory Pract). Aug 2002;8(3):381-391. [CrossRef]
- Fullan M, Miles M. Getting reform right: what works and what doesn’t. Phi Delta Kappan. 1992;73(10):745-752. URL: https://eric.ed.gov/?id=EJ445727 [Accessed 2026-03-27]
- Beemer LR, Ajibewa TA, O’Sullivan MP, et al. Feasibility of the InPACT intervention to enhance movement and learning in the classroom. Transl J Am Coll Sports Med. 2018;3(18):136-151. [CrossRef]
- Darling-Hammond L, Hyler ME, Gardner M. Effective teacher professional development. Learning Policy Institute (LPI); 2017. URL: https://files.eric.ed.gov/fulltext/ED606743.pdf [Accessed 2026-03-27]
- Knowles MS, Holton EFI, Swanson RA, Robinson PA. The Adult Learner: The Definitive Classic in Adult Education and Human Resource Development. 9th ed. Routledge; 2020. ISBN: 9780367417659
- Garett R, Chiu J, Zhang L, Young SD. A literature review: website design and user engagement. Online J Commun Media Technol. Jul 2016;6(3):1-14. [Medline]
- Nielsen J. Usability Engineering. Academic Press; 1993. ISBN: 9780125184052
- The impact of website design on customer acquisition and retention. AIContentfy. 2023. URL: https://aicontentfy.com/en/blog/impact-of-website-design-on-customer-acquisition-and-retention [Accessed 2024-06-28]
- Norman DA, Draaper SW. User Centered System Design New Perspectives on Human-Computer Interaction. Lawrence Erlbaum Associates, Inc; 1986. [CrossRef] ISBN: 9780898598728
- Kehoe B. User experience (UX) design glossary: improving your customer experience with a good UX. Qualtrics. 2024. URL: https://www.qualtrics.com/articles/customer-experience/ux-design-glossary/ [Accessed 2026-04-07]
- Nielsen J. Heuristic evaluation. In: Nielsen J, Mack RL, editors. Usability Inspection Methods. Joh Wiley & Sons; 1994:25-62. ISBN: 978-0-471-01877-3
- Nielsen J, Molich R. Heuristic evaluation of user interfaces. Presented at: CHI ’90: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems; Apr 1-5, 1990:249-256; Seattle, Washington, United States. [CrossRef]
- Nielsen J. 10 usability heuristics for user interface design. Nielsen Norman Group. 1994. URL: https://www.nngroup.com/articles/ten-usability-heuristics/ [Accessed 2025-08-05]
- Garg V. Content utility in content strategy and design. Medium. 2022. URL: https://medium.com/@vingar/content-utility-in-content-strategy-and-design-428e8fbf044d [Accessed 2026-04-07]
- Turner L, Calvert HG, Carlson JA. Supporting teachers’ implementation of classroom-based physical activity. Transl J Am Coll Sports Med. Sep 1, 2019;4(17):165-172. [CrossRef]
- Friday PJ, Beemer LR, Martindale D, et al. A novel policy alignment and enhancement process to improve sustainment of school-based physical activity programming. Int J Environ Res Public Health. Jan 18, 2023;20(3):1791. [CrossRef] [Medline]
- Hasson RE, Eisman AB, Wassmann A, et al. Aligning organizational priorities and system policies to support implementation scale-up of a tailored classroom-based physical activity intervention in low-resource schools. J Sch Health. Jun 2023;93(6):464-474. [CrossRef] [Medline]
- Eisman AB, Martin J, Hasson RE, Kilbourne AM. Resource realities: exploring the foundations of successful implementation in school-based drug prevention. J Sch Health. Dec 2024;94(12):1185-1195. [CrossRef] [Medline]
- McLeod BD, Sutherland KS, Conroy MA, et al. Study protocol: multi-level determinants of implementation and sustainment in the education sector. J Emot Behav Disord. Mar 2023;31(1):27-40. [CrossRef] [Medline]
- Hasson RE, Beemer LR, Eisman AB, Friday P. Closing the gap between classroom-based physical activity intervention adoption and fidelity in low-resource schools. Kinesiol Rev. 2023;12(1):36-46. [CrossRef]
- Otten C, Nash R, Patterson K. Professional development in health education for primary school teachers: a systematised review of the literature. Prof Dev Educ. 2024;50(5):809-831. [CrossRef]
- Manal Q, Cobo C, Wilichowski T, Patil A. Effective teacher professional development using technology: technology‑based strategies from across the globe to enhance teaching practices—a guidance note. World Bank; 2022. URL: https://documents1.worldbank.org/curated/en/099835106172233833/pdf/P1742520d4de390610b784047359e0cefc7.pdf [Accessed 2026-03-27]
- Calvert HG, Lane HG, Bejarano CM, et al. An evaluation of the coverage of theoretically based implementation factors in disseminated classroom physical activity programs. Transl Behav Med. Oct 8, 2020;10(4):959-969. [CrossRef] [Medline]
- Stewart G, Webster CA, Weaver RG, et al. Evaluation of a classroom movement integration training delivered in a low socioeconomic school district. Eval Program Plann. Apr 2019;73:187-194. [CrossRef] [Medline]
- Hasson RE, Beemer LR, Ajibewa TA, Eisman AB. Adapting the InPACT intervention to enhance implementation fidelity and flexibility. Prev Sci. Apr 2021;22(3):324-333. [CrossRef] [Medline]
- Skulmowski A, Xu KM. Understanding cognitive load in digital and online learning: a new perspective on extraneous cognitive load. Educ Psychol Rev. Mar 2022;34(1):171-196. [CrossRef]
- Cuccolo K, DeBruler K. A look back at 3 years of Michigan virtual research. Michigan Virtual. 2024. URL: https://michiganvirtual.org/research/publications/a-look-back-at-3-years-of-michigan-virtual-research/ [Accessed 2025-08-05]
- Sauro J. Can users self-report usability problems? MeasuringU. 2010. URL: https://measuringu.com/self-reporting [Accessed 2026-04-07]
Abbreviations
| HCD: human-centered design |
| InPACT: Interrupting Prolonged Sitting with Activity |
| LMS: learning management system |
| UX: user experience |
Edited by Adeola Bamgboje-Ayodele; submitted 03.Sep.2025; peer-reviewed by Christine Provvidenza, Hui Li; final revised version received 10.Feb.2026; accepted 10.Feb.2026; published 21.Apr.2026.
Copyright© Rebecca E Hasson, Tiffany Tam, Lucy Myers, Anna Schwartz, Alissa Li. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 21.Apr.2026.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.

