Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Journal Description

JMIR Human Factors (JHF, ISSN 2292-9495) is a multidisciplinary journal with contributions from design experts, medical researchers, engineers, and social scientists.

In 2023, JMIR Human Factors received an inaugural Journal Impact Factor™ of 2.7 (Source: Journal Citation Reports™ from Clarivate, 2023).

JMIR Human Factors focuses on understanding how the behaviour and thinking of humans can influence and shape the design of health care interventions and technologies, and how the design can be evaluated and improved to make health care interventions and technologies usable, safe, and effective. This includes usability studies and heuristic evaluations, studies concerning ergonomics and error prevention, design studies for medical devices and healthcare systems/workflows, enhancing teamwork through Human Factors based teamwork training, measuring non-technical skills in staff like leadership, communication, situational awareness and teamwork, and healthcare policies and procedures to reduce errors and increase safety.

JHF aspires to lead health care towards a culture of "usability by design", as well as to a culture of testing, error-prevention and safety, by promoting and publishing reports rigorously evaluating the usability and human factors aspects in health care, as well as encouraging the development and debate on new methods in this emerging field. Possible contributions include usability studies and heuristic evaluations, studies concerning ergonomics and error prevention, design studies for medical devices and healthcare systems/workflows, enhancing teamwork through human factors-based teamwork training, measuring non-technical skills in staff like leadership, communication, situational awareness and teamwork, and healthcare policies and procedures to reduce errors and increase safety. Reviews, viewpoint papers and tutorials are as welcome as original research.

All articles are professionally copyedited and typeset.

JMIR Human Factors is indexed in National Library of Medicine (NLM)/MEDLINE, PubMed, PubMed Central, DOAJ, Scopus, Sherpa Romeo, PsychINFO, and the Web of Science (WoS)/ESCI/SCIE.

 

Recent Articles:

  • Multimodal warning with red ambient lighting and voice. Source: Image created by the first authors; Copyright: Caterina Bérubé (The authors); URL: https://humanfactors.jmir.org/2024/1/e46967/; License: Creative Commons Attribution + Noncommercial + NoDerivatives (CC-BY-NC-ND).

    Multimodal In-Vehicle Hypoglycemia Warning for Drivers With Type 1 Diabetes: Design and Evaluation in Simulated and Real-World Driving

    Abstract:

    Background: Hypoglycemia threatens cognitive function and driving safety. Previous research investigated in-vehicle voice assistants as hypoglycemia warnings. However, they could startle drivers. To address this, we combine voice warnings with ambient LEDs. Objective: The study assesses the effect of in-vehicle multimodal warning on emotional reaction and technology acceptance among drivers with type 1 diabetes. Methods: Two studies were conducted, one in simulated driving and the other in real-world driving. A quasi-experimental design included 2 independent variables (blood glucose phase and warning modality) and 1 main dependent variable (emotional reaction). Blood glucose was manipulated via intravenous catheters, and warning modality was manipulated by combining a tablet voice warning app and LEDs. Emotional reaction was measured physiologically via skin conductance response and subjectively with the Affective Slider and tested with a mixed-effect linear model. Secondary outcomes included self-reported technology acceptance. Participants were recruited from Bern University Hospital, Switzerland. Results: The simulated and real-world driving studies involved 9 and 10 participants with type 1 diabetes, respectively. Both studies showed significant results in self-reported emotional reactions (P<.001). In simulated driving, neither warning modality nor blood glucose phase significantly affected self-reported arousal, but in real-world driving, both did (F2,68=4.3; P<.05 and F2,76=4.1; P=.03). Warning modality affected self-reported valence in simulated driving (F2,68=3.9; P<.05), while blood glucose phase affected it in real-world driving (F2,76=9.3; P<.001). Skin conductance response did not yield significant results neither in the simulated driving study (modality: F2,68=2.46; P=.09, blood glucose phase: F2,68=0.3; P=.74), nor in the real-world driving study (modality: F2,76=0.8; P=.47, blood glucose phase: F2,76=0.7; P=.5). In both simulated and real-world driving studies, the voice+LED warning modality was the most effective (simulated: mean 3.38, SD 1.06 and real-world: mean 3.5, SD 0.71) and urgent (simulated: mean 3.12, SD 0.64 and real-world: mean 3.6, SD 0.52). Annoyance varied across settings. The standard warning modality was the least effective (simulated: mean 2.25, SD 1.16 and real-world: mean 3.3, SD 1.06) and urgent (simulated: mean 1.88, SD 1.55 and real-world: mean 2.6, SD 1.26) and the most annoying (simulated: mean 2.25, SD 1.16 and real-world: mean 1.7, SD 0.95). In terms of preference, the voice warning modality outperformed the standard warning modality. In simulated driving, the voice+LED warning modality (mean rank 1.5, SD rank 0.82) was preferred over the voice (mean rank 2.2, SD rank 0.6) and standard (mean rank 2.4, SD rank 0.81) warning modalities, while in real-world driving, the voice+LED and voice warning modalities were equally preferred (mean rank 1.8, SD rank 0.79) to the standard warning modality (mean rank 2.4, SD rank 0.84). Conclusions: Despite the mixed results, this paper highlights the potential of implementing voice assistant–based health warnings in cars and advocates for multimodal alerts to enhance hypoglycemia management while driving. Trial Registration: ClinicalTrials.gov NCT05183191; https://classic.clinicaltrials.gov/ct2/show/NCT05183191, ClinicalTrials.gov NCT05308095; https://classic.clinicaltrials.gov/ct2/show/NCT05308095

  • Source: iStock by Getty Images; Copyright: Toa55; URL: https://www.istockphoto.com/photo/elderly-woman-holding-on-handrail-with-caregiver-gm1138080345-303698490; License: Licensed by JMIR.

    Academic Detailing as a Health Information Technology Implementation Method: Supporting the Design and Implementation of an Emergency Department–Based...

    Abstract:

    Background: Clinical decision support (CDS) tools that incorporate machine learning–derived content have the potential to transform clinical care by augmenting clinicians’ expertise. To realize this potential, such tools must be designed to fit the dynamic work systems of the clinicians who use them. We propose the use of academic detailing—personal visits to clinicians by an expert in a specific health IT tool—as a method for both ensuring the correct understanding of that tool and its evidence base and identifying factors influencing the tool’s implementation. Objective: This study aimed to assess academic detailing as a method for simultaneously ensuring the correct understanding of an emergency department–based CDS tool to prevent future falls and identifying factors impacting clinicians’ use of the tool through an analysis of the resultant qualitative data. Methods: Previously, our team designed a CDS tool to identify patients aged 65 years and older who are at the highest risk of future falls and prompt an interruptive alert to clinicians, suggesting the patient be referred to a mobility and falls clinic for an evidence-based preventative intervention. We conducted 10-minute academic detailing interviews (n=16) with resident emergency medicine physicians and advanced practice providers who had encountered our CDS tool in practice. We conducted an inductive, team-based content analysis to identify factors that influenced clinicians’ use of the CDS tool. Results: The following categories of factors that impacted clinicians’ use of the CDS were identified: (1) aspects of the CDS tool’s design (2) clinicians’ understanding (or misunderstanding) of the CDS or referral process, (3) the busy nature of the emergency department environment, (4) clinicians’ perceptions of the patient and their associated fall risk, and (5) the opacity of the referral process. Additionally, clinician education was done to address any misconceptions about the CDS tool or referral process, for example, demonstrating how simple it is to place a referral via the CDS and clarifying which clinic the referral goes to. Conclusions: Our study demonstrates the use of academic detailing for supporting the implementation of health information technologies, allowing us to identify factors that impacted clinicians’ use of the CDS while concurrently educating clinicians to ensure the correct understanding of the CDS tool and intervention. Thus, academic detailing can inform both real-time adjustments of a tool’s implementation, for example, refinement of the language used to introduce the tool, and larger scale redesign of the CDS tool to better fit the dynamic work environment of clinicians.

  • Source: Adobe Stock; Copyright: zinkevych; URL: https://stock.adobe.com/ca/images/Two-senior-women-watching-something-on-a-smartphone/454242995; License: Licensed by JMIR.

    A Smartphone App to Support Self-Management for People Living With Sjögren's Syndrome: Qualitative Co-Design Workshops

    Abstract:

    Background: Sjögren's syndrome (SS) is the second most common autoimmune rheumatic disease, and the range of symptoms includes fatigue, dryness, sleep disturbances, and pain. Smartphone apps may help deliver a variety of cognitive and behavioral techniques to support self-management in SS. However, app-based interventions must be carefully designed to promote engagement and motivate behavior change. Objective: We aimed to explore self-management approaches and challenges experienced by people living with SS and produce a corresponding set of design recommendations that inform the design of an engaging, motivating, and evidence-based self-management app for those living with SS. Methods: We conducted a series of 8 co-design workshops and an additional 3 interviews with participants who were unable to attend a workshop. These were audio recorded, transcribed, and initially thematically analyzed using an inductive approach. Then, the themes were mapped to the Self-Determination Theory domains of competency, autonomy, and relatedness. Results: Participants experienced a considerable demand in the daily work required in self-managing their SS. The condition demanded unrelenting, fluctuating, and unpredictable mental, physical, and social efforts. Participants used a wide variety of techniques to self-manage their symptoms; however, their sense of competency was undermined by the complexity and interconnected nature of their symptoms and affected by interactions with others. The daily contexts in which this labor was occurring revealed ample opportunities to use digital health aids. The lived experience of participants showed that the constructs of competency, autonomy, and relatedness existed in a complex equilibrium with each other. Sometimes, they were disrupted by tensions, whereas on other occasions, they worked together harmoniously. Conclusions: An SS self-management app needs to recognize the complexity and overlap of symptoms and the complexities of managing the condition in daily life. Identifying techniques that target several symptoms simultaneously may prevent users from becoming overwhelmed. Including techniques that support assertiveness and communication with others about the condition, its symptoms, and users’ limitations may support users in their interactions with others and improve engagement in symptom management strategies. For digital health aids (such as self-management apps) to provide meaningful support, they should be designed according to human needs such as competence, autonomy, and relatedness. However, the complexities among the 3 Self-Determination Theory constructs should be carefully considered, as they present both design difficulties and opportunities.

  • Home screen of the Young Women's CoOp mHealth app. Source: Image created by the Authors / Canva; Copyright: The Authors / kanchanachitkhamma (Canva user for background image); URL: https://www.canva.com/photos/MAEV6HDzPlI/; License: Licensed by JMIR.

    Assessing Differences in mHealth Usability and App Experiences Among Young African American Women: Secondary Analysis of a Randomized Controlled Trial

    Abstract:

    Background: In North Carolina, HIV continues to disproportionately affect young African American women. Although mobile health (mHealth) technology appears to be a tool capable of making public health information more accessible for key populations, previous technology use and social determinants may impact users’ mHealth experiences. Objective: The objective of this study was to evaluate mHealth usability, assessing differences based on previous technology use and social determinants among a sample of African American women in emerging adulthood. Methods: As part of a National Institute on Drug Abuse–funded randomized controlled trial with African American women (aged 18-25 years), counties were assigned to receive an evidence-based HIV risk reduction intervention through mHealth and participants were asked to complete usability surveys at 6- and 12-month follow-ups. Participants’ first survey responses were analyzed through 2-tailed t tests and linear regression models to examine associations with previous technology use and social determinants (P<.05). Results: The mean System Usability Scale (SUS) score was 69.2 (SD 17.9; n=159), which was higher than the threshold of acceptability (68.0). Participants who had previously used a tablet indicated higher usability compared to participants without previous use (mean 72.9, SD 18.1 vs mean 57.6, SD 11.4; P<.001), and participants with previous smartphone use also reported higher usability compared to participants without previous use (mean 71.9, SD 18.3 vs mean 58.0, SD 10.7; P<.001). Differences in SUS scores were observed among those reporting homelessness (mean 58.3, SD 19.0 vs mean 70.8, SD 17.2; P=.01), unemployment (mean 65.9, SD 17.2 vs mean 71.6, SD 18.1; P=.04), or current school enrollment (mean 73.2, SD 18.5 vs mean 65.4, SD 16.5; P=.006). Statistically significant associations were not observed for food insecurity (mean 67.3, SD 18.6 vs mean 69.9, SD 17.7; P=.45). Conclusions: Although above-average usability was observed overall, these findings demonstrate differences in mHealth usability based on past and current life experiences. As mHealth interventions become more prevalent, these findings may have important implications for ensuring that mHealth apps improve the reach of evidence-based interventions. Trial Registration: ClinicalTrials.gov NCT02965014; https://clinicaltrials.gov/study/NCT02965014

  • Source: Freepik; Copyright: pressfoto; URL: https://www.freepik.com/free-photo/doctor-with-digital-tablet_5633839.htm; License: Licensed by JMIR.

    Influence of Disease-Related Stigma on Patients’ Decisions to Upload Medical Reports to the German Electronic Health Record: Randomized Controlled Trial

    Abstract:

    Background: The rollout of the electronic health record (EHR) represents a central component of the digital transformation of the German health care system. Although the EHR promises more effective, safer, and faster treatment of patients from a systems perspective, the successful implementation of the EHR largely depends on the patient. In a recent survey, 3 out of 4 Germans stated that they intend to use the EHR, whereas other studies show that the intention to use a technology is not a reliable and sufficient predictor of actual use. Objective: Controlling for patients’ intention to use the EHR, we investigated whether disease-specific risk perceptions related to the time course of the disease and disease-related stigma explain the additional variance in patients’ decisions to upload medical reports to the EHR. Methods: In an online user study, 241 German participants were asked to interact with a randomly assigned medical report that varied systematically in terms of disease-related stigma (high vs low) and disease time course (acute vs chronic) and to decide whether to upload it to the EHR. Results: Disease-related stigma (odds ratio 0.154, P<.001) offset the generally positive relationship between intention to use and the upload decision (odds ratio 2.628, P<.001), whereas the disease time course showed no effect. Conclusions: Even if patients generally intend to use the EHR, risk perceptions such as those related to diseases associated with social stigma may deter people from uploading related medical reports to the EHR. To ensure the reliable use of this key technology in a digitalized health care system, transparent and easy-to-comprehend information about the safety standards of the EHR are warranted across the board, even for populations that are generally in favor of using the EHR.

  • Source: iStock by Getty Images; Copyright: lakshmiprasad S; URL: https://www.istockphoto.com/photo/indian-doctor-explaining-from-digital-tablet-to-senior-couple-about-medical-report-gm1496640787-519246728; License: Licensed by the authors.

    Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation

    Abstract:

    Background: Improving shared decision-making (SDM) for patients has become a health policy priority in many countries. Achieving high-quality SDM is particularly important for approximately 313 million surgical treatment decisions patients make globally every year. Large-scale monitoring of surgical patients’ experience of SDM in real time is needed to identify the failings of SDM before surgery is performed. We developed a novel approach to automating real-time data collection using an electronic measurement system to address this. Examining usability will facilitate its optimization and wider implementation to inform interventions aimed at improving SDM. Objective: This study examined the usability of an electronic real-time measurement system to monitor surgical patients’ experience of SDM. We aimed to evaluate the metrics and indicators relevant to system effectiveness, system efficiency, and user satisfaction. Methods: We performed a mixed methods usability evaluation using multiple participant cohorts. The measurement system was implemented in a large UK hospital to measure patients’ experience of SDM electronically before surgery using 2 validated measures (CollaboRATE and SDM-Q-9). Quantitative data (collected between April 1 and December 31, 2021) provided measurement system metrics to assess system effectiveness and efficiency. We included adult patients booked for urgent and elective surgery across 7 specialties and excluded patients without the capacity to consent for medical procedures, those without access to an internet-enabled device, and those undergoing emergency or endoscopic procedures. Additional groups of service users (group 1: public members who had not engaged with the system; group 2: a subset of patients who completed the measurement system) completed user-testing sessions and semistructured interviews to assess system effectiveness and user satisfaction. We conducted quantitative data analysis using descriptive statistics and calculated the task completion rate and survey response rate (system effectiveness) as well as the task completion time, task efficiency, and relative efficiency (system efficiency). Qualitative thematic analysis identified indicators of and barriers to good usability (user satisfaction). Results: A total of 2254 completed surveys were returned to the measurement system. A total of 25 service users (group 1: n=9; group 2: n=16) participated in user-testing sessions and interviews. The task completion rate was high (169/171, 98.8%) and the survey response rate was good (2254/5794, 38.9%). The median task completion time was 3 (IQR 2-13) minutes, suggesting good system efficiency and effectiveness. The qualitative findings emphasized good user satisfaction. The identified themes suggested that the measurement system is acceptable, easy to use, and easy to access. Service users identified potential barriers and solutions to acceptability and ease of access. Conclusions: A mixed methods evaluation of an electronic measurement system for automated, real-time monitoring of patients’ experience of SDM showed that usability among patients was high. Future pilot work will optimize the system for wider implementation to ultimately inform intervention development to improve SDM. Trial Registration:

  • Source: Freepik; Copyright: pvproductions; URL: https://www.freepik.com/free-photo/hands-elderly-woman-holding-mobile-phone_36802594.htm#fromView=search&page=1&position=50&uuid=0bcddac8-9740-4119-bc60-9613d7ea415d; License: Licensed by JMIR.

    A Technological Tool Aimed at Self-Care in Patients With Multimorbidity: Cross-Sectional Usability Study

    Abstract:

    Background: Information and communication technologies (ICTs) have been positioned as useful tools to facilitate self-care. The interaction between a patient and technology, known as usability, is particularly important for achieving positive health outcomes. Specific characteristics of patients with chronic diseases, including multimorbidity, can affect their interaction with different technologies. Thus, studying the usability of ICTs in the field of multimorbidity has become a key element to ensure their relevant role in promoting self-care. Objective: The aim of this study was to analyze the usability of a technological tool dedicated to health and self-care in patients with multimorbidity in primary care. Methods: A descriptive observational cross-sectional usability study was performed framed in the clinical trial in the primary care health centers of Madrid Health Service of the TeNDER (Affective Based Integrated Care for Better Quality of Life) project. The TeNDER technological tool integrates sensors for monitoring physical and sleep activity along with a mobile app for consulting the data collected and working with self-management tools. This project included patients over 60 years of age who had one or more chronic diseases, at least one of which was mild-moderate cognitive impairment, Parkinson disease, or cardiovascular disease. From the 250 patients included in the project, 38 agreed to participate in the usability study. The usability variables investigated were effectiveness, which was determined by the degree of completion and the total number of errors per task; efficiency, evaluated as the average time to perform each task; and satisfaction, quantified by the System Usability Scale. Five tasks were evaluated based on real case scenarios. Usability variables were analyzed according to the sociodemographic and clinical characteristics of patients. A logistic regression model was constructed to estimate the factors associated with the type of support provided for task completion. Results: The median age of the 38 participants was 75 (IQR 72.0-79.0) years. There was a slight majority of women (20/38, 52.6%) and the participants had a median of 8 (IQR 7.0-11.0) chronic diseases. Thirty patients completed the usability study, with a usability effectiveness result of 89.3% (134/150 tasks completed). Among the 30 patients, 66.7% (n=20) completed all tasks and 56.7% (17/30) required personalized help on at least one task. In the multivariate analysis, educational level emerged as a facilitating factor for independent task completion (odds ratio 1.79, 95% CI 0.47-6.83). The median time to complete the total tasks was 296 seconds (IQR 210.0-397.0) and the median satisfaction score was 55 (IQR 45.0-62.5) out of 100. Conclusions: Although usability effectiveness was high, the poor efficiency and usability satisfaction scores suggest that there are other factors that may interfere with the results. Multimorbidity was not confirmed to be a key factor affecting the usability of the technological tool. Trial Registration: Clinicaltrials.gov NCT05681065; https://clinicaltrials.gov/study/NCT05681065

  • Source: Freepik; Copyright: Freepik; URL: https://www.freepik.com/free-photo/young-woman-using-her-smartphone-city_25272325.htm; License: Licensed by JMIR.

    The Asthma App as a New Way to Promote Responsible Short-Acting Beta2-Agonist Use in People With Asthma: Results of a Mixed Methods Pilot Study

    Abstract:

    Background: Approximately 262 million people worldwide are affected by asthma, and the overuse of reliever medication—specifically, short-acting beta2-agonist (SABA) overuse—is common. This can lead to adverse health effects. A smartphone app, the Asthma app, was developed via a participatory design to help patients gain more insight into their SABA use through monitoring and psychoeducation. Objective: This pilot study aims to evaluate the feasibility and usability of the app. The preliminary effects of using the app after 3 months on decreasing asthma symptoms and improving quality of life were examined. Methods: A mixed methods study design was used. Quantitative data were collected using the app. Asthma symptoms (measured using the Control of Allergic Rhinitis and Asthma Test) and the triggers of these symptoms were collected weekly. Quality of life (36-Item Short-Form Health Survey) was assessed at baseline and after 3, 6, and 12 months. User experience (System Usability Scale) was measured at all time points, except for baseline. Furthermore, objective user data were collected, and qualitative interviews, focusing on feasibility and usability, were organized. The interview protocol was based on the Unified Theory of Acceptance and Use of Technology framework. Qualitative data were analyzed using the Framework Method. Results: The baseline questionnaire was completed by 373 participants. The majority were female (309/373, 82.8%), with a mean age of 46 (SD 15) years, and used, on average, 10 SABA inhalations per week. App usability was rated as good: 82.3 (SD 13.2; N=44) at 3 months. The Control of Allergic Rhinitis and Asthma Test score significantly improved at 3 months (18.5) compared with baseline (14.8; β=.189; SE 0.048; P<.001); however, the obtained score still indicated uncontrolled asthma. At 3 months, there was no significant difference in the quality of life. Owing to the high dropout rate, insufficient data were collected at 6 and 12 months and were, therefore, not further examined. User data showed that 335 users opened the app (250/335, 74.6%, were returning visitors), with an average session time of 1 minute, and SABA registration was most often used (7506/13,081, 57.38%). Qualitative data (from a total of 4 participants; n=2, 50% female) showed that the participants found the app acceptable and clear. Three participants stated that gaining insight into asthma and its triggers was helpful. Two participants no longer used the app because they perceived their asthma as controlled and, therefore, did not use SABA often or only used it regularly based on the advice of the pulmonologist. Conclusions: The initial findings regarding the app’s feasibility and usability are encouraging. However, the notable dropout rate underscores the need for a cautious interpretation of the results. Subsequent studies, particularly those focusing on implementation, should explore the potential integration of the app into standard treatment practices.

  • Hand holding smartphone showing Anathema app. Source: Image created by the Authors; Copyright: The Authors; URL: https://humanfactors.jmir.org/2024/1/e56206/; License: Creative Commons Attribution + Noncommercial + NoDerivatives (CC-BY-NC-ND).

    Evaluating the User Experience of a Smartphone-Delivered Sexual Health Promotion Program for Older Adults in the Netherlands: Single-Arm Pilot Study

    Abstract:

    Background: Sexual health is an important component of quality of life in older adults. However, older adults often face barriers to attaining a fulfilling sexual life because of issues such as stigma, lack of information, or difficult access to adequate support. Objective: We aimed to evaluate the user experience of a self-guided, smartphone-delivered program to promote sexual health among older adults. Methods: The mobile app was made available to community-dwelling older adults in the Netherlands, who freely used the app for 8 weeks. User experience and its respective components were assessed using self-developed questionnaires, the System Usability Scale, and semistructured interviews. Quantitative and qualitative data were descriptively and thematically analyzed, respectively. Results: In total, 15 participants (mean age 71.7, SD 9.5 years) completed the trial. Participants showed a neutral to positive stance regarding the mobile app’s usefulness and ease of use. Usability was assessed as “Ok/Fair.” The participants felt confident about using the mobile app. To increase user experience, participants offered suggestions to improve content and interaction, including access to specialized sexual health services. Conclusions: The sexual health promotion program delivered through a smartphone in a self-guided mode was usable. Participants’ perception is that improvements to user experience, namely in content and interaction, as well as connection to external services, will likely improve usefulness and acceptance.

  • Source: Freepik; Copyright: pressfoto; URL: https://www.freepik.com/free-photo/woman-messaging_5398767.htm; License: Licensed by JMIR.

    Designing a Novel Digitally Delivered Antiracism Intervention for Mental Health Clinicians: Exploratory Analysis of Acceptability

    Abstract:

    Background: There is a great need for evidence-based antiracism interventions targeting mental health clinicians to help mitigate mental health disparities in racially and ethnically minoritized groups. Objective: This study provides an exploratory analysis of mental health clinicians’ perspectives on the acceptability of a web-based antiracism intervention. Methods: Mental health clinicians were recruited from a single academic medical center through outreach emails. Data were collected through individual 30-minute semistructured remote video interviews with participants, then recorded, transcribed, and analyzed using content analysis. Results: A total of 12 mental health clinicians completed the study; 10 out of 12 (83%) were female candidates. Over half (7/12, 58%) of the respondents desired more robust antiracism training in mental health care. Regarding the web-based antiracism intervention, (8/12, 67%) enjoyed the digitally delivered demo module, (7/12, 58%) of respondents suggested web-based content would be further enhanced with the addition of in-person or online group components. Conclusions: Our results suggest a strong need for additional antiracist training for mental health clinicians. Overall, participants responded favorably to novel web-based delivery methods for an antiracism intervention. These findings provide important support for future development and pilot testing of a large-scale digitally enhanced antiracist curriculum targeting mental health clinicians.

  • Cancer survivor trying the WeCanManage Prototype on their phone. Source: Image created by the Authors; Copyright: The Authors; URL: https://humanfactors.jmir.org/2024/1/e51522/; License: Creative Commons Attribution (CC-BY).

    Evaluating the Usability of an mHealth App for Empowering Cancer Survivors With Disabilities: Heuristic Evaluation and Usability Testing

    Abstract:

    Background: More than 18 million cancer survivors are living in the United States. The effects of cancer and its treatments can have cognitive, psychological, physical, and social consequences that many survivors find incredibly disabling. Posttreatment support is often unavailable or underused, especially for survivors living with disabilities. This leaves them to deal with new obstacles and struggles on their own, oftentimes feeling lost during this transition. Mobile health (mHealth) interventions have been shown to effectively aid cancer survivors in dealing with many of the aftereffects of cancer and its treatments; these interventions hold immense potential for survivors living with disabilities. We developed a prototype for WeCanManage, an mHealth-delivered self-management intervention to empower cancer survivors living with disabilities through problem-solving, mindfulness, and self-advocacy training. Objective: Our study conducted a heuristic evaluation of the WeCanManage high-fidelity prototype and assessed its usability among cancer survivors with known disabilities. Methods: We evaluated the prototype using Nielsen’s 10 principles of heuristic evaluation with 22 human-computer interaction university students. On the basis of the heuristic evaluation findings, we modified the prototype and conducted usability testing on 10 cancer survivors with a variety of known disabilities, examining effectiveness, efficiency, usability, and satisfaction, including a completion of the modified System Usability Scale (SUS). Results: The findings from the heuristic evaluation were mostly favorable, highlighting the need for a help guide, addressing accessibility concerns, and enhancing the navigation experience. After usability testing, the average SUS score was 81, indicating a good-excellent design. The participants in the usability testing sample expressed positive reactions toward the app’s design, educational content and videos, and the available means of connecting with others. They identified areas for improvement, such as improving accessibility, simplifying navigation within the community forums, and providing a more convenient method to access the help guide. Conclusions: Overall, usability testing showed positive results for the design of WeCanManage. The course content and features helped participants feel heard, understood, and less alone.

  • AI-generated image, using the prompt "Doctor equipped with robot arm to perform spinal surgery, expanding spine angle" (Generator: Midjourney/Open AI, March 4, 2024). Source: Created with Midjourney, an AI System by OpenAI; Copyright: N/A (AI-generated image); URL: https://humanfactors.jmir.org/2024/1/e54425/; License: Public Domain (CC0).

    User Experience Evaluation of a Spinal Surgery Robot: Workload, Usability, and Satisfaction Study

    Abstract:

    Background: Robotic spine surgery has continued to evolve since its US Food and Drug Administration approval in 2004, with products now including real-time video guidance and navigation during surgery. As the market for robotic surgical devices evolves, it is important to consider usability factors. Objective: The primary objective of this study was to determine the user experience of a surgical-assistive robotic device. The secondary objective was to evaluate workload, usability, the After-Scenario Questionnaire (ASQ), and the System Usability Scale (SUS). In addition, this study compares the workload, usability, and satisfaction survey of the device among different occupational groups using the device. Methods: Doctors (n=15) and nurses (n=15), the intended users of the surgical assistant robot, participated in the usability evaluation. Participants performed essential scenarios for the surgical assistant robot and provided scenario-specific satisfaction (ASQ), workload (NASA Task Load Index), and usability (SUS) scores. Results: Both doctors and nurses had task success rates of 85% or higher for each scenario. ASQ results showed that both doctors and nurses were least satisfied with ease of completing the task of registration (group 1: mean 4.73, SD 1.57 and group 2: mean 4.47, SD 1.8), amount of time it took (group 1: mean 4.47, SD 1.63 and group 2: mean 4.40, SD 2.09), and support information satisfaction (group 1: mean 5.13, SD 1.50 and group 2: mean 5.13, SD 1.89). All participants had low workloads, and the overall Task Load Index score had a P value of .77, which is greater than .05. The SUS results showed that the overall usability mean for doctors was 64.17 (SD 16.52) and the mean for nurses was 61.67 (SD 19.18), with a P value of .84, which is greater than .05, indicating no difference between the 2 groups. Conclusions: In this study, doctors and nurses evaluated the interaction of the device in a simulated environment, the operating room. By evaluating the use experience and usability of the device with real intended users, we can develop a more effective and convenient user interface.

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Latest Submissions Open for Peer-Review:

View All Open Peer Review Articles
  • A Patient-Facing Mobile App for Biobank Research Transparency and Engagement: Participatory Design

    Date Submitted: Apr 12, 2024

    Open Peer Review Period: Apr 15, 2024 - Jun 10, 2024

    Background: Patient-derived biospecimens are invaluable tools in biomedical research. Currently, there are no mechanisms for patients to follow along and learn about the uses of their donated samples....

    Background: Patient-derived biospecimens are invaluable tools in biomedical research. Currently, there are no mechanisms for patients to follow along and learn about the uses of their donated samples. Incorporating patients as stakeholders and meaningfully engaging them in biomedical research first requires transparency of research activities. Objective: Here we describe the process and results of using participatory design methods to build a mobile application in which breast cancer patients could learn about their biospecimens collected for research, the status of their use in research protocols, and about the breast disease biobank collection. This decentralized biobanking application (“de-bi”) provided patient-friendly interfaces overlaying institutional biobank databases. Methods: This research occurred in two phases. In Phase 1, we designed app screens containing different information that patients could learn about ongoing research involving their samples. Embedding these screen designs in a survey, we sought to gauge patients’ interests in receiving information about research or about their biospecimens. We engaged some survey respondents in short interviews to discern their views on the importance of having this information and their opinions on its presentation and design. We held a design workshop in which participants gave feedback on the screens and suggested improvements. For Phase 2, we then refined the user interfaces developed a functional app prototype. As we developed the app, we consulted institutional stakeholders to enhance compatibility with regulations and local data architectures. We then presented the app at a second workshop, where participants shared thoughts on usability and design of the app. In this phase we also conducted cognitive walkthroughs with individual participants to measure their success in using the app and to gain in-depth feedback on its functionality. Results: Survey and interview participants were interested in learning the status of their donated biospecimens (47%), the outcomes of research done on their specimens (30%), and in connecting with other patients similar to them. A design workshop assessing initial app screens revealed confusion in language and data presentation, though participants wanted to learn about their samples and expressed interest in using an app to do so. A second design workshop and cognitive walkthroughs assessed a functioning mobile app prototype integrated with institutional biobank data. These activities revealed further interest in the ability to track and learn about donated biospecimens. Half of participants struggled with the onboarding process. These results informed updates to the app design and functionality. Conclusions: Designing a patient-facing mobile app that displays information about biobanked specimens can facilitate greater transparency and engagement in biomedical research. Co-designing the app with patient stakeholders confirmed interest in learning about biospecimens and related research, improved presentation of data, and ensured usability of the app in preparation for a pilot study.

  • Usability, learnability, and trainability of the stay.safe Continuous Ambulatory Peritoneal Dialysis system

    Date Submitted: Mar 26, 2024

    Open Peer Review Period: Mar 26, 2024 - May 21, 2024

    Background: The design of Peritoneal Dialysis systems is critical for the safety and convenience of treatments. The stay.safe Continuous Ambulatory Peritoneal Dialysis system has been designed to faci...

    Background: The design of Peritoneal Dialysis systems is critical for the safety and convenience of treatments. The stay.safe Continuous Ambulatory Peritoneal Dialysis system has been designed to facilitate convenient bag exchanges with reduced risk of contamination. Objective: Objective. To assess the usability, learnability and trainability of the stay.safe system for each step of bag exchanges. Methods: Eight peritoneal dialysis nurses with different degrees of experience with the stay.safe system were included in this qualitative interview study. Each nurse took part in a 90-minute assessment session. After watching the manufacturer’s training video, the nurses performed each step of the bag exchange, commented on their observations, and reported their experience from training patients on the system, if available. Results: The steps associated with connection, outflow, inflow, and disconnection were almost exclusively rated as easy or very easy to perform, to learn and to train. Features for preventing mistakes that could result in a risk of contamination, the possibility of handling the system with only one hand, and the stability of the organizer were considered particularly beneficial. Suggestions for improving the usability of the system aimed at labelling, increasing the size of the switch for the sake of patients with large hands or limited fine motor skills, and improving the training material. Conclusions: Learnability and trainability were mostly rated as easy or very easy and with no handling problems occurring. Overall, 86% of the nurses would recommend stay.safe to their patients. Patients with limited fine motor skills might benefit from a larger switch.

  • Enhancing Online Medical Consultations: A Novel Approach to Personalized Doctor Recommendation Using Semantic Features and Response Metrics

    Date Submitted: Feb 23, 2024

    Open Peer Review Period: Mar 22, 2024 - May 17, 2024

    Background: The rapid growth of online medical services has highlighted the significance of smart triage systems in helping patients find the most appropriate doctors. However, traditional triage meth...

    Background: The rapid growth of online medical services has highlighted the significance of smart triage systems in helping patients find the most appropriate doctors. However, traditional triage methods often rely on department recommendations, and are insufficient to accurately match patients’ textual questions with doctors' specialties. There is an urgent need to develop algorithms for recommending doctors. Objective: To develop and validate a patient-doctor hybrid recommendation model with response metrics (PDHR model) for better triage performance. Methods: A total of 646,383 online medical consultation records from the Internet Hospital of the First Affiliated Hospital of Xiamen University were collected. Semantic features representing patients and doctors were developed to identify the set of most similar questions and to semantically expand the pool of recommended doctor candidates, respectively. The doctors’ response rate was designed to improve candidate rankings. These three characteristics combine to create the PDHR model. Five doctors participated to evaluate the efficiency of the PDHR model through multiple metrics and questionnaires, as well as the performance of SBERT and Doc2Vec in text embedding. Results: The PDHR model reaches the best recommendation performance when the number of recommended doctors is 14. At this point, the model has an F1-score of 76.25%, a proportion of high-quality services of 41.05%, and a rating of 3.90. After removing doctors’ characteristics and response rates from PDHR model, the F1-score decreased by 12.05%, the proportion of high-quality services fell by 10.87%, the average hit ratio dropped by 1.06%, and the rating declined by 11.43%. According to whether those five doctors were hit by PDHR model, SBERT achieved an average hit ratio of 88.60%, while Doc2Vec achieved an average hit ratio of 53.40%. Conclusions: The PDHR model uses semantic features and response metrics to enable patients to accurately find the doctor that best suits their needs.