Abstract
Background: Mobile health (mHealth) apps provide easy and quick access for end users to monitor their health-related activities. Features such as medication reminders help end users adhere to their medication schedules and automatically record these actions, thereby helping manage their overall health. Due to insufficient mHealth tools tailored for HIV preventive care in young men who have sex with men (MSM), our study evaluated the usability of the mChoice app, a tool designed to enhance preexposure prophylaxis (PrEP) adherence and promote sexual health (eg, encouraging the use of condoms and being aware of the partner’s HIV status and PrEP use).
Objective: This study aimed to apply systematic usability evaluations to test the mChoice app and to refine the visualizations to better capture and display patient-reported health information.
Methods: Usability testing involved heuristic evaluations conducted with 5 experts in informatics and user testing with 20 young MSM who were taking or were eligible to take PrEP.
Results: End users demonstrated satisfaction with the appearance of the mChoice app, reporting that the app has an intuitive interface to track PrEP adherence. However, participants highlighted areas needing improvement, including chart titles and the inclusion of “undo” and “edit” buttons to improve user control when recording PrEP use.
Conclusions: Usability evaluations involving heuristic experts and end users provided valuable insights into the mChoice app’s design. Areas for improvement were identified, such as enhancing chart readability and providing additional user controls. These findings will guide iterative refinements, ensuring that future versions of the app better address the needs of its target audience and effectively support HIV prevention.
doi:10.2196/59780
Keywords
Introduction
The incidence of HIV, although having declined modestly overall in the United States, remains a significant public health problem for men who have sex with men (MSM) [,]. Notably, young MSM aged 13 to 34 years represent 58% of the estimated HIV infections in 2021, indicating a pressing need for targeted intervention in this group []. Preexposure prophylaxis (PrEP) is a highly effective biomedical prevention strategy to reduce HIV incidence and curb the HIV epidemic [-]. When taken as prescribed (daily or at least 4 times per week), PrEP reduces HIV transmission by up to 99% among MSM [-,-]. While awareness of PrEP has increased among MSM [,], those who are most disproportionately affected have been found to be less aware of PrEP [], and overall, widespread uptake among those with the greatest indications for PrEP remains low [-].
To overcome this clinical and public health challenge, technological interventions, such as mobile health (mHealth) apps, have emerged to support public health care initiatives []. However, despite the potential of mHealth for delivering sexual health and HIV prevention awareness, mHealth is underutilized for supporting PrEP adherence [,]. In response, our study team developed mChoice, an innovative PrEP adherence monitoring app, which combines the CleverCap smart pill bottle with WiseApp, allowing end users to self-monitor and manage their medication adherence. The CleverCap pill bottle dispenses the prescribed medication and interfaces with WiseApp for real-time tracking. The app was created by Compliance Meds Technology and has been used in prior studies among persons living with HIV [,-]. It was adapted for the mChoice study. The app’s key functionalities include monitoring PrEP adherence, visualizing data trends, and documenting sexual behavior, particularly among young MSM from diverse backgrounds.
A notable issue in the proliferation of mHealth apps is the development of this technology with minimal input from end users, leading to poor design, inadequate consideration of user needs, and ultimately, poor usability []. Poorly designed apps, lacking in usability, are prone to misuse, underutilization, and failure to achieve their intended objectives.
To ensure the best utilization of mHealth apps, it is essential to understand their usability, keeping in mind target end users (eg, young MSM), tasks (eg, PrEP adherence management and sexual health tracking), and cultural contexts (eg, language and beliefs). Adherence to PrEP is crucial for its effectiveness in preventing HIV, yet many young MSM face challenges such as inconsistent medication schedules and limited access to tailored support tools. The mChoice app was designed to address these barriers by providing intuitive features, including medication reminders, adherence tracking, and functions to support sexual health decision-making. In this study, we sought to apply systematic usability evaluations to test the mChoice app and to refine the functions to better capture and display patient-reported health information.
Methods
Ethical Considerations
The Columbia University Institutional Review Board reviewed and approved all study activities (approval number AAAT8812). Participants signed informed consent forms prior to participating in usability testing. In our dataset, each participant was assigned an identifier, and information was deidentified at the point of analysis.
Heuristic Evaluation
Sample
Usability testing of the mChoice app included heuristic evaluation conducted with experts in informatics and end-user testing conducted with young MSM. Five experts were recruited as evaluators in accordance with Nielsen’s recommendation to include 3 to 5 experts in usability testing []. Of the 5 experts, 4 had a PhD in Nursing with expertise in human-computer interaction, interface design, and usability testing. The experience of the experts varied between 7 and 23 years, with several impactful publications in the field of informatics.
Procedure
The experts were provided with the mChoice app and asked to complete a session in the app through case scenarios that represented the main functions of the system and think-aloud methodology []. The mChoice app required a password, and all study data were encrypted and stored on secure HIPAA-compliant servers at Columbia University. The experts were asked to describe what they were thinking, seeing, and doing as they completed the following 10 scenarios: (1) log in to the CleverCap app; (2) complete a sexual activity log; (3) mark your PrEP dose for today as “Taken”; (4) view tomorrow’s pending PrEP dose; (5) edit your sexual activity log; (6) delete your sexual activity log; (7) view information on PrEP dosing over the past month; (8) send a chat to the study team; (9) watch a video about an HIV story; and (10) find PrEP information (see 
Figures 1 and illustrating app functions and 
Figure 3 demonstrating the CleverCap smart pill bottle). Following their use of the app, the experts completed an online Heuristic Evaluation Checklist to assess how the system adhered to Nielsen’s 10 usability principles [] using Qualtrics XM, an online survey software. Each question ranged from 0 (not a usability problem) to 4 (usability catastrophe). A member of the research team analyzed the experts’ comments regarding usability problems to identify areas of usability concern that could be targeted for improvement. The mean usability problem severity scores were calculated for each of the 10 usability heuristics.
End-User Testing
Sample
Twenty end users were recruited for the usability testing. The eligibility criteria were young MSM between 18 and 39 years old, English speaking, living in New York or Alabama, and taking or eligible to take PrEP. The inclusion criteria were designed to ensure the mChoice app was evaluated by its intended target audience, ensuring a diverse usability evaluation. Potential end users were contacted using a research database and invited to participate in the study.
Procedure
During usability testing, the end users were provided with a brief explanation of the mChoice app and its functions. The end users were directed to complete the same 10 scenarios completed by the experts in the heuristic evaluation. Sessions took place remotely via Zoom meetings (Zoom Communications, Inc), and a member of the team was present during sessions to provide guidance when an end user was unable to move through a task independently and to take notes. Following their use of the app, the end users completed a survey using the Qualtrics XM software.
The survey included demographics and two validated measures of usability. The first usability measure was the self-reported ease of use measured by using the Health Information Technology Usability Evaluation Scale (Health-ITUES) [,]. This 20-item tool is designed to support customization at the item level to match the health information technology while retaining standardization at the construct level. It has been demonstrated to be useful for evaluating the usability of mHealth []. It is scored on a 5-point Likert scale ranging from 5 (strongly agree) to 1 (strongly disagree), where higher scores indicate a system that is easier to use. The second measure was the short version of the Post-Study System Usability Questionnaire (PSSUQ), a 16-item survey that assesses users’ perceived satisfaction with a system []. Scoring is based on a 7-point Likert scale ranging from 1 (strongly agree) to 7 (strongly disagree). Lower scores indicate satisfaction with the system. Through validated measures, the end users contributed feedback on the app’s functionality and user experience.
Data analysis was performed using R statistical software (version 4.1.2; R Foundation for Statistical Computing) to analyze the usability measures. The mean scores were calculated for each survey.
Results
Heuristic Evaluation
Overall, the severity scores ranged from 0.8 to 2.2 for the 10 items on the heuristic checklist, where scores closest to 0 indicate a more usable system. The mean severity scores for each heuristic item are presented in 
Table 1. The area identified as the most in need of improvement was “user control and freedom,” where the experts identified that the app did not have an “undo” button or “edit” button for the PrEP medication entry.
The next most identified area for improvement was the “visibility of the system status,” for which experts identified the lack of one “add” button to add a new sexual event. To improve the “visibility of the system status,” the experts suggested we provide one “edit” button for modifying recorded sexual encounters and incorporate a separate “add” button for logging new encounters, especially in instances of multiple events. Additionally, “consistency and standards” was an area of concern with difficult terminology in charts. “Error prevention” was another concern, and experts highlighted the importance of one “edit” button to edit medication time as an issue that might impede system usability. Experts provided favorable feedback on the app’s user experience. One expert (Expert 2) reported, “the app is very simple and intuitive interface…and it’s nice that the button changes color with pleasant colors.”
The rating score ranged from 0 (ie, best) to 4 (ie, worst), with a score of 0 indicating no usability problem, 1 indicating a cosmetic problem only, 2 indicating a minor usability problem, 3 indicating a major usability problem, and 4 indicating a usability catastrophe.
| Heuristic principles | Mean (SD) severity score | Experts’ comments to identify the areas of usability concerns |
| User control and freedom | 2.2 (1.3) |
|
| Visibility of the system status | 1.6 (1.1) |
|
| Consistency and standards | 1.6 (1.1) |
|
| Error prevention | 1.6 (1.1) |
|
| Match between the system and the real world | 1.4 (1.3) |
|
| Recognition rather than recall | 1.4 (0.9) |
|
| Help and documentation | 1.4 (1.3) |
|
| Help users recognize, diagnose, and recover from errors | 1.2 (1.1) |
|
| Aesthetic and minimalist design | 1.2 (1.1) |
|
| Flexibility and efficiency of use | 0.8 (1.1) |
|
End-User Testing
The end-user group for evaluating the mChoice app’s usability consisted entirely of men, with the majority identifying as homosexual (14/20, 70%). The mean (SD) age was 28 (3.4) years. Half of the end users were White, and 75% (15/20) were non-Hispanic or Latino. Considering education, 50% (10/20) had a college degree. Two specific measures were employed for the usability assessment: the Health-ITUES and the PSSUQ, as detailed in Table 2.
The Health-ITUES scale, where a higher score indicates better usability, showed that “perceived ease of use” scored the highest with a mean (SD) score of 4.6 (0.5), suggesting a favorable user assessment. However, “user control” received the lowest score in this category, with a mean (SD) score of 3.8 (0.9), corroborating the heuristic evaluator’s ratings.
Conversely, the PSSUQ, where a lower score indicates better usability, reflected different aspects of the mChoice performance. “System quality” scored the lowest with a mean (SD) of 1.7 (1.2), while “interface quality” had the highest score with a mean (SD) score of 3.0 (1.8). These results suggested a positive user experience with notable ease of use and system quality strengths. However, there were areas for improvement, particularly in enhancing user control and interface quality.
| Measures | Mean (SD) score |
| Health-ITUESa | |
| 4.6 (0.5) | |
| 4.1 (0.8) | |
| 4.0 (0.8) | |
| 3.8 (0.9) | |
| 4.2 (0.4) | |
| PSSUQb | |
| 1.7 (1.2) | |
| 2.4 (1.3) | |
| 3.0 (1.8) | |
| 2.3 (0.6) | |
aHealth-ITUES: Health Information Technology Usability Evaluation Scale (rating the score from 5 being the best score to 1 being the worst score).
bPSSUQ: Post-Study System Usability Questionnaire (rating the score from 1 being the best score to 7 being the worst score).
Discussion
Principal Results
Our study evaluated the mChoice app’s usability in enhancing PrEP adherence for young MSM. Overall, heuristic experts and end users demonstrated satisfaction with the mChoice app, reporting that it is a simple and intuitive interface for tracking PrEP adherence. Graphs, charts, and icons are the main features of mHealth apps that help end users track their goals, habits, and achievements [,]. The mChoice app combines iconography (eg, emoticons) and color-coded charts to provide clear and immediate feedback on PrEP adherence. These diverse visualizations allow end users to interpret their data in several formats. The app includes emoticons in different colors (green for high adherence, red for missed doses, and yellow for off-schedule doses) to represent adherence status. For instance, a sad emoticon in red for low adherence might highlight medication adherence challenges and prompt self-reflection on areas needing improvement. Such immediate visual feedback can motivate end users to improve their medication routine. In addition, graphs showed the trend of PrEP medication adherence over time, including evidence-based information on the percentage of missed, off-schedule, and on-time doses.
While prior research has indicated that varied data visualization options help match different end users’ preferences [] and color-coded visual cues can aid in quick decision-making and interpretation of health data [-], our study did not directly assess end-user interpretations of these visual elements. The mChoice app incorporates these evidence-based design principles, but further research would be needed to evaluate their impact on user comprehension and medication adherence behaviors.
Our findings suggest that the visual elements available in the mChoice app offer a positive end-user experience and function accessibility that could assist in timely medication intake and monitor adherence. However, our heuristic evaluation highlighted areas needing improvement, particularly in the need for clearer chart titles and more labels to exemplify each component (eg, Clever score), underscoring the importance of refinement of the mChoice design for optimized end-user experiences.
The accuracy of the information collected through the mChoice app was another area of attention that heuristic experts raised concerns, particularly highlighting the absence of “undo,” “edit,” and “add” buttons. These limitations restricted user control, potentially affecting the accuracy of patients’ health information input. For instance, the absence of “undo” and “edit” buttons could lead to inaccuracies if end users mistakenly enter the time of their PrEP dose intake. Additionally, the lack of an “add” button for recording multiple sexual events was seen as an important barrier, restricting end users from documenting their sexual event entries accurately. These findings underscore the need for enhanced app capabilities to ensure accurate and comprehensive user input and customizations. Similarly, other studies [,] reported concerns about user experiences and data accuracy in mobile apps, reinforcing the findings of our study.
The actionable finding from this study is to reevaluate the functions of the mChoice app after integrating end-user feedback and addressing heuristic violations. Iterative usability evaluations should be considered as a best practice in the app development process to ensure the effectiveness of the app’s future iterations.
Limitations
A limitation of our study was the convenience sample, recruited from a database that included participants who had participated in past research and expressed interest in future studies. Additionally, while our sample targeted young MSM, English-speaking men, and those living in New York or Alabama, this demographic representation might limit our ability to understand how the app might perform for medication adherence across diverse populations. Given that PrEP users come from varied cultural, linguistic, and socioeconomic backgrounds, our findings may not be generalizable to groups whose cultural beliefs, language preferences, and health care engagement patterns differ from those of our study population. While end users were central for evaluating the usability of the mChoice app through validated quantitative measures, qualitative data were collected only from experts during heuristic evaluations. In this study, we did not evaluate the artificial intelligence or algorithmic components that could enhance personalization and medication adherence predictions. Despite these limitations, we identified areas of improvement to refine the mChoice app. In addition, this study enriched the body of research on evaluating the mHealth usability for HIV prevention. This was achieved by employing end users and heuristic experts to assess this innovative app designed for PrEP adherence and HIV prevention.
Conclusions
Our usability study of the mChoice app involved rigorous evaluations through interactive heuristic evaluations and end-user testing. The results demonstrated the app’s simplicity and user-friendly interface, showcasing its potential in monitoring health-related activities such as PrEP adherence. Further research could explore how these usability enhancements might influence user engagement and behavior change to support HIV prevention efforts.
Acknowledgments
Research reported in this study was funded by the Centers for Disease Control and Prevention through grant #U01PS005229. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
Conflicts of Interest
None declared.
References
- HIV & AIDS trends and U.S. statistics overview. HIV.gov. URL: https://www.hiv.gov/hiv-basics/overview/data-and-trends/statistics [Accessed 2024-02-01]
- Estimated HIV incidence and prevalence in the United States, 2017–2021. Centers for Disease Control and Prevention. 2023. URL: http://www.cdc.gov/hiv/library/reports/hiv-surveillance.html [Accessed 2023-11-12]
- Carnegie NB, Goodreau SM, Liu A, et al. Targeting pre-exposure prophylaxis among men who have sex with men in the United States and Peru: partnership types, contact rates, and sexual role. J Acquir Immune Defic Syndr. May 1, 2015;69(1):119-125. [CrossRef] [Medline]
- Juusola JL, Brandeau ML, Owens DK, Bendavid E. The cost-effectiveness of preexposure prophylaxis for HIV prevention in the United States in men who have sex with men. Ann Intern Med. Apr 17, 2012;156(8):541-550. [CrossRef] [Medline]
- Kessler J, Myers JE, Nucifora KA, et al. Evaluating the impact of prioritization of antiretroviral pre-exposure prophylaxis in New York. AIDS. Nov 28, 2014;28(18):2683-2691. [CrossRef] [Medline]
- Zablotska IB. Likely impact of pre-exposure prophylaxis on HIV epidemics among men who have sex with men. Sex Health. Feb 2017;14(1):97-105. [CrossRef] [Medline]
- McCormack S, Dunn DT, Desai M, et al. Pre-exposure prophylaxis to prevent the acquisition of HIV-1 infection (PROUD): effectiveness results from the pilot phase of a pragmatic open-label randomised trial. Lancet. Jan 2, 2016;387(10013):53-60. [CrossRef] [Medline]
- Grant RM, Anderson PL, McMahan V, et al. Uptake of pre-exposure prophylaxis, sexual practices, and HIV incidence in men and transgender women who have sex with men: a cohort study. Lancet Infect Dis. Sep 2014;14(9):820-829. [CrossRef] [Medline]
- Volk JE, Marcus JL, Phengrasamy T, et al. No new HIV infections with increasing use of HIV preexposure prophylaxis in a clinical practice setting. Clin Infect Dis. Nov 15, 2015;61(10):1601-1603. [CrossRef] [Medline]
- Dos Santos FC, Batey DS, Kay ES, et al. The effect of a combined mHealth and community health worker intervention on HIV self-management. J Am Med Inform Assoc. Mar 1, 2025;32(3):510-517. [CrossRef] [Medline]
- Effectiveness of prevention strategies to reduce the risk of acquiring or transmitting HIV. Centers for Disease Control and Prevention. 2022. URL: https://www.cdc.gov/hiv/risk/estimates/preventionstrategies.html#anchor_1562942347 [Accessed 2024-05-03]
- Liu AY, Cohen SE, Vittinghoff E, et al. Preexposure prophylaxis for HIV infection integrated with municipal- and community-based sexual health services. JAMA Intern Med. Jan 2016;176(1):75-84. [CrossRef] [Medline]
- Marcus JL, Hurley LB, Nguyen DP, Silverberg MJ, Volk JE. Redefining human immunodeficiency virus (HIV) preexposure prophylaxis failures. Clin Infect Dis. Oct 30, 2017;65(10):1768-1769. [CrossRef] [Medline]
- Grov C, Rendina HJ, Whitfield THF, Ventuneac A, Parsons JT. Changes in familiarity with and willingness to take preexposure prophylaxis in a longitudinal study of highly sexually active gay and bisexual men. LGBT Health. Aug 2016;3(4):252-257. [CrossRef] [Medline]
- Mayer KH, Agwu A, Malebranche D. Barriers to the wider use of pre-exposure prophylaxis in the United States: a narrative review. Adv Ther. May 2020;37(5):1778-1811. [CrossRef] [Medline]
- Dawit R, Predmore Z, Raifman J, et al. Identifying HIV PrEP attributes to increase PrEP use among different groups of gay, bisexual, and other men who have sex with men: a latent class analysis of a discrete choice experiment. AIDS Behav. Jan 2024;28(1):125-134. [CrossRef] [Medline]
- Dubov A, Ogunbajo A, Altice FL, Fraenkel L. Optimizing access to PrEP based on MSM preferences: results of a discrete choice experiment. AIDS Care. May 2019;31(5):545-553. [CrossRef] [Medline]
- Global strategy on digital health 2020 - 2025. World Health Organization. 2021. URL: https://iris.who.int/handle/10665/344249 [Accessed 2024-02-01]
- Liu AY, Laborde ND, Coleman K, et al. DOT diary: developing a novel mobile app using artificial intelligence and an electronic sexual diary to measure and support PrEP adherence among young men who have sex with men. AIDS Behav. Apr 2021;25(4):1001-1012. [CrossRef] [Medline]
- Whiteley L, Mena L, Craker LK, Healy MG, Brown LK. Creating a theoretically grounded gaming app to increase adherence to pre-exposure prophylaxis: lessons from the development of the viral combat mobile phone game. JMIR Serious Games. Mar 27, 2019;7(1):e11861. [CrossRef] [Medline]
- Schnall R, Rojas M, Bakken S, et al. A user-centered model for designing consumer mobile health (mHealth) applications (apps). J Biomed Inform. Apr 2016;60:243-251. [CrossRef] [Medline]
- Aliabadi N, Carballo-Dieguez A, Bakken S, et al. Using the information-motivation-behavioral skills model to guide the development of an HIV prevention smartphone application for high-risk MSM. AIDS Educ Prev. Dec 2015;27(6):522-537. [CrossRef] [Medline]
- Schnall R, Travers J, Rojas M, Carballo-Diéguez A. eHealth interventions for HIV prevention in high-risk men who have sex with men: a systematic review. J Med Internet Res. May 26, 2014;16(5):e134. [CrossRef] [Medline]
- Schnall R, Kuhns LM, Pearson C, et al. Efficacy of MyPEEPS mobile, an HIV prevention intervention using mobile technology, on reducing sexual risk among same-sex attracted adolescent males: a randomized clinical trial. JAMA Netw Open. Sep 1, 2022;5(9):e2231853. [CrossRef] [Medline]
- Beauchemin M, Gradilla M, Baik D, Cho H, Schnall R. A multi-step usability evaluation of a self-management app to support medication adherence in persons living with HIV. Int J Med Inform. Feb 2019;122:37-44. [CrossRef] [Medline]
- McCurdie T, Taneva S, Casselman M, et al. mHealth consumer apps: the case for user-centered design. Biomed Instrum Technol. 2012;Suppl:49-56. [CrossRef] [Medline]
- Nielsen J, Molich R. Heuristic evaluation of user interfaces. Presented at: CHI90: Conference on Human Factors in Computing; Apr 1-5, 1990:249-256; Seattle, Washington, United States. URL: https://dl.acm.org/doi/10.1145/97243.97281 [Accessed 2025-02-19] [CrossRef]
- Bertini E, Gabrielli S, Kimani S, Catarci T, Santucci G. Appropriating and assessing heuristics for mobile computing. Presented at: AVI06: The International Conference on Advanced Visual Interfaces; May 23-26, 2006; Venezia, Italy. URL: https://dl.acm.org/doi/10.1145/1133265.1133291 [Accessed 2025-02-19] [CrossRef]
- Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. Sep 1989;13(3):319. [CrossRef]
- Schnall R, Cho H, Liu J. Health Information Technology Usability Evaluation Scale (Health-ITUES) for usability assessment of mobile health technology: validation study. JMIR Mhealth Uhealth. Jan 5, 2018;6(1):e4. [CrossRef] [Medline]
- Brown W 3rd, Yen PY, Rojas M, Schnall R. Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology. J Biomed Inform. Dec 2013;46(6):1080-1087. [CrossRef] [Medline]
- Lewis JR. Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int J Hum Comput Interact. Sep 2002;14(3-4):463-488. [CrossRef]
- Caldeira C, Chen Y, Chan L, Pham V, Chen Y, Zheng K. Mobile apps for mood tracking: an analysis of features and user reviews. AMIA Annu Symp Proc. 2017;2017:495-504. [Medline]
- Carroll LN, Au AP, Detwiler LT, Fu TC, Painter IS, Abernethy NF. Visualization and analytics tools for infectious disease epidemiology: a systematic review. J Biomed Inform. Oct 2014;51:287-298. [CrossRef] [Medline]
- Albers EAC, Fraterman I, Walraven I, et al. Visualization formats of patient-reported outcome measures in clinical practice: a systematic review about preferences and interpretation accuracy. J Patient Rep Outcomes. Mar 3, 2022;6(1):18. [CrossRef] [Medline]
- Kuijpers W, Giesinger JM, Zabernigg A, et al. Patients’ and health professionals’ understanding of and preferences for graphical presentation styles for individual-level EORTC QLQ-C30 scores. Qual Life Res. Mar 2016;25(3):595-604. [CrossRef] [Medline]
- Smith KC, Brundage MD, Tolbert E, et al. Engaging stakeholders to improve presentation of patient-reported outcomes data in clinical practice. Support Care Cancer. Oct 2016;24(10):4149-4157. [CrossRef] [Medline]
- Dos Santos FC, Yao Y, Macieira TGR, Dunn Lopez K, Keenan GM. Nurses’ preferences for the format of care planning clinical decision support coded with standardized nursing languages. J Am Med Inform Assoc. Oct 19, 2023;30(11):1846-1851. [CrossRef] [Medline]
- Gu J, Mackin S, Zheng Y. Making sense: an innovative data visualization application utilized via mobile platform. Presented at: 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS); Jun 28-30, 2018:1105-1109; Exeter, United Kingdom. [CrossRef]
- Katz D, Dalton N, Holland S, O’Kane A, Price BA. Questioning the reflection paradigm for diabetes mobile apps. In: Giokas K, Bokor L, Hopfgartner F, editors. eHealth 360°. Springer, Cham; 2017:315-326. [CrossRef]
Abbreviations
| Health-ITUES: Health Information Technology Usability Evaluation Scale |
| mHealth: mobile health |
| MSM: men who have sex with men |
| PrEP: preexposure prophylaxis |
| PSSUQ: Post-Study System Usability Questionnaire |
Edited by Andre Kushniruk; submitted 16.05.24; peer-reviewed by Christian Grov, Dillon Chrimes, Richard Ma; final revised version received 19.01.25; accepted 19.01.25; published 28.02.25.
Copyright© Fabiana Cristina Dos Santos, Maeve Brin, Mary R Tanner, Carla A Galindo, Rebecca Schnall. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 28.2.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.