Background: Cardiovascular disease (CVD) and type 2 diabetes mellitus (T2DM) are posing a huge burden on health care systems worldwide. Mobile apps can deliver behavior change interventions for chronic disease prevention on a large scale, but current evidence for their effectiveness is limited.
Objective: This paper reported on the development and user testing of a mobile app that aims at increasing risk awareness and engaging users in behavior change. It would form part of an intervention for primary prevention of CVD and T2DM.
Methods: The theoretical framework of the app design was based on the Behaviour Change Wheel, combined with the capability, opportunity, and motivation for behavior change system and the behavior change techniques from the Behavior Change Technique Taxonomy (version 1). In addition, evidence from scientific literature has guided the development process. The prototype was tested for user-friendliness via an iterative approach. We conducted semistructured interviews with individuals in the target populations, which included the System Usability Scale. We transcribed and analyzed the interviews using descriptive statistics for the System Usability Scale and thematic analysis to identify app features that improved utility and usability.
Results: The target population was Australians aged ≥45 years. The app included 4 core modules (risk score, goal setting, health measures, and education). In these modules, users learned about their risk for CVD and T2DM; set goals for smoking, alcohol consumption, diet, and physical activity; and tracked them. In total, we included 12 behavior change techniques. We conducted 2 rounds of usability testing, each involving 5 participants. The average age of the participants was 58 (SD 8) years. Totally, 60% (6/10) of the participants owned iPhone Operating System phones, and 40% (4/10) of them owned Android phones. In the first round, we identified a technical issue that prevented 30% (3/10) of the participants from completing the registration process. Among the 70% (7/10) of participants who were able to complete the registration process, 71% (5/7) rated the app above average, based on the System Usability Scale. During the interviews, we identified some issues related to functionality, content, and language and clarity. We used the participants’ feedback to improve these aspects.
Conclusions: We developed the app using behavior change theory and scientific evidence. The user testing allowed us to identify and remove technical errors and integrate additional functions into the app, which the participants had requested. Next, we will evaluate the feasibility of the revised version of the app developed through this design process and usability testing.
Description of the Behaviors
Cardiovascular disease (CVD) and type 2 diabetes mellitus (T2DM) are 2 widely prevalent chronic conditions . They are highly associated with unhealthy lifestyle, including tobacco smoking, alcohol consumption, poor diet, and physical inactivity. This means that preventative interventions that target these 4 behavioral risk factors can help reduce the risk of developing CVD and T2DM. According to the Global Burden of Disease Study 2019, these 4 factors are among the top behavioral risk factors for the total burden of disease [ ]. In 2018, tobacco use contributed the most (8.6%) to the total disability-adjusted life years of Australians, followed by overweight and obesity (8.4%), dietary risk factors (5.4%), high blood pressure (5.1%), and alcohol use (4.5%) [ ]. The authors of the report estimated that 38% of the burden of disease measured in the Australian Burden of Disease Study 2018 could have been prevented by reducing or avoiding exposure to the modifiable risk factors that were included in the study [ ].
Overview of Existing Mobile Interventions for Chronic Disease Prevention
Mobile health interventions can be used to address these risk behaviors and help people reduce their risk for CVD and T2DM. Many apps have already been developed for the 4 risk behaviors. In a systematic review from 2020, Milne-Ives et al  concluded that there was no strong evidence to show that mobile apps can effectively improve health behaviors or outcomes, because only a few studies demonstrated statistically significantly better results in the intervention compared with the control group [ ]. Similar results were reported by Palmer et al [ ], Marcolino et al [ ], Romeo et al [ ], and Lunde et al [ ]. We conducted a systematic review of mobile health–based multiple risk factor interventions for the prevention of CVD and T2DM [ ]. The review included 3 studies on CVD prevention [ - ] and 6 on T2DM prevention [ - ]. Although the evidence was weak, the findings indicated that at least small to moderate reductions in CVD and T2DM risk can be achieved through mobile health interventions [ ]. More recently, Redfern et al [ ] published the results of a randomized controlled trial of an app-based intervention for CVD prevention. The intervention aimed at changes in diet, physical activity, smoking, and mental health, but not in alcohol consumption [ ]. It showed borderline improvements in risk factors (blood pressure and lipids) and risk-related behaviors (physical activity and eHealth literacy) [ ]. None of these interventions targeted CVD and T2DM prevention simultaneously, which is a gap that we aimed to address.
A recurring criticism by authors of systematic reviews is the low quality of evidence for the effectiveness of mobile health interventions [- , - ]. Many have highlighted a lack of rigorous reporting on the theory underlying the intervention and the behavior change techniques included in the app [ , , , - ]. Michie et al [ ] explained that the interventions need to be accurately and fully described to subsequently understand which parts of behavior change interventions contributed to outcomes. Carraça et al [ ] and Black et al [ ] found that effective behavior change techniques vary depending on the mode of delivery, for example, between face-to-face and digital interventions. This means that researchers cannot simply refer to the results of face-to-face behavior change interventions when deciding which behavior change techniques are to be included in the app design.
In addition, Palmer et al  found that many studies have focused on individual risk factors. In their systematic review of mobile-based interventions for the prevention of noncommunicable diseases, only 2 of the 71 studies targeted smoking, diet, and physical inactivity, and none targeted all the 4 behaviors (ie, smoking, diet, physical inactivity, and alcohol consumption) [ ]. Noble et al [ ] conducted a systematic review to investigate which behavioral risk factors were related. They identified that the 4 behaviors often occurred in clusters. Therefore, they argued in favor of multiple behavioral risk interventions [ ]. Geller et al [ ] highlighted that the behavioral risk factors for chronic conditions are overlapping, which means that successfully addressing these factors will reduce the risk for various chronic diseases.
This study formed part of a larger project in which we aimed to develop and evaluate a mobile app–based intervention for CVD and T2DM risk awareness and prevention. The intervention’s goal is to reduce the risk of both CVD and T2DM by targeting smoking, alcohol consumption, poor diet, and physical inactivity. In this paper, we have described the systematic development and refinement of the mobile app through usability testing.
This study followed the methodology developed by Tombor et al  for the development of digital behavior change interventions. The methodology combines elements of the United Kingdom’s Medical Research Council guidance [ ], Multiphase Optimization Strategy [ ], and Behaviour Change Wheel (BCW) [ ]. Following these multiphase approaches, the development of the app-based intervention was divided into three phases—preparation, design, and piloting.
Step 1: Identify Target Behavior
This app-based intervention focused on 4 behaviors: smoking cessation, moderate alcohol intake, healthy diet (ie, adequate fruit and vegetable intake and avoidance of sugary drinks), and physical activity (ie, walking and other forms of exercise). These 4 behaviors are associated with decreased risk of CVD and T2DM . Regarding smoking, the Australian National Strategy aims to prevent the uptake of smoking, encourage smokers to stop as soon as possible, and support former smokers to stay smoke-free [ ]. Regarding alcohol, the Australian guidelines recommend ≤10 standard drinks per week and a maximum of 4 drinks on any day [ ]. The Australian recommendations for a healthy diet include a combination of 5 serves of vegetables and 2 serves of fruits per day and no sugary drinks [ ]. The advice on exercise states at least 150 minutes of physical activity for people aged 45 to 64 years per week and at least 30 minutes on most, if not all, days for people aged ≥65 years [ ]. We assumed that not everyone had to change all 4 risk behaviors. The specific target would depend on the individuals and their needs. Long-term behavior changes were required to lower CVD or T2DM risk [ - ].
Step 2: Identify the Theoretical Base
We used BCW as a theoretical base and combined it with the Behavior Change Technique Taxonomy (version 1) by Michie et al  to develop the app. Michie et al [ ] developed BCW based on findings from a systematic review of existing frameworks of behavior change interventions. The researchers assessed the identified frameworks and addressed each of their limitations in a unified framework, namely the BCW [ ]. Then, they tested the reliability with which the framework can be applied in practice [ ]. BCW incorporates the capability, opportunity, and motivation for behavior change (COM-B) system [ ], which describes the 3 components, capability, opportunity, and motivation, that jointly influence behavior. BCW consists of 3 layers that interact with each other [ ]. The COM-B system builds the inner layer [ ]. Capability describes physical and psychological factors that allow an individual to act on certain behavior [ ]. Opportunity consists of physical and social factors that enable behavior [ ]. Motivation comprises automatic or reflective thought processes that influence an individual’s action [ ]. The next layer consists of 9 intervention functions (education, persuasion, incentivization, coercion, training, enablement, modeling, environmental restructuring, and restrictions), followed by a layer of 9 policy categories (environmental and social planning, communication and marketing, legislation, service provision, regulation, fiscal measures, and guidelines) [ ].
Step 3: Review Relevant Scientific Literature
We conducted a systematic literature review to assess the current evidence for the effectiveness of mobile health–based interventions in reducing the risk for CVD and T2DM, with a focus on multiple behavioral risk factor interventions . In addition, we conducted a scoping review between August 2019 and August 2020 to identify relevant papers on behavior change, user engagement, and persuasion in the context of digital health, CVD and T2DM risk prediction, goal setting theory, and risk communication.
Step 4: Conduct Needs Assessment
The focus of the app-based intervention is the prevention of CVD and T2DM in Australian adults aged ≥45 years through behavior change. The Australian CVD risk guidelines defined CVD “collectively...as coronary heart disease, stroke and other vascular disease including peripheral arterial disease and renovascular disease” . Diagnostic criteria depended on the specific condition. The Royal Australian Commission of General Practitioners defined T2DM as a "chronic and progressive medical condition that results from two major metabolic dysfunctions: insulin resistance and then pancreatic islet cell dysfunction causing a relative insulin deficiency" [ ]. The diagnostic criteria comprised presentation of hyperglycemic crisis, a single elevated fasting blood glucose level ≥7 mmol/L, a single hemoglobin A1c ≥6.5%, or a random blood glucose level ≥11.1 mmol/L (the criteria is slightly different for asymptomatic individuals) [ ]. We chose the age group for the intervention based on the advice of the Royal Australian Commission of General Practitioners for general practitioners (GPs) to conduct screening for risk factors and potentially initiate preventative measures in the healthy population ≥45 years [ ]. For quantitative needs assessment, we reviewed the data from the Australian Burden of Disease Study 2015 [ ] and the Australian National Health Survey 2017-18 [ ]; these are summarized in Table S1 of [ , - , - ]. For qualitative needs assessment, we studied the audio and video presentations of people’s real-life experiences of aging in Australia by Healthtalk Australia [ ].
Step 5: Select Mode of Delivery
We will deliver the intervention via a mobile app. According to the National Health Survey 2017-18 , 89.7% of Australians aged ≥45 years stated that they owned a mobile phone or smartphone.
Step 6: Select Intervention Components
We selected BCW intervention functions following the affordability, practicability, effectiveness and cost-effectiveness, acceptability, side effects and safety, and equity (APEASE) criteria . The criteria include whether the intervention is within an acceptable budget, whether it can be delivered as designed, whether it delivers desirable outcomes in practice, whether the benefit-cost ratio is favorable, whether relevant stakeholders consider it as appropriate, whether the risk-benefit ratio is favorable, and whether it narrows or widens disparities between different societal groups [ ]. We selected 4 intervention functions: education (ie, “increasing knowledge or understanding”), persuasion (ie, “using communication to induce positive or negative feelings or stimulate action”), incentivization (ie, “creating an expectation of reward”), and enablement (ie, “increasing means/reducing barriers to increase capability [beyond education and training] or opportunity [beyond environmental restructuring]”) from the BCW [ ]. Furthermore, we picked 2 policy categories: communication and marketing, and service provision. We chose the intervention components based on previous experience with other apps and published literature.
Step 7: Specify the Intervention Content by Behavior Change Techniques
We used the Behavior Change Technique Taxonomy (version 1) by Michie et al  to select suitable behavior change techniques and connected them to the appropriate intervention functions, COM-B system components, and policy categories. We identified literature that reported on effective behavior change techniques in mobile health interventions. Subsequently, we developed an intervention strategy based on the selected behavior change techniques. Several systematic reviews and meta-analyses as well as other studies have been published, aiming to identify effective behavior change techniques for mobile health interventions, such as the studies by Carraça et al [ ], Qin et al [ ], Van Rhoon et al [ ], Kaner et al [ ], Garnett et al [ ], McCrabb et al [ ], Black et al [ ], Schroé et al [ ], and Asbjørnsen et al [ ] (for an overview of the results, refer to Table S2 in ). This shows that, currently, there is no absolute answer as to which techniques are effective in practice; however, there is a clear indication for the effectiveness of self-regulatory strategies. Owing to this uncertainty, we could not simply draw on the results from such meta-analyses to select effective behavior change techniques for our intervention.
Step 8: Translate the Intervention Into App Features
In regular meetings, the research team and software engineers discussed the practical translation of the intervention into app features, focusing on user-friendliness and accessibility aspects.
Step 9: Design a Prototype App
We based the design of the prototype app on previous apps developed by members of the research team [- ]. These apps have been validated by different stakeholders, including patients and clinicians. With a focus on the APEASE criteria [ ], we set the goal of keeping the app design simple and user-friendly and using less internet data volume and less storage space on the smartphone. In addition, the software engineers developed the app such that it was compatible with iPhone Operating System (iOS) and Android systems. The prototype included 4 core modules: risk score, goal setting, health measures, and education.
Pilot Phase—Step 10: Conduct User Testing
In the next step, we tested the usability of the app iteratively. We anticipated requiring 2 to 3 cycles to remove all the major design issues. Each cycle consisted of 5 participants from the target population (aged ≥45 years, residing in Australia, fluent in written and spoken English, and owning a smartphone with internet access). We based the sample size calculation on previous studies [- ]. We recruited participants through the institutional Twitter account and by contacting community groups (eg, community choirs, community gardens, and advocacy groups for older Australians). We offered participants a gift voucher worth Aus $20 (US $14) to thank them for their participation. After providing consent, participants received the study instructions, a link to download the app, a dummy profile, and the user guide ( ) via email. The app was available in a test version only; therefore, the iOS users were required to download the TestFlight app first. Once the app was installed, we asked the participants to use the information provided in the dummy profile to register with the app. We did not collect any app data and asked participants to use the dummy information because, at this stage, we were interested only in the user-friendliness of the app. We invited participants to explore the app further and to book a time for a feedback interview. A researcher (VHB) conducted the semistructured phone interviews (refer to for the interview guide). The interviews consisted of questions about the downloading and registration processes and the System Usability Scale [ ]. Then, VHB transcribed the interviews verbatim, analyzed the results of the System Usability Scale using descriptive statistics, and conducted a thematic analysis using NVivo (version 12; QSR International). As described by Neubeck et al [ ], we classified the findings into three themes: functionality, content, or language and clarity. On the basis of the findings of the thematic analysis, we resolved the identified issues and added features to the app and user guide according to the participants’ feedback. We repeated the steps until we achieved an adequate version of the app that we could use in a feasibility study.
We received ethics approval from the University of New South Wales Australia Human Research Ethics Advisory Panel (approval number HC200069) and reciprocal approval from the Commonwealth Scientific and Industrial Research Organisation Health and Medical Human Research Ethics Committee (approval number 2020_041_RR).
Registration Process and General App Features
Principles generated from the capability, opportunity, and motivation for behavior change model.
- Educational videos and links to external websites with evidence-based health information to impart knowledge and train behavioral skills.
- Gradually making behavioral goals more difficult to train the behavioral skills.
- Providing values for goal setting and displaying last achieved values to train the cognitive skills.
- Advice on actions based on personal risks for cardiovascular disease (CVD) and type 2 diabetes mellitus (T2DM) as part of the visualization to improve understanding of adequate measures to achieve target behavior.
- Links to websites that provide healthy recipes and exercise instructions to develop skills in cooking and physical activity.
- Advise for contacting general practitioner (included in risk score–related actions, educational videos, and advice if blood pressure or lipid levels not known) for social support.
- Links to websites including support programs (eg, for smoking cessation) for social support.
- Advise for contacting general practitioner (included in risk score–related actions, educational videos, and advice if blood pressure or lipid levels not known) who can check blood pressure levels and lipid levels or provide pharmacotherapy (eg, for hypertension or dyslipidemia) among others.
- Visualization of risk for CVD and T2DM displayed on the home screen of the app and the potential to change the risk based on health measures to elicit impulses and counterimpulses related to the target behavior.
- Announcing that the goals have been achieved in 3 consecutive weeks to trigger positive feelings about the behavioral goals.
- Facilitating self-monitoring of behavioral risk factors and reviewing the progress toward the self-set goals to increase understanding of own behavior and elicit positive or negative feelings about the behavioral goals.
- Highlighting the discrepancy between current behavior and goals to elicit positive or negative feelings and increase understanding of own capabilities about the behavioral goals.
- Encouraging self-reward after achieving weekly goals to elicit positive feelings about the behavioral goals.
- Providing feedback on personal risk of CVD and T2DM in the form of visualization to improve knowledge about own health and elicit positive feelings about the behavioral goals.
- Providing links to websites from credible sources and educational videos to increase knowledge and understanding about the target behavior.
- Setting goals to commit to target behavior and elicit positive feelings about it.
|Module||Linked intervention functions||Key COM-B system components served by module||Selected behavior change techniques||Intervention strategies|
|Risk score||Enablement and persuasion||Automatic and reflective motivation||Self-monitoring of outcomes of behavior and goal setting (outcome)||Risk score visualization on home screen; outcome goal: low to moderate risk of CVDb and T2DMc; and advice on actions based on personal risk, for example, advice to contact their general practitioner|
|Goal setting||Enablement||Psychological capability and reflective motivation||Goal setting (behavior) and graded tasks||Set behavioral goals for numbers of cigarettes, alcoholic drinks, fruit serves, vegetable serves, and sugary drinks, step count, and minutes of physical activity per day or week based on provided value ranges and advice to gradually make behavioral goals more difficult when they have been achieved in 3 consecutive weeks|
|Health measures||Persuasion and incentivization||Automatic and reflective motivation||Review behavioral goals, discrepancy between current behavior and goal, and self-reward||Icons and charts showing progress toward self-set daily or weekly goals, display discrepancies between current behavior and previously set goals through color-coding (red circle for negative counting or green circle for positive counting), display last achieved goals, encourage to reward themselves with an object or activity after they achieved their self-set goals, and congratulate when goals were achieved in 3 consecutive weeks|
|Education||Education, persuasion, and enablement||Physical and psychological capability||Instruction on how to perform the behavior, information about health consequences, information about social and environmental consequences, credible sources, and social support (unspecified)||Links to websites with health information and information about social, environmental, and emotional consequences; short videos on CVD, T2DM, and risk factors with advice to contact general practitioner; all information from credible sources (evidence-based); and links to support groups|
aCOM-B: capability, opportunity, and motivation for behavior change.
bCVD: cardiovascular disease.
cT2DM: type 2 diabetes mellitus.
The long-term goal of the app-based intervention is primary prevention of CVD and T2DM. Therefore, risk presentations for both conditions built a central feature of the app (). The risk scores that were embedded into the app were the 1991 version of the Framingham CVD risk score [ ] and the Australian Type 2 Diabetes Risk Assessment Tool [ ]. These are the standards currently used by clinicians in Australia and endorsed by the Royal Australian Commission of General Practitioners [ , ]. Users provided the information required for the risk calculation during the registration process. We designed the app such that the participants had the option to use Australian averages for lipids and blood pressure based on their age and sex if they did not know their values. Then, they received a recommendation to check the values with their GP. After completing the registration process, users saw their current risk of CVD and T2DM for the next 5 years.
Each time the users opened the app, they saw the risk score screen first. We hypothesized that this would create the impulse to work on the behavioral goals to see a low or moderate disease risk displayed. We followed the principles that we identified during the risk communication scoping review [- ]: keep the information simple and compact, use absolute instead of relative risk values, combine visuals with text, include information on action to take, and integrate a color scheme that is associated with different risk levels. In particular, the study by Reading Turchioe et al [ ] influenced the final version of the visualization. The risk was stratified into 3 different levels (low, moderate, or high) and 3 corresponding actions (“Keep going. You are doing well”; “Work on your health goals”; or “Talk to your GP about your risk”). The recommended action focused on the higher of the 2 risks. Absolute risk values were not displayed because of the difficulty for users to interpret them. Users saw the date on which they had last updated their risk score and can update it at any time. Variables that do not change, such as gender and date of birth, were stored. Physical activity levels were collected through the health measures module. Users could update all other variables in the risk score module.
The app incorporated a goal setting function (), which included proximal, specific goals related to the 4 behavioral factors, smoking, alcohol intake, diet, and physical activity. We designed this module based on the following findings from our literature review, particularly, the principles from the Goal Setting Theory by Locke and Latham [ ]. Miller et al [ ] stated that combining distal goals with proximal goals is particularly effective because proximal goals are perceived as an important step to achieving personally important distal goals. Locke and Latham [ ] explained that specific goals increase self-efficacy and improve performance. Hence, the app incorporated a goal setting function that included proximal, specific goals related to the 4 behavioral factors. The motivation to change behavior is intended to arise from the goal to reduce the risks of CVD and T2DM, which is both a distal goal [ ] and the behavior outcome of the intervention. Users had to self-set their behavioral goals, which, according to Locke and Latham [ ], increases their self-efficacy compared with assigned goals. There is no goal related to body weight as the studies by Nothwehr and Yang [ ] and Shilts et al [ ] have shown that more specific goals such as diet and physical activity lead to better results than body weight. Regarding diet-related behavior change, Atkins and Michie [ ] outlined that focusing on a specific diet-related target behavior was more effective than focusing on the whole diet. In a study by Rohde et al [ ], when asked to rate different food categories, participants voted fruits, vegetables, and sugary drinks as “easy-to-track.” Although whole grains play a significant role in a healthy diet, Foster et al [ ] showed in an Australian survey that the general population had poor understanding of the subject. Hence, we assumed that comprehensive education on the subject would be required if it was to be incorporated into the app. The decision to track only sugary drink consumption and not discretionary food consumption was based on findings from 2 studies. Sui et al [ ] reported that consumption of discretionary beverages has stronger correlation with high BMI in Australian adults than discretionary foods. Furthermore, Grieger et al [ ] showed that raising fruit and vegetable intake can reduce discretionary food intake by subsidizing one for the other. Guided by these findings, we selected fruits, vegetables, and sugary drinks as the diet-related target behaviors.
To support users in their goal setting, the app displayed the last tracked values and offered a range of values for each goal to select from (eg, for vegetables, between 1-5 serves per day). The former helped people to set achievable goals, whereas the latter was consistent with the Australian guidelines. Further support for goal setting could be found in the educational module. To ensure that every user set their goals at least once, they were directed to the goal setting module directly after completing the registration process. Regarding physical activity, users set 2 goals—step count and exercise. This provided users with both daily and weekly goals. Gouveia et al  have shown with physical activity that by using a default setting, people may keep this as their goal, even if they could achieve a more ambitious goal. In contrast, not everyone may be able to achieve the guideline recommendations, as argued by Kwasnicka et al [ ]. Therefore, users could choose from a wide range of values that allowed for personalized and flexible goals, which Kwasnicka et al [ ] argued to be important features in physical activity promotion. In the app, users could select that they did not drink any sugary or alcoholic drinks, which would automatically exclude these from the tracking function. Otherwise, they could select a value from the provided range. The smoking feature was personalized according to the smoking status that the users specified during the registration process.
In the health measures module (), users could track their behavior and receive feedback on their progress toward the self-set goals. Locke and Latham [ ] stated that the combination of single goal feedback with summary feedback has shown to be more effective than one of them alone. In the context of the app, the summary feedback (ie, feedback on the behavior outcome) was in the form of risk scores (ie, risk of CVD and T2DM), whereas the single goal feedback (ie, feedback on the four behaviors: smoking, alcohol, diet, and physical activity) was displayed in the health measures module. Each tracked goal was symbolized by an icon surrounded by a circle. The circle showed the progress. With each step that brought the user closer to their goal, a part of the circle turned yellow. A fully colored circle indicated that the self-set goal had been achieved. For positive behaviors (eg, serves of fruits), the circle turned green, and for negative behaviors (eg, sugary drinks), the circle turned red. Two types of in-app push notifications encouraged self-reward and graded tasks (ie, increased the difficulty of the goal over time). First, when users achieved their weekly goals, they received a message encouraging them to reward themselves for their success (“You achieved your weekly goals, well done. Think of a way how you can reward yourself for that.”). The message addressed the incentivization intervention function and aimed to motivate users and increase their self-regulation, as postulated by Locke and Latham [ ]. Second, when the users achieved the goals in 3 consecutive weeks, a message would pop up to encourage them to set a more ambitious goal (“You achieved your weekly goals 3 times in a row, well done. It’s time to set a more challenging goal.”). This addressed the enablement intervention function and was based on 2 principles. First, Locke and Latham [ ] advocated for difficult but attainable goals. Second, Gordon et al [ ] found that success in the first week of trying to achieve a new goal is highly determinant of the overall success toward this goal. Graphs showed users their behavior over time ( ).
The educational module () contained 5 videos explaining how different risk factors could increase an individual’s risk of developing CVD and T2DM, the difference between modifiable and nonmodifiable risk factors, and behavioral and biomedical risk factors. Each video played for approximately 1 minute, was in plain language, and included captions. Furthermore, for each behavior (smoking, alcohol, diet, and physical activity), there were links to external websites. These websites were Australian and contained evidence-based information about healthy lifestyle. The information was provided to help users to formulate strategies to attain their goals, for example, quit lines for smoking cessation, recipes for a healthy diet, and exercise instructions for a home workout. An infographic ( ) provided a quick overview of the guideline recommendations. This module also included the user guide and a short video that introduced the app.
Usability Testing Results
We conducted the usability tests between May 2021 and July 2021. In the second round of usability testing, we did not identify any major issues. Hence, we concluded the testing after the second round. A total of 12 individuals provided consent to participate in the study. Of these 12 individuals, 2 (17%) individuals were lost to follow-up and were not included in the analysis. The participants who completed the usability testing were, on average, aged 58 (SD 8) years, ranging from 47 to 67 years. Of the 10 participants, 2 (20%) participants identified as men and 8 (80%) identified as women. Of the 10 participants, 6 (60%) participants owned an iOS phone and 4 (40%) owned an Android phone. When asked about their app experience on a scale of 1 to 5 (1=very unexperienced and 5=very experienced), the average response was 4 (SD 0.9). In the first round, we identified a technical issue that prevented 30% (3/10) of the participants from completing the registration process.presents the results of the System Usability Scale. Totally, 71% (5/7) of the participants who did not encounter the issue rated the usability of the app above average (ie, score >68 [ ]). The median response for ease of use was strong agreement. The median response for confidence in using the app, frequent app use, and quickly learning to use the app was agreement. The median response for inconsistencies in the app, cumbersome use, and the need to learn much before using the app was disagreement. The median response for the app being unnecessarily complex and requiring technical support for its use was strong disagreement. There were mixed results regarding how well the various functions in the app were integrated (median response was neutrality).
None of the participants faced issues while installing the app. All of them stated that the process was easy and quick. Those who did not experience the technical issue during the registration process said that the process was easy and quick. Participants said that it took them from <1 minute to couple of minutes to download the app and <5 minutes to register. During the interviews, the following issues regarding functionality were identified. A participant mentioned the need to adjust the font size for people with impaired vision. This functionality was already available, but we added an explanation to the user guide about how to adjust the font size through the phone settings. Another participant considered it “self-defeating” to have an extra file for the user guide. Hence, we integrated the user guide into the educational module of the app. In response to that participant’s comments, we included a short video in the educational module that explained the app’s features and their purposes. Regarding language and clarity, we changed some icons and wording that the participants found unintuitive. For example, we changed the tick symbol to a return arrow and used the wording “tap to register” instead of “register.” Another finding regarding language and clarity was the ambiguity about the intended use of the app. A participant wanted the information directly in the app instead of the extra user guide. Another participant explained that it was not clear how often they were supposed to enter their health measures. The participants in the user testing were only asked to download the app and complete the registration process and not to use it for a long period. Therefore, we had not provided them specific information about the frequency of use. For future users, we elaborated on the intended use of the app in the user guide and highlighted that we recommended regular use in the short introductory video.
|Statement||Strongly agree, n (%)||Agree, n (%)||Neutral, n (%)||Disagree, n (%)||Strongly disagree, n (%)|
|I think that I would like to use this app frequently.||0 (0)||5 (71)||1 (14)||1 (14)||0 (0)|
|I found the app unnecessarily complex.||0 (0)||1 (14)||1 (14)||0 (0)||5 (71)|
|I thought the app was easy to use.||4 (57)||1 (14)||1 (14)||1 (14)||0 (0)|
|I think that I would need the support of a technical person to be able to use this app.||0 (0)||1 (14)||0 (0)||1 (14)||5 (71)|
|I found the various functions in this app were well integrated.||1 (14)||2 (29)||1 (14)||3 (43)||0 (0)|
|I thought there was too much inconsistency in this app.||0 (0)||1 (14)||1 (14)||3 (43)||2 (29)|
|I would imagine that most people would learn to use this app very quickly.||1 (14)||4 (57)||1 (14)||1 (14)||0 (0)|
|I found the app very cumbersome to use.||0 (0)||1 (14)||1 (14)||2 (29)||3 (43)|
|I felt very confident using the app.||3 (43)||3 (43)||0 (0)||1 (14)||0 (0)|
|I needed to learn a lot of things before I could get going with this app.||0 (0)||0 (0)||1 (14)||3 (43)||3 (43)|
Regarding the content, a few participants expressed interest in the risk scores that were being calculated in the app. A participant stated the following:
And yet, it showed up that I was at moderate risk of getting diabetes in the next five years, and I thought: ‘What on Earth is that based on?’ and it undermined my confidence in the app.
To show that the risk scores were from credible sources, we included links to the websites for the risk scores in the educational module. Furthermore, some participants wanted to see time trends for the health measure. In response to their comments, we included a graphical display for each health measure that showed the progress over time. A participant expressed confusion about the external websites that we linked to in the education section. Another participant suggested a summary of the most important information about the health behaviors in the app in a visually appealing form. In response to these comments, we added some information about the external websites to the user guide and instructional video. In addition, we added an infographic to the educational module that summarized the guideline recommendations regarding the 4 behaviors. A few participants commented on the blood pressure and lipid levels that were required for the registration. Comments from the participants include the following:
I couldn‘t answer my cholesterol levels. I couldn’t remember them.”
Why are they only asking about HDL? And why aren’t they asking about LDL?
Another participant explained the following regarding the registration process:
...my only thoughts when I was doing it that some people, uhm, wouldn’t know what a systolic or a diastolic pressure was and so that may be something that you may need. A little explanation of what that is.
We had already anticipated that users might not know their blood pressure or cholesterol levels. Hence, we included an option to use average values instead for the registration. The interviews further highlighted an issue that led us to add 2 educational videos explaining the relationship between disease risk, blood pressure, and cholesterol.
During the interviews, 3 of the participants mentioned commercial apps. Totally, 1 of them commented positively on the risk score module, but criticized that commercial apps would be better at incentivizing the user to continue by showing them how changes in their behavior influenced their risk and by providing incentives when the user achieved their target behavior. The remaining 2 participants said that many commercial apps automatically tracked many daily features, and concluded that this might not be required for our app. Comments from the participants include the following:
There’s lots of different apps in the market, isn’t there, to collect health data like that on a daily basis and monitor it. I don’t know if you need to go down that track of providing a trend, given that there’s so many other competitors in the market.
You know some of the fitness apps or whatever that I’ve been on they have actually almost too, too much stuff. I mean, I think this app is, is very good for kind of, you know, kind of like the basics.
Similarly, another participant explained the following:
I don’t know what your demographic for the app is, but my parents are in their 90s and I think at least one of them would be able to, to use it, with a bit of help.
We developed an app that will form part of an intervention for the prevention of CVD and T2DM. The app’s role in the intervention will be to make users aware of their disease risk and to engage them in healthy behavior. We developed the app around the principles of BCW to achieve a robust app construct. In total, we incorporated 12 behavior change techniques into the app to increase the capability, opportunity, and motivation of users to change their behavior. During the usability testing, participants ranked the usability of the app above average, based on the System Usability Scale. They stated that the app was easy and quick to download, basic in design, and easy to use. We used the participants’ feedback to eliminate technical errors and adapt the app to their wishes and needs. Regarding the intervention, we do not anticipate that every user will adopt the ideal behaviors as described by the guidelines. For example, we do not expect that simply by using the app, a heavy drinker will stop consuming alcohol, a person who is obese will achieve normal weight, or a smoker will quit smoking. However, even small changes in behavior can decrease an individual’s risk for CVD and T2DM. In addition, we do not consider the app as a stand-alone tool. Instead, we anticipate that app users will learn about their disease risk, risk behavior, and the connection between the 2 and that the app will help them seek information about where to receive help if needed (eg, from their GP or through support programs).
Comparison With Previous Studies
A similar study from Singapore that targeted coronary heart disease prevention via an app measured risk awareness, knowledge of risk factors, perceived stress levels, and heart-related lifestyle measures as outcomes . Jiang et al [ ] concluded that the intervention increased risk awareness and disease knowledge and the effects persisted for at least 6 months. They did not measure disease risk or incidence as outcomes [ ]. The intervention of Jiang et al [ ] differed from ours, as it focused on a 28-day time frame in which participants additionally received daily SMS text messages. In addition, the app included a stress management module, and the focus of the app was on written educational content including short quizzes [ , ]. The app features that we implemented were more diverse, including goal setting and tracking of different behavioral risk factors. Redfern et al [ ] recruited Australians who are at moderate to high risk of CVD via GPs for their digital health intervention for CVD prevention. Similarities between their intervention and ours were that participants could learn about the relationship between CVD risk and their lifestyle, were encouraged to talk to their GP about these topics, and could set goals and monitor their lifestyle behavior [ ]. Differences were that their intervention also focused on medication adherence and included data input from the electronic health record [ ]. Redfern et al [ ] concluded that the intervention was not successful at improving medication adherence, which was the primary outcome.
Plotnikoff et al  developed an app-based intervention for T2DM prevention in Australia. In contrast to ours, a noteworthy proportion of their intervention was delivered in person in the form of cognitive training and exercise classes [ ]. This limits the ability of the intervention to be scaled up. Block et al [ ] developed a fully automated digital intervention for T2DM prevention in people who are prediabetic. The program consisted of weekly tailored goal setting and tracking of behaviors for the first 6 months and fortnightly for the following 6 months [ ]. The intervention led to improved diabetes biomarkers and overall decreased T2DM risk [ ]. In addition, it positively affected diet-related and physical activity–related behaviors [ ]. The intervention differed from ours in that it included behavioral support for stress and sleep in addition to physical activity, diet, and weight loss [ ]. It also comprised a website, automated phone calls, and emails [ ]. Another difference was that it included social comparison features such as team competitions [ ]. The theoretical base for competitions is the social upward comparison [ ]. According to Spohrer et al [ ], the social upward comparison theory is not compatible with the protection motivation theory because, in combination, they would lead to negative effects. We focused on aspects of the protection motivation theory. More specifically, the risk assessment module targets threat appraisal and the other modules target coping appraisal.
Implications and Future Research
We designed the app as simple as possible, so that it could be a tool for laypeople to use on their own. Ideally, it should encourage users to recognize their risks and make lifestyle-related changes without the direct need for medical or technical support. However, if they are at high risk of developing CVD or T2DM, engaging with the app should alert users and encourage them to seek help from their GP. We believe this is what sets our study apart from previous studies, which has tended to focus on people at high risk, includes the involvement of health care providers, or both. A recent systematic review of mobile health apps for the management of chronic conditions by Cucciniello et al  showed that the studies with additional human-led components did not have higher likelihood of positive effects on the outcomes for those in the intervention group. However, we believe that a few points should be considered when there is no direct involvement of health care professionals in the intervention. These include the appropriate promotion and uptake of the intervention to ensure that those who are likely to benefit are aware of and have access to it. In addition, the intervention should be designed such that the users who are at high risk will use it with medical supervision. Currently, we are in the process of evaluating the feasibility of this app-based intervention. Depending on the results of the feasibility study, we intend to conduct a study to evaluate the effectiveness of the app.
Strength and Limitations
A strength of our app was that the development process was guided by scientific evidence, with a focus on the APEASE criteria. We provided a detailed description of the theoretical principles and design considerations, which showed transparency as opposed to the It Seemed Like A Good Idea At The Time principle . This enabled the research team to understand which app features might be effective in changing the user’s behavior. It also allows other researchers to replicate this study. Another strength was that we included feedback from potential users in the development process. A limitation was that the intervention focused on changes that were needed in the person rather than in the environment. The BCW from which we built the theoretical base comprised 9 intervention functions. We did not address 4 functions, such as coercion, restriction, environmental restructuring, and modeling, which, according to Michie et al [ ], focus on external influences. Our app-based intervention focused on the personal agency of the participants. We limited diet-related risk factors to vegetables, fruits, and sugary drinks, which could potentially undermine the importance of other diet aspects, such as salt and whole grain intake. However, this was a conscious choice based on previous studies, which suggested that vegetables, fruits, and sugary drinks were easier to track than other diet-related behaviors. Another limitation was that the app relies on user input. It does not automatically collect information, for example, step count or data from the electronic health record. We made these choices owing to reliability and privacy issues.
This paper describes the theoretical framework, design process, and usability testing of an app that will form the basis of an intervention for the primary prevention of CVD and T2DM. The app addressed the 3 behavior components, capability, opportunity, and motivation, which are core components of the BCW. In the usability testing, the participants rated the apps’ usability as above average, according to the System Usability Scale. Most participants found the app easy to use, and they thought that most people would learn to use the app quickly. They also showed interest in using it frequently. After the user testing, some additional functions requested by the participants were integrated into the app. For example, a short introductory video and graphs that show the health measures over time were included. Next, we will use the revised version of the app that resulted from this design process and usability testing in a feasibility study.
This study was supported by a joint stipend from the University of New South Wales and the Commonwealth Scientific and Industrial Research Organisation. Furthermore, the authors would like to acknowledge the work of Karen Harrap (senior software engineer) and Derek Ireland (team leader) of the software engineering team, both at the Australian e-Health Research Centre, for providing their expertise and translating the theoretical framework and design concept into a viable product.
VHB participated in the research design, conceptualization, and theoretical development of the app and writing of the manuscript. MV, MB, and MH contributed to the research design, conceptualization, and theoretical development of the app and revision of the manuscript. All the authors provided final approval for the version to be published.
Conflicts of Interest
Additional information on the 4 behavioral risk factors, design principles, and evidence for the effectiveness of certain behavior change techniques.PDF File (Adobe PDF File), 103 KB
Android version of the user guide.PDF File (Adobe PDF File), 838 KB
Interview guide.PDF File (Adobe PDF File), 229 KB
- GBD 2017 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018 Nov 10;392(10159):1789-1858 [FREE Full text] [CrossRef] [Medline]
- GBD 2019 Risk Factors Collaborators. Global burden of 87 risk factors in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet 2020 Oct 17;396(10258):1223-1249 [FREE Full text] [CrossRef] [Medline]
- Australian Burden of Disease Study 2018 – Key findings. Australian Institute of Health and Welfare. 2021 Aug 15. URL: https://www.aihw.gov.au/reports/burden-of-disease/burden-of-disease-study-2018-key-findings/contents/about [accessed 2021-11-15]
- Milne-Ives M, Lam C, De Cock C, Van Velthoven MH, Meinert E. Mobile apps for health behavior change in physical activity, diet, drug and alcohol use, and mental health: systematic review. JMIR Mhealth Uhealth 2020 Mar 18;8(3):e17046 [FREE Full text] [CrossRef] [Medline]
- Palmer M, Sutherland J, Barnard S, Wynne A, Rezel E, Doel A, et al. The effectiveness of smoking cessation, physical activity/diet and alcohol reduction interventions delivered by mobile phones for the prevention of non-communicable diseases: a systematic review of randomised controlled trials. PLoS One 2018 Jan 5;13(1):e0189801 [FREE Full text] [CrossRef] [Medline]
- Marcolino MS, Oliveira JA, D'Agostino M, Ribeiro AL, Alkmim MB, Novillo-Ortiz D. The impact of mHealth interventions: systematic review of systematic reviews. JMIR Mhealth Uhealth 2018 Jan 17;6(1):e23 [FREE Full text] [CrossRef] [Medline]
- Romeo A, Edney S, Plotnikoff R, Curtis R, Ryan J, Sanders I, et al. Can smartphone apps increase physical activity? Systematic review and meta-analysis. J Med Internet Res 2019 Mar 19;21(3):e12053 [FREE Full text] [CrossRef] [Medline]
- Lunde P, Nilsson BB, Bergland A, Kværner KJ, Bye A. The effectiveness of smartphone apps for lifestyle improvement in noncommunicable diseases: systematic review and meta-analyses. J Med Internet Res 2018 May 04;20(5):e162 [FREE Full text] [CrossRef] [Medline]
- Buss VH, Leesong S, Barr M, Varnfield M, Harris M. Primary prevention of cardiovascular disease and type 2 diabetes mellitus using mobile health technology: systematic review of the literature. J Med Internet Res 2020 Oct 29;22(10):e21159 [FREE Full text] [CrossRef] [Medline]
- Rubinstein A, Miranda JJ, Beratarrechea A, Diez-Canseco F, Kanter R, Gutierrez L, GISMAL group. Effectiveness of an mHealth intervention to improve the cardiometabolic profile of people with prehypertension in low-resource urban settings in Latin America: a randomised controlled trial. Lancet Diabetes Endocrinol 2016 Jan;4(1):52-63. [CrossRef] [Medline]
- Gore MO, Krantz MJ, Albright K, Beaty B, Coronel-Mockler S, Bull S, et al. A controlled trial of mobile short message service among participants in a rural cardiovascular disease prevention program. Prev Med Rep 2019 Mar;13:126-131 [FREE Full text] [CrossRef] [Medline]
- Muntaner-Mas A, Vidal-Conti J, Borràs PA, Ortega FB, Palou P. Effects of a WhatsApp-delivered physical activity intervention to enhance health-related physical fitness components and cardiovascular disease risk factors in older adults. J Sports Med Phys Fitness 2017;57(1-2):90-102. [CrossRef] [Medline]
- Bender MS, Cooper BA, Flowers E, Ma R, Arai S. Filipinos Fit and Trim - a feasible and efficacious DPP-based intervention trial. Contemp Clin Trials Commun 2018 Dec;12:76-84 [FREE Full text] [CrossRef] [Medline]
- Block G, Azar KM, Romanelli RJ, Block TJ, Hopkins D, Carpenter HA, et al. Diabetes prevention and weight loss with a fully automated behavioral intervention by email, Web, and mobile phone: a randomized controlled trial among persons with prediabetes. J Med Internet Res 2015 Oct 23;17(10):e240 [FREE Full text] [CrossRef] [Medline]
- Fischer HH, Fischer IP, Pereira RI, Furniss AL, Rozwadowski JM, Moore SL, et al. Text message support for weight loss in patients with prediabetes: a randomized clinical trial. Diabetes Care 2016 Aug;39(8):1364-1370. [CrossRef] [Medline]
- Fukuoka Y, Gay CL, Joiner KL, Vittinghoff E. A novel diabetes prevention intervention using a mobile app: a randomized controlled trial with overweight adults at risk. Am J Prev Med 2015 Aug;49(2):223-237 [FREE Full text] [CrossRef] [Medline]
- Ramachandran A, Snehalatha C, Ram J, Selvam S, Simon M, Nanditha A, et al. Effectiveness of mobile phone messaging in prevention of type 2 diabetes by lifestyle modification in men in India: a prospective, parallel-group, randomised controlled trial. Lancet Diabetes Endocrinol 2013 Nov;1(3):191-198. [CrossRef] [Medline]
- Arens JH, Hauth W, Weissmann J. Novel app- and Web-supported diabetes prevention program to promote weight reduction, physical activity, and a healthier lifestyle: observation of the clinical application. J Diabetes Sci Technol 2018 Jul;12(4):831-838 [FREE Full text] [CrossRef] [Medline]
- Redfern J, Coorey G, Mulley J, Scaria A, Neubeck L, Hafiz N, et al. A digital health intervention for cardiovascular disease management in primary care (CONNECT) randomized controlled trial. NPJ Digit Med 2020 Sep 10;3:117 [FREE Full text] [CrossRef] [Medline]
- Duff OM, Walsh DM, Furlong BA, O'Connor NE, Moran KA, Woods CB. Behavior change techniques in physical activity eHealth interventions for people with cardiovascular disease: systematic review. J Med Internet Res 2017 Aug 02;19(8):e281 [FREE Full text] [CrossRef] [Medline]
- Carraça E, Encantado J, Battista F, Beaulieu K, Blundell J, Busetto L, et al. Effective behavior change techniques to promote physical activity in adults with overweight or obesity: a systematic review and meta-analysis. Obes Rev 2021 Jul;22 Suppl 4:e13258 [FREE Full text] [CrossRef] [Medline]
- Villinger K, Wahl DR, Boeing H, Schupp HT, Renner B. The effectiveness of app-based mobile interventions on nutrition behaviours and nutrition-related health outcomes: a systematic review and meta-analysis. Obes Rev 2019 Oct;20(10):1465-1484 [FREE Full text] [CrossRef] [Medline]
- Kaner EF, Beyer FR, Garnett C, Crane D, Brown J, Muirhead C, et al. Personalised digital interventions for reducing hazardous and harmful alcohol consumption in community-dwelling populations. Cochrane Database Syst Rev 2017 Sep 25;9:CD011479 [FREE Full text] [CrossRef] [Medline]
- Qin Y, Wang X, Namkoong K. A meta-analysis of the overall effect of mHealth physical activity interventions for weight loss and the moderating effect of behavioral change theories, techniques, and mobile technologies. Mob Media Commun 2021 Nov 16;10(2):337-359. [CrossRef]
- Black N, Johnston M, Michie S, Hartmann-Boyce J, West R, Viechtbauer W, et al. Behaviour change techniques associated with smoking cessation in intervention and comparator groups of randomized controlled trials: a systematic review and meta-regression. Addiction 2020 Nov;115(11):2008-2020. [CrossRef] [Medline]
- Michie S, West R, Sheals K, Godinho CA. Evaluating the effectiveness of behavior change techniques in health-related behavior: a scoping review of methods used. Transl Behav Med 2018 Mar 01;8(2):212-224 [FREE Full text] [CrossRef] [Medline]
- Noble N, Paul C, Turon H, Oldmeadow C. Which modifiable health risk behaviours are related? A systematic review of the clustering of Smoking, Nutrition, Alcohol and Physical activity ('SNAP') health risk factors. Prev Med 2015 Dec;81:16-41. [CrossRef] [Medline]
- Geller K, Lippke S, Nigg CR. Future directions of multiple behavior change research. J Behav Med 2017 Feb;40(1):194-202. [CrossRef] [Medline]
- Tombor I, Shahab L, Brown J, Crane D, Michie S, West R. Development of SmokeFree Baby: a smoking cessation smartphone app for pregnant smokers. Transl Behav Med 2016 Dec;6(4):533-545 [FREE Full text] [CrossRef] [Medline]
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council Guidance. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008 Sep 29;337:a1655 [FREE Full text] [CrossRef] [Medline]
- Collins LM, Baker TB, Mermelstein RJ, Piper ME, Jorenby DE, Smith SS, et al. The multiphase optimization strategy for engineering effective tobacco use interventions. Ann Behav Med 2011 Apr;41(2):208-226. [CrossRef] [Medline]
- Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 2011 Apr 23;6:42. [CrossRef] [Medline]
- Intergovernmental Committee on Drugs. National Tobacco Strategy 2012–2018: a strategy to improve the health of Australians by reducing smoking rates. Department of Health, Australian Government. 2012. URL: https://www.health.gov.au/resources/publications/national-tobacco-strategy-2012-2018 [accessed 2021-11-15]
- Australian guidelines to reduce health risks from drinking alcohol. National Health and Medical Research Council, Australian Government. 2020. URL: https://www.nhmrc.gov.au/about-us/publications/australian-guidelines-reduce-health-risks-drinking-alcohol [accessed 2021-11-15]
- Australian dietary guidelines. Department of Health and Aging, National Health and Medical Research Council, Australian Government. 2013. URL: https://www.health.gov.au/sites/default/files/australian-dietary-guidelines.pdf [accessed 2022-02-14]
- Physical activity and exercise guidelines for all Australians. Department of Health, Australian Government. 2021 May 07. URL: https://tinyurl.com/2jywfrux [accessed 2021-11-15]
- Tuomilehto J, Lindström J, Eriksson JG, Valle TT, Hämäläinen H, Ilanne-Parikka P, Finnish Diabetes Prevention Study Group. Prevention of type 2 diabetes mellitus by changes in lifestyle among subjects with impaired glucose tolerance. N Engl J Med 2001 May 03;344(18):1343-1350. [CrossRef] [Medline]
- Knowler WC, Barrett-Connor E, Fowler SE, Hamman RF, Lachin JM, Walker EA, Diabetes Prevention Program Research Group. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med 2002 Feb 07;346(6):393-403 [FREE Full text] [CrossRef] [Medline]
- Hooper L, Summerbell CD, Higgins JP, Thompson RL, Capps NE, Smith GD, et al. Dietary fat intake and prevention of cardiovascular disease: systematic review. BMJ 2001 Mar 31;322(7289):757-763 [FREE Full text] [CrossRef] [Medline]
- Simons-Morton DG, Calfas KJ, Oldenburg B, Burton NW. Effects of interventions in health care settings on physical activity or cardiorespiratory fitness. Am J Prev Med 1998 Nov;15(4):413-430. [CrossRef] [Medline]
- Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013 Aug;46(1):81-95. [CrossRef] [Medline]
- National Vascular Disease Prevention Alliance. Guidelines for the management of absolute cardiovascular disease risk 2012. Stroke Foundation. 2012. URL: https://informme.org.au/Guidelines/Guidelines-for-the-assessment-and-management-of-absolute-CVD-risk [accessed 2021-11-15]
- General practice management of type 2 diabetes. The Royal Australian College of General Practitioners. 2016. URL: https://static.diabetesaustralia.com.au/s/fileassets/diabetes-australia/5d3298b2-abf3-487e-9d5e-0558566fc242.pdf [accessed 2021-11-15]
- Guidelines for preventive activities in general practice. 9th edition. The Royal Australian College of General Practitioners. 2018. URL: https://www.racgp.org.au/clinical-resources/clinical-guidelines/key-racgp-guidelines/view-all-racgp-guidelines/guidelines-for-preventive-activities-in-general-pr/preamble/introduction [accessed 2021-11-15]
- Australian Burden of Disease Study: impact and causes of illness and death in Australia 2015. Australian Institute of Health and Welfare. 2019 Jun 13. URL: https://www.aihw.gov.au/reports-data/health-conditions-disability-deaths/burden-of-disease/data [accessed 2021-11-15]
- National Health Survey: first results, 2017-18. Australian Bureau of Statistics. 2019. URL: https://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/4364.0.55.0012017-18?OpenDocument [accessed 2021-11-15]
- Van Rhoon L, Byrne M, Morrissey E, Murphy J, McSharry J. A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions. Digit Health 2020 Mar 24;6:2055207620914427. [CrossRef] [Medline]
- Garnett C, Crane D, West R, Brown J, Michie S. Identification of behavior change techniques and engagement strategies to design a smartphone app to reduce alcohol consumption using a formal consensus method. JMIR Mhealth Uhealth 2015 Jun 29;3(2):e73 [FREE Full text] [CrossRef] [Medline]
- McCrabb S, Baker AL, Attia J, Skelton E, Twyman L, Palazzi K, et al. Internet-based programs incorporating behavior change techniques are associated with increased smoking cessation in the general population: a systematic review and meta-analysis. Ann Behav Med 2019 Feb 01;53(2):180-195. [CrossRef] [Medline]
- Arch A, Abou-Zahra S, Henry SL. Older Users Online: WAI Guidelines Address Older Users Web Experience. Web Accessibility Initiative. 2009. URL: https://www.w3.org/WAI/posts/2009/older-users-online [accessed 2022-02-14]
- Senior Surfers: Diverse levels of digital literacy among older Australians. National Seniors Australia. 2019 Aug. URL: https://nationalseniors.com.au/uploads/NationalSeniorsAustralia-SeniorSurfer-ResearchReport-2019.pdf [accessed 2022-02-14]
- Helbostad JL, Vereijken B, Becker C, Todd C, Taraldsen K, Pijnappels M, et al. Mobile health applications to promote active and healthy ageing. Sensors (Basel) 2017 Mar 18;17(3):622 [FREE Full text] [CrossRef] [Medline]
- Morey SA, Stuck RE, Chong AW, Barg-Walkow LH, Mitzner TL, Rogers WA. Mobile health apps: improving usability for older adult users. Ergon Des 2019 Apr 01;27(4):4-13. [CrossRef]
- Schroé H, Van Dyck D, De Paepe A, Poppe L, Loh WW, Verloigne M, et al. Which behaviour change techniques are effective to promote physical activity and reduce sedentary behaviour in adults: a factorial randomized trial of an e- and m-health intervention. Int J Behav Nutr Phys Act 2020 Oct 07;17(1):127 [FREE Full text] [CrossRef] [Medline]
- Asbjørnsen RA, Smedsrød ML, Solberg Nes L, Wentzel J, Varsi C, Hjelmesæth J, et al. Persuasive system design principles and behavior change techniques to stimulate motivation and adherence in electronic health interventions to support weight loss maintenance: scoping review. J Med Internet Res 2019 Jun 21;21(6):e14265 [FREE Full text] [CrossRef] [Medline]
- Ageing. Healthtalk Australia. 2021. URL: https://www.healthtalkaustralia.org/experience-ageing/overview/ [accessed 2021-11-15]
- Michie S, Atkins L, Gainforth HL. Changing behaviour to improve clinical practice and policy. In: Dias PC, Gonçalves A, Azevedo A, Lobo F, editors. Novos desafios, novas competencias: contributos atuais da psicologia. Braga, Portugal: Axioma - Publicações da Faculdade de Filosofia; 2016:41-60.
- Varnfield M, Karunanithi M, Lee CK, Honeyman E, Arnold D, Ding H, et al. Smartphone-based home care model improved use of cardiac rehabilitation in postmyocardial infarction patients: results from a randomised controlled trial. Heart 2014 Nov;100(22):1770-1779 [FREE Full text] [CrossRef] [Medline]
- Varnfield M, Redd C, Stoney RM, Higgins L, Scolari N, Warwick R, et al. M♡THer, an mHealth system to support women with gestational diabetes mellitus: feasibility and acceptability study. Diabetes Technol Ther 2021 May;23(5):358-366 [FREE Full text] [CrossRef] [Medline]
- Gonzalez-Garcia M, Budd M, Varnfield M, Rogers R, Karunanithi M, Tan KS. PD-Buddy: mobile technology can provide support in homebased peritoneal dialysis to patients with chronic kidney disease. In: Proceedings of the 25th Australian National Health Informatics Conference. 2017 Presented at: HIC '17; August 6-9, 2017; Brisbane, Australia.
- Molich R. A commentary of “How to specify the participant group size for usability studies: a practitioner’s guide” by R. Macefield. J Usability Stud 2010;5(3):124-128 [FREE Full text]
- Stinson JN, Jibb LA, Nguyen C, Nathan PC, Maloney AM, Dupuis LL, et al. Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer. J Med Internet Res 2013 Mar 08;15(3):e51 [FREE Full text] [CrossRef] [Medline]
- Jibb LA, Cafazzo JA, Nathan PC, Seto E, Stevens BJ, Nguyen C, et al. Development of a mHealth real-time pain self-management app for adolescents with cancer: an iterative usability testing study [formula: see text]. J Pediatr Oncol Nurs 2017;34(4):283-294. [CrossRef] [Medline]
- System Usability Scale (SUS). Usability.: U.S. Department of Health & Human Services; 2021. URL: https://www.usability.gov/how-to-and-tools/methods/system-usability-scale.html [accessed 2021-11-15]
- Neubeck L, Coorey G, Peiris D, Mulley J, Heeley E, Hersch F, et al. Development of an integrated e-health tool for people with, or at high risk of, cardiovascular disease: the Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) web application. Int J Med Inform 2016 Dec;96:24-37. [CrossRef] [Medline]
- Anderson KM, Odell PM, Wilson PW, Kannel WB. Cardiovascular disease risk profiles. Am Heart J 1991 Jan;121(1 Pt 2):293-298. [CrossRef] [Medline]
- Chen L, Magliano DJ, Balkau B, Colagiuri S, Zimmet PZ, Tonkin AM, et al. AUSDRISK: an Australian type 2 diabetes risk assessment tool based on demographic, lifestyle and simple anthropometric measures. Med J Aust 2010 Feb 15;192(4):197-202. [CrossRef] [Medline]
- Lipkus IM, Hollands JG. The visual communication of risk. J Natl Cancer Inst Monogr 1999(25):149-163. [CrossRef] [Medline]
- Edwards A, Elwyn G, Mulley A. Explaining risks: turning numerical data into meaningful pictures. BMJ 2002 Apr 06;324(7341):827-830 [FREE Full text] [CrossRef] [Medline]
- Ancker JS, Senathirajah Y, Kukafka R, Starren JB. Design features of graphs in health risk communication: a systematic review. J Am Med Inform Assoc 2006;13(6):608-618 [FREE Full text] [CrossRef] [Medline]
- Reading Turchioe MR, Grossman LV, Myers AC, Baik D, Goyal P, Masterson Creber RM. Visual analogies, not graphs, increase patients' comprehension of changes in their health status. J Am Med Inform Assoc 2020 May 01;27(5):677-689 [FREE Full text] [CrossRef] [Medline]
- Lipkus IM. Numeric, verbal, and visual formats of conveying health risks: suggested best practices and future recommendations. Med Decis Making 2007;27(5):696-713. [CrossRef] [Medline]
- Peters E, Hibbard J, Slovic P, Dieckmann N. Numeracy skill and the communication, comprehension, and use of risk-benefit information. Health Aff (Millwood) 2007;26(3):741-748. [CrossRef] [Medline]
- Spiegelhalter D, Pearson M, Short I. Visualizing uncertainty about the future. Science 2011 Sep 09;333(6048):1393-1400. [CrossRef] [Medline]
- Garcia-Retamero R, Cokely ET. Designing visual aids that promote risk literacy: a systematic review of health research and evidence-based design heuristics. Hum Factors 2017 Jun;59(4):582-627. [CrossRef] [Medline]
- Damman OC, Vonk SI, van den Haak MJ, van Hooijdonk CM, Timmermans DR. The effects of infographics and several quantitative versus qualitative formats for cardiovascular disease risk, including heart age, on people's risk understanding. Patient Educ Couns 2018 Aug;101(8):1410-1418. [CrossRef] [Medline]
- Tao D, Yuan J, Qu X. Presenting self-monitoring test results for consumers: the effects of graphical formats and age. J Am Med Inform Assoc 2018 Aug 01;25(8):1036-1046 [FREE Full text] [CrossRef] [Medline]
- Gigerenzer G, Edwards A. Simple tools for understanding risks: from innumeracy to insight. BMJ 2003 Sep 27;327(7417):741-744 [FREE Full text] [CrossRef] [Medline]
- Locke EA, Latham GP. Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. Am Psychol 2002 Sep;57(9):705-717. [CrossRef] [Medline]
- Miller RB, Brickman SJ. A model of future-oriented motivation and self-regulation. Educ Psychol Rev 2004 Mar;16(1):9-33. [CrossRef]
- Nothwehr F, Yang J. Goal setting frequency and the use of behavioral strategies related to diet and physical activity. Health Educ Res 2007 Aug;22(4):532-538. [CrossRef] [Medline]
- Shilts MK, Horowitz M, Townsend MS. Goal setting as a strategy for dietary and physical activity behavior change: a review of the literature. Am J Health Promot 2004;19(2):81-93. [CrossRef] [Medline]
- Atkins L, Michie S. Designing interventions to change eating behaviours. Proc Nutr Soc 2015 May;74(2):164-170. [CrossRef] [Medline]
- Rohde A, Duensing A, Dawczynski C, Godemann J, Lorkowski S, Brombach C. An app to improve eating habits of adolescents and young adults (Challenge to Go): systematic development of a theory-based and target group-adapted mobile app intervention. JMIR Mhealth Uhealth 2019 Aug 12;7(8):e11575 [FREE Full text] [CrossRef] [Medline]
- Foster S, Beck E, Hughes J, Grafenauer S. Whole grains and consumer understanding: investigating consumers' identification, knowledge and attitudes to whole grains. Nutrients 2020 Jul 22;12(8):2170 [FREE Full text] [CrossRef] [Medline]
- Sui Z, Wong WK, Louie JC, Rangan A. Discretionary food and beverage consumption and its association with demographic characteristics, weight status, and fruit and vegetable intakes in Australian adults. Public Health Nutr 2017 Feb;20(2):274-281. [CrossRef] [Medline]
- Grieger JA, Wycherley TP, Johnson BJ, Golley RK. Discrete strategies to reduce intake of discretionary food choices: a scoping review. Int J Behav Nutr Phys Act 2016 May 06;13:57 [FREE Full text] [CrossRef] [Medline]
- Gouveia R, Karapanos E, Hassenzahl M. How do we engage with activity trackers? A longitudinal study of Habito. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2015 Sep Presented at: UbiComp '15; September 7-11, 2015; Osaka, Japan p. 1305-1316. [CrossRef]
- Kwasnicka D, Ntoumanis N, Sniehotta FF. Setting performance and learning goals is useful for active and inactive individuals, if goals are personalized and flexible: commentary on Swann et al. (2020). Health Psychol Rev 2021 Mar;15(1):51-55. [CrossRef] [Medline]
- Gordon M, Althoff T, Leskovec J. Goal-setting and achievement in activity tracking apps: a case study of MyFitnessPal. In: Proceedings of the 2019 World Wide Web Conference. 2019 May Presented at: WWW '19; May 13-17, 2019; San Francisco, CA, USA p. 571-582. [CrossRef]
- Jiang Y, Jiao N, Nguyen HD, Lopez V, Wu VX, Kowitlawakul Y, et al. Effect of a mHealth programme on coronary heart disease prevention among working population in Singapore: a single group pretest-post-test design. J Adv Nurs 2019 Sep;75(9):1922-1932. [CrossRef] [Medline]
- Wang W, Zhang H, Lopez V, Wu VX, Poo DC, Kowitlawakul Y. Improving awareness, knowledge and heart-related lifestyle of coronary heart disease among working population through a mHealth programme: study protocol. J Adv Nurs 2015 Sep;71(9):2200-2207. [CrossRef] [Medline]
- Plotnikoff RC, Wilczynska M, Cohen KE, Smith JJ, Lubans DR. Integrating smartphone technology, social support and the outdoor physical environment to improve fitness among adults at risk of, or diagnosed with, type 2 diabetes: dindings from the 'eCoFit' randomized controlled trial. Prev Med 2017 Dec;105:404-411. [CrossRef] [Medline]
- Block G, Azar KM, Romanelli RJ, Block TJ, Palaniappan LP, Dolginsky M, et al. Improving diet, activity and wellness in adults at risk of diabetes: randomized controlled trial. Nutr Diabetes 2016 Sep 19;6(9):e231 [FREE Full text] [CrossRef] [Medline]
- Spohrer K, Fallon M, Hoehle H, Heinzl A. Designing effective mobile health apps: does combining behavior change techniques really create synergies? J Manag Inf Syst 2021 Aug 06;38(2):517-545. [CrossRef]
- Cucciniello M, Petracca F, Ciani O, Tarricone R. Development features and study characteristics of mobile health apps in the management of chronic conditions: a systematic review of randomised trials. NPJ Digit Med 2021 Oct 05;4(1):144 [FREE Full text] [CrossRef] [Medline]
|APEASE: affordability, practicability, effectiveness and cost-effectiveness, acceptability, side effects and safety, and equity|
|BCW: Behaviour Change Wheel|
|COM-B: capability, opportunity, and motivation for behavior change|
|CVD: cardiovascular disease|
|GP: general practitioner|
|iOS: iPhone Operating System|
|T2DM: type 2 diabetes mellitus|
Edited by A Kushniruk; submitted 19.11.21; peer-reviewed by J Meyer, J Ayre; comments to author 03.02.22; revised version received 26.02.22; accepted 26.03.22; published 10.05.22Copyright
©Vera Helen Buss, Marlien Varnfield, Mark Harris, Margo Barr. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 10.05.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.