Background: Health professionals’ perceptions of persuasive design techniques for use in technological solutions to improve health workforce capability have not been previously explored.
Objective: This study aims to explore rural health professionals’ perceptions of health workforce capability and persuasive design techniques; and translate these into recommendations for designing a health workforce capability app to increase their impact and usefulness.
Methods: Qualitative interviews with 13 rural health professionals were conducted. Subsequently, 32 persuasive techniques were used as a framework to deductively analyze the data. Persuasive design technique domains were Primary Task Support, Dialog Support, System Credibility Support, Social Support, and Cialdini’s Principles of Persuasion.
Results: Persuasive design techniques can be applied across the factors that influence health workforce capability including health and personal qualities; competencies and skills; values, attitudes, and motivation; and factors that operate outside of work and at the team, organizational, and labor market levels. The majority of the 32 persuasive design techniques were reflected in the data from the interviews and led to recommendations as to how these could be translated into practice, with the exception of scarcity. Many suggestions and persuasive design techniques link back to the need for tailored and localized solutions such as the need for country-specific–based evidence, the wish for localized communities of practice, learning from other rural health professionals, and referral pathways to other clinicians. Participants identified how persuasive design techniques can optimize the user experience to help meet rural health professionals needs for more efficient systems to improve patient access to care, quality care, and to enable working in interprofessional team-based care. Social inclusion plays a vital role for health professionals, indicating the importance of the Social Support domain of persuasive techniques. Overall, health professionals were open to self-monitoring of their work performance and some professionals used wearables to monitor their health.
Conclusions: Rural health professionals’ perceptions of health workforce capability informed which persuasive design techniques can be used to optimize the user experience of an app. These were translated into recommendations for designing a health workforce capability app to increase likelihood of adoption. This study has also contributed to the further validation of the Persuasive Systems Design model through empirically aligning elements of the model to increase persuasive system content and functionality with real-world applied data, in this case the health workforce capability of rural health professionals. Our findings confirm that these techniques can be used to develop a future prototype of an app that may assist health professionals in improving or maintaining their health workforce capability which in turn may increase recruitment and retention in rural areas. Health professionals need to be central during the design phase. Interventions are needed to provide a supportive environment to rural and remote health professionals to increase their rural health workforce capability.
Globally, people in rural areas are disadvantaged when it comes to seeking health care [, ]. This manifests as poorer health outcomes and has, in part, been directly attributed to persistent recruitment and retention challenges in rural areas [ ]. Additionally, high levels of burnout are reported among rural health professionals across the globe [ , ]. For example, 47.6% of rural Chinese primary health care workers reported moderate burnout and 3% severe burnout [ ].
Health Workforce Capability
There is a growing body of evidence that aims to address the barriers to, and enablers of, recruiting and retaining a rural health workforce [, ]. For example, multiple initiatives are aimed at incentivizing work in rural areas for health professionals [ ], and others demonstrate the potential effectiveness of regulatory change such as increased scope of practice for nurse practitioners [ ]. Specifically, workforce capability plays a significant role in the attraction, recruitment, and maintenance of health practitioners in a rural setting [ ]. Health workforce capability describes “a health professional’s overall ability to fulfil their health care role” [ ]. Health workforce capability can be defined as “the intersection between individual capacity and ability to adapt to work considering the whole of health care context, including the labor market, population needs, family, schools, partner, education, and social options.” Thus, health workforce capability is a complex construct that consists of much more than just clinical competence. It is a holistic concept that considers the multidirectional interactions both internal and external to the individual practitioner [ - ]. Internally, it considers interactions between an individual practitioner’s personal and professional spheres, both of which are complicated domains that vary greatly between individuals. Externally, workforce capability takes into account the interactions between the professional and their environment, including their employer, co-workers, and social circles. For rural health professionals, it also takes into account patients, clients, and the communities they serve. Despite the clear importance of understanding capability in the context of the rural health workforce, it is an underexplored area.
Digital Technology and Health Workforce Capability
Before the role of technology in the clinical context was forced into the limelight due to COVID-19 , rural health professionals globally had long been using digital solutions [ ] to bridge large geographical distances. Complementary to this, recent studies have demonstrated technology’s role in supporting the workforce capability of the rural health workforce [ ]. Indeed, it has been suggested that employing technology solutions in the rural context can improve the capability and retention of rural health professionals [ ]. What then are the appropriate solutions to improve health workforce capability? To answer this question, the authors of this paper undertook 2 previous studies [ , ].
The first study investigated the wants and needs of the rural health workforce to improve their capability and the potential role of technology in assisting them . Theories around the acceptability of information technology solutions, including the Mobile Application Rating Scale (MARS) [ ], the Technology Acceptance Model (TAM) [ ], and the Health Information Technology Acceptance Model (HITAM) [ ] were used to address this question. The study identified 7 factors that had the greatest influence on health workforce capability: health and personal qualities; competencies and skills; values, attitudes, and motivation; and factors that operate outside of work and at the team, organizational, and labor market levels.
The second study consisted of reviewing apps in Google Play Store and technical design elements that allow the technology solution to fulfill the wants and needs of health professionals . Persuasive design techniques can be used to encourage people to use a product or to take certain actions or to make certain positive decisions. Persuasion is a complex concept and can use computer-human or computer-mediated approaches. Computer-human approaches are computer driven, yet need to be programmed, so the developer has a critical role to play and has a large impact on design. Computer-mediated persuasion [ ] occurs through using digital social communication tools. In the health context, this could include, for example, chats, interactive webinars, and virtual clinics where health professionals would persuade each other. Specifically, this second study investigated persuasive design techniques used to improve use of existing capability-building–related apps, and offered some basic suggestions for incorporating these techniques into a health workforce capability app to increase its persuasiveness. It used theories on persuasive design elements that influence behavioral change, including the Persuasive System Design Model (PSD Model) [ ] and Cialdini’s Principles of Persuasion [ , ]. A total of 32 persuasive design techniques were studied clustered by 5 design features categories: Primary Task Support, Dialog Support, System Credibility Support, Social Support, and Cialdini’s Principles. The design techniques are further explained in - . While several studies have tried to understand the 2 questions independently [ , ], to our knowledge, none have examined improving health workforce capability on their own, let alone mapping the 2 together. To fill this gap, this study will map persuasive design techniques with the health workforce capability needs and perspectives of rural health professionals within the context of improving health workforce capability.
|Primary task support||Persuasive design technique definitiona||Quote qualitative interviews health professionals||Implementation examples|
|Reduction||A system that reduces complex behavior into simple tasks helps users perform the target behavior, and it may increase the benefit-to-cost ratio of a behavior.|
|Tunneling||Using the system to guide users through a process or experience provides opportunities to persuade along the way.|
|Tailoring||Information provided by the system will be more persuasive if it is tailored to the potential feeds, interests, personality, usage context, or other factors relevant to a user group.|
|Personalization||A system that offers personalized content or services has a greater capability for persuasion.|
|Self-monitoring||A system that keeps track of one’s own performance or status supports the user in achieving goals.|
|Simulation||Systems that provide simulations can persuade by enabling users to observe immediately the link between cause and effect.|
|Rehearsal||A system providing means with which to rehearse a behavior can enable people to change their attitudes or behavior in the real world.|
|Dialog support||Persuasive design technique definitiona||Quote qualitative interviews health professionals||Implementation examples|
|Praise||By offering praise, a system can make users more open to persuasion.|
|Rewards||Systems that reward target behaviors may have great persuasive powers.|
|Reminders||If a system reminds users of their target behavior, the users will more likely achieve their goals.|
|Suggestion||Systems offering fitting suggestions will have greater persuasive powers.|
|Similarity||People are more readily persuaded through systems that remind them of themselves in some meaningful way.|
|Liking||A system that is visually attractive for its users is likely to be more persuasive.|
|Social role||If a system adopts a social role, users will more likely use it for persuasive purposes.|
aSource: Oinas-Kukkonen and Harjumaa Marja .
bGP: general practitioner.
|System credibility support||Persuasive design technique definitiona||Quote qualitative interviews health professionals||Implementation examples|
|Trustworthiness||A system that is viewed as trustworthy will have increased powers of persuasion.|
|Expertise||A system that is viewed as incorporating expertise will have increased powers of persuasion.|
|Surface credibility||People make initial assessments of the system credibility based on a firsthand inspection.|
|Real-world feel||A system that highlights people or organization behind its content or services will have more credibility.|
|Authority||A system that leverages roles of authority will have enhanced powers of persuasion.|
|Third-party endorsements||Third-party endorsements, especially from well-known and respected sources, boost perceptions on system credibility.|
|Verifiability||Credibility perceptions will be enhanced if a system makes it easy to verify the accuracy of site content via outside sources.|
aSource: Oinas-Kukkonen and Harjumaa Marja .
bGP: general practitioner.
|Social support||Persuasive design technique definitiona||Quote qualitative interviews health professionals||Implementation examples|
|Social learning||A person will be more motivated to perform a target behavior if (s)he can use a system to observe others performing the behavior.|
|Social comparison||System users will have a greater motivation to perform the target behavior if they can compare their performance with that of others.|
|Normative influence||A system can leverage normative influence or peer pressure to increase the likelihood that a person will adopt a target behavior.|
|Social facilitation||System users are more likely to perform target behavior if they discern via the system that others are performing the behavior along with them.|
|Cooperation||A system can motivate users to adopt a target attitude or behavior by leveraging human beings’ natural drive to co-operate.|
|Competition||A system can motivate users to adopt a target attitude or behavior by leveraging human beings’ natural drive to compete.|
|Recognition||By offering public recognition for an individual or group, a system can increase the likelihood that a person/group will adopt a target behavior.|
aSource: Oinas-Kukkonen and Harjumaa Marja .
bGP: general practitioner.
|Cialdini||Persuasive design technique definitiona||Quote qualitative interviews health professionals||Implementation examples|
|Commitment/consistency||Are a pair of interrelated attributes in the sense that people often adhere (consistently) to their significant choices (commitments).||And if there was an app that actually tracked what you were doing, tracked your KPIs, then that information could be funnelled back through middle management, but also the higher levels as well [ID number 17, female, occupational therapist]|
|Scarcity||Causes people to almost panic out of the fear that something will disappear or become unavailable, so they make an intent effort to acquire or preserve it.||—c|
|Social proof||Explains the human tendency to look around at others in society for reinforcement and direction in taking action.||But I was thinking...that when we couldn\'t save the little boy that died in front of our eyes, could digitally, or through Zoom or something, could we have gotten a trauma counsellor, instead of us driving over to |
|Reciprocity||Describes a human desire to make others feel appreciated by responding in ways that return good gestures.||So it’s also very interesting just clinically – seeing what people are doing or their approaches to similar cases, so we encourage that kind of discussion a lot. [ID number 10, female speech pathologist]|
This study aims to:
- explore rural health professionals’ perceptions of health workforce capability and persuasive design techniques;
- translate these into recommendations for designing a health workforce capability app to increase their impact and usefulness.
A qualitative analysis of interview data used in the 2 previous studies was conducted to evaluate how persuasive design techniques can be used to build a health workforce capability app. As outlined in Ramsden et al , 13 rural health professionals were interviewed about their understanding of health workforce capability, their perceived needs to improve health workforce capability, and how technological solutions can assist in improving rural health workforce capability and intentions to remain in rural practice.
Interview questions were informed by the work of Anderson and co-workers  and Jeffrey and colleagues [ ] in terms of focusing on technology acceptance and behavior change. Persuasive strategy questions were informed by the work of Oyebode and co-workers [ ] as described above.
Recruitment occurred via the telephone, in person, or through the Rural Health Pro newsletter. Rural Health Pro is a digital platform that links health professionals and organizations interested in rural health . A plain language statement was emailed to participants expressing interest. An interview time was established after consent. Telephone interviews were conducted by RR and SP, digitally recorded, and transcribed. Transcripts were not returned to participants for comment, verification, or correction. Upon transcription, identifying information was removed. The transcribed interviews were managed in MS Word. Both RR and SP have extensive experience in conducting qualitative interviews. SP has lived rurally since 2005 and worked in rural health research since 2006. RR has worked in rural health since 2012. These experiences have shaped the interviewers desire to improve rural health workforce.
Participants included general practitioners (GPs), a pain specialist, nurses, and allied health practitioners. The group comprised 4 males and 9 females. Age ranged between 39 and 65 years, with an average age of 51 years. Interviews took on average 46 minutes (range 29-98 minutes). The interviewers had no previous existing relationship with the participants. RR and SP undertook reflexivity exercises during the data collection to ensure rigor, in addition to the checks during analysis listed below. RR and SP recognized that they have an interest in improving rural health workforce capability using technology. Both ethical and practical issues that arose during the interviews were discussed between the 2 interviewers to ensure alignment and rigor when conducting the interviews.
Our systematic review of persuasive apps that are related to health workforce capability generated examples of how the various techniques can be used in practice to develop a health workforce capability app. Subsequently, the 32 persuasive techniques [, - ] were used as a framework to deductively analyze the data. Descriptions of the 32 persuasive design techniques are listed in - .
Verbatim transcripts were coded manually. The first 2 recordings were coded separately by 2 authors (KP and RR). The remaining 11 interviews were coded primarily by authors KP and SP. RR and AT were involved in coding transcripts and reaching consensus. SP and KP subsequently used the coded data to analyze and identify quotes to support the development of suggestions for how persuasive design techniques can be used to build a health workforce capability digital tool. The findings were discussed and checked by RR and AT to ensure validity of the data. JB provided specific feedback on user design and discussions were held to further shape the data interpretation.
The study was approved by the North Coast NNSWLHD Human Research Ethics Committee (2020/ETH03020).
- show how health professionals’ needs and suggestions are reflected in the 32 persuasive design techniques that can be used when building a health workforce capability online support tool.
The results are displayed by the main domains in persuasive design techniques: Primary Task Support, Dialog Support, System Credibility Support, Social Support, and Cialdini’s Principles of Persuasion. The researchers analyzed the qualitative data to identify how health professionals’ perspectives could be translated into recommendations for designing a health workforce capability app to increase their persuasiveness. The majority of the 32 persuasive design techniques were reflected in the quotes from the interviews and led the researchers to a recommendation as to how these could be translated into practice, with the exception of competition and scarcity.
Primary Task Support techniques, for example, may be utilized to guide health professionals through a clinical protocol or professional development activity by reducing complex behaviors into simple tasks, tailoring evidence-based information to needs, and personalizing content (eg, Australian guidelines). Further, techniques such as simulation would enable health professionals to observe other clinicians performing procedures and rehearse behaviors themselves, accommodating health professionals’ ideas of how they would like to use an app to build capability.
Health professional perspectives also highlighted the importance of credibility for app design. For example, under the domain System Credibility Support () a GP mentioned “Like pharmaceutical ads...I think it’s going to the dark side really a bit” [ID number 13, female, GP], suggesting that consideration should be given to developing criteria about which type of ads would be acceptable. Simultaneously, given the importance placed by the participants on addressing various social needs to improve health workforce capability, designers would need to consider eligibility criteria for joining online communities to safeguard the quality of online community members (System Credibility Support).
Giving feedback to support health professionals to move toward their goals, such as rewards and praise in the form of continuing professional development points or encouragement for goal-directed behaviors, is a suggested design feature. Further, reminders about target behavior, such as taking a break, and suggestions related to capability-supporting behaviors that are suitable or appropriate to health professionals were examples provided that align with Dialog Support techniques.
Further analyses revealed that health professional needs and digital solutions mapped against persuasive techniques broadly align with the factors affecting health workforce capability. The analyses are summarized in. Based on health practitioners’ insights and suggestions, practical recommendations have also been presented in . It is noted that the findings are not necessarily mutually exclusive given the complexity. For example, depending on the level and governance, the recommendation about communities of practices on team level can also be viewed as Primary Task Support and Social Support if, for example, a national or state body would manage the communities of practice. The recommendation relating to organizational level refers to the fact that referrals and closed-loop communication are professional activities that form part of the practitioner’s primary scope of work. Thus, this function would be simplifying a process that already takes place and falls within the definition of reduction. The design techniques appear acceptable to rural health professionals and can be incorporated into future apps that focus on improving or maintaining health workforce capability across several areas.
|Factors influencing health workforce capability and persuasive design technique||Persuasive design feature domain||Recommendations provided by participants that can be linked with health workforce capability factors|
|Health and personal qualities|
|Primary Task Support|
|Competencies and skills|
|System Credibility Support|
|Values, attitudes, and motivation|
|System Credibility Support|
|Factors outside of work|
|Primary Task Support|
|Primary Task Support|
aGP: general practitioner.
A qualitative analysis of semistructured interviews with rural health professionals was undertaken to investigate the alignment of user perceptions of health workforce capability with persuasive design techniques. These findings were then translated into recommendations for designing a health workforce capability app to increase their impact and usefulness (-6). The authors found that the persuasive design techniques can be applied across the factors that influence health workforce capability including health and personal qualities, competencies and skills, values, attitudes, and motivation, as well as factors that operate outside of work, and at the team, organizational, and labor market levels. There is alignment between the needs of health professionals and persuasive design techniques. The health professionals’ interviews clearly identified the persuasive design techniques that were appealing. Many suggestions link back to the need for credible, tailored, and localized solutions such as having Australian-based evidence, localized communities of practice, access to learning from other rural health professionals, and referral pathways to other clinicians.
It was also clear that rural health professionals in our study aspired to have more efficient systems to improve patient access to care, quality care, and to enable working in interprofessional team-based care. Persuasive design techniques that can assist here are, for example, tailoring, reduction, social roles of digital technology, and authority. These techniques can influence team and organizational factors to improve health workforce capability. Indeed, the need for team-based care is an old adage, and barriers and facilitators to this have been explored over time . Notably, our previous work [ ] demonstrated that COVID-19 has accelerated the capability and willingness for team-based care arrangements in primary and remote care through using digital solutions. This study has clear recommendations as to how persuasive design techniques can be used in digital solutions to further improve patient access, quality care, and promote team-based care. For example, one GP recommended that GPs should be able to book an appointment with a local allied health professional with an online booking system (Primary Task Support) so the patient does not have to do that. This ensures the patient is booked in (tunneling) and reduces the risk of the patient not following up with their allied health appointment, thereby enhancing the quality of care as well as the GPs own health workforce capability. Ways in which this system may improve a GPs and allied health professional’s workforce capability are reduced red tape and less inconvenience in making referrals; improved close loop communication that reduces the workload for the GP and the allied health professional; better outcomes for patient that leads to further reduction in the future workload; positive feedback to GPs and allied health professionals (recognition); and improved job satisfaction for both allied health professionals and GPs as closer relationships may be developed overtime.
Overall, health professionals were open to self-monitoring of their work performance and some already regularly use wearables to monitor their health. Although using wearables to measure work performance and stress levels at work has potential , it is still in its infancy. A 2019 randomized controlled trial showed that using wearables to improve emergency physicians’ well-being through monitoring their pulse rate while at work was feasible but not recommended [ ]. The authors found that the biosensor could not provide reliable estimates of metrics of interest in their study context. However, Ferdous and colleagues [ ] found that patterns of smartphone app usage were correlated with stress levels in work environments and thus recommended that these could be used to measure stress at work. Alhasani et al [ ] presented the possibility of an app that creates behavioral data, based on self-report and sensors, that can be analyzed in real-time to predict users’ needs and provide tailored interventions for the user. In the case of rural health workforce capability, if a health professional’s heart rate variability indicates high stress levels derived from a sensor, the app can recommend a predetermined meditation session. The behavioral data can also be merged with self-reports generated by in-app journals or self-report. Synthesizing and interpreting this information using machine learning could improve the accuracy of predictions and hence provide more targeted and personalized recommendations for the user.
Social inclusiveness is a known contributing factor for improved health workforce capability . Therefore, computer-mediated persuasion [ ] using digital social communication tools that have a real-world feel and demonstrate that there are real people and experts (surface credibility) behind a digital tool or content is important. Health professionals will be more likely to engage with a digital system if they know that real people and respected experts are involved. In a study of nurses, Mayer and colleagues [ ] found that approximately half of the nurses used apps for their work and stressed the importance of apps being validated by credible bodies before they can be used in practice. Expert design, content, and involvement will lead to greater system credibility and also improved social connections and support channels for rural health professionals. This stresses the importance of policies to ensure high-quality membership of digital communities and, thus, system credibility (persuasive design technique) to guarantee impact and engagement with the tool. Ultimately, the quality of the online membership can have an impact on usage and engagement of health workforce capability apps. Therefore, factors to consider when developing an app are closed or open membership; verification of credentials; potential publication of credentials; role and credentials of moderators; and rules of participation.
Validation of Persuasive Systems Design Model and Persuasive Design Theories
Our work has contributed to the further validation of the Persuasive Systems Design model  through empirically aligning elements of the model to increase persuasive system content and functionality with real-world applied data, in this case the health workforce capability of rural health professionals. We analyzed the use context through identifying problem domain–dependent features which are the factors that influence health workforce capability [ ]. We also analyzed the user context that are the user-dependent features such as goals or motivations of health professionals [ ]. Subsequently, we analyzed the technology context through identifying the technology-dependent features for health workforce capability–related apps [ ]. In this paper, we then described example software apps and implementations. Some of these examples are relatively novel in addressing health workforce capability needs such as geolocation of health professionals in a rural area to reduce social isolation [ ] and some are already used in varying capability building–related apps such as easy access to clinical guidelines to increase medical performance [ ] in apps such as UptoDate [ ] or online communities such as Rural Health Pro [ ]. Rural Health Pro is a digital platform that connects people and organizations who care about keeping rural communities healthy. Notably, we found that sometimes comments made by health professionals could apply to several persuasive design techniques. This is confirmed by feedback from user experience designers that, for example, tailoring and personalization are often the same in practice.
Study Strengths and Limitations
Overall, the alignment between the needs of health professionals and persuasive design techniques to improve health workforce capability through optimizing the user experience means that we can support rural health professionals which may lead to greater retention [, , ]. The above findings are important as they confirm that these techniques can be used to develop a future prototype that may assist health professionals in improving or maintaining their health workforce capability which in turn may increase recruitment and retention in rural areas. However, we stress that it is unlikely that a single app could cover all persuasive design techniques explored in this paper, nor do we imply a health workforce capability app should do so. For example, if we built a health workforce capability app for GPs, it likely would not have the ability to book appointments for allied health professionals as that may not make sense from a product or commercial perspective to bundle and market those features together. Additionally, a system itself needs to provide enough value and solve a problem for health professionals, regardless of the number of persuasive techniques built into the app. A very useful system without any or a limited number of persuasive techniques could still improve health professional capability. Persuasive design techniques are only one element to consider in the development process of a health workforce capability app. For example, usability heuristics are useful to develop an easy-to-use interface, marketing campaigns may be necessary to promote uptake of a health workforce capability app, and service blueprinting can be used to guide the whole process.
It is important to consider the ethic factors in using persuasive strategies. Jacobs  explored the use and ethical concerns of persuasive technology for vulnerable people. While health professionals are not considered vulnerable overall, they can be vulnerable when working in isolation for long periods and this may be exacerbated by the COVID-19 pandemic and other natural disasters such as bushfires, droughts, and floods. Their strong sense of responsibility and commitment to their patients and community make health professionals potentially more vulnerable over time as their energy levels and resources are depleted [ ]. However, the point of using persuasive design techniques in digital solutions is to make health professionals feel more capable when they are feeling overstretched or underconfident. The implication is that thorough consideration of, and trialing of, appropriate strategies is important.
Vulnerability can be caused by intrinsic factors (within a person) or can be caused by external factors that are situational specific . An example of situational vulnerability is that an app may be designed for support but reduces the health professional’s privacy, and increases feelings of being watched. It may also increase their feelings of anxiety about the potential for negative consequences if their capability goes down, and they could potentially start to feel powerless. The ethical concept of autonomy may be violated in this example.
The design should ensure that the user, in this case, the health professional, can easily retract their consent to take part to avoid coercion . This should include the ability to withdraw any data already submitted or collected about them. This will have the secondary function of improving engagement as the participants are assured of the ability to cease their involvement at any time. For example, a rural health professional when highly capable may be willing to partake in an app that measures their capability; however, if they feel less capable for any reason, it may well be that they become increasingly vulnerable. Completing a rating on a regular basis can make people aware of their shortcomings and have unintended consequences [ ], such as exacerbated feelings of incompetence or reinforcing unconscious incompetence.
Jacobs  recommends that to safeguard against unintended consequences, technology designers should understand the experiences, interests, and needs of prospective users through inclusion of vulnerable populations at every stage of the design process. Our study described here has done that and is the first step in the co-design process. Designers need to ensure they understand the values, needs, and interests that are important to the users. A second safeguard is to take into account real-life contexts, which can reduce unintended negative consequences [ ]. The latter issue demonstrates the importance of considering a digital tool as part of an integrated approach that includes a real-life support component. Finally, there must be a clear and continuous feedback mechanism where users can identify and raise issues of concern for the developers to remedy.
Organizations developing or managing apps or online communities would need to ensure high-quality online membership. Ethical principles, membership criteria, and policies will need to be developed to ensure mechanisms are in place to ensure members or users genuinely represent the purpose and values of the community.
To design a digital health workforce capability solution, it is important to select and apply an ethical framework that fits the health workforce capability needs and assists in carefully weighing up risks and benefits. Many ethical frameworks exist in the medical research field. They can be disease specific or goal specific such as an ethical framework for COVID-19 contact tracing  or more general such as the work conducted by Tokgöz and co-workers [ ] who developed an ethical framework for health and medical apps based on a systematic review and expert interviews. However, it is ultimately recommended to use an ethical framework that aligns with international standards. Several international standards are available and selection of a standard will depend on the context of the app such as ‘ISO/TS 82304-2:2021 Health software — Part 2: Health and wellness apps — Quality and reliability’ [ ] or ‘the ISO/TS 17033:2019 Ethical claims and supporting information — Principles and requirements’ [ ]. The latter can be used when specific standards are not available or can complement existing standards. It covers principles and requirements for developing and declaring ethical claims.
Given that rural health professionals are often subject to burn out due to isolation, high stress, long working hours, lack of local staff, and limited resources, being able to provide a technology solution with persuasive strategies to boost capability is a positive aspect.
Rural health professionals’ perceptions of health workforce capability informed which persuasive design techniques can be used to optimize the user experience of an app. These were translated into recommendations for designing a health workforce capability app to increase likelihood of adoption. This study has also contributed to the further validation of the Persuasive Systems Design model through empirically aligning elements of the model to increase persuasive system content and functionality with real-world applied data, in this case the health workforce capability of rural health professionals. Our findings confirm that these techniques can be used to develop a future prototype of an app that may assist health professionals in improving or maintaining their health workforce capability, which in turn may increase recruitment and retention in rural areas. Health professionals need to be central during the design phase. Interventions are needed to provide a supportive environment to rural and remote health professionals to increase their rural health workforce capability.
We thank the NIB Foundation for contributing part funding for the analyses of this study. The funder has had no impact on the study design, interpretation, or outcomes of this study. We thank Katie Carlisle for contributing to study design and project management.
SWP, RR, and RC designed the study. SWP, RR, and KP analyzed the qualitative data, with input from AJHT. SWP, RR, AJHT, and KP interpreted study results with input from RC, JB, BE, and ME. AJHT drafted the introduction. SWP drafted the remainder of the initial manuscript with major inputs from RR, RC, AJHT, and KP. JB, ME, and BE provided further content expertise. All authors contributed to developing the study materials, writing the manuscript, and read and approved the final manuscript.
Conflicts of Interest
New South Wales Rural Doctors Network and authors declare an interest in developing the health workforce capability of rural health professionals.
- Angrish S, Sharma M, Bashar M, Tripathi S, Hossain M, Bhattacharya S, et al. How effective is the virtual primary healthcare centers? An experience from rural India. J Family Med Prim Care 2020 Feb;9(2):465-469 [FREE Full text] [CrossRef] [Medline]
- Streeter RA, Snyder JE, Kepley H, Stahl AL, Li T, Washko MM. The geographic alignment of primary care Health Professional Shortage Areas with markers for social determinants of health. PLoS One 2020;15(4):e0231443 [FREE Full text] [CrossRef] [Medline]
- Walsh S, Lyle D, Thompson S, Versace V, Browne L, Knight S, et al. The role of national policies to address rural allied health, nursing and dentistry workforce maldistribution. Medical Journal of Australia 2020;213(11):S18-S22 [FREE Full text]
- Fitzpatrick M, Garsia K, Eyre K, Blackhall C, Pit S. Emotional exhaustion among regional doctors in training and the application of international guidelines on sustainable employability management for organisations. Aust Health Rev 2020 Aug;44(4):609-617. [CrossRef] [Medline]
- Xu W, Pan Z, Li Z, Lu S, Zhang L. Job Burnout Among Primary Healthcare Workers in Rural China: A Multilevel Analysis. Int J Environ Res Public Health 2020 Jan 22;17(3):727 [FREE Full text] [CrossRef] [Medline]
- NSW Rural Doctors Network. 2020-21 Primary health workforce needs assessment. Summary Report. NSW Rural Doctors Network. 2021. URL: https://www.nswrdn.com.au/client_images/2268722.pdf [accessed 2022-03-21]
- Buykx P, Humphreys J, Wakerman J, Pashen D. Systematic review of effective retention incentives for health workers in rural and remote areas: towards evidence-based policy. Aust J Rural Health 2010 Jun;18(3):102-109. [CrossRef] [Medline]
- Yang BK, Johantgen ME, Trinkoff AM, Idzik SR, Wince J, Tomlinson C. State Nurse Practitioner Practice Regulations and U.S. Health Care Delivery Outcomes: A Systematic Review. Med Care Res Rev 2021 Jun;78(3):183-196. [CrossRef] [Medline]
- Martiniuk AL, Colbran R, Ramsden R, Edwards M, Barrett E, O'Callaghan E, et al. Capability ... what's in a word? Rural Doctors Network of New South Wales Australia is shifting to focus on the capability of rural health professionals. Rural Remote Health 2020 Jul;20(3):5633 [FREE Full text] [CrossRef] [Medline]
- Ramsden R, Pit S, Payne K, Tan A, Eames B, Edwards M, et al. Development of a framework to promote rural health workforce capability through digital solutions: A qualitative study of user perspectives. Digital Health 2022:1 (forthcoming)(forthcoming).
- Pit SW, Tan AJH, Ramsden R, Payne K, Freihaut W, Hayes O, et al. Persuasive Design Solutions for a Sustainable Workforce: Review of Persuasive Apps for Real-Time Capability Support for Rural Health Care Professionals. JMIR Mhealth Uhealth 2022 Feb 7;10(2):e33413 [FREE Full text] [CrossRef] [Medline]
- Fisk M, Livingstone A, Pit SW. Telehealth in the Context of COVID-19: Changing Perspectives in Australia, the United Kingdom, and the United States. J Med Internet Res 2020 Jun 09;22(6):e19264 [FREE Full text] [CrossRef] [Medline]
- Ramsden R, Colbran R, Christopher E, Edwards M. The role of digital technology in providing education, training, continuing professional development and support to the rural health workforce. Health Education 2021 Feb 18;122(2):126-149 [FREE Full text] [CrossRef]
- Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015;3(1):e27 [FREE Full text] [CrossRef] [Medline]
- Holden RJ, Karsh B. The technology acceptance model: its past and its future in health care. J Biomed Inform 2010 Feb;43(1):159-172 [FREE Full text] [CrossRef] [Medline]
- Kim J, Park H. Development of a health information technology acceptance model using consumers' health behavior intention. J Med Internet Res 2012;14(5):e133 [FREE Full text] [CrossRef] [Medline]
- Oinas-Kukkonen H, Harjumaa M. Persuasive Systems Design: Key Issues, Process Model, and System Features. Communications of the Association for Information Systems 2009;24(1):28. [CrossRef]
- Cialdini RB. Harnessing the science of persuasion. Harvard Business Review 2001;79(9):72-81 [FREE Full text]
- Hines J. An Analysis of the Use of Robert B. Cialdini's Six Persuasive Techniques in YouTube Videos about Endurance Training/Life Balance. Doctoral Dissertation. Edwardsville, IL: Southern Illinois University; 2021. URL: https://media.proquest.com/media/hms/PFT/2/CPzXJ?_s=gqlPU5iZCw7ZnZPt0YTvgJUkdg0%3D [accessed 2022-03-21]
- Oyebode O, Ndulue C, Alhasani M, Orji R. Persuasive Mobile Apps for Health and Wellness: A Comparative Systematic Review. In: Gram-Hansen S, Jonasen T, Midden C, editors. Persuasive Technology. Designing for Future Change. PERSUASIVE 2020. Lecture Notes in Computer Science, vol 12064. Cham, Switzerland: Springer; 2020:163-181.
- Carolan S, Harris PR, Cavanagh K. Improving Employee Well-Being and Effectiveness: Systematic Review and Meta-Analysis of Web-Based Psychological Interventions Delivered in the Workplace. J Med Internet Res 2017 Jul 26;19(7):e271 [FREE Full text] [CrossRef] [Medline]
- Anderson K, Burford O, Emmerton L. Mobile Health Apps to Facilitate Self-Care: A Qualitative Study of User Experiences. PLoS One 2016;11(5):e0156164 [FREE Full text] [CrossRef] [Medline]
- Jeffrey B, Bagala M, Creighton A, Leavey T, Nicholls S, Wood C, et al. Mobile phone applications and their use in the self-management of Type 2 Diabetes Mellitus: a qualitative study among app users and non-app users. Diabetol Metab Syndr 2019;11:84 [FREE Full text] [CrossRef] [Medline]
- NSW Rural Doctors Network. Rural Health Pro. NSW Rural Doctors Network. 2022. URL: https://www.ruralhealthpro.org/s [accessed 2022-03-21]
- Cromp D, Hsu C, Coleman K, Fishman PA, Liss DT, Ehrlich K, et al. Barriers and facilitators to team-based care in the context of primary care transformation. J Ambul Care Manage 2015;38(2):125-133. [CrossRef] [Medline]
- Hopkins L, Stacey B, Robinson DBT, James OP, Brown C, Egan RJ, et al. Consumer-grade biosensor validation for examining stress in healthcare professionals. Physiol Rep 2020 Jun;8(11):e14454 [FREE Full text] [CrossRef] [Medline]
- Peters GA, Wong ML, Joseph JW, Sanchez LD. Pulse Rate Variability in Emergency Physicians During Shifts: Pilot Cross-Sectional Study. JMIR Mhealth Uhealth 2019 Oct 2;7(10):e13909. [CrossRef] [Medline]
- Ferdous R, Osmani V, Mayora O. Smartphone apps usage patterns as a predictor of perceived stress levels at workplace. 2015 Presented at: 9th International Conference on Pervasive Computing Technologies for Health care (PervasiveHealth); May 20-23, 2015; Istanbul, Turkey p. 225-228. [CrossRef]
- Alhasani M, Mulchandani D, Oyebode O, Orji R. A Systematic Review of Persuasive Strategies in Stress Management Apps. 2020. URL: http://ceur-ws.org/Vol-2662/BCSS2020_paper4.pdf [accessed 2021-09-29]
- Mayer MA, Rodríguez Blanco O, Torrejon A. Use of Health Apps by Nurses for Professional Purposes: Web-Based Survey Study. JMIR Mhealth Uhealth 2019 Nov 01;7(11):e15195 [FREE Full text] [CrossRef] [Medline]
- Dijkstra R, Wensing M, Thomas R, Akkermans R, Braspenning J, Grimshaw J, et al. The relationship between organisational characteristics and the effects of clinical guidelines on medical performance in hospitals, a meta-analysis. BMC Health Serv Res 2006 Apr 28;6:53 [FREE Full text] [CrossRef] [Medline]
- Jacobs N. Two ethical concerns about the use of persuasive technology for vulnerable people. Bioethics 2020 Jun;34(5):519-526 [FREE Full text] [CrossRef] [Medline]
- Smyth J, Pit SW, Hansen V. Can the work ability model provide a useful explanatory framework to understand sustainable employability amongst general practitioners: a qualitative study. Hum Resour Health 2018 Jul 24;16(1):32 [FREE Full text] [CrossRef] [Medline]
- Lo B, Sim I. Ethical Framework for Assessing Manual and Digital Contact Tracing for COVID-19. Ann Intern Med 2021 Mar;174(3):395-400. [CrossRef] [Medline]
- Tokgöz P, Eger H, Funke S, Gutjar A, Nguyen-Thi T, Dockweiler C. Development and presentation of an ethical framework for health and medical apps. Journal of the International Society for Telemedicine and eHealth 2019;16(7):e15-e11 [FREE Full text]
- International Organization for Standardization (ISO). ISO/TS 82304-2:2021. Health software — Part 2: Health and wellness apps — Quality and reliability. ISO. 2021. URL: https://www.iso.org/standard/78182.html [accessed 2022-03-21]
- International Organization for Standardization (ISO). ISO/TS 17033:2019 Ethical claims and supporting information — Principles and requirements. ISO. 2021. URL: https://www.iso.org/standard/29356.html [accessed 2022-03-21]
|GP: general practitioner|
|HITAM: Health Information Technology Acceptance Model|
|KPI: key performance indicator|
|MARS: Mobile Application Rating Scale|
|PSD: Persuasive System Design Model|
|TAM: Technology Acceptance Model|
Edited by G Eysenbach; submitted 20.11.21; peer-reviewed by I Wilson; comments to author 10.12.21; revised version received 11.12.21; accepted 28.12.21; published 02.05.22Copyright
©Sabrina Pit, Robyn Ramsden, Aaron JH Tan, Kristy Payne, James Barr, Benjamin Eames, Mike Edwards, Richard Colbran. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 02.05.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.