The Karma system is currently undergoing maintenance (Monday, January 29, 2018).
The maintenance period has been extended to 8PM EST.

Karma Credits will not be available for redeeming during maintenance.

JMIR Human Factors

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 23.03.18 in Vol 5, No 1 (2018): Jan-Mar

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/8913, first published Sep 07, 2017.

This paper is in the following e-collection/theme issue:

    Original Paper

    General Practitioners’ Attitudes Toward a Web-Based Mental Health Service for Adolescents: Implications for Service Design and Delivery

    1Black Dog Institute, Randwick, Sydney, Australia

    2Faculty of Medicine, University of New South Wales, Sydney, Australia

    Corresponding Author:

    Mirjana Subotic-Kerry, PhD

    Black Dog Institute

    Hospital Road

    Prince of Wales Hospital

    Randwick, Sydney, 2031

    Australia

    Phone: 61 2 9382 8509

    Email:


    ABSTRACT

    Background: Anxiety disorders and depression are prevalent among youth. General practitioners (GPs) are often the first point of professional contact for treating health problems in young people. A Web-based mental health service delivered in partnership with schools may facilitate increased access to psychological care among adolescents. However, for such a model to be implemented successfully, GPs’ views need to be measured.

    Objective: This study aimed to examine the needs and attitudes of GPs toward a Web-based mental health service for adolescents, and to identify the factors that may affect the provision of this type of service and likelihood of integration. Findings will inform the content and overall service design.

    Methods: GPs were interviewed individually about the proposed Web-based service. Qualitative analysis of transcripts was performed using thematic coding. A short follow-up questionnaire was delivered to assess background characteristics, level of acceptability, and likelihood of integration of the Web-based mental health service.

    Results: A total of 13 GPs participated in the interview and 11 completed a follow-up online questionnaire. Findings suggest strong support for the proposed Web-based mental health service. A wide range of factors were found to influence the likelihood of GPs integrating a Web-based service into their clinical practice. Coordinated collaboration with parents, students, school counselors, and other mental health care professionals were considered important by nearly all GPs. Confidence in Web-based care, noncompliance of adolescents and GPs, accessibility, privacy, and confidentiality were identified as potential barriers to adopting the proposed Web-based service.

    Conclusions: GPs were open to a proposed Web-based service for the monitoring and management of anxiety and depression in adolescents, provided that a collaborative approach to care is used, the feedback regarding the client is clear, and privacy and security provisions are assured.

    JMIR Hum Factors 2018;5(1):e12

    doi:10.2196/humanfactors.8913

    KEYWORDS



    Introduction

    Background

    Anxiety and depression are prevalent among adolescents. These disorders are associated with significant disability, including educational failure, poor relationships, and impaired daily functioning [1-3]. If left untreated, adolescents with these issues are more likely to experience chronic mental health problems in adulthood, alongside reduced workforce productivity, lower income, and poorer quality of life [4,5]. Seeking professional help is crucial for early detection, prevention, and treatment [6]. In Australia, general practitioners (GPs) provide the most accessible primary health care for young people [7,8], and are the main clinical services used by adolescents with a mental illness and emotional or behavioral problem [9]. GPs act as a first point of contact in the assessment and management of mental health issues and are well placed to identify mental health issues when youth present for other matters. GPs are a gateway to other services within the health system and facilitate access to rebated psychological therapy and psychiatric assessments. However, GPs face several barriers when treating youth mental health issues. These include inadequate training in the identification and management of adolescent mental health, a lack of confidence in recognizing youth mental health problems, and their consultation skills [10,11]. There is also a need for longer sessions, which are poorly remunerated [10,11]. Additional barriers relating to time constraints and poor linkages with other relevant services have also been reported, particularly among those in rural areas [12,13]. As such, many GPs feel ill-equipped and under-resourced when providing adolescent mental health care.

    Web-based interventions, also known as e-mental health, have emerged as a safe, therapeutically effective, and acceptable referral option for common mental health concerns [14]. The advantages of using internet technology in the treatment of youth mental health have been well documented [1,15,16]. Web-based interventions are cost-effective, supplement standard therapy [17-20], and allow for greater dissemination of psychological treatments as access to the internet bypasses geographical distance, costs, and stigma [1,15,16]. Web-based interventions also improve the flexibility of psychological treatment, as they are available at a time suitable to the person and provide a sense of anonymity [21]. Two recent meta-analyses indicate that Web-based interventions are effective in reducing young people’s symptoms of anxiety and depression, and suggest that Web-based prevention and treatments are a viable alternative to face-to-face care [22,23]. In Australia, this has led to a national training initiative aimed at increasing GPs’ referrals to e-mental health. However, many GPs are still concerned about the use of eHealth. GPs cite complex systems, access issues, and privacy concerns as barriers to implementation in their practice [24,25]. Others have highlighted the lack of evidence and quality control for interventions [26], and the lack of time, technical skills, and financial compensations to implement eHealth properly [27]. In addition, youth living in rural and remote Australia may have limited access to the internet [28,29]. To address these barriers, the Black Dog Institute has designed and developed a Web-based mental health service, Smooth Sailing, to identify and treat anxiety and depression in secondary school students.

    Delivered in the classroom, the Smooth Sailing service is based on the principles of stepped care [30], where the intensity of interventions is matched to individuals’ symptom severity. This service utilizes the internet to register students to a service where their mental health is screened. Using clinically validated algorithms, youth are automatically allocated to one of the four sequential treatment steps based on their symptom severity. Treatment intensity is matched to the step, and ranges from self-directed online psychoeducation and computerized cognitive behavioral therapy to individual face-to-face psychotherapy. The service has an e-monitoring component, in which students are sent mobile phone or email messages to assess their recent mood. In the school context, students who are at risk for suicidality or have severe levels of symptoms are automatically alerted to the school counselor who initiates consultation within 24 to 48 hours. The school counselor is then responsible for assessing risk, triaging, and referring to external support such as a GP, who can facilitate access to rebated psychological services and medication. GPs would then have access to the monitoring and alerting features. However, GPs’ attitudes toward this type of service model are unknown.

    Acceptability research in health services aims to understand the extent to which people delivering or receiving an intervention consider it to be appropriate and suited to their needs, based on either anticipated or experimentation responses [31]. A study of the acceptability of the Smooth Sailing service among school counselors [32] found that personal beliefs, knowledge of e-mental health, internet accessibility, privacy, and confidentiality issues influenced their likelihood of use. Previous research on the adoption of eHealth among GPs has mainly been conducted in relation to adult health services [27]. In general, GPs and adult patients have expressed a positive attitude toward eHealth in adult health services, although GPs have also identified barriers such as time constraints, lack of skills, and lack of financial incentives to implement new ways of working [27]. In contrast, the adoption of new technologies in health care by youth mental health clinicians was less positive. Resistance to technology was based on a preference for face-to-face engagement with young consumers and a belief that the integration of new technology would create extra work in an already under-resourced environment [33]. Additional barriers identified by youth workers were related to skills, training, and concerns around confidentiality and the legal implications of online technology [33]. It is unknown whether GPs working with youth share these same concerns. Understanding the needs of GPs and their attitudes toward a Web-based, stepped care, youth mental health service is vital for designing and delivering high-quality mental health services.

    Study Aims

    This study aimed to examine GPs’ attitudes toward Smooth Sailing—a Web-based, stepped care, mental health service for reducing depression and anxiety among youth. This study will help to identify the factors that may facilitate greater uptake and effectiveness of the proposed service model among GPs, and will help researchers and developers to better understand how e-mental health can be adapted for general practice.


    Methods

    Study Design

    This is a multi-methods study consisting of interviews and an online survey. Ethics approval was obtained from the University of New South Wales (HC154456).

    Participants, Procedure, and Recruitment

    Participants were aged over 18 years, fluent in English, and currently working as a GP in Australia. Recruitment took place between May and June 2016 via the Black Dog Institute website, social media channels, word of mouth, and an electronic direct mail-out to professional networks. The study advertisements invited GPs who were interested in the mental health of young people, the acceptability of providing mental health care to adolescents via the internet, and those wishing to inform the development of an online service. Interested participants contacted the research team and were subsequently provided with a consent form via email. Interview details were arranged via email. All interviews were conducted over the phone and were audiotaped. Interviews were conducted by one of the researchers (KOM) and were approximately 25 minutes in duration. Before the interview, a detailed overview of Smooth Sailing was emailed to participants. The interview also began with a verbal description of the service model and an opportunity to discuss and clarify any aspects of the model. The online survey link was sent to all GPs at the completion of their telephone interview. Participants were reimbursed with an Aus $20 gift voucher. Recruitment ceased when saturation was reached.

    Interview Schedule

    The semistructured interview consisted of the following 4 questions:

    1. What do you think of the proposed online stepped care model?
    2. What do you think about the role of the GP in this model?
    3. Do you have any concerns with this model and suggestions on how we could manage these?
    4. What sort of things would you need to integrate this model into your general practice?

    Survey

    The online survey consisted of 13 questions, with 6 questions assessing participant demographics and background factors including age, gender, state (New South Wales, Australian Capital Territory, Queensland, Victoria, South Australia, Northern Territory, Western Australia, or Tasmania), years working as a GP, mental health training (yes or no), and frequency of seeing adolescent patients (daily, weekly, fortnightly, monthly, or every 3-6 months). Participants were asked to rate the acceptability of the service (eg, how acceptable is this online clinic to you as a GP?) on a 5-point Likert scale ranging from unacceptable (1) to acceptable (5). In addition, participants were asked about the likelihood of integrating a Web-based service into practice (eg, how likely are you to refer patients into the service? and how likely are you to integrate this service into your regular clinical practice?) on a 5-point Likert scale ranging from not at all likely (1) to highly likely (5). Furthermore, 2 questions regarding frequency and type of feedback were asked (If you did refer a young person, how often would you like to receive feedback about your patient’s progress? and What feedback would you want to receive from the online clinic? [answered daily, weekly, fortnightly, monthly, or other]). GPs were asked what types of feedback notifications they would like to receive (registration, improvement, deterioration, suicidality, module completions, nonadherence, or other) and duration of follow-up (once your patient has recovered, how long would you like your patient to be followed up by the service? [answered 1-3 months, 6 months, or 12 months]) with the option of other (free response) to include alternate durations. Finally, GPs were asked if they had any other comments or advice (free response).

    Data Analysis

    The online survey was delivered using the Key Survey platform version 8.13, an online survey tool developed by WorldAPP. Data were then exported to IBM SPSS version 22, and basic descriptives were calculated and reported. Audio recordings of the interviews were transcribed and analyzed using the six phases of Braun and Clarke’s [34] thematic analysis guidelines. First, two researchers (MSK and MA) read through each transcript several times to gain an overview of the interview data before code generation. Second, all data extracts were initially coded, and the search for underlying themes began by combining the emerging codes. Third, all data extracts were classified in relation to the identified themes. This process was repeated for each transcript, and any clear patterns within the data were identified. The themes were then reviewed, and any data extracts that did not fit into the initial themes were once again investigated for identification of different themes. There was discussion on higher-order codes and on points of agreement or disagreement, leading to consensual validation. Final themes were agreed upon through collaborative analysis. Final coder agreement was 80%.


    Results

    Participants

    A total of 13 GPs completed the telephone interview. Of these, 11 completed the online survey and 9 out of the 11 (82%) were female. Participants had a mean age of 51.0 years (standard deviation [SD] 12.16; range: 35-79). The mean number of years that participants had been working was 21 (SD 13.76; range: 4-50). All participants had undertaken additional mental health training. Nearly half of the participants (5/11, 46%) reported having weekly contact with adolescent patients, with less than one-third (3/11, 28%) reporting daily contact.

    Level of Acceptability of the Proposed Service

    All participants reported that the proposed service was entirely (9/11) or slightly (2/11) acceptable. Thematic analyses found that four key themes contributed to GPs’ acceptability of the proposed service (Table 1).

    Tables 2-4 outline GPs’ preferences about the type and frequency of patient feedback and duration of follow-up within the proposed Web-based service.

    As outlined in Table 5, eight themes emerged as potential barriers to the service. These themes were then classified into one of the four main issues: (1) barriers relating to the service model, (2) characteristics of youth patients, (3) environmental factors, and (4) GP characteristics.

    Table 1. Themes contributing to the acceptability of the proposed service model (N=13).
    View this table
    Table 2. Type of patient feedback desired by general practitioners (N=11).
    View this table
    Table 3. Frequency of patient feedback desired by general practitioners (N=11).
    View this table
    Table 4. Duration of follow-up desired by general practitioners (N=11).
    View this table
    Table 5. Potential barriers to the proposed service model (N=13). GPs: general practitioners. CBT: cognitive behavioral therapy.
    View this table

    Likelihood of Referral and Integration Into Clinical Practice

    All GPs reported that they were highly (7/11) or somewhat (4/11) likely to refer youth patients to the proposed Web-based service. Thematic analyses found that two themes influenced likelihood of referral (Table 6).

    All GPs reported they would be highly (6/11) or somewhat (5/11) likely to integrate the proposed Web-based service into their clinical practice. Thematic analyses revealed that six key needs influenced the likelihood of GPs integrating the proposed service (Table 7).

    Table 6. Themes influencing likelihood of referral of the proposed Web-based service (N=13). GPs: general practitioners.
    View this table
    Table 7. General practitioner (GP) needs for service integration (N=13).
    View this table

    Discussion

    Principal Findings

    This study aimed to examine GPs’ attitudes toward a Web-based mental health service for treating depression and anxiety among adolescents. This study also aimed to identify barriers to integrating a Web-based service into clinical practice. This knowledge is important for determining best practice in the field of e-mental health service design and delivery for youth. In this study, most GPs reported that the proposed service was an acceptable type of care because of its focus on early intervention and prevention, the alignment with adolescents’ help-seeking preferences, the provision of anonymity to reduce stigma and ensure privacy, and its delivery in the school setting. These attitudes are consistent with other health workers, who have reported that access to care via the internet overcomes geographical, psychological, and physical barriers, is cost-effective, and a viable adjunct to standard therapy [1,15,16,35,36]. The sense of anonymity of online care somewhat overcomes issues relating to stigma and embarrassment about seeking help for mental health problems, which has previously been identified as the most prominent barrier to help-seeking in young people [37]. The stepped care component of the model was also supported. GPs felt that the proposed service could improve the detection of mental health problems among youth and identify those with subthreshold symptoms who are currently not receiving care. Future evaluations of the service will need to provide evidence to support the effectiveness of such a model in this severity group.

    Factors Influencing Likely Use

    In this study, the GPs identified several issues that may influence the acceptability, both positively and negatively, of the proposed Web-based service. Participants reported that GPs may be concerned that young people using a Web-based service may not receive adequate care, or that some youth may not be able to access the service because of poor internet connectivity. In addition, participants reported that GPs may be worried about data security and privacy. Although this is a common concern of internet-delivered care [24,25,32], participants felt that this could be alleviated by clear delineation of roles and responsibilities within the service alongside robust informed consent procedures with the young person. Additional barriers to acceptability of the proposed service included noncompliance by adolescents and GPs, as well as differences in mental health training and youth experience of GPs. Interestingly, lack of financial incentives for extra consultation time was only mentioned by 3 GPs. This is in contrast to previous research that identified poor financial reimbursement as a major constraint to GPs delivering high-quality youth mental health care [10,13]. These differences in study findings may be because of unique characteristics of the Web-based service (eg, the school counselor being the primary carer, thus reducing the workload of the GP) or because of characteristics of the GPs interviewed (eg, all reported having mental health training, thus the service proposed may not be viewed as an additional burden on time). However, this is purely speculative and future studies would benefit from investigating whether financial incentives increase rates of referral among GPs.

    Importance of Patient Follow-Up and Feedback

    All GPs agreed that they would like feedback on symptom deterioration and suicidality, as well as clinical improvement. This is not surprising, given the significant ethical and legal obligations associated with providing treatment to adolescents. Interestingly, perspectives on the frequency of feedback and duration of follow-up varied. Half of the GPs surveyed wanted fortnightly or monthly feedback, whereas others felt feedback should be dependent on patient progress and/or symptom severity. Over half of the sample felt the duration of follow-up should not exceed 6 to 12 months. These results highlight the importance of monitoring functionality, and a future model of the service should incorporate customizable options for frequency of patient feedback and follow-up to account for GP preferences.

    Likelihood of Referral and Integration Into Clinical Practice

    All GPs reported that they were highly or somewhat likely to refer youth patients to the proposed Web-based mental health service. However, referral was found to be influenced by perceived need and beliefs, such that GPs who do not self-identify as needing assistance in providing care to youth, or those who do not believe in the effectiveness of Web-services, would be unlikely to refer to the proposed service. This is consistent with previous research in which GPs’ attitudes to treatments were largely influenced by their personal beliefs about effectiveness [26,33]. This poses a significant challenge to researchers and policy makers who are attempting to increase GPs’ use of e-mental health. A future trial of the proposed service may need to involve additional pretraining that addresses GP's knowledge and awareness of e-mental health.

    Although the participants reported that they would be likely to integrate the proposed service model into their clinical practice, six key needs were outlined. GPs were more likely to integrate the proposed service if it involved close collaboration with other health care professionals, duty of care and medico-legal implications were clearly addressed, the service encouraged an ongoing relationship with a GP, the quality of information provided to GPs about the service was concise, and if community awareness and promotion of the service, as well as training on how to use the service, was offered. Future trials of the service will need to ensure that GPs have mechanisms of maintaining contact with school counselors, parents, and any additional care providers involved in the treatment of the client. Trial studies of the service may benefit from demonstrations of the online service, alongside case studies and evaluation data to increase the likelihood of GPs recommending and using the service.

    Limitations

    Although this study provides support for the acceptability of a Web-based mental health service for adolescents by GPs across Australia, there were a few limitations. First, it is a small study in which only 13 participants were involved. These findings therefore present only an initial indication of GPs’ attitudes, which would be strengthened by a larger sample size. GPs in this study were not using the proposed service. Thus, the results indicate intention rather than actual behavior. In addition, all participants had undergone additional mental health training and had experience working with young people. Different results may have been found among GPs without this, and future work may be strengthened by targeting different GPs with less training and youth experience. Views may also differ among international samples, where the role of GPs in adolescent mental health care may vary.

    Conclusions and Future Work

    Overall, GPs in this study were open to the proposed service, but have concerns about certain aspects of Web-based care, characteristics of youth and GPs, and accessibility of a Web-based service. These would need to be addressed before GPs will refer or integrate the service into their clinical practice. In future work, researchers and service designers need to consider GPs as end users and evaluate the effects of the proposed service model on GPs’ confidence in delivering youth mental health care and the clinical effectiveness. Key next steps would be a pilot study of the service in primary care settings, alongside a formal evaluation of the effectiveness of the service for improving quality of care and symptom reductions among youth. Given the complex nature of the intervention and its setting, the multiphase optimization strategy methodology [38], utilizing factorial designs, may be well suited to evaluating the independent effects of each of the components. This will assist the service designers and developers to optimize the service for both the practitioner and the patient.

    Acknowledgments

    Funding for this project was provided by Hong Kong and Shanghai Banking Corporation (HSBC).

    Authors' Contributions

    MSK was responsible for data analysis, interpretation, project management, and authorship of the manuscript. BOD and CK were involved in study design and manuscript preparation. MA assisted with data analysis. KOM undertook recruitment and data collection.

    Conflicts of Interest

    BOD is a Section Editor for JMIR Mental Health.

    References

    1. Leach LS, Christensen H, Griffiths KM, Jorm AF, Mackinnon AJ. Websites as a mode of delivering mental health information: perceptions from the Australian public. Soc Psychiatry Psychiatr Epidemiol 2007;42(2):167-172. [CrossRef] [Medline]
    2. Merikangas KR, He J, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in U.S. adolescents: results from the National Comorbidity Survey Replication--Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry 2010;49(10):980-989 [FREE Full text] [CrossRef] [Medline]
    3. Avenevoli S, Knight E, Kessler R, Merikangas K. Epidemiology of depression in children and adolescents. In: Abela JH, Hankin BL, editors. Handbook of depresion in children and adolescents. New York: Guilford; 2008:6-32.
    4. Gibb SJ, Fergusson DM, Horwood LJ. Burden of psychiatric disorder in young adulthood and life outcomes at age 30. Br J Psychiatry 2010;197(2):122-127 [FREE Full text] [CrossRef] [Medline]
    5. Shankman SA, Lewinsohn PM, Klein DN, Small JW, Seeley JR, Altman SE. Subthreshold conditions as precursors for full syndrome disorders: a 15-year longitudinal study of multiple diagnostic classes. J Child Psychol Psychiatry 2009;50(12):1485-1494 [FREE Full text] [CrossRef] [Medline]
    6. Tylee A, Haller DM, Graham T, Churchill R, Sanci LA. Youth-friendly primary-care services: how are we doing and what more needs to be done? Lancet 2007;369(9572):1565-1573. [CrossRef] [Medline]
    7. Bennett DL. Adolescent health in Australia: An overview of needs and approaches to care. Sydney: Australian Medical Association; 1984.
    8. Issakidis C, Andrews G. Who treats whom? An application of the Pathways to Care model in Australia. Aust N Z J Psychiatry 2006;40(1):74-86. [CrossRef] [Medline]
    9. Lawrence D, Johnson S, Hafekost J, Boterhoven DH, Sawyer M, Ainley J, et al. Health.gov. Canberra, ACT, Australia: Australian Government Department of Health; 2015. The mental health of children and adolescents: Report on the second Australian Child and Adolescent Survey of Mental Health and Wellbeing   URL: http:/​/https:/​/www.​​health.gov.au/​​internet/​​main/​​publishing.nsf/​​Content/​​9DA8CA21306FE6EDCA257E2700016945/​​%24File/​​child2.​​ [accessed 2018-02-20] [WebCite Cache]
    10. Veit FC, Sanci LA, Coffey CM, Young DY, Bowes G. Barriers to effective primary health care for adolescents. Med J Aust 1996 05;165(3):131-133. [Medline]
    11. O'Brien D, Harvey K, Howse J, Reardon T, Creswell C. Barriers to managing child and adolescent mental health problems: a systematic review of primary care practitioners' perceptions. Br J Gen Pract 2016;66(651):e693-e707 [FREE Full text] [CrossRef] [Medline]
    12. Kang M, Bernard D, Booth M, Quine S, Alperstein G, Usherwood T, et al. Access to primary health care for Australian young people: service provider perspectives. Br J Gen Pract 2003;53(497):947-952.
    13. Booth M, Bernard D, Quine S, Kang M, Usherwood T, Alperstein G, et al. NSW Government: Health. The Children's Hospital Westmead, Sydney, Australia: NSW Centre for the Advancement of Adolescent Health; 2002. Access to health care among NSW adolescents. Phase 1 Final Report   URL: http://www.health.nsw.gov.au/kidsfamilies/youth/Documents/access-phase-1-report.pdf [accessed 2017-11-01] [WebCite Cache]
    14. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
    15. Christensen H, Griffiths K. The Internet and mental health literacy. Aust N Z J Psychiatry 2000;34(6):975-979. [CrossRef] [Medline]
    16. Tait RJ, Christensen H. Internet-based interventions for young people with problematic substance use: a systematic review. Med J Aust 2010;192(11 Suppl):S15-S21. [Medline]
    17. Calear AL, Christensen H. Review of internet-based prevention and treatment programs for anxiety and depression in children and adolescents. Med J Aust 2010;192(11 Suppl):S12-S14. [Medline]
    18. Hickie IB, Davenport TA, Luscombe GM, Moore M, Griffiths KM, Christensen H. Practitioner-supported delivery of internet-based cognitive behaviour therapy: evaluation of the feasibility of conducting a cluster randomised trial. Med J Aust 2010;192(11 Suppl):S31-S35. [Medline]
    19. Perini S, Titov N, Andrews G. Clinician-assisted Internet-based treatment is effective for depression: randomized controlled trial. Aust N Z J Psychiatry 2009;43(6):571-578. [CrossRef] [Medline]
    20. van Straten A, Seekles W, van ‘t Veer-Tazelaar NJ, Beekman AT, Cuijpers P. Stepped care for depression in primary care: what should be offered and how? Med J Aust 2010;192(11 Suppl):S36-S39. [Medline]
    21. Barak A, Klein B, Proudfoot JG. Defining internet-supported therapeutic interventions. Ann Behav Med 2009;38(1):4-17. [CrossRef] [Medline]
    22. Clarke AM, Kuosmanen T, Barry MM. A systematic review of online youth mental health promotion and prevention interventions. J Youth Adolesc 2015;44(1):90-113. [CrossRef] [Medline]
    23. Das JK, Salam RA, Lassi ZS, Khan MN, Mahmood W, Patel V, et al. Interventions for adolescent mental health: an overview of systematic reviews. J Adolesc Health 2016 Oct;59(4S):S49-S60 [FREE Full text] [CrossRef] [Medline]
    24. Anderson JG. Social, ethical and legal barriers to e-health. Int J Med Inform 2007;76(5-6):480-483. [CrossRef] [Medline]
    25. Orman J, O'Dea B, Shand F, Berk M, Proudfoot J, Christensen H. e-Mental health for mood and anxiety disorders in general practice. Aust Fam Physician 2014;43(12):832-837. [Medline]
    26. Lal S, Adair CE. E-mental health: a rapid review of the literature. Psychiatr Serv 2014;65(1):24-32. [CrossRef] [Medline]
    27. Peeters JM, Krijgsman JW, Brabers AE, Jong JD, Friele RD. Use and uptake of eHealth in general practice: a cross-sectional survey and focus group study among health care users and general practitioners. JMIR Med Inform 2016;4(2):e11 [FREE Full text] [CrossRef] [Medline]
    28. Griffiths KM, Christensen H. Internet-based mental health programs: a powerful tool in the rural medical kit. Aust J Rural Health 2007;15(2):81-87. [CrossRef] [Medline]
    29. Australian Institute of Health and Welfare. Canberra; 2008. Rural, regional and remote health: Indicators of health system performance   URL: https://www.aihw.gov.au/getmedia/68916c65-a5e8-4e7e-a821-374a9455ef0b/rrrh-ihsp.pdf.aspx?inline=true [accessed 2017-11-01] [WebCite Cache]
    30. van Straten A, Hill J, Richards DA, Cuijpers P. Stepped care treatment delivery for depression: a systematic review and meta-analysis. Psychol Med 2015;45(2):231-246. [CrossRef] [Medline]
    31. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res 2017;17(1):88 [FREE Full text] [CrossRef] [Medline]
    32. O'Dea B, King C, Subotic-Kerry M, O'Moore K, Christensen H. School counselors' perspectives of a web-based stepped care mental health service for schools: cross-sectional online survey. JMIR Ment Health 2017;4(4):e55 [FREE Full text] [CrossRef] [Medline]
    33. Orlowski S, Lawn S, Matthews B, Venning A, Wyld K, Jones G, et al. The promise and the reality: a mental health workforce perspective on technology-enhanced youth mental health service delivery. BMC Health Serv Res 2016;16(1):562 [FREE Full text] [CrossRef] [Medline]
    34. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3(2):77-101. [CrossRef]
    35. Olfson M, Guardino M, Struening E, Schneier FR, Hellman F, Klein DF. Barriers to the treatment of social anxiety. Am J Psychiatry 2000;157(4):521-527. [Medline]
    36. Essau CA. Frequency and patterns of mental health services utilization among adolescents with anxiety and depressive disorders. Depress Anxiety 2005;22(3):130-137. [CrossRef] [Medline]
    37. Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry 2010;10:113 [FREE Full text] [CrossRef] [Medline]
    38. Collins L, Chakraborty B, Murphy S, Strecher V. Comparison of a phased experimental approach and a single randomized clinical trial for developing multicomponent behavioral interventions. Clin Trials 2009;6(1):5-15. [CrossRef] [Medline]


    Abbreviations

    CBT: Cognitive Behavior Therapy
    GP: General practitioner


    Edited by P Santana-Mancilla; submitted 07.09.17; peer-reviewed by M Rodríguez Ortiz, M Yap; comments to author 23.10.17; revised version received 23.11.17; accepted 31.12.17; published 23.03.18

    ©Mirjana Subotic-Kerry, Catherine King, Kathleen O'Moore, Melinda Achilles, Bridianne O'Dea. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 23.03.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on http://humanfactors.jmir.org, as well as this copyright and license information must be included.