Published on in Vol 11 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/57360, first published .
The Doctors, Their Patients, and the Symptom Checker App: Qualitative Interview Study With General Practitioners in Germany

The Doctors, Their Patients, and the Symptom Checker App: Qualitative Interview Study With General Practitioners in Germany

The Doctors, Their Patients, and the Symptom Checker App: Qualitative Interview Study With General Practitioners in Germany

Original Paper

1Institute of Occupational and Social Medicine and Health Services Research, University Hospital Tübingen, Tübingen, Germany

2Institute for General Practice and Interprofessional Care, University Hospital Tübingen, Tübingen, Germany

3Institute for General Practice and Palliative Care, Hannover Medical School, Hannover, Germany

4Institute of Philosophy, University Bremen, Bremen, Germany

5Faculty of Health Sciences Brandenburg, University of Potsdam, Potsdam, Germany

Corresponding Author:

Christine Preiser, MA, Dr phil

Institute of Occupational and Social Medicine and Health Services Research

University Hospital Tübingen

Wilhelmstr. 27

Tübingen, 72074

Germany

Phone: 49 70712984361

Email: christine.preiser@med.uni-tuebingen.de


Background: Symptom checkers are designed for laypeople and promise to provide a preliminary diagnosis, a sense of urgency, and a suggested course of action.

Objective: We used the international symptom checker app (SCA) Ada App as an example to answer the following question: How do general practitioners (GPs) experience the SCA in relation to the macro, meso, and micro level of their daily work, and how does this interact with work-related psychosocial resources and demands?

Methods: We conducted 8 semistructured interviews with GPs in Germany between December 2020 and February 2022. We analyzed the data using the integrative basic method, an interpretative-reconstructive method, to identify core themes and modes of thematization.

Results: Although most GPs in this study were open to digitization in health care and their practice, only one was familiar with the SCA. GPs considered the SCA as part of the “unorganized stage” of patients’ searching about their conditions. Some preferred it to popular search engines. They considered it relevant to their work as soon as the SCA would influence patients’ decisions to see a doctor. Some wanted to see the results of the SCA in advance in order to decide on the patient’s next steps. GPs described the diagnostic process as guided by shared decision-making, with the GP taking the lead and the patient deciding. They saw diagnosis as an act of making sense of data, which the SCA would not be able to do, despite the huge amounts of data.

Conclusions: GPs took a techno-pragmatic view of SCA. They operate in a health care system of increasing scarcity. They saw the SCA as a potential work-related resource if it helped them to reduce administrative tasks and unnecessary patient contacts. The SCA was seen as a potential work-related demand if it increased workload, for example, if it increased patients’ anxiety, was too risk-averse, or made patients more insistent on their own opinions.

JMIR Hum Factors 2024;11:e57360

doi:10.2196/57360

Keywords



The right to diagnose is reserved for physicians and is a core element of professional authority [1]. Finding the proper diagnosis as part of GPs’ expertise has been reported to contribute to physicians’ perceived job satisfaction [2]. Patients also play an important role in the process. They first assess their symptoms, schedule an appointment, present their symptoms, and react to the diagnosis [3,4].

But what happens when technologies enter this process? Here we explore this with the example of the perspectives of general practitioners (GPs) on the Ada App, an internationally available symptom checker app (SCA).

Since the 1950s, physicians and computer scientists have been exploring how computers can be used to assist and improve the diagnostic process [5,6]. Part of the technologies are primarily designed to assist trained physicians or other health care professionals. Other technologies, such as symptom checkers, are designed for laypersons. A plethora of different apps exist [7]. The wording about what browser- and app-based symptom checkers actually deliver is rather heterogeneous, as the debate is ongoing [8]. For the purpose of this study, we use an operational definition: symptom checkers provide lay users with preliminary diagnoses, give a first sense of urgency, and suggest a course of action [9]. As such, we understand symptom checkers as “sociocultural artifacts” that are “(nonhuman) participants in networks of meaning and power relations” [10].

Symptom checkers are discussed ambivalently in the literature. Some expect that symptom checkers could outperform physicians’ diagnostic capabilities [11], increase anxieties in patients [12], disrupt the doctor-patient relationship [10,13-15], or cause overuse of the health care system [16,17]. Further perspectives suggest that physicians’ expertise and authority remain unchallenged by symptom checkers [10,18,19], patients could be empowered [12,18], and symptom checkers might have the potential to reduce physicians’ workload and relieve an overburdened health care system [15,20,21]. Therefore, despite physicians not being the primary target group, symptom checkers might have far-reaching impacts on their work in terms of work content and work organization. These two dimensions are central to established models of perceived work-related stress [22-25].

As GPs are the primary access point to the health care system for patients [26], they might be particularly affected by laypersons’ respectively patients’ use of symptom checkers and the aforementioned impacts such as the use of the health care system or changes in the doctor-patient relationship. To date, little is known about the lived experiences and perspectives of GPs in regard to SCAs. A survey among GPs in the United States showed that only 30% had first-hand experiences with chatbots in health care [27]. One survey from Finland analyzed the experiences of health care professionals with a symptom checker at occupational health clinics and found that symptom checkers were of limited relevance in their daily work [15]. In both studies, the attitudes of the respondents mirrored the aforementioned discourse. While the studies give a first overview of relevant topics in the field, there is no in-depth analysis of how GPs experience SCAs as nonhuman participants in their daily work and how they see SCAs in relation to their own “apostolic function” [4], that is, their expectations on patients, their illness concepts, and personal and professional values and attitudes. Depending on how GPs disintegrate or integrate SCAs in their “apostolic function,” this, too, might have further impacts in regard to job satisfaction and perceived work-related stress.

This study is embedded in the multidisciplinary joint project CHECK.APP, in which the ethical, legal, and social implications of SCAs in general practice in Germany are analyzed using the example of the Ada App [28]. The Ada App [29] had originally been conceptualized as a clinical decision support system but was later redesigned for laypersons. Laypersons enter their symptoms guided by the questions in the app and will be presented with a ranking of several potential diseases in combination with a sense of urgency and potential courses of action. It appeared to be a promising case for a wider phenomenon. Its advertising campaign #tellada won the German brand award in 2019 and included slogans such as “How are you? Be honest” [30,31]. At the same time, the actual number of users remained unclear. A health insurance had planned to implement the app, but it canceled its plans due to data privacy concerns [32-34]. As such, the app represents the aforementioned ambivalence around SCAs. In this study, we take a technology-in-practice approach [35] and will focus on GPs’ lived experiences with the SCA and their perspectives on it. From an occupational health perspective, we are particularly interested in the following research questions: (1) How do GPs experience the SCA in relation to the macro, meso, and micro levels of their daily work? (2) How does this relate to their professional identity, job satisfaction, and psychosocial resources and demands?


Study Design

In a scoping review on the impacts of laypersons’ use of SCAs on physicians in primary care, we showed that while some publications include the perspectives and voices of physicians, they primarily portray expectations rather than lived experiences [36]. In this empirical study, we aimed to fill this gap by exploring the experiences of GPs in Germany through the in-depth reconstructive analysis of semistructured qualitative interviews. The interview study was embedded in the joint project CHECK.APP which integrates the perspectives of users, experts, and GPs and works with a mixed methods research design, including a scoping review on ethical, legal, and social aspects [8], a survey among the wider German population, a diary and interview study with app users, qualitative interviews with GPs, and qualitative interviews with experts with regards to SCAs in general and the German health care system in particular [28].

Sample

We used several common recruitment strategies: as we know from previous studies, it is almost impossible to contact GPs directly by telephone, as practice assistants act as gatekeepers [37,38]. We contacted GPs by letter, email, or fax, depending on the information available through internet searches, and sent follow-up messages after 2-4 weeks. In addition, one of the GPs in the collaborative project (RK), who was not directly involved in this part of the study, contacted GPs through his institute’s practice network. Our final sample included 8 GPs from different regions of Germany, representing different theoretically derived dimensions of our intended sample (Table 1).

Table 1. Sample of the study.
Relative dimensions and featureValue (N=8), n
GPsa

Age (in years)


<453


45-552


55+3

Gender


Women3


Men5


Diverseb

Race


Black


Person of color


White8

Migrant


Yes1


No7

Experiences with SCAc


Yes1


No7

Use of digital tools


No indicators2


Indicators such as browser- or app-based system to book appointments, telemedical appointments, focus of the practice, and profile in social media6
Practice

Location


Rural3


Suburban3


City2

Structure of the practice


Single practice3


Joint practice5


Medical center

Size of the practice


<5 employees3


>5 employees5

aGP: general practitioner.

bIndicate the dimensions that, despite our efforts, were not represented in our sample.

cSCA: symptom checker app.

Data Collection

We developed the interview guide in several rounds, translating our research interests into final interview questions [39] (Multimedia Appendix 1). Two researchers (NR and CP) and one research assistant (EÖ) each conducted at least one of the interviews. Each interviewer obtained verbal and written consent for their interview. All 3 interviewers were trained sociologists with 3 (EÖ), 6 (NR), and 10 (CP) years of professional experience in health services research and occupational medicine. The interviews were conducted between December 2020 and February 2022 using the video conferencing tool VidyoConnect (version 21.6.3.17468; Vidyo Inc), which is provided by the University Hospital of Tübingen. The interviews lasted between 30 and 63 minutes and were recorded using an external audio recorder. The videos were not recorded. The files were transcribed by a certified office and pseudonymized by NR.

Data Analysis

The interviews were analyzed by NR, EÖ, and CP using the integrative basic method [40]. This reconstructive-interpretive method allowed the reconstruction of manifest and latent meanings by analyzing semantics, syntax, and metaphors. We chose agency and positioning as analytical approaches [40] because these proved particularly promising for understanding how GPs see and navigate themselves and their agency in a network of potentially conflicting participants and interests. We used the “Risk assessment of work-related psychological stress” of the Joint German Occupational Safety and Health Strategy (Gemeinsame Deutsche Arbeitsschutzstrategie) which operationalizes established models of work-related perceived stress [41] as a core sensitizing concept [42] for our analysis. It defines work content, social relations, work organization, work environment, and new forms of work as dimensions of work-related stress.

All interviews were interpreted line by line in order to identify the main motives and modes of thematization. Analytical case protocols were written for each interview. Interviews were continuously compared with each other. For the purpose of quality assurance, the analyses were discussed with MAR and researchers of the joint project [40]. Furthermore, we conducted a member check [43] with study participants and experts on SCAs in Germany in April 2022. The reporting of this study follows the Standards for Reporting Qualitative Research guidelines [44].

Ethical Considerations

The ethics committee of the Medical Faculty and University Hospital of Tübingen has approved the study (464/2020BO). All study participants were informed and gave consent verbally and in written form.


Overview

The results reflect the perspectives of GPs and are presented along the main stages of the diagnosis process: the unorganized stage, the patient’s decision to see a GP, and the shared process of exploring the patient’s condition.

Doctor, Have You Heard of Ada?

The GPs in this study were mostly receptive to digitalization in their area of practice and used digital tools to varying degrees to manage patient volumes and streamline workflows. These included tools that helped to free up the telephone line, tools that helped with documentation, and tools that enabled easy and direct digital communication between patients and the practice. Several GPs made it clear that the digital tools were not suitable for all patient groups but helped to relieve capacity for those patients who did not use digital tools (eg, ensuring telephone availability). Although the GPs in this study were rather receptive to digital tools, only one GP was aware of symptom checkers in general and the introduced SCA in particular. This GP used it as an additional interlocutor:

GP 3: (2) So I personally use it for patients with … rare symptoms or unusual laboratory constellations ... too. So then ... I ask Ada, ... simply to get differential diagnoses again and then think about it: Could any of these differential diagnoses be correct?
Interviewer: During the consultation?
GP 3: No, in the evening on the couch (laughs).
Interviewer: (laughs) So you don’t finish work, but still google about Ada in the evening ... another symptom?
GP 3: Exactly. So that’s ... I usually already have an idea, and if it’s a more complicated case, I also take a blood sample. And the blood values ... I go through them in the evening anyway. And if I then somehow come to a standstill or think maybe I’ve forgotten something in the differential diagnosis, then I often use Ada and ... see if it gives me new ideas, new impulses, yes.
[female, <45 years old, rural area]

This means that our results reflect expectations rather than experiences of the specific SCA and SCAs in general. However, the differences between GPs who were familiar with the SCA and those who were not were mainly in aspects of the app’s practicality, not in perspectives on the app or their work.

The SCA in the Black Box of the “Unorganized Stage”

GPs normalized patients’ desire to explore their condition and considered it helpful if patients had already thought about their symptoms, as this might help some patients to accept the outcome of the consultation.

So there is the example of the well-informed, intelligent patient who has already obtained preliminary information, which may not always be correct, but which sometimes makes it more difficult to find a diagnosis because it is unfiltered information. But I would say that, looking at all patients, it is easier if the patients have been informed in advance. You often have to revise patients’ misjudgements, but they have already considered the issue in more detail. That is on average ... It certainly always depends on the type of patient you have in the practice, but ultimately it helps rather than harms if the patients are preinformed.
[GP 8, male, 55+ years old, big city]

At best, the SCA could help patients reflect on their condition in preparation for a consultation with their GP, or reduce unnecessary patient anxiety. However, patients may include irrelevant information or omit relevant information, leading to misleading results. GPs portrayed patients as laypeople who often focus on and present subordinate aspects, use the wrong search terms when searching the internet, or are unable to assess the quality of information and follow the most appropriate course of action. According to GPs, internet searches in particular can increase patients’ uncertainty and anxiety, as they may experience a flood of (negative) information and focus on the most serious potential outcomes. Some GPs preferred the SCA to internet searches because the information might be more evidence-based and focused. As such, GPs did not consider the SCA to be suitable for all patients, but only for those with eHealth literacy, general health literacy, and anxious patients, for whom the SCA might be the lesser of two evils compared to internet searches.

(...) then the app might come up with an initial result that is not quite as bad as a search engine. I don’t know whether this will reassure patients, because someone who is worried about their health from home doesn’t know whether they’ll trust the app’s result, and in the end the app has to present the result, so if in doubt, they’ll go to their doctor. If one or two people with a cold don’t rush straight to the GP’s surgery, then perhaps there could be a marginal relief effect for GP surgeries...
[GP 7, male, 45-55 years old, suburban area]

However, GPs mostly portrayed patients’ path to information as a black box for GPs, as patients did not necessarily disclose their sources of information. It became clear that GPs also rarely actively asked patients where they got their information from, as they considered the source of information to be secondary once patients were in the consultation room. GPs therefore focused on what they could control: direct contact and discussion with patients. In addition, GPs emphasized that asking about the source of information would in most cases take up scarce time without adding value to their work. They felt it was more important to probe the patient’s understanding of their condition (“disease model” [German: Krankheitsmodell]).

(Better) Too Early, (Than) Too Late—The SCA and Patients’ Timing

GPs expressed that they were dependent on patients’ decisions about when to see a doctor. They expected patients to go to the GP at the right time, but in their narratives, patients often went either too early or too late. This reasoning was embedded in the GPs’ understanding of health care as a system with limited resources, with the scarcest resource being health professionals’ time. In all interviews, GPs referred to the context of their working conditions, which may also shape their expectations of SCA. All GPs reported an intense workload with a high number of patient contacts. The workload has been increased by the COVID-19 pandemic. When in doubt, GPs preferred patients to seek help too early to avoid avoidable suffering. For them, the most important question about the SCA was: would it encourage patients to seek help at the right time? If it was too risk-averse, it would send patients too early and lead to oversupply, sabotaging the GP’s mandate.

So, the back pain doesn’t have to be something bad, you’re doing this and this and this and we’ll talk again in a fortnight and you’ll tell me how it’s gone then. So a watchful waiting approach. Whereas so-called red flags in general medicine, that is, obviously highly conspicuous and potentially dangerous symptom indications, lead to immediate consequences. This is how we handle evidence-based general medicine, at least in my practice. If the Ada app now turns everything into red flags ... it not only destroys our health care system but also unsettles patients and does the opposite of what is also very important in general practice, namely the prevention of overdiagnosis. For a variety of reasons, of course also for reasons of cost, the economic costs, but also (pauses) to ... yes, to keep the feeling of illness away from patients.
[GP 5, male, 45-55 years old, rural area]

Conversely, if the SCA was not risk-averse enough, it would lead to underuse for patients. GPs attributed the potential for both to the SCA. The SCA could give wrong results and exacerbate the challenge of resource scarcity, or it could give patients the right sense of urgency and self-care instructions for simple cases. However, GPs felt that this risk or potential of the SCA would ultimately depend on the competence or personality of the user, not the technology itself.

Some GPs were considering how to integrate the SCA into their workflow, particularly with regard to practicalities that might have the potential to reduce unnecessary patient contact and thus workload. Some imagined that the results could be made available to GPs in advance.

So ultimately it’s just a decision: He has to come or he doesn’t have to come, or I have to visit him or not visit him. Those are the two things that are ultimately at the end of the decision-making tree. Yes. And I have to make the decision in the end when I have looked at it and realize: OK, it doesn’t look very good somehow. Then you just have to say: You have to come. Or you just have to say: I’m going there. So, that ... (2) But you don’t have to ask about all this previous history because it’s already done. And, well, you have to be able to rely on it, that’s the crucial thing (laughs).
[GP 4, male, 55+ years old, suburban area]

In this way, the SCA would document the initial history and become a tool for communication between the patient and the GP, while the GP would ultimately decide how to proceed.

Finding Diagnosis—Humble Paternalism and the Art of Sense-Making

GPs described finding a diagnosis as a process that could involve several steps, patient contacts, and time (watchful waiting, see also the response of GP 5 above). From the GPs’ perspective, both GPs and patients had a common goal: to find out what the patient had and to take the necessary measures. GPs and patients also shared the challenge of limited knowledge (see also the response of GP 3). However, from the GPs’ perspective, GPs as medical experts and patients as medical laypeople had different knowledge limitations and different roles in the process. In the interviews, GPs positioned themselves as experts who, as such, were better able to search for information and assess information quality (including internet searches in medical databases and popular search engines), given their existing broad medical knowledge and years of professional experience. GPs positioned themselves as the medical authority who knew better, but who also had an ethical and legal responsibility to do their best to reach the right conclusion and treatment. GPs expected trust from their patients and offered skepticism in return. In the diagnostic process, they expected patients to share (information relevant to the GP) but not to overshare (information irrelevant to the GP) and thus to contribute smoothly to the GP’s work.

So my favorite patient is the one who describes their complaints and not immediately their interpretation: “I read on Google, and that fits together.” (laughs) “No, stop, (laughs) that’s what I do (laughs). I would need your complaints (2) and not your interpretation of your complaints, please leave that to me.” Hm, well, I would say about 20% of patients already prepare information from the internet. But to be honest, that bothers me more than it helps.
[GP 6, female, 55+ years old, big city]

The GPs in this study reacted negatively to terms such as “self-diagnosis,” which we used in the interview guide in reference to common wording in the literature on SCA. Our interviewees rarely used the term “diagnosis” themselves. Rather, they spoke of “ideas,” “assessments,” “interpretations,” “perceptions,” “categorizations,” etc in relation to SCA, but also in relation to their work. GPs considered it potentially helpful for patients to gain an initial understanding of their case, as long as they remained open to the GPs’ guidance. They therefore describe the process of exploration as one of guided shared decision-making, with the GP guiding the patient and knowing best, but ultimately knowing that the patient will decide their own direction.

When it came to the SCA in this process, the GPs drew clear boundaries.

But yes, I actually see myself more as a symptom checker myself, so (laughs) people come to me and tell me their symptoms and I’m the one who helps them categorize them. (...) I think I can do that better than any app (laughs).
[GP 1, female, <45 years old, rural area]

The GPs ascribed to the SCA the potential to act as a nonhuman actor. The SCA could help guide the process of exploration—but it could also be an uncontrollable element that “spits out diagnoses,” as one GP stated. GPs problematized the SCA if it disrupted their workflow and the doctor-patient relationship. GPs were concerned that the SCA could create avoidable extra work over which GPs had no control if GPs had to deal with the impact of the app on patients before they could focus on their work. The SCA was seen as an intruder if it cemented patients’ insistence on their ideas and lay diagnoses, thus causing extra work:

So I think that if the app ... for example, really just says: “Go to your GP at short notice, he should clarify this,” I have no problem with that at all, I think that’s a great thing. Then I don’t have to do a lot of educational work, I can look at the patient and then make a decision and discuss it with them. However, if the app now throws specific diagnoses into the room, and that’s what it does here, i.e. infection with the bacterium Clostridium difficile, then it could be that the app leads to more work for me because then I first have to work through the app’s diagnoses and reassure the patient, and above all I have to justify why I think this is not the right thing to do, even though the app suggests it. (...) I would find that unfortunate.
[GP 2, male, <45 years old, suburban area]

The GPs positioned themselves as the real intelligence against the artificial intelligence (AI) behind the SCA. From their point of view, the SCA could not offer anything that a human could not: the SCA had no empathy and could not offer physical examinations. GPs could send patients to a specialist when they reached the limits of their expertise, while the app would not send users to another, more appropriate app. They made it clear that the diagnostic process is more complex than a compilation of symptoms. From the GPs’ perspective, diagnosing and finding the line between ill and not ill was a process of making sense of information. The SCA could collect potentially relevant information, and at best, organize it, but would not be able to make sense of it. GPs presented their view as limited but more objective, neutral, and less biased than that of the SCA, whose results were seen as one-dimensional. Ultimately, GPs concluded:

That depends on what the take-home message is for the patient at the end of the AI utilization, as I just said. If the take-home message is: You have complaints that (3) ... should result in a doctor’s consultation within the next week - then I think that’s fine. (00:30:55) If it’s different, (...), then I would say to the patient: OK, now ... we’re starting from scratch, please don’t tell me anything about Ada, but tell me everything you told Ada again because I’m not going to let an AI take my decision-making away from me. If I go through a PHQ-9 questionnaire ... with my patient who has depression, then the questionnaire doesn’t make the diagnosis, I do. But it can contribute to the validation of the diagnosis, in addition to my medical skills. And that’s why AI can be part of the doctor-patient relationship, but in my view, it can’t replace it - at least in the GP sector, where it’s all about relationships.
[GP 5, male, 45-55 years old, rural area]

SCAs as a “Proximate Future”

This study is one of the first empirical studies of GPs’ perceptions of SCA in their daily work. One of our main findings is that SCAs seem to be much less relevant in the current daily work of GPs in Germany than we had initially expected from the scientific literature and public discourse on symptom checkers. There may be several reasons for this. As we found out in the joint project, the use of symptom checkers is not widespread in the German population, that is, only a small proportion of patients actually use symptom checkers [45]. Furthermore, patients have been shown to be reluctant to share their source of information with physicians for fear of criticism from their physicians and disruption of the physician-patient relationship [46], so even if patients are using the particular SCA or other symptom checkers, they are unlikely to tell their GPs. In addition, GPs in this study reported that they did not ask patients about potential sources of information and did not differentiate between digital sources, but used the umbrella term “internet searches” for all types of digital tools. GPs might consequently have experiences with patients who use symptom checkers but might not be aware of this experience. To date, symptom checkers are rather a “proximate future” in German health care, a yet unachieved future envisioned by tech companies or other stakeholders as to be “just around the corner” and to be about to solve pressing issues of the present [47]. Centering “proximate futures” and the associated techno-utopian or techno-dystopian visions tend to distract from the unresolved issues of the present [47]. For us, then, the question is what we learn about the present work of GPs through the lens of GPs’ perceptions of symptom checkers.

GPs’ Perception of the SCA in Their Daily Work

GPs used language that presented the SCA and symptom checkers as “(nonhuman) participants in networks of meaning and power relations” [10]. Our results address SCA in GPs’ perspectives in relation to the macro, meso, and micro levels of their work.

At the macro level of the German health care system, we are to date not only facing a demographic change in the German population and among GPs (in 2022, about 36.6% of the GPs in Germany were 60 years or older [48]) but also a shortage of GPs due to lack of young practitioners, physicians’ wish for more part-time work, and an uneven distribution between urban and rural, as well as high- and low-income areas [49,50]. This is prognosed to intensify within the next decade. Some authors envision symptom checkers or other AI- or algorithm-based technologies as promising tools in a health care system of increased scarcity [17,51]. At present, symptom checkers are hardly used among the population in Germany [45,52] and—as shown by our data—are hardly known among GPs. GPs were critical about the future potentials of symptom checkers as useful participants in the German health care system if symptom checkers were too risk-adverse or not risk-adverse enough and led patients to the medically wrong time within the health care system. Patients’ individual decisions to follow the suggestions of the SCA might thus have impacts on the macro level and lead to over- or undersupply. Nevertheless, patients’ current decision-making process is more complex than following the results of a symptom checker [52,53].

At the meso level, GPs considered the SCA as a nonhuman participant on the organizational level of the practice and the interpersonal level of the physician-patient relationship. Digitization in the German health care system is a fragmented and slow process [54,55]. On an organizational level, GPs work in an environment that is characterized by a patchwork of technologies that lack interoperability. They perceived symptom checkers to feed into this pattern instead of improving it. Some GPs currently use digital tools to streamline patient contacts and administrative tasks. GPs welcomed the SCA as a potential future technology if it facilitated documentation and administration or helped to reduce unnecessary patient visits. In regards to the physician-patient relationship, GPs located the SCA in the black box of the patient’s search as part of the patient's “unorganized stage” [4] and “prediagnosis work” of patients [3], where it might complicate but not fundamentally damage the GPs’ and patients’ shared process of exploration. The SCA was attributed to the larger phenomenon of internet searches and “Dr Google” [56] which does not create a new phenomenon, but at worst reinforces an already existing one, namely patients who distrust their own health literacy, anxious patients, or patients who insist on their own assessment instead of trusting that of the GP. However, as the SCA is hardly present in the GPs’ daily work, it is not perceived as having a real impact on the meso level.

On the micro level, GPs positioned the SCA in relation to themselves. GPs in this study reacted negatively to terms such as “self-diagnosis,” often used in the popular and scientific literature on symptom checkers [16,46,57], and rejected the idea that the SCA could provide a proper diagnosis. They saw the SCA as lacking the holistic view, empathy, accumulated experience, and flexibility of human physicians ([58]). Similar to other studies, GPs saw diagnosis as a process of making sense of data and information and understood the SCA as monodimensional and static, full of correct information but unable to make full sense of the data (cf. [58]). They saw themselves as real, complex, and flexible, adaptive intelligence, acknowledging their own biases and knowledge limitations, compared to an artificial, schematic thinking intelligence ([10,20,58]). They therefore framed medicine as science and art, and technology as data minus art in the present and the future. As such, the SCA would not touch the GP’s professional expertise. This perspective also resonates with the current quality of symptom checkers. Databases in medicine might grow, but are biased and reinforce inequalities, and health data is of economic and political interest [59-62]. When it comes to SCAs, currently, the diagnostic accuracy of symptom checkers does not match the vision [63-65] even after decades of research [6,7,66], but they have the potential to provide an initial sense of urgency [17,63,64].

The SCA in Relation to Perceived Work-Related Resources and Demands

From an occupational health perspective, we were particularly interested in what our findings mean in the context of professional identity, subjective job satisfaction, work content, work organization, social relationships, and work-related psychosocial resources and demands [67]. The focus on the SCA in the following should not obscure the fact that the causes of the main work-related stressors for GPs can be found and should be addressed at the macro level [68,69].

Studies have repeatedly shown that GPs in Germany have a high workload, long working hours, and a higher prevalence of burnout [70,71]. The GPs in this study are no exception to this and faced an even increased workload due to the COVID-19 pandemic. Lack of enough time is a key stressor for GPs. As a consequence, their perspective on both patients and the SCA alike is structured by the question: Who or what will cost time for what? GPs see some aspects of the SCA as a potential resource in their work. Similar to other publications, the SCA is seen as a better source of health information for patients using internet searches than, for example, popular search engines or digital encyclopedias ([12,46]). The SCA is seen as potentially increasing work demands if it increases patients’ anxiety, is too risk-averse and sends patients to the doctor unnecessarily or makes patients more insistent on their view, that is, if the effects of the SCA add to the already high workload or interfere with the doctor-patient relationship as an important part of GPs’ work. GPs also see the SCA as a potential resource if it “streamlines access to physicians” [58], for example, if they can see and work with the results and inform patients whether or not they should come to the practice ([17]). The latter aspect has implications for the organization of work of GPs and possibly the practice team, for example, the question of when and how to integrate the results of the SCA into the workflow [72]. A study of a symptom checker embedded in an occupational health clinic shows that physicians do not integrate the results into their workflow [15]. As implementation theories and patient-reported outcome studies have shown, the additional information will only be used by health care professionals if it is meaningfully embedded into workflows [73-75]. In another recent study, the use of an AI-based chatbot did not reduce the workload of GPs or the duration of patient visits [76]. Furthermore, if the integration of SCAs leads to an even higher density of patient-related decisions to be made by the GP or the practice team, or if they are dealt with during breaks, the potential resource could become a demand.

For the GPs in this study, similar to other studies, patient work and especially the doctor-patient relationship is an important resource in terms of their subjective job satisfaction [68], as well as finding the proper diagnosis [2]. It has been shown that administrative tasks are the least favored tasks and inhibit job satisfaction [2,77]. Anything that threatens job satisfaction is viewed critically by GPs and—from an occupational health point of view—has to be seen as critical in terms of work-related psychosocial stress, even more so if it increases an already high workload. The SCAs were seen as a potential resource if they allowed GPs to focus on patient contact, thus reducing unfavored work tasks and allowing more time for favored work content. Some authors envision the physician-patient relationship to transform fundamentally through patients’ use of SCAs [78]. GPs in this study appear to be protective of the physician-patient relationship. This study shows that GPs currently see the SCA as another means of diversifying patients’ access to knowledge, rather than as a challenge to the doctor-patient relationship or their professional identity as medical experts. Treating the source of information as secondary and focusing on direct interaction with the patient can also be read as a resource for maintaining control in a network of increasing numbers of nonhuman participants. In this way, GPs also protect important pillars of their job satisfaction: the physician-patient relationship, their medical and interpersonal expertise, and the lead in the diagnostic process.

Strengths and Limitations

This study focuses on the perspective of GPs, although practice assistants also play an important role in general practice [79]. Initially, we had aimed to conduct 10 interviews with GPs that represent heterogeneous lived experiences in general practice [28]. Finding interview partners proved to be a challenge. GPs are known to have very high workloads and long working hours, so it is generally difficult to involve them in research studies [37,38,80]. The situation was exacerbated by the fact that we were looking for interview partners at the peak of the COVID-19 pandemic due to the funding period. We used various common strategies to reach out to GPs and eventually succeeded in finding 8 interview partners. The interviews were conducted between December 2020 and February 2022. We do not see striking differences between earlier and later interviews, probably also due to the fact that no COVID-19–related symptom checkers were used in Germany which might have introduced symptom checkers to a wider population. The sample only includes White GPs despite attempts to reach GPs of color and Black GPs. In addition to the aforementioned challenges, we assume unfitting sampling strategies and too homogeneous professional networks of the researchers as further reasons. It remains unclear, which impact race would have had on the perceptions of and experiences with the SCA. Within the given sample, the interview partners represent a variety of contexts and experiences and the data are rich enough to include shared patterns and conflicting perspectives [81]. Our results create resonance [40] with existing literature but also expand it. On the one hand, in terms of the issues raised by GPs in this study, we see strong parallels with the discourse on SCAs that we developed in our corresponding scoping review [36]. On the other hand, our data suggest that neither techno-utopian nor techno-dystopian visions of the literature are a dominant perceived reality in general practice in Germany. Instead, practitioners operating in a health care system of increasing scarcity display an attitude of techno-pragmatism in their daily work.

Conclusions

Some of the current scientific literature on symptom checkers presents rather techno-utopian visions of symptom checkers as a means to make health care more humane by supporting health care professionals and patients [58,82], democratizing access to knowledge and expertise [12,18], and relieving a burdened health care system [15,20,21]. Others emphasize techno-dystopian visions of a technology that outperforms or replaces humans [11,83] and becomes an uncontrollable participant in health care systems [16]. Our results show that symptom checkers are a “proximate future” [47] rather than a lived experience among GPs in Germany. The German Federal Association of Statutory Health Insurance Physicians established the so-called Patient-Navi [84], which shows similarities to symptom checkers, and some health insurance agents are working on their own symptom checkers. Our results help to understand the context in which these technologies might enter and to identify possible long-term effects in the future. Given the fact that the main challenges for GPs and patients can be found on the macro level of the health care system, this study also highlights that singular technological solutions do not solve complex societal issues, but can at best be one means in a plethora of means taken.

Acknowledgments

We thank all interview partners for their time and perspectives. The project was fully funded by the German Federal Ministry of Education and Research (grant 01GP1907A). The work of the Institute of Occupational and Social Medicine and Health Services Research Tübingen was supported by an unrestricted grant from the employers’ association of the metal and electric industry Baden-Württemberg (Südwestmetall). The funding bodies had no role in the design of the study phases, during its execution, in the analyses of the data, or in the decision to submit any results. We acknowledge the support from the Open Access Publishing Fund of the University of Tübingen.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Interview guide.

DOCX File , 23 KB

  1. de Swaan A. The reluctant imperialism of the medical profession. Soc Sci Med. 1989;28(11):1165-1170. [CrossRef] [Medline]
  2. Behmann M, Schmiemann G, Lingner H, Kühne F, Hummers-Pradier E, Schneider N. Job satisfaction among primary care physicians: results of a survey. Dtsch Arztebl Int. 2012;101(11):193-200. [FREE Full text] [CrossRef]
  3. Jutel AGG. Putting a Name to It: Diagnosis in Contemporary Society. Baltimore, Maryland. Johns Hopkins University Press; 2014.
  4. Balint M. The doctor, his patient, and the illness. Lancet. 1955;268(6866):683-688. [CrossRef] [Medline]
  5. Engle RL, Davis BJ. Present concepts of the meaning and limitations of medical diagnosis. Arch Intern Med. 1963;112:512-519. [CrossRef] [Medline]
  6. Engle RL. Attempts to use computers as diagnostic aids in medical decision making: a thirty-year experience. Perspect Biol Med. 1992;35(2):207-219. [CrossRef] [Medline]
  7. Pairon A, Philips H, Verhoeven V. A scoping review on the use and usefulness of online symptom checkers and triage systems: how to proceed? Front Med (Lausanne). 2022;9:1040926. [FREE Full text] [CrossRef] [Medline]
  8. Müller R, Klemmt M, Ehni HJ, Henking T, Kuhnmünch A, Preiser C, et al. Ethical, legal, and social aspects of symptom checker applications: a scoping review. Med Health Care Philos. 2022;25(4):737-755. [FREE Full text] [CrossRef] [Medline]
  9. Chambers D, Cantrell AJ, Johnson M, Preston L, Baxter SK, Booth A, et al. Digital and online symptom checkers and health assessment/triage services for urgent health problems: systematic review. BMJ Open. 2019;9(8):e027743. [FREE Full text] [CrossRef] [Medline]
  10. Lupton D, Jutel A. 'It's like having a physician in your pocket!' a critical analysis of self-diagnosis smartphone apps. Soc Sci Med. 2015;133:128-135. [CrossRef] [Medline]
  11. Gilbert S, Mehl A, Baluch A, Cawley C, Challiner J, Fraser H, et al. How accurate are digital symptom assessment apps for suggesting conditions and urgency advice? A clinical vignettes comparison to GPs. BMJ Open. 2020;10(12):e040269. [FREE Full text] [CrossRef] [Medline]
  12. Kuhn S, Jungmann SM, Jungmann F. Künstliche intelligenz für Ärzte und Patienten: "Googeln" war gestern. Dtsch Arztebl. 2018;115(26):A1262-A1266.
  13. Jutel A, Lupton D. Digitizing diagnosis: a review of mobile applications in the diagnostic process. Diagnosis (Berl). 2015;2(2):89-96. [FREE Full text] [CrossRef] [Medline]
  14. Denecke K, Tschanz M, Dorner TL, May R. Intelligent conversational agents in healthcare: hype or hope? Stud Health Technol Inform. 2019;259:77-84. [Medline]
  15. Kujala S, Hörhammer I, Hänninen-Ervasti R, Heponiemi T. Health professionals' experiences of the benefits and challenges of online symptom checkers. Stud Health Technol Inform. 2020;270:966-970. [CrossRef] [Medline]
  16. Semigran HL, Linder JA, Gidengil C, Mehrotra A. Evaluation of symptom checkers for self diagnosis and triage: audit study. BMJ. 2015;351:h3480. [FREE Full text] [CrossRef] [Medline]
  17. Altendorf M, Luckmann M, Lägel R, Amelung VE. Use of symptom checkers to increase care efficiency—competent patients and better decisions? Monitor Versorgungsforschung. 2023:66-70. [CrossRef]
  18. Müschenich M, Wamprecht L. Health 4.0—how are we doing tomorrow? Bundesgesundheitsbl. 2018;61(3):334-339. [CrossRef] [Medline]
  19. Miles O, West R, Nadarzynski T. Health chatbots acceptability moderated by perceived stigma and severity: a cross-sectional survey. Digit Health. 2021;7:20552076211063012. [FREE Full text] [CrossRef] [Medline]
  20. Summerton N, Cansdale M. Artificial intelligence and diagnosis in general practice. Br J Gen Pract. 2019;69(684):324-325. [FREE Full text] [CrossRef] [Medline]
  21. Gottliebsen K, Petersson G. Limited evidence of benefits of patient operated intelligent primary care triage tools: findings of a literature review. BMJ Health Care Inform. 2020;27(1):e100114. [FREE Full text] [CrossRef] [Medline]
  22. Bakker AB, Demerouti E, de Boer E, Schaufeli WB. Job demands and job resources as predictors of absence duration and frequency. J Vocat Behav. 2003;62(2):341-356. [CrossRef]
  23. Karasek R, Theorell T. Healthy Work: Stress, Productivity, and the Reconstruction of Working Life. New York. Basic Books, Inc; 1990.
  24. Johnson JV, Hall EM. Job strain, work place social support, and cardiovascular disease: a cross-sectional study of a random sample of the Swedish working population. Am J Public Health. 1988;78(10):1336-1342. [CrossRef] [Medline]
  25. Siegrist J. Adverse health consequences of continued effort-reward imbalance at work. Int J Psychol. 1992;27(3-4):599. [CrossRef]
  26. Döring A, Paul F. The German healthcare system. EPMA J. 2010;1(4):535-547. [FREE Full text] [CrossRef] [Medline]
  27. Palanica A, Flaschner P, Thommandram A, Li M, Fossat Y. Physicians' perceptions of chatbots in health care: cross-sectional web-based survey. J Med Internet Res. 2019;21(4):e12887. [FREE Full text] [CrossRef] [Medline]
  28. Wetzel A, Koch R, Preiser C, Müller R, Klemmt M, Ranisch R, et al. Ethical, legal, and social implications of symptom checker apps in primary health care (CHECK.APP): protocol for an interdisciplinary mixed methods study. JMIR Res Protoc. 2022;11(5):e34026. [FREE Full text] [CrossRef] [Medline]
  29. Ada. GmbH AH. 2020. URL: https://ada.com/ [accessed 2024-07-29]
  30. GmbH RfFM. German Innovation Award: Winners 2019. 2019. URL: https://www.german-innovation-award.de/en/winners/preis/gewinner/ada/ [accessed 2023-11-23]
  31. GmbH RfFS. German Brand Award: Winners 2019. 2019. URL: https://www.german-brand-award.com/preistraeger/galerie/detail/26114-tellada.html [accessed 2023-11-23]
  32. Tremmel S, Gieselmann H, Eikenberg R. Massive Datenschutzmängel in der Gesundheits-App Ada. 2019. URL: https://www.heise.de/news/Massive-Datenschutzmaengel-in-der-Gesundheits-App-Ada-4549354.html [accessed 2023-11-30]
  33. ÄrzteZeitung. TK legt Kooperation mit Ada Health auf Eis. 2019. URL: https://www.aerztezeitung.de/Wirtschaft/TK-legt-Kooperation-mit-Ada-Health-auf-Eis-404721.html [accessed 2023-11-30]
  34. Sauer J. Hausärzte-Chef erteilt Diagnose-App Ada klare Absage. 2022. URL: https:/​/www.​hausarzt.digital/​politik/​hausaerzteverband/​bundesverband/​weigeldt-erteilt-diagnose-app-ada-klare-absage-42908.​html [accessed 2022-05-22]
  35. Timmermans S, Berg M. The practice of medical technology. Sociol Health Illness. 2003;25:97-114. [FREE Full text] [CrossRef] [Medline]
  36. Radionova N, Ög E, Wetzel A, Rieger MA, Preiser C. Impacts of symptom checkers for laypersons' self-diagnosis on physicians in primary care: scoping review. J Med Internet Res. 2023;25:e39219. [FREE Full text] [CrossRef] [Medline]
  37. Güthlin C, Beyer M, Erler A, Gensichen J, Hoffmann B, Mergenthal K. Recruitment of family practitioners for research: experiences from five studies. Z Allg Med. 2012;88(4):173-181. [CrossRef]
  38. Hummers-Pradier E, Scheidt-Nave C, Martin H, Heinemann S, Kochen MM, Himmel W. Simply no time? Barriers to GPs' participation in primary health care research. Fam Pract. 2008;25(2):105-112. [CrossRef] [Medline]
  39. Helfferich C. Die Qualität qualitativer Daten: Manual für die Durchführung qualitativer Interviews. Wiesbaden. VS Verlaf für Sozialwissenschaften; 2011.
  40. Kruse J. Qualitative Interviewforschungin integrativer Ansatz. Weinheim, Basel. Juventa Verlag GmbH; 2015.
  41. Gemeinsame Deutsche Arbeitsschutzstrategie. Consideration of psychosocial factors in risk assessment: recommendations for implementation in business practice. Gemeinsame Deutsche Arbeitsschutzstrategie. 2022. URL: https:/​/www.​gda-portal.de/​EN/​Download/​pdf/​Psychosocial-factors-in-risk-assessment.​pdf?__blob=publicationFile&v=1 [accessed 2024-05-24]
  42. Blumer H. What is wrong with social theory? Am Sociol Rev. 1954;19(1):3-10. [CrossRef]
  43. Birt L, Scott S, Cavers D, Campbell C, Walter F. Member checking: a tool to enhance trustworthiness or merely a nod to validation? Qual Health Res. 2016;26(13):1802-1811. [CrossRef] [Medline]
  44. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. Sep 2014;89(9):1245-1251. [FREE Full text] [CrossRef] [Medline]
  45. Wetzel AJ, Koch R, Koch N, Klemmt M, Müller R, Preiser C, et al. 'Better see a doctor?' status quo of symptom checker apps in Germany: a cross-sectional survey with a mixed-methods design (CHECK.APP). Digit Health. 2024;10:20552076241231555. [FREE Full text] [CrossRef] [Medline]
  46. Farnood A, Johnston B, Mair FS. A mixed methods systematic review of the effects of patient online self-diagnosing in the 'smart-phone society' on the healthcare professional-patient relationship and medical authority. BMC Med Inform Decis Making. 2020;20(1):253. [FREE Full text] [CrossRef] [Medline]
  47. Dourish P, Bell G. Divining a Digital Future: Mess and Mythology in Ubiquitous Computing. Cambridge, Massachusetts. The MIT Press; 2011.
  48. Bundesvereinigung K. Gesundheitsdaten: Niedergelassene Ärztinnen und Ärzte werden immer älter. 2023. URL: https://gesundheitsdaten.kbv.de/cms/html/16397.php [accessed 2023-11-30]
  49. Bundesvereinigung K. Ärztemangel. URL: https://www.kbv.de/html/themen_1076.php [accessed 2023-11-30]
  50. Bundesvereinigung K. Arztzeit-Mangel: Warum immer weniger Zeit für die Patientenversorgung da ist. URL: https://www.kbv.de/html/themen_38343.php [accessed 2023-11-30]
  51. Marcolino MS, Oliveira JAQ, D'Agostino M, Ribeiro AL, Alkmim MBM, Novillo-Ortiz D. The impact of mhealth interventions: systematic review of systematic reviews. JMIR Mhealth Uhealth. 2018;6(1):e23. [FREE Full text] [CrossRef] [Medline]
  52. Koch R, Steffen MT, Wetzel AJ, Preiser C, Klemmt M, Ehni H, et al. An interface between ehealth, health literacy and health-related behavior: qualitative interview study on laypersons experiences with a mobile symptom checker app. JMIR Preprints. Preprint posted online on May 17, 2024. [CrossRef]
  53. Ubel PA. Beyond costs and benefits: understanding how patients make health care decisions. Oncologist. 2010;15 Suppl 1:5-10. [FREE Full text] [CrossRef] [Medline]
  54. Nohl-Deryk P, Brinkmann JK, Gerlach FM, Schreyögg J, Achelrod D. Barriers to digitalisation of healthcare in Germany: a survey of experts. Gesundheitswesen. 2018;80(11):939-945. [CrossRef] [Medline]
  55. Caumanns J. For discussion: the state of digitization of the German healthcare system. Z Evid Fortbild Qual Gesundhwes. 2019;143:22-29. [CrossRef] [Medline]
  56. Lee K, Hoti K, Hughes JD, Emmerton LM. Consumer use of "Dr google": a survey on health information-seeking behaviors and navigational needs. J Med Internet Res. 2015;17(12):e288. [FREE Full text] [CrossRef] [Medline]
  57. Aboueid S, Liu RH, Desta BN, Chaurasia A, Ebrahim S. The use of artificially intelligent self-diagnosing digital platforms by the general public: scoping review. JMIR Med Inform. 2019;7(2):e13445. [FREE Full text] [CrossRef] [Medline]
  58. Blease C, Kaptchuk TJ, Bernstein MH, Mandl KD, Halamka JD, DesRoches CM. Artificial intelligence and the future of primary care: exploratory pualitative study of UK general practitioners' views. J Med Internet Res. 2019;21(3):e12802. [FREE Full text] [CrossRef] [Medline]
  59. Broussard M. More Than a Glitch: Confronting Race, Gender, and Ability Bias in Tech. Cambridge, Massachusetts. MIT Press; 2023.
  60. Noble S. Algorithms of Oppression: How Search Engines Reinforce Racism. New York. New York University Press; 2018.
  61. Benjamin R, editor. Captivating Technology: Race, Carceral Technoscience, and Liberatory Imagination in Everyday Life. Durham. Duke University Press; 2019.
  62. Cheung S. Disambiguating the benefits and risks from public health data in the digital economy. Big Data Soc. 2020;7(1):205395172093392. [CrossRef]
  63. Schmieding ML, Mörgeli R, Schmieding MAL, Feufel MA, Balzer F. Benchmarking triage capability of symptom checkers against that of medical laypersons: survey study. J Med Internet Res. 2021;23(3):e24475. [FREE Full text] [CrossRef] [Medline]
  64. Hennemann S, Kuhn S, Witthöft M, Jungmann SM. Diagnostic performance of an app-based symptom checker in mental disorders: comparative study in psychotherapy outpatients. JMIR Ment Health. 2022;9(1):e32832. [FREE Full text] [CrossRef] [Medline]
  65. Nateqi J, Lin S, Krobath H, Gruarin S, Lutz T, Dvorak T, et al. From symptom to diagnosis-symptom checkers re-evaluated : are symptom checkers finally sufficient and accurate to use? An update from the ENT perspective. HNO. 2019;67(5):334-342. [CrossRef] [Medline]
  66. Wallace W, Chan C, Chidambaram S, Hanna L, Iqbal FM, Acharya A, et al. The diagnostic and triage accuracy of digital and online symptom checker tools: a systematic review. NPJ Digital Med. 2022;5(1):118. [FREE Full text] [CrossRef] [Medline]
  67. Arbeitsschutzstrategie G. Consideration of Psychosocial Factors in Risk Assessment: Recommendations for Implementation in Business Practice. Gemeinsame Deutsche. Arbeitsprogramm Psyche; 2022.
  68. Gündel H, Born M, Drews A, Mulfinger N, Junne F, Müller A. Gesundheit von Krankenhauspersonal: Kaum Spielräume für Verbesserungen. Dtsch Arztebl. 2020;117(47):A-2281-B-1927.
  69. West CP, Dyrbye LN, Shanafelt TD. Physician burnout: contributors, consequences and solutions. J Intern Med. 2018;283(6):516-529. [FREE Full text] [CrossRef] [Medline]
  70. Viehmann A, Kersting C, Thielmann A, Weltermann B. Prevalence of chronic stress in general practitioners and practice assistants: personal, practice and regional characteristics. PLoS One. 2017;12(5):e0176658. [FREE Full text] [CrossRef] [Medline]
  71. Dreher A, Theune M, Kersting C, Geiser F, Weltermann B. Prevalence of burnout among German general practitioners: comparison of physicians working in solo and group practices. PLoS One. 2019;14(2):e0211223. [FREE Full text] [CrossRef] [Medline]
  72. Kujala S, Hörhammer I. Health care professionals’ experiences of web-based symptom checkers for triage: cross-sectional survey study. J Med Internet Res. 2022;24(5):e33505. [CrossRef]
  73. Grol R, Wensing M, Eccles M, Davis D. Improving Patient Care: The Implementation of Change in Health Care. Chichester. Wiley Blackwell; 2013.
  74. Antunes B, Harding R, Higginson IJ, EUROIMPACT. Implementing patient-reported outcome measures in palliative care clinical practice: a systematic review of facilitators and barriers. Palliative Med. 2014;28(2):158-175. [FREE Full text] [CrossRef] [Medline]
  75. Maguire R, McCann L, Miller M, Kearney N. Nurse's perceptions and experiences of using of a mobile-phone-based advanced symptom management system (ASyMS) to monitor and manage chemotherapy-related toxicity. Eur J Oncol Nurs. 2008;12(4):380-386. [CrossRef] [Medline]
  76. Mahlknecht A, Engl A, Piccoliori G, Wiedermann CJ. Supporting primary care through symptom checking artificial intelligence: a study of patient and physician attitudes in Italian general practice. BMC Prim Care. 2023;24(1):174. [FREE Full text] [CrossRef] [Medline]
  77. Ochmann R, an der Heiden I, Bernhard J. IHP-Survey Deutschland 2022—Befragung der Hausärztinnen und Hausärzte in Deutschland: Bericht für das Bundesministerium für Gesundheit. Berlin. iGES Institut; 2022.
  78. Fiske A, Buyx A, Prainsack B. The double-edged sword of digital self-care: physician perspectives from Northern Germany. Soc Sci Med. 2020;260:113174. [FREE Full text] [CrossRef] [Medline]
  79. Litchfield I, Burrows M, Gale N, Greenfield S. Understanding the invisible workforce: lessons for general practice from a survey of receptionists. BMC Primary Care. 2022;23(1):230. [FREE Full text] [CrossRef] [Medline]
  80. Poß-Doering R, Kunz A, Pohlmann S, Szecsenyi J. Engaging family physicians in a research project to pilot an electronic health record. Z Allg Med. 2019;95:515-519. [CrossRef]
  81. Malterud K, Siersma VD, Guassora AD. Sample size in pualitative interview studies: guided by information power. Qual Health Res. 2016;26(13):1753-1760. [CrossRef] [Medline]
  82. Fogel AL, Kvedar JC. Artificial intelligence powers digital medicine. NPJ Digital Med. 2018;1:5. [FREE Full text] [CrossRef] [Medline]
  83. Wattanapisit A, Teo CH, Wattanapisit S, Teoh E, Woo WJ, Ng CJ. Can mobile health apps replace GPs? A scoping review of comparisons between mobile apps and GP tasks. BMC Med Inf Decis Making. 2020;20(1):5. [FREE Full text] [CrossRef] [Medline]
  84. Versorgung ZK. Neues Angebot für Patient:innen zur Medizinischen Ersteinschätzung Online. 2021. URL: https://www.zi.de/das-zi/medien/medieninformationen-und-statements/detailansicht/7-dezember-2021 [accessed 2023-11-30]


AI: artificial intelligence
GP: general practitioner
SCA: symptom checker app


Edited by Y Gong; submitted 14.02.24; peer-reviewed by K Savolainen, F Balzer; comments to author 07.06.24; revised version received 01.08.24; accepted 22.08.24; published 18.11.24.

Copyright

©Christine Preiser, Natalia Radionova, Eylem Ög, Roland Koch, Malte Klemmt, Regina Müller, Robert Ranisch, Stefanie Joos, Monika A Rieger. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 18.11.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.