Background: Around the world, over half of the global population experiences noncommunicable diseases, resulting in premature death. Health care providers (HCPs) can deliver medical treatment from a distance by using digital advancements such as telemedicine. However, there is a limited understanding of the difficulties and opportunities of implementing telemedicine solutions in different socioeconomic and cultural environments, including Kuwait.
Objective: The purpose of this study is to (1) examine the obstacles and benefits of telemedicine in the context of diabetes treatment and management, as perceived by both HCPs and patients with diabetes; (2) investigate the nonfunctional requirements for telemedicine applications used in diabetes care and management; and (3) provide suggestions to enhance the integration and adoption of telemedicine in Kuwait’s health care system for diabetes care and management.
Methods: The research used a qualitative and exploratory design, with semistructured interviews as the main data collection method. Participants were recruited on the internet through social media platforms due to the COVID-19 pandemic. The results were analyzed using thematic analysis and the Framework Method. The “diffusion of innovation” model was used as a perspective to interpret the findings.
Results: A total of 20 participants were included in this study—10 HCPs and 10 patients with diabetes—all of whom supported telemedicine. The HCPs reported that many diabetes cases could be managed through telemedicine, with only a few requiring in-person visits. Patients with diabetes noted the convenience and time-saving aspect of telemedicine. Both groups recommended the creation of a secure and user-friendly telemedicine system similar to popular social media platforms. Additionally, participants emphasized the importance of telemedicine during the pandemic as a way to prioritize patient safety.
Conclusions: The results of this study provide valuable insights into the needs and preferences of both HCPs and patients with diabetes in a resource-rich country like Kuwait to embrace telemedicine. The COVID-19 pandemic has changed the way medical care is provided and has pushed both groups to consider digital solutions for ongoing diabetes management and treatment.
Globally, more than one-half of the world's population experience noncommunicable diseases (NCDs) causing premature death [, ]. Diabetes, cancer, cardiovascular diseases, and chronic respiratory diseases are considered the main types of NCDs [ ]. The International Diabetes Federation estimates that about 463 million individuals worldwide experience diabetes, with this number expected to reach 700 million individuals by 2045 with 681,100 reported cases in the State of Kuwait [ , ]. This results in an economic burden for individuals with diabetes as each would spend around US $2000 for treatments [ ]. According to the World Health Organization [ ], diabetes is solely responsible for 1.5 million deaths in 2019; almost half of all deaths due to diabetes happen before the age of 70 years.
Self-management and lifestyle adjustments are essential for patients with NCDs [, ]; regular checkups with physicians are mandatory to ensure health status. However, regular checkups are time and effort-consuming and may be inconvenient for patients to attend [ ]. With the technology available today, physicians can provide medical care remotely to patients and help save resources through telemedicine [ ]. The World Health Organization [ ] defines telemedicine as “the delivery of health care services, where distance is a critical factor, by all health care professionals using information and communication technologies for the exchange of valid information for diagnosis, treatment, and prevention of disease and injuries, research and evaluation, and for the continuing education of health care providers (HCPs), all in the interests of advancing the health of individuals and their communities.”
As technology is rapidly evolving, telemedicine consultations are now carried out via video calls from laptops or smartphones . It promises patients to deliver remote medical care over long distances at less cost [ ]. For NCDs management, telemedicine solutions can improve self-management, increase patient satisfaction with receiving medical test results from home, enhance diabetes control, and reduce stress [ , - ]. During the COVID-19 pandemic, telemedicine was reintroduced into the health care system globally and intensively. Kuwait was one of the countries that had not systematically introduced telemedicine in hospitals until the early start of the pandemic, when a large portion of HCPs provided health care services using telemedicine technology as a comfortable and safe alternative to physical visits [ - ].
While studies have proven the efficiency of using telemedicine, several barriers are limiting the adoption of this technology . Costs, technical issues (eg, internet speed and poor user experience), concerns for privacy and security, and patient population (eg, older patients and those that face difficulties using technology) were described as major barriers [ , ]. Especially for rural communities, internet inaccessibility can be a major barrier [ ]. Lifestyle, cultural beliefs, values, and social factors are crucial in managing diabetes and should be considered carefully for any intervention to be successful [ , ]. While opportunities exist for leveraging telemedicine for diabetes care and management, there is still little known about the contextual challenges and opportunities of leveraging telemedicine solutions in varying socioeconomic and cultural contexts, including the State of Kuwait.
This research aims to (1) examine the obstacles and benefits of telemedicine in the context of diabetes treatment and management, as perceived by both HCPs and patients with diabetes; (2) investigate the nonfunctional requirements for telemedicine applications used in diabetes care, and management; and (3) provide suggestions to enhance the integration and adoption of telemedicine in Kuwait’s health care system for diabetes care and management.
This study used a case study approach  to answer questions related to “how” and “why” telemedicine is worth the experience for patients with diabetes from the perspectives of patients and HCPs. Through semistructured interviews, this study primarily used a qualitative and exploratory design to uncover rich context-specific findings. This study followed the social science theory of “diffusion of innovation” [ ] which is highly used in measuring the population’s acceptance of adopting a new system or innovation [ ]. Driven by the “diffusion of innovation” theory, the questions were derived and inspired by previously published studies [ - ].
This study followed a purposeful convenience sampling approach that considered a random selection of participants with diverse backgrounds, roles, and demographics. Interviews were carried out from December 2020 to July 2021 during the COVID-19 pandemic. Using Instagram and WhatsApp, the researchers recruited the participants; contacts were made with participants either via direct messages or email. Based on the participants’ preferences, interviews have been conducted either face-to-face, over the phone, or on the internet using Microsoft Teams or Zoom apps (Zoom Video Communications, Qumu Corporation).
Before conducting an interview, each participant signed a consent form explaining the purpose of this study and how the information obtained will be protected. In cases where obtaining the participant’s signature was not possible (phone or on the internet), the participant was presented with the consent form and the interview commenced only after the participant agreed. Each interview involved 1 participant and lasted for approximately 35 (SD 11.75) minutes on average. The interviews were conducted in English or Arabic based on the participant’s preference, except for HCPs in English. Both face-to-face and phone interviews were audio-recorded and transcribed verbatim for analysis purposes.
The interviews with HCPs started with general technology used in the workplace before the pandemic. On the other hand, the interviews with patients with diabetes started with general diabetes management questions. The questions that followed the introductory questions were related to the participant’s knowledge about telemedicine’s challenges, nonfunctional requirements, challenges during the pandemic, and their suggested recommendations for improving telemedicine adoption and uptake; the questionnaires can be found inand .
The analysis of the transcripts followed a thematic analysis approach and used the Framework Method [, ]. This approach allowed the researchers to incorporate the perspectives and viewpoints of a diverse group of participants systematically. Initially, the analysis involved the familiarization of the researchers, independently, with the interview transcripts searching for basic observations and patterns in the data, and coding them accordingly. Iteratively, the researchers reviewed the coding concepts and grouped them into themes. The researchers met regularly to discuss, compare, corroborate, and revise codes and themes. Saturation was achieved at approximately the seventh and eighth interviews for patients with diabetes and HCPs, respectively. However, we preferred a cautious approach and continued the remaining interviews as planned.
The ethics committee of the Ministry of Health approved this study (REC 2019/1187).
In the following sections, we present the findings from the perspectives of HCPs and patients with diabetes separately. Overall, from December 2020 to July 2021, a total of 10 HCPs and 10 patients with diabetes agreed to participate in this study. Refer tofor a summary of the HCPs’ demographics and for a summary of the patients’ demographics.
|Health care providers (N=10)||Female (n=7), n||Male (n=3), n|
|Age group (years)|
|Years of experience|
|Patients (N=10)||Female (n=5), n||Male (n=5), n|
|Age group (years)|
|High school degree||3||0|
Perspectives of HCPs
Challenges and Opportunities
In total, 9 participants agree that this technology is compatible in Kuwait (Q1—refer tofor selected representative quotes). In addition, 1 participant felt that foot diabetes may be difficult to apply (Q2).
Representative quotes from participants. Q refers to quote; P refers to health care provider; C refers to patient with diabetes.
- Q1: I think it will improve patient care and probably improve the flow of clinics making them more flexible, I think I could see it being able to see a potentially larger volume of patients through virtual means rather than just because it does not increase efficiency. [P6]
- Q2: With a diabetic foot, we cannot tell anything because this patient today we need to see the wound because every day it is different, patient blood sugar also affects, some patients one day have stable sugar, somedays not, we cannot diagnose this telemedicine, diabetes it is possible but diabetic foot no. [P10]
- Q3: The patient will have fast contact with the doctor instead of waiting and going to the parking and booking appointment and waiting his turn. [P8]
- Q4: I do a lot of virtual care I have clinic on Tuesdays where we do a lot of telephone calls and I have to say that clinic I finish really quickly. [P6]
- Q5: Maybe if we had WhatsApp, we could make the visit short and give him instructions and advice I can tell him to come to emergency if they are feeling unwell. [P9]
- Q6: Infrastructure within the government whether this is a hospital-based or Ministry and the technology. [P3]
- Q7: The problem is in the implementation so if it is implemented right then it will be great but the problem with IT in our organization is their implementations are very poor. [P7]
- Q8: If we have to print the papers and then have to come to collect, then there is no benefit in doing virtual clinic. [P7]
- Q9: We also need people who are aware of technology we need classes to teach them how to use technology. [P8]
- Q10: The internet is very poor, so we find sometimes technical issues, the internet is off connection. [P2]
- Q11: [System name masked] is available in [hospital name masked] and [hospital name masked], [system name masked] system is bad it is not integrated with the labs or pharmacy just for the doctor to write in the file, for medication he needs to print paper and give to the patients. Also, there is no integration between hospitals. [P4]
- Q12: There shouldn't be any risks if it's used as a supporting method to help patients manage their care. [P3]
- Q13: Patients’ misunderstandings that lead to medical errors may be because it is new way of providing care so there may be more errors because the doctors and the patients are not used to it, but I think this is just a difficult in the beginning if we are cautious then that should not be a problem another thing of course if the implementation as I said. [P7]
- Q14: Unfortunately, my colleague hates it, a lot of them are camera shy and they don't like to appear in front of the camera they fear that maybe patients are recording the conversation behind the camera while you can't see them or they're taking pictures of them and spreading it over social media. [P1]
- Q15: My colleagues are already adopting this technology and we are all interested because this is where diabetes is going, in a conference they were talking about new technologies and how we adapted in diabetic education, diabetic clinic, at a visit, in follow-ups we are all into this approach. [P4]
- Q16: Safety is number one especially if I am going to use the system as also a payment portal for regarding to provide my services in the private sector. [P5]
- Q17: Now all the hospitals have their own system it is also safety that not everyone can view their record, it is safe that each hospital and each doctor can view only their patients record it is safety for the patient, but if the patient wants to go to another hospital, he can take permission from the doctor to take his record and he can go anywhere. [P8]
- Q18: If the system is implemented correctly people will know how to use it because people know how to use WhatsApp and Instagram and Twitter and all of these apps even older patients, they know how to use that because they are user-friendly. [P7]
- Q19: Accessibility of the system, uptime, being able to log in and everything working, the latency. [P7]
- Q20: I think we are using it now because it is probably safer than the patient coming in and getting covid, we probably need more data for specific patients like diabetes safety and what are the red flags that would need you to bring the patient in clinic. [P6]
- Q21: I think the biggest problem in safety is patients mix ups because a lot of patients have similar names, and this is an unrecognized problem in our hospitals in Kuwait a lot of patients have similar names ... we open the chart we start talking to the patients and prescribe medications and realize it is all in the wrong patient that can be huge problem. [P7]
- Q22: This is our big concern, for such cases the caregiver, we depend on the son, nanny or the nurse we contact them. [P2]
- Q23: We give them an option of the whether it is through Zoom or it is through the phone and most likely they pick that they want their consultation through the phone. [P1]
- Q24: Old people like to feel or see things not just speak they tend to be more emotional; I would rather have it as a video call maybe rather than just an audio or voice call. [P5]
- Q25: It has to be incorporated with the electronic medical records not as a separate way on how to deal with patients. [P3]
- Q26: Don’t make a lot of clicks, the easier it is the simple it is the better it is for the patients. [P4]
- Q27: Having good visuals either color relaxing for the eyes or easy on the eye. [P5]
- Q28: Make it simple and easy, easy to give information to the patients. [P9]
- Q29: Maybe alarming with blood glucose...a reminder would be good, especially now we are back to normal and if we want to continue with telemedicine. [P2]
- Q30: We need sign language for those deaf patients the doctor attends the appointment, but he does not have translator … and maybe the things to be heard for those who do not see. [P7]
- Q31: A lot of them were sleeping, not answering, not saying the right answers, why is your blood sugar high? Oh, what? I do not know… it's a vacation or whatever they say, the patient was not aware he does not have the awareness of stabilizing the blood sugar whether it is before or during COVID. So COVID did increase this problem under pretext of we are in pandemic and staying at home, so we overeat. [P4]
- Q32: The patient felt feared that no one will see them, or they don’t have the medications, but the good thing is we introduced telemedicine fast, this is number one, fast introduction. [P2]
- Q33: It was affected, the patient who does not have cars, the car is not available and there was a curfew and no taxi so how the patient can come? he cannot because of transportations. [P8]
- Q34: Many people hesitate to come not related to the safety of the clinic itself, but rather to many constraints including a curfew, people have less time to do many things during the day. [P5]
- Q35: Reducing crowding in the hospital, reducing exposure, reducing people who will catch covid or pass it, prevent what we call nosocomial (hospital spread) it was very helpful in terms of reducing covid risks but also freeing physicians and nurses to deal with covid related issues. [P6]
- Q36: It worked, it helped us to communicate with patients and help patients communicate with us. We were able to update them about their health and give them the right information about what to do with their sick or how to manage their chronic medical condition away from Clinic. We responded to their concerns and questions. We have them to refill their medications all these were done by these means of communication. [P3]
- Q37: Support all the staff in the hospital to improve telemedicine, give classes, to improve healthcare professional to improve telemedicine. [P8]
- Q38: Providing a good internet connection, is very important. [P2]
- Q39: The most important thing is that it is implemented well because if it is implemented well then people will love it and use it you don’t even have to convince them to use you just show it to them, and they will love it and use it. [P7]
- Q40: Establishing a law would make them feel better and would make them be more acceptance of it and it is all how you sell it. [P1]
- Q41: Form a group of interested people who would be interested in telemedicine with a representation of different institutions and different backgrounds and system design and software, engineers for sure, people who understand physical spaces and how that can be accommodated to enable telemedicine and physicians and clinicians as well. [P6]
- Q42: Having a distance conversation with my doctor without physically meeting him. [C10]
- Q43: All medical data about a person is stored in one place or a place where we can retrieve data. All the data from lab analysis results, to rays, to treatments, are stored in one place, or anyone can retrieve them from a specific place and then the doctor anywhere in the world in any health center. He sees the history and looks at all the treatments and he can prescribe treatments. [C9]
- Q44: You go to the appointment and find that the doctor is not in the hospital or took permission to leave or vacations and he did not say it before, so online much better support and it will make me stick to the appointment. [C6]
- Q45: When I am at work, I do not have to take permission, nor not going to work because I have to see the doctor no, I can finish the appointment in my workplace. [C10]
- Q46: I don’t believe the consultant does not know how to diagnosis, but in some cases, it cannot be done electronically like iris or pressure measurement he might have different equipment that what I have at home, they use more accurate equipment. [C9]
- Q47: Of course, it will be more comfortable, instead of you call them and arranging an appointment, and do not know when the appointment is or you go walk-in appointments that could annoy the patients' and might delay them by showing up between their appointments and someone misses his appointment, this way will be easier and more comfortable for people and people. [C8]
- Q48: Telemedicine is better in all stages, it is easier and more comfortable to let go of things like waiting in queue t and crowding, I mean, I can wait 3 or 4 hours to enter the doctor’s just for exactly 3 minutes follow up. but when it is online it is easier not only for me but also the doctor, I show him the reading results and then he decided if coming to the hospital is necessary. [C6]
- Q49: A face-to-face consultation, currently I see it as the best, but telemedicine certainly has goals, especially since we are Corona. We can benefit in the case that I have a great consultant outside Kuwait but for me, I prefer face-to-face. [C9]
- Q50: Of course, of course, it makes me keep the appointment because it will save me time and effort, and I will benefit. [C7]
- Q51: It will give me, easier access it will save money, it will save me time as well. And also, when I use telemedicine, it helps me to have entry to my data, an entry to my vitals on regular basis. [C1]
- Q52: I love to explore and discover and research the topic if it becomes official. [C8]
- Q53: I do not have the love of exploration; I wait for the results then decide. [C5]
- Q54: The examination is not accurate, other than face-to-face. It is possible that the doctor needs measurements. I can measure it with me, but the pressure device, for example, that I have is not like the one he has. It is a manual examination or when we need it, and this we lose by electronic medicine. [C9]
- Q55: There are no concerns... Except for the Internet it could disconnect. [C3]
- Q56: There must be a back-up and more printed, but in comparisons, you see it possible that there are many files that are lost by the government or, like when the warehouse was burnt, I see online, and it is easier because this is a record that I want to print. [C6]
- Q57: How will he manage to enter all the patients’ data, in diabetes we see the doctor less than the nurse or diabetes educator...even patients’ need to enter data if the blood sugar is not stable, but he does not write that in the logbook instead of in the application and see if the dosage was high or low, or maybe was it stress. [C1]
- Q58: It should not be complicated, because I do not have much experience with computers you know so I do not want complications I want it to be easy and when I open it, I want to have a direct way to reach the doctor with no complications. [C3]
- Q59: Maybe if someone enters my account and withdraws my data, I mean, for example, if there are blood tests inside and they pull the data and they know what I suffer from, and sometimes maybe the consultations are recorded with the doctor they can hear what I say to the doctor my fears or fears I have for the future, these are all information that I do not want anyone to know about. [C6]
- Q60: It is possible that there are hackers and they hack the patients’ information, but at the same time, one should think that what do they want with my information *laughs* just to see my insulin levels? it is fine I will tell you my dose, maybe some people could get sensitive about it if they think the disease as a flaw but not me. [C8]
- Q61: The fears are that there is an interference with the data, meaning in playing with the main data. This, if it happens in whether data is lost or played with data, will certainly affect the result, because it is data corruption or an error in data, so this is the confidentiality of storing information that no one can communicate the same to those who have an account in the bank The most important thing is that it is the bank’s security and its job again is the strength of the advisor himself that I will meet with him. [C9]
- Q62: With respect that there is no leakage between patients, the most important thing is honesty. [C9]
- Q63: The most important thing is speed and no lagging. [C10]
- Q64: The system should be compatible with the phone; some systems are not compatible with phones it gives you an error or cannot load the page because you are using it on your through phone or tablet. [C1]
- Q65: It should be simple, a report is sent via email for example if the system is hard to use, reminders for certain appointments and so and if we told them before, get notifications like ‘your report has been released’, your next appointment is tomorrow, accept the appointment so they don’t need to check on you by phone, you have the option to say yes or no, accept, reject. [C1]
- Q66: We could use the well-known social media networking, or we could design a special program for it, and the servers must be strong with minimum load errors and such, so prepare servers for this system. [C8]
- Q67: The language. I do not know English, so I ask my daughters to tell me what is written and translate for me, when the nurse does not know Arabic in the hospital I panic. [C5]
- Q68: To be honest, there is no effect on me, I see the doctor between three months, four months, sometimes times, five months. [C10]
- Q69: Yes, it did affect me, and I canceled my appointments during COVID-19 because I was afraid and did not check back because I did not want to go and get germs. [C5]
- Q70: Perhaps most of the things that happened to the dispensing of medicines, I did not need follow-ups with my doctor, but when I wanted to receive my medicine, the system was not well integrated, and they gave me the wrong medicine. [C6]
- Q71: It protected us diabetes patients the type where we did not have the protection, I mean why do I go to the hospital and catch epidemic from hospital or clinic, so this telemedicine has protected us it is like precautionary thing. [C4]
- Q72: The best thing was that it saved time, effort, and money. If appointments were online, it is better than going to the appointment in the hospital because online will reduce the spread of the virus. [C7]
- Q73: I think that is also a secondary way of doing things and we should look into it because we don’t know another pandemic may come so you have to be very much aware of that. [C1]
- Q74: It is possible that there are people who do not have much experience in technology, for example, they make lectures for people on how to use the program, educate the people because the technology as you said you can create it and use it however your like. [C8]
- Q75: Make interviews for different patients because they face problems different than mine, people are aware of other problems happening, from their perspective, and see many opinions the topic should be for public ... do questionnaire for all categories not just diabetes there are other diseases like immune deficiency let it be more general and make brochures or something for people to read if they have not done an interview so they are aware of it. [C3]
- Q76: First thing is honesty, do not to leak patient or patient information and to have fast service. [C7]
- Q77: The first recommendation is for the Ministry of Health to complete, the health issues, which is linking all the data of people in all centers. It is something very important, I collect all the information and put it in the system, and wherever I go to look at the data. [C9]
In total, 6 participants mentioned how patients complain about the time they waste in the parking area and the waiting area (Q3) Likewise, 2 participants mentioned that telemedicine does not only save the patient's time but theirs as well (Q4). Further, 8 participants stated that telemedicine could improve clinical practices with patients (Q5).
In total, 3 participants reported infrastructure as the main challenge (Q6). Along with infrastructure, 1 participant mentioned the importance of the implementation (Q7). The same participant mentioned that if we bring the patient to collect the papers there is no point in using telemedicine (Q8). In addition, 1 participant stated the importance of increasing technology awareness to increase the acceptance of telemedicine (Q9). Further, 4 participants mentioned technical issues and poor internet connection makes it difficult to rely on telemedicine (Q10). In total, 2 participants mentioned the importance of system integration (Q11).
In total, 1 participant mentioned that telemedicine is not risky if used along with physical visits (Q12). Of note, 6 participants mentioned that patients might misunderstand the given advice (Q13).
Trialability and Staff Acceptance
In total, 1 participant mentioned that her colleagues do not favor telemedicine for camera and trust reasons (Q14). While 7 participants reported their colleagues are interested in telemedicine (Q15).
Security and Confidentiality
In total, 1 participant mentioned that the security of the service is essential when it involves payment (Q16). In addition, 1 participant mentioned patients' records should remain confidential to their HCPs only (Q17).
Of note, 6 participants mentioned that user-friendly systems are what attract users of different ages (Q18).
In total, 1 participant mentioned more nonfunctional requirements attributes that should be supported (Q19).
Safe to Use
In total, 1 participant mentioned that telemedicine is safe to use under emergencies like COVID-19 but we need more data to determine whether telemedicine is safe to use under normal circumstances (Q20). In addition, 1 participant was uncertain of telemedicine use as it could result in a patient mix-up (Q21).
Older People Considerations
Of note, 4 participants mentioned that older people are advised to have a caregiver as they might have low levels of technology knowledge (Q22). In total, 1 participant mentioned that their workplace provides options for older people to choose from (Q23). In addition, 1 participant mentioned that older patients prefer to have visuals instead of audio so video consultations would be a better option as well as adjusting the website to be suitable for them (Q24).
Better System Recommendations
In total, 1 participant mentioned that telemedicine should be integrated with electronic health records (Q25). In addition, 1 participant mentioned that reducing clicks for systems is advisable (Q26). Further, 1 participant mentioned having visuals in the system to make it more friendly (Q27). Moreover, 1 participant recommends that the system should be easy (Q28). Furthermore, 1 participant mentioned there should be an alarm raised when the blood glucose is high or low (Q29). Notably, 2 participants suggest adding features for a patient with special needs and diabetes, such as sign language (Q30).
Telemedicine During Pandemics
Challenges During Lockdown
In total, 2 participants mentioned that one of the challenges they faced was finding the right timing to reach patients, sleep patterns, and not being honest with their answers (Q31). In total, 1 participant mentioned that the patient feared that they could not visit the doctor for a follow-up (Q32). Further, 2 participants mentioned that some patients faced transportation problems during the curfew (Q33). In addition, 1 participant mentioned that some patients had other obligations that they were committed to so they could not make it to the appointment due to time constraints (Q34).
Relative Advantages of Telemedicine During the Pandemic
In total, 10 participants agreed that telemedicine during the pandemic has its advantages for patients’ safety (Q35). In total, 1 participant mentioned that they were able to reach the patients and provide them with treatment and updates (Q36).
In total, 3 participants suggested educating the staff and patients through lectures and workshops (Q37). Further, 3 participants mentioned establishing good service and a strong internet connection (Q38). In total, 1 participant focused on the importance of implementation because if it is not well implemented then no one will use it (Q39).
In total, 1 participant mentioned that there should be laws and regulations when using telemedicine (Q40). Further, 1 participant mentioned forming a group of individuals who are interested in telemedicine (Q41).
Perspectives of Patients With Diabetes
All 10 patients were aware of the definition of telemedicine; 1 participant stated (Q42). One of our participants was a computer programmer who defined telemedicine from his perspective (Q43).
Challenges and Opportunities
In total, 1 participant mentioned that it is easier to cancel an appointment on the internet rather than going to the hospital and waiting for the appointment to receive the cancelation (Q44). Further, 2 participants mentioned an advantage of telemedicine by not having to take permission to leave work to attend an appointment, it can be done in the workplace (Q45).
In total, 3 participants mentioned that diagnosing medical complaints from a patient with diabetes can be a challenge (Q46).
Patients With Diabetes Who Experienced Telemedicine
In total, 4 participants have experience with telemedicine. All 4 participants agreed that they had a comfortable feeling communicating with their health provider on the internet (Q47). Further, 2 participants prefer telemedicine appointments rather than face-to-face ones (Q48). Furthermore, 2 participants preferred face-to-face consultation but do favor using telemedicine in some situations (Q49).
All 10 participants agree that web-based appointments would encourage them to keep up with the appointment (Q50). All 10 participants agreed that telemedicine will save time and money (Q51). Of note, 7 early adopter participants mentioned that they would like to explore telemedicine by themselves (Q52). Further, 2 laggards mentioned that they would rather observe the results of telemedicine rather than directly adopt it (Q53).
In total, 3 participants mentioned that their concern is that there might be a misdiagnosis or misunderstanding (Q54). In total, 1 participant said that internet connection could be a concern (Q55). In addition, 1 participant mentioned that there should be backup data that he could print himself (Q56). In total, 1 participant was concerned about data entry and how the doctor will enter each patient’s data with minimum visits (Q57).
In total, 7 participants noted that telemedicine applications must be easy to use (Q58).
Security and Data Integrity
Of note, 4 participants mentioned they care about security and confidentiality (Q59). Further, 2 participants mentioned that security is not a concern to use telemedicine (Q60). In total, 1 participant mentioned the importance of how to preserve the data in telemedicine (Q61). The same participant mentioned that honesty is also a factor that telemedicine should include (Q62).
Performance and Availability
In total, 5 participants mentioned that telemedicine should be fast performance and available most of the time (Q63).
In total, 2 participants mentioned that telemedicine should be compatible with different devices (Q64).
In total, 1 participant mentioned that sending appointment reminders, and notifications would be appreciated (Q65). In addition, 1 participant mentioned that servers for the system should be strong with minimum errors (Q66). Further, 3 participants mentioned that telemedicine should support the mother language (Q67).
Telemedicine During Pandemics
Lockdown Appointments Challenges
In total, 2 participants mentioned that the lockdown did not have any effect on their appointments (Q68). Of note, 7 participants mentioned that they were worried about catching COVID-19 so they canceled the appointments (Q69). Further, 1 participant mentioned that he did not have a problem with appointments as much as problems with receiving the medicine (Q70).
Relative Advantages for Telemedicine During a Pandemic
All 10 participants agreed that telemedicine has many advantages during the pandemic—in our case COVID-19 (Q71). Of note, 5 participants mentioned that telemedicine will reduce virus spread as well as save time and effort (Q72). In total, 1 participant mentioned that telemedicine is secondary, and we need to have it ready if another pandemic occurs (Q73).
Of note, 4 participants mentioned that people need to be educated about telemedicine and how to use it through lectures (Q74). In total, 1 participant reported that researchers should do more interviews and surveys to have a complete understanding of patients' perspectives (Q75). In addition, 1 participant mentioned that honesty is a priority (Q76). Moreover, 1 participant suggested that the Ministry of Health should link the health data across health centers (Q77).
The results of this study showed that the majority of the participants, including HCPs and patients with diabetes, are aware of and eager to adopt telemedicine technology. This is the first study that explores the challenges and opportunities of telemedicine adoption for diabetes care and management in Kuwait. Patients with diabetes require frequent monitoring and appointments, which can be challenging to manage in person. Telemedicine provides a solution for HCPs to deliver medical care remotely through video calls on mobile or computer devices.
Previous studies have used telemedicine videoconferencing and in-person consultations for patients with diabetes to evaluate the impact on hemoglobin A1c levels and to help patients improve their management through lifestyle changes ; although a small decrease was noted in both groups, patients who used telemedicine showed more satisfaction [ , ].
Not all our participants with diabetes have experienced telemedicine, however, they were more enthused to attempt it. Notable patients’ responses to the challenges of adopting telemedicine are that the physicians might misdiagnose their health condition and may not provide accurate information. However, the fear of misdiagnosis is also present in patients who hesitate to seek physical medical care in the first place [, ].
HCP participants in this study have illustrated the importance of building trust between HCPs and patients for telemedicine to succeed as a reliable method for delivering health care . According to similar studies, the researchers found that patients would be more inclined to use telemedicine if they could communicate with the same HCP they were already comfortable with in person, thus helping them accept telemedicine [ - ].
A crucial key to continuously using telemedicine in health care systems is to pay attention to the nonfunctional requirements mainly focusing on ease of use and user-friendliness. The participants in this study were from varying age groups and pointed out that to use the system needs to be easy and friendly to use; similar results were found in a recent study that used telemedicine for patients and caregivers with head and neck conditions who reported that they were satisfied with using it because of how easy it was to use .
Security requirements were controversial; patients were either concerned that physicians may misuse their data or patients would not mind third parties viewing personal data. Similar studies recommend producing a well-planned implementation structure for the adoption of telemedicine according to the regulations for protection [, ].
COVID-19 raised the need of adopting telemedicine across the globe to reduce the spread of the virus among patients, especially with patients with low immunity as well as to stay in communication with patients during lockdowns. Some of our participants have been introduced to web-based consultations through phone calls and social media communication applications resulting in feedback that it was satisfying in terms of time-saving. A recent study explained that telemedicine maintains unnecessary social distances yet succeeds at disaster management [, ]. HCPs report that one challenge facing the adoption of telemedicine is the staff’s insufficient knowledge of technology, and reported that it can be time-consuming for staff to change workflows [ , ].
Surprisingly, older patients in our study gave positive and supportive feedback regarding the use of telemedicine, not to mention that one of the HCPs shared that older patients are good with using technology. Age is not a factor to limit telemedicine to a certain group age as similar studies found that older patients are using technology . HCPs have mentioned that patients with disability and diabetes require more attention and need to focus on adding design and functional features [ ].
To enhance the adoption and usage of telemedicine for diabetes care and management, participants in this study have provided suggestions for relevant stakeholders. IT staff can work together to provide educational sessions, training workshops, and hands-on experience for both HCPs and patients with diabetes to ensure they are ready for the new system and can provide feedback for continuous improvement . Distributing surveys after telemedicine implementation can help to better understand how users feel about it and how it has affected their treatment, it can be useful to measure the level of population acceptance of telemedicine adoption.
Policy makers are required to generate new regulation laws and ethical concerns to help minimize the risks of telemedicine consumption and help protect HCPs and patients' medical rights. Another recommendation to minimize risks and concerns for the users is to focus on a good implementation strategy. Because telemedicine needs internet to work, it is vital to provide strong internet connection in hospitals, this will ensure better performance, as well as ensure a high scalability system.
Because telemedicine is a useful tool to deliver medical care to remote locations, there are opportunities to expand the reach of care services to patients with diabetes across the globe and provide the services they require conveniently. Additionally, developers of telemedicine platforms should consider borrowing similar design concepts from social media platforms due to many people being familiar with using such platforms for communication purposes, which in turn can ensure ease of use of telemedicine .
Study Strengths and Limitations
Like other studies, this research has certain limitations. The participants were limited to those over 21 years old, and further research is needed to understand the perspectives of adolescent patients on telemedicine adoption. Although the patients with diabetes in this study were eager to adopt telemedicine and recruited through social media, more interviews with a diverse range of socioeconomic backgrounds would be necessary to understand those who do not support telemedicine. The COVID-19 pandemic has limited the outreach to this study’s population and relied on the use of social media and web-based communication platforms to recruit participants. This study aimed to gain in-depth knowledge on the topic, not to generalize the results, as there is limited evidence available. While the findings may relate to similar cultural contexts of neighboring nations, caution should be exercised before assuming applicability. Future research could gather data from a larger and more diverse group of patients with diabetes and HCPs in various settings (ie, health system organization, population characteristics, and cultural context).
The findings of this study provide important insights into the challenges and opportunities of adopting telemedicine for diabetes care and management in Kuwait, including during the times of health emergencies such as the COVID-19 pandemic. This qualitative and exploratory study sheds light on the perspectives of both patients with diabetes and HCPs regarding the adoption and use of telemedicine in Kuwait. Participants were generally familiar with and interested in using telemedicine and noted its benefits, such as saving time and increasing patient safety. However, they also highlighted the importance of ensuring a secure and user-friendly system, as well as providing education and training for HCPs and patients with diabetes. Policy makers and HCPs should consider these findings as they work to improve the adoption and use of telemedicine for diabetes care in Kuwait.
We would like to express our gratitude to the Ministry of Health, Kuwait, and all the participants who agreed to participate in this study. We thank Fajer Al Khalifah for her time to review this paper.
Conflicts of Interest
Health care professionals' interview questions.DOCX File , 35 KB
Patients with diabetes interview questions.DOCX File , 33 KB
- Benziger CP, Roth GA, Moran AE. The Global Burden of Disease study and the preventable burden of NCD. Glob Heart 2016;11(4):393-397 [https://globalheartjournal.com/articles/abstract/10.1016/j.gheart.2016.10.024] [CrossRef] [Medline]
- Badr H, Maktabi MA, Al-Kandari M, Sibai AM. Review of non-communicable disease research activity in Kuwait: where is the evidence for the best practice? Ann Glob Health 2019;85(1):45 [https://europepmc.org/abstract/MED/30924616] [CrossRef] [Medline]
- Noncommunicable diseases. World Health Organization. 2018. URL: https://www.who.int/news-room/fact-sheets/detail/noncommunicable-diseases [accessed 2019-09-04]
- Country profile: Kuwait. International Diabetes Federation. 2019. URL: https://idf.org/our-network/regions-members/middle-east-and-north-africa/members/38-kuwait.html [accessed 2019-09-03]
- Saeedi P, Petersohn I, Salpea P, Malanda B, Karuranga S, Unwin N, IDF Diabetes Atlas Committee. Global and regional diabetes prevalence estimates for 2019 and projections for 2030 and 2045: results from the International Diabetes Federation Diabetes Atlas, 9 edition. Diabetes Res Clin Pract 2019;157:107843 [https://www.diabetesresearchclinicalpractice.com/article/S0168-8227(19)31230-6/fulltext] [CrossRef] [Medline]
- Alkandari A, Longenecker JC, Barengo NC, Alkhatib A, Weiderpass E, Al-Wotayan R, et al. The prevalence of pre-diabetes and diabetes in the Kuwaiti adult population in 2014. Diabetes Res Clin Pract 2018;144:213-223 [CrossRef] [Medline]
- Diabetes. World Health Organization. 2021. URL: https://www.who.int/news-room/fact-sheets/detail/diabetes [accessed 2022-01-23]
- Task Force on diabetes, pre-diabetes, and cardiovascular diseases of the European Society of Cardiology (ESC), European Association for the Study of Diabetes (EASD), Rydén L, Grant PJ, Anker SD, Berne C, et al. ESC guidelines on diabetes, pre-diabetes, and cardiovascular diseases developed in collaboration with the EASD—summary. Diab Vasc Dis Res 2014;11(3):133-173 [https://journals.sagepub.com/doi/10.1177/1479164114525548?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub 0pubmed] [CrossRef] [Medline]
- So CF, Chung JW. Telehealth for diabetes self-management in primary healthcare: a systematic review and meta-analysis. J Telemed Telecare 2018;24(5):356-364 [CrossRef] [Medline]
- Taber JM, Leyva B, Persoskie A. Why do people avoid medical care? A qualitative study using national data. J Gen Intern Med 2015;30(3):290-297 [https://europepmc.org/abstract/MED/25387439] [CrossRef] [Medline]
- Kane CK, Gillis K. The use of telemedicine by physicians: still the exception rather than the rule. Health Aff (Millwood) 2018;37(12):1923-1930 [https://www.healthaffairs.org/doi/10.1377/hlthaff.2018.05077] [CrossRef] [Medline]
- A health telematics policy in support of WHO's health-for-all strategy for global health development: report of the WHO Group Consultation on Health Telematics: report No.: WHO/DGO/98.1. World Health Organization. Geneva, Switzerland; 1998. URL: https://apps.who.int/iris/handle/10665/63857 [accessed 2022-09-03]
- Mackillop L, Loerup L, Bartlett K, Farmer A, Gibson OJ, Hirst JE, et al. Development of a real-time smartphone solution for the management of women with or at high risk of gestational diabetes. J Diabetes Sci Technol 2014;8(6):1105-1114 [https://europepmc.org/abstract/MED/25004915] [CrossRef] [Medline]
- Bashshur RL, Shannon GW, Smith BR, Woodward MA. The empirical evidence for the telemedicine intervention in diabetes management. Telemed J E Health 2015;21(5):321-354 [http://hdl.handle.net/2027.42/140288] [CrossRef] [Medline]
- Ayatollahi H, Hasannezhad M, Fard HS, Haghighi MK. Type 1 diabetes self-management: developing a web-based telemedicine application. Health Inf Manag 2016;45(1):16-26 [CrossRef] [Medline]
- L'Esperance ST, Perry DJ. Assessing advantages and barriers to telemedicine adoption in the practice setting: a MyCareTeam(TM) exemplar. J Am Assoc Nurse Pract 2016;28(6):311-319 [CrossRef] [Medline]
- Vatnøy TK, Thygesen E, Dale B. Telemedicine to support coping resources in home-living patients diagnosed with chronic obstructive pulmonary disease: patients' experiences. J Telemed Telecare 2017;23(1):126-132 [CrossRef] [Medline]
- Armstrong D, Moore J, Fraher EP, Frogner BK, Pittman P, Spetz J. COVID-19 and the health workforce. Med Care Res Rev 2021;78(1_suppl):4S-6S [CrossRef] [Medline]
- Zhu D, Paige SR, Slone H, Gutierrez A, Lutzky C, Hedriana H, et al. Exploring telemental health practice before, during, and after the COVID-19 pandemic. J Telemed Telecare 2021:1357633X211025943 [https://journals.sagepub.com/doi/10.1177/1357633X211025943] [CrossRef] [Medline]
- Rettinger L, Klupper C, Werner F, Putz P. Changing attitudes towards teletherapy in Austrian therapists during the COVID-19 pandemic. J Telemed Telecare 2023;29(5):406-414 [https://journals.sagepub.com/doi/abs/10.1177/1357633X20986038?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub 0pubmed] [CrossRef] [Medline]
- Fraticelli F, Nicola MD, Vitacolonna E. A nutritional web-based approach in obesity and diabetes before and during the COVID-19 lockdown. J Telemed Telecare 2023;29(2):91-102 [https://europepmc.org/abstract/MED/33081596] [CrossRef] [Medline]
- Lin CCC, Dievler A, Robbins C, Sripipatana A, Quinn M, Nair S. Telehealth in health centers: key adoption factors, barriers, and opportunities. Health Aff (Millwood) 2018;37(12):1967-1974 [https://www.healthaffairs.org/doi/10.1377/hlthaff.2018.05125] [CrossRef] [Medline]
- Weber AS, Turjoman R, Shaheen Y, Al Sayyed F, Hwang MJ, Malick F. Systematic thematic review of e-health research in the Gulf Cooperation Council (Arabian Gulf): Bahrain, Kuwait, Oman, Qatar, Saudi Arabia and United Arab Emirates. J Telemed Telecare 2017;23(4):452-459 [CrossRef] [Medline]
- Hosseini H, Yilmaz A. Using telehealth to address pediatric obesity in rural Pennsylvania. Hosp Top 2019;97(3):107-118 [CrossRef] [Medline]
- Rebolledo JA, Arellano R. Cultural differences and considerations when initiating insulin. Diabetes Spectr 2016;29(3):185-190 [https://europepmc.org/abstract/MED/27574375] [CrossRef] [Medline]
- Caballero AE. The "A to Z" of managing type 2 diabetes in culturally diverse populations. Front Endocrinol (Lausanne) 2018;9:479 [https://europepmc.org/abstract/MED/30233490] [CrossRef] [Medline]
- Yin RK. Case Study Research: Design and Methods. Thousand Oaks, California: Sage Publications; 2014.
- Zhang X, Yu P, Yan J, Spil ITAM. Using diffusion of innovation theory to understand the factors impacting patient acceptance and use of consumer e-health innovations: a case study in a primary care clinic. BMC Health Serv Res 2015;15:71 [https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-015-0726-2] [CrossRef] [Medline]
- Dearing JW, Cox JG. Diffusion of innovations theory, principles, and practice. Health Aff (Millwood) 2018;37(2):183-190 [https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-015-0726-2] [CrossRef] [Medline]
- Lien ASY, Jiang YD. Integration of diffusion of innovation theory into diabetes care. J Diabetes Investig 2017;8(3):259-260 [https://europepmc.org/abstract/MED/27550077] [CrossRef] [Medline]
- Abosede OE. Diffusion of innovation theory: an effective approach to accelerate adoption of information and communication technology in twenty-first century knowledge society. Int J Innov Stud 2020;9(4):147-155 [http://www.internationaljournalcorner.com/index.php/ijird_ojs/article/view/152423] [CrossRef]
- Albarrak AI, Mohammed R, Almarshoud N, Almujalli L, Aljaeed R, Altuwaijiri S, et al. Assessment of physician's knowledge, perception and willingness of telemedicine in Riyadh region, Saudi Arabia. J Infect Public Health 2021;14(1):97-102 [https://linkinghub.elsevier.com/retrieve/pii/S1876-0341(19)30139-X] [CrossRef] [Medline]
- Ritchie J, Lewis J, Nicholls C, Ormston R. In: Ritchie J, Lewis J, editors. Qualitative Research Practice: A Guide for Social Science Students and Researchers. Los Angeles: SAGE Publications; 2013.
- Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol 2013;13:117 [https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-13-117] [CrossRef] [Medline]
- Aberer F, Hochfellner DA, Mader JK. Application of telemedicine in diabetes care: the time is now. Diabetes Ther 2021;12(3):629-639 [https://europepmc.org/abstract/MED/33474646] [CrossRef] [Medline]
- Sood A, Watts SA, Johnson JK, Hirth S, Aron DC. Telemedicine consultation for patients with diabetes mellitus: a cluster randomised controlled trial. J Telemed Telecare 2018;24(6):385-391 [CrossRef] [Medline]
- Dixon RF, Zisser H, Layne JE, Barleen NA, Miller DP, Moloney DP, et al. A virtual type 2 diabetes clinic using continuous glucose monitoring and endocrinology visits. J Diabetes Sci Technol 2020;14(5):908-911 [https://journals.sagepub.com/doi/abs/10.1177/1932296819888662?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub 0pubmed] [CrossRef] [Medline]
- Mubaraki AA, Alrabie AD, Sibyani AK, Aljuaid RS, Bajaber AS, Mubaraki MA. Advantages and disadvantages of telemedicine during the COVID-19 pandemic era among physicians in Taif, Saudi Arabia. Saudi Med J 2021;42(1):110-115 [https://europepmc.org/abstract/MED/33399180] [CrossRef] [Medline]
- Almundi K, Esmaeil B, Ahmad I. Exploring the adoption challenges of Shlonik application during the COVID-19 pandemic in Kuwait. J Health Inf Dev Countries 2021;15(1):1-10 [https://www.jhidc.org/index.php/jhidc/article/view/321]
- Bradford NK, Caffery LJ, Smith AC. Awareness, experiences and perceptions of telehealth in a rural Queensland community. BMC Health Serv Res 2015;15:427 [https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-015-1094-7] [CrossRef] [Medline]
- Welch BM, Harvey J, O'Connell NS, McElligott JT. Patient preferences for direct-to-consumer telemedicine services: a nationwide survey. BMC Health Serv Res 2017;17(1):784 [https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-017-2744-8] [CrossRef] [Medline]
- Orrange S, Patel A, Mack WJ, Cassetta J. Patient satisfaction and trust in telemedicine during the COVID-19 pandemic: retrospective observational study. JMIR Hum Factors 2021;8(2):e28589 [https://humanfactors.jmir.org/2021/2/e28589/] [CrossRef] [Medline]
- Triantafillou V, Layfield E, Prasad A, Deng J, Shanti RM, Newman JG, et al. Patient perceptions of head and neck ambulatory telemedicine visits: a qualitative study. Otolaryngol Head Neck Surg 2021;164(5):923-931 [CrossRef] [Medline]
- Crico C, Renzi C, Graf N, Buyx A, Kondylakis H, Koumakis L, et al. mHealth and telemedicine apps: in search of a common regulation. ecancermedicalscience 2018;12:853 [https://air.unimi.it/handle/2434/587365] [CrossRef] [Medline]
- Christiansen EK, Skipenes E, Hausken MF, Skeie S, Østbye T, Iversen MM. Shared electronic health record systems: key legal and security challenges. J Diabetes Sci Technol 2017;11(6):1234-1239 [https://europepmc.org/abstract/MED/28560899] [CrossRef] [Medline]
- Elkbuli A, Ehrlich H, McKenney M. The effective use of telemedicine to save lives and maintain structure in a healthcare system: current response to COVID-19. Am J Emerg Med 2021;44:468-469 [https://europepmc.org/abstract/MED/32303410] [CrossRef] [Medline]
- Latifi R, Doarn CR. Perspective on COVID-19: finally, telemedicine at center stage. Telemed J E Health 2020;26(9):1106-1109 [https://www.liebertpub.com/doi/10.1089/tmj.2020.0132] [CrossRef] [Medline]
- Kruse CS, Karem P, Shifflett K, Vegi L, Ravi K, Brooks M. Evaluating barriers to adopting telemedicine worldwide: a systematic review. J Telemed Telecare 2018;24(1):4-12 [https://journals.sagepub.com/doi/abs/10.1177/1357633X16674087?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub 0pubmed] [CrossRef] [Medline]
- Sagaro GG, Battineni G, Amenta F. Barriers to sustainable telemedicine implementation in Ethiopia: a systematic review. Telemed Rep 2020;1(1):8-15 [https://europepmc.org/abstract/MED/35722252] [CrossRef] [Medline]
- Eiland L, Thangavelu T, Drincic A. Has technology improved diabetes management in relation to age, gender, and ethnicity? Curr Diab Rep 2019;19(11):111 [CrossRef] [Medline]
- Annaswamy TM, Verduzco-Gutierrez M, Frieden L. Telemedicine barriers and challenges for persons with disabilities: COVID-19 and beyond. Disabil Health J 2020;13(4):100973 [https://europepmc.org/abstract/MED/32703737] [CrossRef] [Medline]
- Crossen S, Raymond J, Neinstein A. Top 10 tips for successfully implementing a diabetes telehealth program. Diabetes Technol Ther 2020;22(12):920-928 [https://europepmc.org/abstract/MED/32191141] [CrossRef] [Medline]
- Ju HH. Using telehealth for diabetes self-management in underserved populations. Nurse Pract 2020;45(11):26-33 [https://journals.lww.com/tnpj/Fulltext/2020/11000/Using_telehealth_for_diabetes_self_management_in.6.aspx] [CrossRef] [Medline]
|HCP: health care provider|
|NCD: noncommunicable disease|
Edited by A Kushniruk; submitted 07.02.23; peer-reviewed by C Doarn, M Sousa, V Brahmbhatt; comments to author 15.04.23; revised version received 22.07.23; accepted 28.07.23; published 07.09.23Copyright
©Rabab Altabtabaei, Dari Alhuwail. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 07.09.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.