Letter to the Editor
We would like to share our ideas on the paper “Evaluating Voice Assistants’ Responses to COVID-19 Vaccination in Portuguese: Quality Assessment” . Seródio Figueiredo et al [ ] concluded, “Under the urgent context of COVID-19 vaccination, this work can help to understand how VAs must be improved to be more useful to the society and how careful people must be when considering VAs as a source of health information.” We agree that voice assistants (VAs) could be useful in managing COVID-19 mass immunization campaigns. Current reports can provide an overview of existing technologies and the mission of various VA suppliers in order to meet current information distribution requirements. However, as previously said, the question of system functioning remains critical. Findings on VAs still have variability and need to be harmonized [ ]. In addition, effective governance is required for transparency and usefulness in information partnerships [ ].
Seródio Figueiredo et al  assessed VAs via 2 evaluators. A set of questions was used. The focus was on agreement between the 2 evaluators. Interevaluator variability should be assessed and presented as well. In general, there should be 3 evaluators to aid the final decision. Additionally, the scoring system of this study might be easily influenced by bias. Essentially, any questionnaire-based study requires a reliability test of the questionnaire. Content validity, face validity, and criterion-related validity tests are required. A standard method, as presented by Bolarinwa [ ], should be used. A statistical analysis of the questionnaire’s reliability must be presented in addition to a general description. Without proven measures of questionnaire reliability and evaluator variability, the use of this tool in this study might be questionable.
Conflicts of Interest
The corresponding author of “Evaluating Voice Assistants’ Responses to COVID-19 Vaccination in Portuguese: Quality Assessment” declined to respond to this letter.
- Seródio Figueiredo CM, de Melo T, Goes R. Evaluating Voice Assistants' Responses to COVID-19 Vaccination in Portuguese: Quality Assessment. JMIR Hum Factors 2022 Mar;9(1):e34674 [FREE Full text] [CrossRef] [Medline]
- Alagha EC, Helbing RR. Evaluating the quality of voice assistants' responses to consumer health questions about vaccines: an exploratory comparison of Alexa, Google Assistant and Siri. BMJ Health Care Inform 2019 Nov;26(1) [FREE Full text] [CrossRef] [Medline]
- Bolarinwa OA. Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Niger Postgrad Med J 2015;22(4):195-201 [FREE Full text] [CrossRef] [Medline]
|VA: voice assistant|
Edited by T Leung; This is a non–peer-reviewed article. submitted 18.01.22; accepted 25.01.22; published 21.03.22Copyright
©Rujittika Mungmunpuntipantip, Viroj Wiwanitkit. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 21.03.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.