This paper is in the following e-collection/theme issue:

Design and Usability of Medical Devices (86) Clinical Decision Support for Anaesthesiology (4) New and Emerging Methods and Tools in Surgery and Anaesthesiology (40) User-centred Design Case Studies (564)

Published on in Vol 11 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/47991, first published .
User Perceptions of Visual Clot in a High-Fidelity Simulation Study: Mixed Qualitative-Quantitative Study

User Perceptions of Visual Clot in a High-Fidelity Simulation Study: Mixed Qualitative-Quantitative Study

User Perceptions of Visual Clot in a High-Fidelity Simulation Study: Mixed Qualitative-Quantitative Study

Authors of this article:

Greta Gasciauskaite1 Author Orcid Image ;   Clara Castellucci1 Author Orcid Image ;   Amos Malorgio1 Author Orcid Image ;   Alexandra D Budowski1 Author Orcid Image ;   Giovanna Schweiger1 Author Orcid Image ;   Michaela Kolbe2 Author Orcid Image ;   Daniel Fries1 Author Orcid Image ;   Bastian Grande1 Author Orcid Image ;   Christoph B Nöthiger1 Author Orcid Image ;   Donat R Spahn1 Author Orcid Image ;   Tadzio R Roche1 Author Orcid Image ;   David W Tscholl1 Author Orcid Image ;   Samira Akbas1 Author Orcid Image
Article Authors Cited by Tweetations (2) Metrics

    Original Paper

    1Institute of Anesthesiology, University Hospital Zurich, Zurich, Switzerland

    2Simulation Centre, University Hospital Zurich, Zurich, Switzerland

    Corresponding Author:

    Samira Akbas, MD

    Institute of Anesthesiology

    University Hospital Zurich

    Raemistrasse 100

    Zurich, 8091

    Switzerland

    Phone: 41 432532242

    Email: Samira.Akbas@usz.ch


    Background: Viscoelastic hemostatic assays, such as rotational thromboelastometry (ROTEM) or thromboelastography, enable prompt diagnosis and accelerate targeted treatment. However, the complex interpretation of the results remains challenging. Visual Clot—a situation awareness-based visualization technology—was developed to assist clinicians in interpreting viscoelastic tests.

    Objective: Following a previous high-fidelity simulation study, we analyzed users’ perceptions of the technology, to identify its strengths and limitations from clinicians’ perspectives.

    Methods: This is a mixed qualitative-quantitative study consisting of interviews and a survey. After solving coagulation scenarios using Visual Clot in high-fidelity simulations, we interviewed anesthesia personnel about the perceived advantages and disadvantages of the new tool. We used a template approach to identify dominant themes in interview responses. From these themes, we defined 5 statements, which were then rated on Likert scales in a questionnaire.

    Results: We interviewed 77 participants and 23 completed the survey. We identified 9 frequently mentioned topics by analyzing the interview responses. The most common themes were “positive design features,” “intuitive and easy to learn,” and “lack of a quantitative component.” In the survey, 21 respondents agreed that Visual Clot is easy to learn and 16 respondents stated that a combination of Visual Clot and ROTEM would help them manage complex hemostatic situations.

    Conclusions: A group of anesthesia care providers found Visual Clot well-designed, intuitive, and easy to learn. Participants highlighted its usefulness in emergencies, especially for clinicians inexperienced in coagulation management. However, the lack of quantitative information is an area for improvement.

    JMIR Hum Factors 2024;11:e47991

    doi:10.2196/47991

    Keywords

    Visual Clot; blood coagulation; blood coagulation test; hemostasis; rotational thromboelastometry; situation awareness; user-centered design; visualization; user; perception; interpretation; thromboelastography; viscoelastic hemostatic; technology; coagulation; quantitative information 


    Rapid hemostatic assessment is essential to targeted coagulation management in acute bleeding [1]. Increasingly used viscoelastic hemostatic assays, such as rotational thromboelastometry (ROTEM) or thromboelastography, enable faster insights into coagulation dysfunction than conventional laboratory tests. Standard coagulation assays are not optimal for managing acute hemorrhages that require rapid therapeutic action, as it often takes more than an hour to obtain the results [2,3]. European and North American transfusion recommendations underline the advantages of viscoelastic hemostatic assays for managing trauma and severe perioperative bleeding, including the reduced need for transfusions, fewer perioperative complications, shorter hospitalization, and lower overall treatment costs [1,4,5]. Its usefulness has been demonstrated in many operative areas such as obstetrics [6,7], pediatric surgery [8], transplantation [9], cardiac surgery [10,11], neurosurgery [12], and burn surgery [13,14]. Viscoelastic hemostatic tests are also paramount in the diagnostic and treatment adjustment of hematological disorders, such as inherited afibrinogenemia, hemophilia, or multiple myeloma [15-18]. However, despite these technologies’ widespread use and considerable advantages, their results’ interpretation remains challenging and requires well-trained clinical personnel [19-21]. Visual Clot—a situation awareness-based visualization technology—was developed to support health care professionals in interpreting viscoelastic test results by reducing the complexity of their presentation. Based on raw ROTEM data, the results are displayed in real time as a 3D animated model of a blood clot to represent various elements of hemostasis, including platelets, plasmatic factors, and fibrin. It can also effectively illustrate the influence of heparin and hyperfibrinolysis [22] (Multimedia Appendix 1). In a high-fidelity simulation study, anesthesiologists using Visual Clot were 2.2 times more likely to articulate the correct therapeutic approach. In addition, these anesthesiologists had a lower median time to administer the first appropriate targeted coagulation product. Overall, physicians presented with the results of viscoelastic testing using Visual Clot were approximately 56% more likely to provide accurate therapeutic interventions. In the same study, physicians were 3.5 times more likely to feel confident in their decisions when working with Visual Clot compared to traditional ROTEM results [23]. In the first computer-based study analyzing user perceptions of Visual Clot, participants described the technology as well-designed, easy to learn, and intuitive [24]. The guiding principles of the Visual Clot technology that result in enhanced situation awareness include Endsley’s user-centered design principles [25], Wittgenstein's philosophy as articulated in Tractatus Logico-Philosophicus [26], and insights from the National Aeronautics and Space Administration (NASA) publication “On Organization of Information: Approach and Early Work” by Degani et al [27]. Endsley’s principles emphasize the use of direct visual representations of data to enhance situational awareness, a central principle in Visual Clot's data visualization. Wittgenstein's theory emphasizes the importance of logical representations that meaningfully correspond to the reality they are intended to represent. Visual Clot follows this principle by visually representing elements such as fibrin, platelets, plasmatic factors, hyperfibrinolysis, and bleeding. Following NASA's approach, Visual Clot strives to achieve the highest level of “order and wholeness” by consolidating all essential data into a single display. The primary goal of Visual Clot technology is to provide the care provider with situational information quickly and with minimal cognitive load. In this study, we aimed to capture and analyze perceptions of anesthesia personnel working with Visual Clot in a high-fidelity simulation to identify the strengths and recognize the potential for future improvements.


    Ethical Considerations

    The Cantonal Ethics Committee of the Canton of Zurich reviewed the study protocol and issued a declaration of no objection (Business Management System for Ethics Committees Number Req-2021-01112). Furthermore, each participant gave informed consent to use his or her data for research purposes. Participation was voluntary and without financial compensation.

    Study Design

    We conducted a researcher-initiated single-center mixed qualitative-quantitative study at the University Hospital Zurich, Institute of Anesthesiology, Switzerland. Study participants were anesthesia personnel, including staff anesthesiologists, residents, and nurses. After participating in a high-fidelity simulation study of perioperative bleeding scenarios, where they worked with Visual Clot and ROTEM, we interviewed participants on their perceptions of Visual Clot technology.

    As a second step, the same participants received an email invitation to participate in a survey a few weeks later. They rated statements we generated from identified and frequently mentioned themes in interview responses on a Likert scale.

    Previous High-Fidelity Simulation Study

    In the high-fidelity simulation study [23], anesthesia teams, composed of a staff anesthesiologist, a resident, and an anesthesia nurse, participated in high-fidelity perioperative bleeding scenarios using either Visual Clot or ROTEM. The primary outcome of the study was correct targeted coagulation therapy. Secondary outcomes were time to targeted coagulation therapy, confidence, and workload.

    ROTEM is the standard of care for managing acute hemorrhage in the study center, so all participants were familiar with the technology before participating [20]. Some participants had taken part in previous Visual Clot studies and, therefore, were already familiar with the technology [22,24].

    Nevertheless, before the simulations began, we gave a 10-minute presentation that reviewed ROTEM and introduced Visual Clot. Multimedia Appendix 1 provides an instructional video of Visual Clot. Participants were invited to ask questions freely before starting work in the simulation environment. Each team solved 1 of 4 different perioperative bleeding scenarios, which were randomly allocated. We ended the scenarios when all necessary therapeutic measures were derived or, at the latest, after 15 minutes. Figure 1 illustrates an example of a Visual Clot printout used in the simulation study.

    ‎
    Figure 1. A Visual Clot result presentation showing a fibrin deficiency. The fibrin in the clot is shown as a dashed line, indicating its absence. The blood drops indicate the presence of a coagulation pathology.

    Participant Interviews

    After the simulations, we encouraged the participants to freely verbalize their thoughts in a distraction-free environment while the data collectors made field notes. The only suggestion to the participants before the interviews was to verbalize their positive and negative opinions of Visual Clot. The participants could define final adjustments in the collected answers at the end of the interviews.

    Survey

    In the second step, we formulated 5 statements to summarize the insights gathered during the interviews. The statements were submitted for evaluation on a 5-point Likert scale graded from “strongly agree” to “strongly disagree.” An email invitation was sent to all interviewed participants.

    Outcomes and Statistical Analyses

    Part I: Participant Interviews

    Collected interview responses were translated from original German to English using a translation system DeepL (DeepL GmbH). Multimedia Appendix 2 provides the complete translated field notes.

    The most commonly used terms in positive and negative responses were identified using the word count function. Word groups with the same root were united, excluding the frequently used filler words such as “to,” “and,” or “the” (Table 1). Using a template approach [28] we identified the major themes that dominated participants’ answers. As a result, we generated a coding tree (Figure 2). According to the coding template, we assigned statements to the themes. A total of 3 of the study authors, all anesthesiology residents GG, GS, and SA, rated the interview statements separately from each other using the coding tree (Figure 2). If the 3 investigators disagreed after multiple data coding, the final decision was taken in a joint discussion. Interrater reliability was calculated to investigate the consistency of the coding tree’s application.

    Table 1. The most commonly used positive and negative terms to describe Visual Clot.
    Positive termsNegative terms
    TermsFrequency, nTermsFrequency, n
    Easy or easier28Missing13
    Good16Quantitative or quantification11
    Fast or faster13Information9
    See a problem12Values8
    Interpret quickly11Time8
    Simple9Fibrinogen6
    Understand9Numbers6
    Visual8Hyperfibrinolysis6
    Interpretation7Less5
    Intuitive7Confusing4
    At a glance7Flashing4
    Overview7Simplified3
    ‎
    Figure 2. A coding tree representing the themes describing positive and negative user perceptions. ROTEM: rotational thromboelastometry.
    Part II: Survey

    The literature states that quantitative data can help generalize and confirm specific observations found in qualitative research [29-32]. For the subsequent survey, we defined 5 statements based on the previously identified themes. The same group of interviewed anesthesiologists was asked to rate them on 5-point Likert scales in a questionnaire created using Google Forms (Alphabet Inc). Participants were informed that the survey takes only a few minutes to complete, participation is voluntary, and no compensation is offered. The translated announcement of the survey invitation is displayed in Multimedia Appendix 3. The data collection was finished 3 weeks after the questionnaire was sent.

    Statistical Analysis

    The interview data analysis and figures were made using Microsoft Word and Excel (Microsoft Corp). We present the number of statements and their percentage distribution in the identified themes.

    To define the interrater reliability of the coding template, we calculated Fleiss’ Kappa using R (version 4.0.5; R Foundation for Statistical Computing). We calculated every statement's median and IQR for the survey analysis. We used the Wilcoxon signed rank test to determine the difference between the median and neutral answers. Statistical significance was indicated as P<.05.


    Study and Participant Characteristics

    Detailed information on the study and participants is provided in Table 2. Residents and nurses were the dominant participants in the interviews. The most experienced participant had 33 years of experience in anesthesia. The least experienced had less than 1 year. Residents and nurses also dominated the survey.

    Table 2. Study and participant characteristics.
    CharacteristicsValues
    Study characteristics

    		Total number of interviewed participants, n77

    		Total number of participants completed the survey, n23
    Participant characteristics

    		Interview participants


    		Staff physicians, n (%)8 (10.4)


    		Residents, n (%)35 (45.5)


    		Anesthesiology nurses, n (%)34 (44.2)


    		Anesthesia experience in years, median (IQR)8 (3-10)


    		Number of ROTEMa interpretations per year, median (IQR)26 (5-41)

    		Survey participants


    		Staff physicians, n (%)7 (30.4)


    		Residents, n (%)8 (34.8)


    		Anesthesiology nurses, n (%)8 (34.8)

    aROTEM: rotational thromboelastometry.

    Part I: Qualitative Analysis of Interview Answers

    Word Count Analysis

    The most frequently used words and word combinations used to describe the advantages of Visual Clot were: easier or easy (26/77, 33.8%), interpret or interpretation (23.4%, 18/77 participants), quick or quickly (19.5%, 15/77 participants), visual, visualize, visualized, or visualization (19.5%, 15/77 participants), good (16.9%, 13/77 participants), faster or fast (15.6%, 12/77 participants). In the group of statements describing the limitations of Visual Clot, the words and word groups most frequently used were: ROTEM (23.4%, 18/77 participants), missing (information or values or numbers; 16.9%, 13/77 participants), quantitative or quantification (16.9%, 13/77 participants). Table 1 visually represents the most commonly used words in positive and negative perceptions.

    Coding Tree

    Figure 2 shows the generated coding tree, including 2 main domains and 9 themes. The interrater reliability of the tree raters was 0.856 (95% CI 0.831-0.880), indicating almost perfect agreement [33].

    Statements Describing Visual Clot

    Table 3 demonstrates examples of statements assigned to particular subtopics with participant counts and percentages.

    A total of 4 comments were defined as positive but not assigned to any themes. There was 1 such statement in the negative group. A total of 19 comments were not assigned to any theme and were described as noncodable.

    Table 3. Statements examples assigned to particular domain and subtopics with participant count and percentages.
    Major domain and subtopicsExamples
    Positive statements describing Visual Clot (179/319, 56.1%)

    		Positive design features (63/295, 21.4%)
    • “Very simplified” (Participant 13).
    • “Visual presentation” (Participant 21).
    • “Tells figuratively what to do” (Participant 26).

    		Positive usability features (30/295, 10.2%)
    • “It can be perfectly integrated in the clinic” (Participant 24).
    • “A good tool to get an overview” (Participant 32).
    • “You can see at-a-glance what is missing” (Participant 70).

    		Intuitive and easy to learn (61/295, 20.7%)
    • “Directly applicable and does not require long training” (Participant 5).
    • “Very intuitive” (Participant 75).
    • “Easy to understand” (Participant 76).

    		Time saving (21/295, 7.1%)
    • “2-3 seconds to a quick overview” (Participant 22).
    • “Immediate detection of the problem” (Participant 5).
    • “Quick to interpret” (Participant 27).
    Negative statements describing Visual Clot (113/319, 35.4%)

    		Design problems (23/295, 7.8%)
    • “Confusing, blinking” (Participant 57).
    • “Quality of hyperfibrinolysis difficult to demonstrate” (Participant 22).
    • “Not everything you see is relevant” (Participant 24).

    		Usability problems (12/295, 4.1%)
    • “Quantity of change is not visible” (Participant 2).
    • “You have to know the pictures first” (Participant 30).
    • “No prioritization possible” (Participant 76).

    		Incompleteness: a lack of a quantitative component (62/295, 21.0%)
    • “Also values that are in normal range—is it close to the limit or not?” (Participant 54).
    • “No graduation ‘all or nothing’” (Participant 60).
    • “Exact quantification not possible” (Participant 4).

    		Need for training (15/295, 5.1%)
    • “Not yet established” (Participant 29).
    • “Needs to get used to it” (Participant 45).
    • “Needs habituation (not used by default yet)” (Participant 50).
    Combination: Visual Clot and ROTEMa (8/295, 2.7%)

    • “Would be nice to have it together with ROTEM” (Participant 50).
    • “Ideal solution if could be combined with ROTEM” (Participant 49).
    • “Combination of both necessary” (Participant 74).

    aROTEM: rotational thromboelastometry.

    Positive Statements Describing Visual Clot
    Positive Design Features

    Most comments were made on this topic, emphasizing that a “pictorially summarized” (participant 2) and “visually appealing” (participant 3) data presentation allows one to see “the relevant ROTEM information at-a-glance” (participant 9). Such a design supports health care professionals in making clinical decisions. It is essential in emergencies because the actual coagulation status is immediately visible (participant 14) and it is instantly apparent which hemostasis components are missing (participant 12).

    Positive Usability Features

    Visual Clot is “a good tool for broad application,” stated participant 72. It enables “pre-interpretation of the complex information” (participant 3) and focuses “on the essential” (participant 65). The benefits of the Visual Clot in urgent situations were also highlighted: the technology is “very good for emergencies,” stated participant 13.

    Intuitive and Easy to Learn

    As in the previous study [24], the Visual Clot was also described here as intuitive and easy to learn. “Very intuitive, short time needed to understand it,”—pointed out participant 6. It was underlined that visualizations provided by the Visual Clot are “quickly recognizable even by untrained persons or with little knowledge of coagulation” (participant 13).

    Time Saving

    The Visual Clot provides an “overview at-a-glance,” as participant 76 said. “I immediately saw what was missing,” stated participant 16. These features lead to quicker diagnosis—“focus is faster on the problem”—as participant 46 said, and thus to faster initiation of treatment.

    Negative Statements Describing Visual Clot
    Design Problems

    Several ideas that could potentially enhance Visual Clot's design were identified. Participant 47 pointed out that the presentation of platelets and fibrinogen are similar, and thus it is difficult to distinguish. Participant 48 also agreed: “I did not notice that platelets were missing because it was white and dashed like fibrinogen.” Some participants found that the Visual Clot is too dynamic—too much movement on the screen, which can lead to distraction and make the interpretation of the results difficult “Even if coagulation status is fine, everything is moving, and you can poorly differentiate what is missing” (participant 53), “moves too much, even if everything is fine—distraction” (participant 55).

    Usability Problems

    Visual Clot is “confusing at the beginning”—stated participant 31 and added that it is “difficult to use without routine.” Visual Clot provides “too much information at once,”—participant 53 pointed out.

    Incompleteness: Lack of a Quantitative Component

    The central Visual Clot aspect criticized was the technology's incompleteness in terms of lacking a quantitative component. Several participants stated that the Visual Clot is “not precise” (participant 1), which can be explained in the words of participants 53 and 9, respectively, who said that in the Visual Clot “quantitative is missing” and that one “can get more information with the ROTEM.”

    Need for Training

    The main point identified in the participants’ opinions on this topic was the lack of experience working with this technology and that it is a very new tool not yet established in clinical practice.

    Combination of Visual Clot and ROTEM

    Several participants said they could benefit from combining the Visual Clot and ROTEM when interpreting coagulation assays. “A combination of Visual Clot and ROTEM would be perfect,” pointed out participant 19, while participant 74 said, “a combination of both is necessary.” There was no difference in positive and negative statements based on participants' specialty or level of experience.

    Part II: Analysis of Statements Assessed in the Survey

    Figure 3 shows the detailed evaluation of the statements rated in the survey.

    ‎
    Figure 3. Pie charts presenting survey results with the number of participants who chose a particular category (N=23). ROTEM: rotational thromboelastometry.

    All sample medians differed statistically significantly from neutral (P<.05). The number of participants in the quantitative part of the evaluation differs from the qualitative part because not all participants completed the questionnaire. The results are presented as medians and IQR. P values are provided to indicate a statistically significant difference between the median of the sample and the neutral value.


    Principal Findings

    This mixed qualitative-quantitative study analyzed the perceptions of anesthesiology personnel regarding Visual Clot—a new situation-awareness and user-oriented visualization technology for viscoelastic hemostatic resuscitation—after the high-fidelity simulation study. User perceptions enable us to identify the positive aspects of the technology and reveal the potential for improvement in the future. After computer-based studies, this is the first time that Visual Clot has been evaluated in a high-fidelity simulation study, a validated process for testing a noncertified product in an environment that closely resembles clinical reality [34,35].

    The principal findings demonstrate that the design features of Visual Clot have received the most positive comments. As in the previous computer-based Visual Clot study [24], the participants of this high-fidelity simulation study emphasized that the way this technology is designed provides a good overview of the clotting situation and is an additional help in the decision-making process during acute bleeding situations. Further, Visual Clot was described as intuitive and easy to learn. Participants repeatedly mentioned that the results of Visual Clot are quickly recognizable and understandable even by inexperienced clinicians. The main criticism concerned the lack of quantitative information.

    Previous Visual Clot studies [22-24,36,37] underline the benefits of additional visualization technology, simplifying standard ROTEM data interpretation [20]. Anesthesia providers using Visual Clot in a high-fidelity simulation study were more likely to correctly administer targeted coagulation therapy and to give the first targeted coagulation product faster. In addition, participants demonstrated greater decision-making confidence with Visual Clot [23]. Moreover, the correctness of the clinical decisions was independent of previous rotational thromboelastometry knowledge and experience.

    The superior participants’ performance when working with Visual Clot may be explained by its design supporting the strengths of human sensory perception. The Visual Clot was developed to assist care providers in managing highly complex coagulation situations, presenting the data in an awareness-oriented interface design. The main aim of this design is to convey the information as quickly as possible and with the lowest cognitive effort [25].

    Principles of situation awareness-oriented and user-centered design enables effective data management and a comprehensive understanding of what is happening and thus help to stay situationally aware. This concept is essential in many domains, including medicine, where managing complex and dynamic situations is fundamental [38,39].

    Its definition breaks down into three separate phases (1) the perception of environmental elements in the current situation within a volume of time and space, (2) understanding their meaning, and (3) their projection in the near future. Based on this, the Visual Clot data are visually represented, preprocessed, and simplified. The results of coagulation parameters are divided into 3 categories: too low, normal, or too high. Such information presentation increases diagnostic confidence, but numeric indicators are needed for precise data analysis and targeted treatment initiation. As previously indicated, the lack of quantitative information is reflected in user responses. It also explains the participants’ considerations that combining Visual Clot and ROTEM would be helpful in clinical decision-making.

    Some other technologies based on situation awareness and user-centered design principles include Philips Visual Patient Avatar (Philips) [40], AlertWatch (AlertWatch Inc), Dynamic Lung Panel and PulmoSight (Hamilton Medical AG), HemoSight and Physiology Screen (Mindray Medical International Limited), and Alarm Status Visualizer (Masimo Corp) [41,42].

    This study showed user perceptions regarding the new situation awareness-based, user-oriented technology for thromboelastometry data presentation—Visual Clot. It makes us aware of the user’s needs and could help us simplify information processing and decision-making in the future. An integral facet of advancing the technological framework informed by the results of this study lies in the prospect of merging quantitative data into the Visual Clot platform and presenting this merged information in a consolidated interface. This concerted integration promises to align both quantitative and qualitative data to provide a more complete and accurate representation of prevailing conditions. This integration can be achieved in a variety of ways, including the direct overlay of numerical values onto the Visual Clot visualization, or the parallel juxtaposition of a complementary graphical representation alongside the numerical data set.

    Strengths and Limitations

    This study has several strengths and limitations. The interview part of the study has the typical limitations of qualitative research. The findings of qualitative analysis cannot be extrapolated to larger populations with the same certainty as quantitative results because the findings are on the subjective basis and not tested for statistical significance [43]. However, the quantitative survey helped to provide greater insight into the importance of the main themes identified. Moreover, the interviewed participants were selected according to their availability in the clinical praxis and not randomly.

    Furthermore, the number of participants in the survey was lower than in the interviews because not all participants in the simulation study completed the survey. Finally, it is a single-center study performed in a university hospital with high care standards in Europe. User perceptions may vary across diverse clinical settings in different parts of the world.

    Conclusions

    After previous studies investigating user perceptions of Visual Clot in computer-based simulation studies, this is the first study to analyze the user perceptions of Visual Clot in a high-fidelity simulation—the intermediate step between computer-based simulation studies in a laboratory and real-life use. In this study, Visual Clot appeared to be a well-accepted additional tool supporting health care professionals working with ROTEM. Based on participants’ perceptions, user-centered and situation awareness-oriented design, as shown in Visual Clot, can simplify the presentation of complex information and thus make critical decision-making quicker and more efficient. The benefits of this technology have been particularly highlighted in emergencies and even for care providers with little experience in coagulation management. Participants described Visual Clot as intuitive and easy to learn. The lack of a quantitative component has been identified as a significant limitation. These findings highlight the advantages of Visual Clot and its potential for improvement may help further develop this and other situation awareness-based technologies.

    Acknowledgments

    The authors are thankful to the study participants for their time and effort. The Institute of Anesthesiology of the University Hospital of Zurich, Zurich, Switzerland and the University of Zurich, Zurich, Switzerland funded this study.

    Data Availability

    The data sets used and analyzed during this study are available from the corresponding author on reasonable request.

    Authors' Contributions

    GG, AM, CC, ADB, GS, MK, BG, CBN, TRR, DWT, and SA contributed to the conceptualization; GG, AM, CC, ADB, GS, MK, BG, CBN, TRR, DWT, and SA contributed to the methodology; GG, GS, and SA performed the formal analysis; AM, CC, ADB, GS, TRR, and DWT contributed to the investigation; GG, GS, and SA performed data curation; GG and DWT contributed to writing—original draft preparation; GG, DRS, CBN, DWT, SA, and DF contributed to writing—review and editing; GG and DWT contributed to visualization; DWT and SA performed supervision; and DWT performed project administration.

    Conflicts of Interest

    DRS’s academic department is receiving grant support from the Swiss National Science Foundation, Berne, Switzerland, the Swiss Society of Anesthesiology and Perioperative Medicine, Berne, Switzerland, the Swiss Foundation for Anesthesia Research, Zurich, Switzerland, Vifor SA, Villars-sur-Glâne, Switzerland and Vifor (International) AG, St. Gallen, Switzerland. DRS is cochair of the ABC-Trauma Faculty, sponsored by unrestricted educational grants from Novo Nordisk Health Care AG, Zurich, Switzerland, CSL Behring GmbH, Marburg, Germany, LFB Biomédicaments, Courtaboeuf Cedex, France and Octapharma AG, Lachen, Switzerland. DRS received honoraria or travel support for consulting or lecturing from Alliance Rouge, Bern, Switzerland, Danube University of Krems, Austria, European Society of Anesthesiology and Intensive Care, Brussels, BE, International Foundation for Patient Blood Management, Basel, Switzerland, Korean Society of Anesthesiologists, Seoul, Korea, Network for the Advancement of Patient Blood Management, Haemostasis and Thrombosis, Paris, France, Society for the Advancement of Blood Management, Mount Royal NJ, Alexion Pharmaceuticals Inc, Boston, MA, AstraZeneca AG, Baar, Switzerland, Bayer AG, Zürich, Switzerland, B. Braun Melsungen AG, Melsungen, Germany, Baxter AG, Glattpark, Switzerland, CSL Behring GmbH, Hattersheim am Main, Germany and Berne, Switzerland, CSL Vifor (Switzerland) Villars-sur-Glâne, Switzerland, CSL Vifor (International), St Gallen, Switzerland, Celgene International II Sàrl, Couvet, Switzerland, Daiichi Sankyo AG, Thalwil, Switzerland, Haemonetics, Braintree, Massachusetts, United States, LFB Biomédicaments, Courtaboeuf Cedex, France, Merck Sharp & Dohme, Kenilworth, New Jersey, United States, Novo Nordisk Health Care AG, Zurich, Switzerland, Octapharma AG, Lachen, Switzerland, Pharmacosmos A/S, Holbaek, Denmark, Pierre Fabre Pharma, Alschwil, Switzerland, Portola Schweiz GmbH, Aarau, Switzerland, Roche Diagnostics International Ltd, Reinach, Switzerland, Sarstedt AG & Co, Sevelen, Switzerland and Nümbrecht, Germany, Shire Switzerland GmbH, Zug, Switzerland, Takeda, Glattpark, Switzerland, Werfen, Bedford, MA, Zuellig Pharma Holdings, Singapore, Singapore. CBN is an inventor of Visual Patient and Visual Patient Predictive technologies, for which the University of Zurich and Koninklijke Philips N.V. hold patents, patent applications, design protections, and trademarks. Joint-development and licensing agreements exist with Philips Medizin Systeme Böblingen GmbH, Böblingen, Germany; Koninklijke Philips N.V., Amsterdam, The Netherlands; Philips Research/Philips Electronics Nederland BV, Eindhoven, The Netherlands; and Philips USA, Cambridge, Massachusetts, United States. Within the framework of these agreements, CBN receives travel support, lecturing and consulting honoraria, and may potentially receive royalties in the event of successful commercialization. CBN is an inventor of Visual Clot technology, with patent applications, design protections, and trademarks held by the University of Zurich. In case of successful commercialization, CBN may receive royalties. CBN is an inventor of Visual Blood technology, for which the University of Zurich holds patent applications and design protections; potential royalties may follow successful commercialization. CBN received travel support, lecturing, and consulting honoraria from Instrumentation Laboratory—Werfen, Bedford, Massachusetts, United States. DWT is the first named inventor of Visual Patient and Visual Patient Predictive technologies, for which the University of Zurich and Koninklijke Philips N.V. hold patents, patent applications, design protections, and trademarks. Joint-development and licensing agreements exist with Philips Medizin Systeme Böblingen GmbH, Böblingen, Germany; Koninklijke Philips N.V., Amsterdam, The Netherlands; Philips Research/Philips Electronics Nederland BV, Eindhoven, The Netherlands; and Philips USA, Cambridge, Massachusetts, United States. Within the framework of these agreements, DWT receives research funding, travel support, lecturing and consulting honoraria, and may potentially receive royalties in the event of successful commercialization. DWT also holds a position on the Philips Patient Safety Advisory Board. DWT is the first named inventor of Visual Clot technology, with patent applications, design protections, and trademarks held by the University of Zurich. In case of successful commercialization, DWT may receive royalties. DWT is the first named inventor of Visual Blood technology, for which the University of Zurich holds patent applications and design protections; potential royalties may follow successful commercialization. Additionally, DWT received travel support, lecturing, and consulting honoraria from Instrumentation Laboratory—Werfen, Bedford, Massachusetts, United States, the Swiss Foundation for Anaesthesia Research in Zurich, Switzerland, and the International Symposium on Intensive Care and Emergency Medicine in Brussels, Belgium. No other funding or competing interests declared.

    Multimedia Appendix 1

    Educational Visual Clot video.

    MOV File , 19983 KB
    Multimedia Appendix 2

    Complete translated field notes of participant interviews.

    PDF File (Adobe PDF File), 669 KB
    Multimedia Appendix 3

    Translated announcement of the survey invitation.

    PDF File (Adobe PDF File), 204 KB
    1. Spahn DR, Bouillon B, Cerny V, Duranteau J, Filipescu D, Hunt BJ, et al. The European guideline on management of major bleeding and coagulopathy following trauma: fifth edition. Crit Care. 2019;23(1):98. [FREE Full text] [CrossRef] [Medline]
    2. Weber CF, Zacharowski K. [Point of care 2.0: coagulation monitoring using Rotem® Sigma and Teg® 6S]. Anasthesiol Intensivmed Notfallmed Schmerzther. 2018;53(6):412-424. [CrossRef] [Medline]
    3. Riehl K, Lefering R, Maegele M, Caspers M, Migliorini F, Schenker H, et al. Is ROTEM diagnostic in trauma care associated with lower mortality rates in bleeding patients?-A retrospective analysis of 7461 patients derived from the TraumaRegister DGU®. J Clin Med. 2022;11(20):6150. [FREE Full text] [CrossRef] [Medline]
    4. American Society of Anesthesiologists Task Force on Perioperative Blood Management. Practice guidelines for perioperative blood management: an updated report by the American Society of Anesthesiologists Task Force on perioperative blood management*. Anesthesiology. 2015;122(2):241-275. [FREE Full text] [CrossRef] [Medline]
    5. Tibi P, McClure RS, Huang J, Baker RA, Fitzgerald D, Mazer CD, et al. STS/SCA/AmSECT/SABM update to the clinical practice guidelines on patient blood management. Ann Thorac Surg. 2021;112(3):981-1004. [FREE Full text] [CrossRef] [Medline]
    6. Collins PW, Lilley G, Bruynseels D, Laurent DBS, Cannings-John R, Precious E, et al. Fibrin-based clot formation as an early and rapid biomarker for progression of postpartum hemorrhage: a prospective study. Blood. 2014;124(11):1727-1736. [FREE Full text] [CrossRef] [Medline]
    7. McNamara H, Kenyon C, Smith R, Mallaiah S, Barclay P. Four years' experience of a ROTEM® -guided algorithm for treatment of coagulopathy in obstetric haemorrhage. Anaesthesia. 2019;74(8):984-991. [FREE Full text] [CrossRef] [Medline]
    8. Wikkelsø A, Wetterslev J, Møller AM, Afshari A. Thromboelastography (TEG) or thromboelastometry (ROTEM) to monitor haemostatic treatment versus usual care in adults or children with bleeding. Cochrane Database Syst Rev. 2016;2016(8):CD007871. [FREE Full text] [CrossRef] [Medline]
    9. Hawkins RB, Raymond SL, Hartjes T, Efron PA, Larson SD, Andreoni KA, et al. Review: the perioperative use of thromboelastography for liver transplant patients. Transplant Proc. 2018;50(10):3552-3558. [CrossRef] [Medline]
    10. Weber CF, Görlinger K, Meininger D, Herrmann E, Bingold T, Moritz A, et al. Point-of-care testing: a prospective, randomized clinical trial of efficacy in coagulopathic cardiac surgery patients. Anesthesiology. 2012;117(3):531-547. [FREE Full text] [CrossRef] [Medline]
    11. Görlinger K, Dirkmann D, Hanke AA, Kamler M, Kottenberg E, Thielmann M, et al. First-line therapy with coagulation factor concentrates combined with point-of-care coagulation testing is associated with decreased allogeneic blood transfusion in cardiovascular surgery: a retrospective, single-center cohort study. Anesthesiology. 2011;115(6):1179-1191. [FREE Full text] [CrossRef] [Medline]
    12. Kvint S, Schuster J, Kumar MA. Neurosurgical applications of viscoelastic hemostatic assays. Neurosurg Focus. 2017;43(5):E9. [FREE Full text] [CrossRef] [Medline]
    13. Welling H, Ostrowski SR, Stensballe J, Vestergaard MR, Partoft S, White J, et al. Management of bleeding in major burn surgery. Burns. 2019;45(4):755-762. [CrossRef] [Medline]
    14. Sahli SD, Pedrazzi N, Braun J, Spahn DR, Kaserer A, Plock JA. Effect of a factor-based coagulation management on blood product use after major burn injury: a retrospective cohort study. Burns. 2021;47(7):1486-1494. [FREE Full text] [CrossRef] [Medline]
    15. Treliński J, Misiewicz M, Robak M, Smolewski P, Chojnowski K. Assessment of rotation thromboelastometry (ROTEM) parameters in patients with multiple myeloma at diagnosis. Thromb Res. 2014;133(4):667-670. [CrossRef] [Medline]
    16. Young GA, Carmona R, Garcia VC. Thromboelastography and thrombin generation assay in inherited afibrinogenemia. Haemophilia. 2018;24(6):e410-e416. [CrossRef] [Medline]
    17. Chitlur M, Rivard GE, Lillicrap D, Mann K, Shima M, Young G, et al. Factor VIII, Factor IX, and Rare Coagulation Disorders Subcommittee of the Scientific and Standardisation Committee of the International Society on Thrombosis and Haemostasis. Recommendations for performing thromboelastography/thromboelastometry in hemophilia: communication from the SSC of the ISTH. J Thromb Haemost. 2014;12(1):103-106. [FREE Full text] [CrossRef] [Medline]
    18. Young G, Sørensen B, Dargaud Y, Negrier C, Brummel-Ziedins K, Key NS. Thrombin generation and whole blood viscoelastic assays in the management of hemophilia: current state of art and future perspectives. Blood. 2013;121(11):1944-1950. [FREE Full text] [CrossRef] [Medline]
    19. Srivastava A, Kelleher A. Point-of-care coagulation testing. Contin Educ Anaesth Crit Care Pain. 2013;13(1):12-16. [FREE Full text] [CrossRef]
    20. Gasciauskaite G, Malorgio A, Castellucci C, Budowski A, Schweiger G, Kolbe M, et al. User perceptions of ROTEM-guided haemostatic resuscitation: a mixed qualitative-quantitative study. Bioengineering (Basel). 2023;10(3):386. [FREE Full text] [CrossRef] [Medline]
    21. Dixon A, Underwood S, Schreiber M. Implementing thrombelastography: experiences from a level I trauma institution. Transfusion. 2020;60(Suppl 6):S29-S32. [FREE Full text] [CrossRef] [Medline]
    22. Rössler J, Meybohm P, Spahn DR, Zacharowski K, Braun J, Nöthiger CB, et al. Improving decision making through presentation of viscoelastic tests as a 3D animated blood clot: the visual clot. Anaesthesia. 2020;75(8):1059-1069. [FREE Full text] [CrossRef] [Medline]
    23. Castellucci C, Malorgio A, Budowski AD, Akbas S, Kolbe M, Grande B, et al. Coagulation management of critically bleeding patients with viscoelastic testing presented as a 3D-animated blood clot (the visual clot): randomized controlled high-fidelity simulation study. J Med Internet Res. 2023;25:e43895. [FREE Full text] [CrossRef] [Medline]
    24. Roche TR, Said S, Rössler J, Gozdzik M, Meybohm P, Zacharowski K, et al. Physicians' perceptions of a situation awareness-oriented visualization technology for viscoelastic blood coagulation management (visual clot): mixed methods study. JMIR Serious Games. 2020;8(4):e19036. [FREE Full text] [CrossRef] [Medline]
    25. Endsley MR. Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition. Boca Raton, FL, USA. CRC Press Inc; 2011.
    26. Wittgenstein L. Tractatus Logico-Philosophicus. London, UK. Routledge & Kegan Paul; 1922.
    27. Degani A, Jorgensen C, Iverson D, Shafto M, Olson L. On Organization of Information: Approach and Early Work. Moffett Field, California. National Aeronautics and Space Administration, Ames Research Center; 2009.
    28. Symon G, Cassell C. Qualitative Organizational Research: Core Methods and Current Challenges. Thousand Oaks, CA. SAGE Publications; 2012.
    29. Guetterman TC, Fetters MD, Creswell JW. Integrating quantitative and qualitative results in health science mixed methods research through joint displays. Ann Fam Med. 2015;13(6):554-561. [FREE Full text] [CrossRef] [Medline]
    30. Smajic E, Avdic D, Pasic A, Prcic A, Stancic M. Mixed methodology of scientific research in healthcare. Acta Inform Med. 2022;30(1):57-60. [FREE Full text] [CrossRef] [Medline]
    31. Kaur N, Vedel I, El Sherif R, Pluye P. Practical mixed methods strategies used to integrate qualitative and quantitative methods in community-based primary health care research. Fam Pract. 2019;36(5):666-671. [FREE Full text] [CrossRef] [Medline]
    32. Webster CS, McKillop A, Bennett W, Bagg W. A qualitative and semiquantitative exploration of the experience of a rural and regional clinical placement programme. Med Sci Educ. 2020;30(2):783-789. [FREE Full text] [CrossRef] [Medline]
    33. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-174. [Medline]
    34. Merry AF, Hannam JA, Webster CS, Edwards KE, Torrie J, Frampton C, et al. Retesting the hypothesis of a clinical randomized controlled trial in a simulation environment to validate anesthesia simulation in error research (the VASER study). Anesthesiology. 2017;126(3):472-481. [FREE Full text] [CrossRef] [Medline]
    35. Kurup V, Matei V, Ray J. Role of in-situ simulation for training in healthcare: opportunities and challenges. Curr Opin Anaesthesiol. 2017;30(6):755-760. [CrossRef] [Medline]
    36. Castellucci C, Braun J, Said S, Roche TR, Nöthiger CB, Spahn DR, et al. Faster time to treatment decision of viscoelastic coagulation test results through improved perception with the animated visual clot: a multicenter comparative eye-tracking study. Diagnostics (Basel). 2022;12(5):1269. [FREE Full text] [CrossRef] [Medline]
    37. Said S, Roche TR, Braun J, Ganter MT, Meybohm P, Herrmann J, et al. Effects of an animated blood clot technology (visual clot) on the decision-making of users inexperienced in viscoelastic testing: multicenter trial. J Med Internet Res. 2021;23(5):e27124. [FREE Full text] [CrossRef] [Medline]
    38. Schulz C, Endsley MR, Kochs EF, Gelb AW, Wagner KJ. Situation awareness in anesthesia: concept and research. Anesthesiology. 2013;118(3):729-742. [FREE Full text] [CrossRef] [Medline]
    39. Kang J, Hu J, Yan C, Xing X, Tu S, Zhou F. Development and applications of the anaesthetists' non-technical skills behavioural marker system: protocol for a systematic review. BMJ Open. 2022;12(12):e065519. [FREE Full text] [CrossRef] [Medline]
    40. Patient monitoring: visual patient avatar. Philips. 2023. URL: https://www.philips.co.uk/healthcare/technology/visual-patient-avatar [accessed 2023-12-22]
    41. Products. mindray. 2023. URL: https://www.mindray.com/uk/products [accessed 2023-12-22]
    42. Gasciauskaite G, Lunkiewicz J, Roche TR, Spahn DR, Nöthiger CB, Tscholl DW. Human-centered visualization technologies for patient monitoring are the future: a narrative review. Crit Care. 2023;27(1):254. [FREE Full text] [CrossRef] [Medline]
    43. Atieno OA. An analysis of the strengths and limitation of qualitative and quantitative research paradigms. Probl Educ 21st Century. 2009;13:13-38. [FREE Full text]

    ‎
    NASA: National Aeronautics and Space Administration
    ROTEM: rotational thromboelastometry

    Edited by A Kushniruk; submitted 07.04.23; peer-reviewed by D Smriti, M Endsley; comments to author 23.09.23; revised version received 17.10.23; accepted 27.11.23; published 11.01.24.

    Copyright

    ©Greta Gasciauskaite, Clara Castellucci, Amos Malorgio, Alexandra D Budowski, Giovanna Schweiger, Michaela Kolbe, Daniel Fries, Bastian Grande, Christoph B Nöthiger, Donat R Spahn, Tadzio R Roche, David W Tscholl, Samira Akbas. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 11.01.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.