JMIR Human Factors JMIR Hum Factors JMIR Human Factors 2292-9495 JMIR Publications Toronto, Canada v11i1e47991 38206666 10.2196/47991 Original Paper Original Paper User Perceptions of Visual Clot in a High-Fidelity Simulation Study: Mixed Qualitative-Quantitative Study Kushniruk Andre Smriti Diva Endsley Mica Gasciauskaite Greta MD 1 https://orcid.org/0000-0003-4963-8489 Castellucci Clara MD 1 https://orcid.org/0000-0002-0517-6609 Malorgio Amos MD 1 https://orcid.org/0000-0002-1355-6804 Budowski Alexandra D MD 1 https://orcid.org/0000-0002-9721-3461 Schweiger Giovanna MD 1 https://orcid.org/0000-0002-9284-896X Kolbe Michaela Dr rer nat 2 https://orcid.org/0000-0001-6654-6370 Fries Daniel MD 1 https://orcid.org/0009-0005-1361-1200 Grande Bastian MD 1 https://orcid.org/0000-0003-2935-1317 Nöthiger Christoph B MD 1 https://orcid.org/0000-0002-0336-1421 Spahn Donat R MD 1 https://orcid.org/0000-0002-4782-183X Roche Tadzio R MD 1 https://orcid.org/0000-0002-1072-5748 Tscholl David W MD 1 https://orcid.org/0000-0002-3677-3705 Akbas Samira MD 1
Institute of Anesthesiology University Hospital Zurich Raemistrasse 100 Zurich, 8091 Switzerland 41 432532242 Samira.Akbas@usz.ch
https://orcid.org/0000-0001-7692-4718 Institute of Anesthesiology University Hospital Zurich Zurich Switzerland Simulation Centre University Hospital Zurich Zurich Switzerland Corresponding Author: Samira Akbas Samira.Akbas@usz.ch 2024 11 1 2024 11 e47991 7 4 2023 23 9 2023 17 10 2023 27 11 2023 ©Greta Gasciauskaite, Clara Castellucci, Amos Malorgio, Alexandra D Budowski, Giovanna Schweiger, Michaela Kolbe, Daniel Fries, Bastian Grande, Christoph B Nöthiger, Donat R Spahn, Tadzio R Roche, David W Tscholl, Samira Akbas. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 11.01.2024. 2024

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.

 Background

Viscoelastic hemostatic assays, such as rotational thromboelastometry (ROTEM) or thromboelastography, enable prompt diagnosis and accelerate targeted treatment. However, the complex interpretation of the results remains challenging. Visual Clot—a situation awareness-based visualization technology—was developed to assist clinicians in interpreting viscoelastic tests.

 Objective

Following a previous high-fidelity simulation study, we analyzed users’ perceptions of the technology, to identify its strengths and limitations from clinicians’ perspectives.

 Methods

This is a mixed qualitative-quantitative study consisting of interviews and a survey. After solving coagulation scenarios using Visual Clot in high-fidelity simulations, we interviewed anesthesia personnel about the perceived advantages and disadvantages of the new tool. We used a template approach to identify dominant themes in interview responses. From these themes, we defined 5 statements, which were then rated on Likert scales in a questionnaire.

 Results

We interviewed 77 participants and 23 completed the survey. We identified 9 frequently mentioned topics by analyzing the interview responses. The most common themes were “positive design features,” “intuitive and easy to learn,” and “lack of a quantitative component.” In the survey, 21 respondents agreed that Visual Clot is easy to learn and 16 respondents stated that a combination of Visual Clot and ROTEM would help them manage complex hemostatic situations.

 Conclusions

A group of anesthesia care providers found Visual Clot well-designed, intuitive, and easy to learn. Participants highlighted its usefulness in emergencies, especially for clinicians inexperienced in coagulation management. However, the lack of quantitative information is an area for improvement.

 Visual Clot blood coagulation blood coagulation test hemostasis rotational thromboelastometry situation awareness user-centered design visualization user perception interpretation thromboelastography viscoelastic hemostatic technology coagulation quantitative information Introduction

Rapid hemostatic assessment is essential to targeted coagulation management in acute bleeding [1]. Increasingly used viscoelastic hemostatic assays, such as rotational thromboelastometry (ROTEM) or thromboelastography, enable faster insights into coagulation dysfunction than conventional laboratory tests. Standard coagulation assays are not optimal for managing acute hemorrhages that require rapid therapeutic action, as it often takes more than an hour to obtain the results [2,3]. European and North American transfusion recommendations underline the advantages of viscoelastic hemostatic assays for managing trauma and severe perioperative bleeding, including the reduced need for transfusions, fewer perioperative complications, shorter hospitalization, and lower overall treatment costs [1,4,5]. Its usefulness has been demonstrated in many operative areas such as obstetrics [6,7], pediatric surgery [8], transplantation [9], cardiac surgery [10,11], neurosurgery [12], and burn surgery [13,14]. Viscoelastic hemostatic tests are also paramount in the diagnostic and treatment adjustment of hematological disorders, such as inherited afibrinogenemia, hemophilia, or multiple myeloma [15-18]. However, despite these technologies’ widespread use and considerable advantages, their results’ interpretation remains challenging and requires well-trained clinical personnel [19-21]. Visual Clot—a situation awareness-based visualization technology—was developed to support health care professionals in interpreting viscoelastic test results by reducing the complexity of their presentation. Based on raw ROTEM data, the results are displayed in real time as a 3D animated model of a blood clot to represent various elements of hemostasis, including platelets, plasmatic factors, and fibrin. It can also effectively illustrate the influence of heparin and hyperfibrinolysis [22] (Multimedia Appendix 1). In a high-fidelity simulation study, anesthesiologists using Visual Clot were 2.2 times more likely to articulate the correct therapeutic approach. In addition, these anesthesiologists had a lower median time to administer the first appropriate targeted coagulation product. Overall, physicians presented with the results of viscoelastic testing using Visual Clot were approximately 56% more likely to provide accurate therapeutic interventions. In the same study, physicians were 3.5 times more likely to feel confident in their decisions when working with Visual Clot compared to traditional ROTEM results [23]. In the first computer-based study analyzing user perceptions of Visual Clot, participants described the technology as well-designed, easy to learn, and intuitive [24]. The guiding principles of the Visual Clot technology that result in enhanced situation awareness include Endsley’s user-centered design principles [25], Wittgenstein's philosophy as articulated in Tractatus Logico-Philosophicus [26], and insights from the National Aeronautics and Space Administration (NASA) publication “On Organization of Information: Approach and Early Work” by Degani et al [27]. Endsley’s principles emphasize the use of direct visual representations of data to enhance situational awareness, a central principle in Visual Clot's data visualization. Wittgenstein's theory emphasizes the importance of logical representations that meaningfully correspond to the reality they are intended to represent. Visual Clot follows this principle by visually representing elements such as fibrin, platelets, plasmatic factors, hyperfibrinolysis, and bleeding. Following NASA's approach, Visual Clot strives to achieve the highest level of “order and wholeness” by consolidating all essential data into a single display. The primary goal of Visual Clot technology is to provide the care provider with situational information quickly and with minimal cognitive load. In this study, we aimed to capture and analyze perceptions of anesthesia personnel working with Visual Clot in a high-fidelity simulation to identify the strengths and recognize the potential for future improvements.

 Methods Ethical Considerations

The Cantonal Ethics Committee of the Canton of Zurich reviewed the study protocol and issued a declaration of no objection (Business Management System for Ethics Committees Number Req-2021-01112). Furthermore, each participant gave informed consent to use his or her data for research purposes. Participation was voluntary and without financial compensation.

 Study Design

We conducted a researcher-initiated single-center mixed qualitative-quantitative study at the University Hospital Zurich, Institute of Anesthesiology, Switzerland. Study participants were anesthesia personnel, including staff anesthesiologists, residents, and nurses. After participating in a high-fidelity simulation study of perioperative bleeding scenarios, where they worked with Visual Clot and ROTEM, we interviewed participants on their perceptions of Visual Clot technology.

As a second step, the same participants received an email invitation to participate in a survey a few weeks later. They rated statements we generated from identified and frequently mentioned themes in interview responses on a Likert scale.

 Previous High-Fidelity Simulation Study

In the high-fidelity simulation study [23], anesthesia teams, composed of a staff anesthesiologist, a resident, and an anesthesia nurse, participated in high-fidelity perioperative bleeding scenarios using either Visual Clot or ROTEM. The primary outcome of the study was correct targeted coagulation therapy. Secondary outcomes were time to targeted coagulation therapy, confidence, and workload.

ROTEM is the standard of care for managing acute hemorrhage in the study center, so all participants were familiar with the technology before participating [20]. Some participants had taken part in previous Visual Clot studies and, therefore, were already familiar with the technology [22,24].

Nevertheless, before the simulations began, we gave a 10-minute presentation that reviewed ROTEM and introduced Visual Clot. Multimedia Appendix 1 provides an instructional video of Visual Clot. Participants were invited to ask questions freely before starting work in the simulation environment. Each team solved 1 of 4 different perioperative bleeding scenarios, which were randomly allocated. We ended the scenarios when all necessary therapeutic measures were derived or, at the latest, after 15 minutes. Figure 1 illustrates an example of a Visual Clot printout used in the simulation study.

A Visual Clot result presentation showing a fibrin deficiency. The fibrin in the clot is shown as a dashed line, indicating its absence. The blood drops indicate the presence of a coagulation pathology.

 Participant Interviews

After the simulations, we encouraged the participants to freely verbalize their thoughts in a distraction-free environment while the data collectors made field notes. The only suggestion to the participants before the interviews was to verbalize their positive and negative opinions of Visual Clot. The participants could define final adjustments in the collected answers at the end of the interviews.

 Survey

In the second step, we formulated 5 statements to summarize the insights gathered during the interviews. The statements were submitted for evaluation on a 5-point Likert scale graded from “strongly agree” to “strongly disagree.” An email invitation was sent to all interviewed participants.

 Outcomes and Statistical Analyses Part I: Participant Interviews

Collected interview responses were translated from original German to English using a translation system DeepL (DeepL GmbH). Multimedia Appendix 2 provides the complete translated field notes.

The most commonly used terms in positive and negative responses were identified using the word count function. Word groups with the same root were united, excluding the frequently used filler words such as “to,” “and,” or “the” (Table 1). Using a template approach [28] we identified the major themes that dominated participants’ answers. As a result, we generated a coding tree (Figure 2). According to the coding template, we assigned statements to the themes. A total of 3 of the study authors, all anesthesiology residents GG, GS, and SA, rated the interview statements separately from each other using the coding tree (Figure 2). If the 3 investigators disagreed after multiple data coding, the final decision was taken in a joint discussion. Interrater reliability was calculated to investigate the consistency of the coding tree’s application.

The most commonly used positive and negative terms to describe Visual Clot.

Positive terms Negative terms
Terms Frequency, n Terms Frequency, n
Easy or easier 28 Missing 13
Good 16 Quantitative or quantification 11
Fast or faster 13 Information 9
See a problem 12 Values 8
Interpret quickly 11 Time 8
Simple 9 Fibrinogen 6
Understand 9 Numbers 6
Visual 8 Hyperfibrinolysis 6
Interpretation 7 Less 5
Intuitive 7 Confusing 4
At a glance 7 Flashing 4
Overview 7 Simplified 3

A coding tree representing the themes describing positive and negative user perceptions. ROTEM: rotational thromboelastometry.

 Part II: Survey

The literature states that quantitative data can help generalize and confirm specific observations found in qualitative research [29-32]. For the subsequent survey, we defined 5 statements based on the previously identified themes. The same group of interviewed anesthesiologists was asked to rate them on 5-point Likert scales in a questionnaire created using Google Forms (Alphabet Inc). Participants were informed that the survey takes only a few minutes to complete, participation is voluntary, and no compensation is offered. The translated announcement of the survey invitation is displayed in Multimedia Appendix 3. The data collection was finished 3 weeks after the questionnaire was sent.

 Statistical Analysis

The interview data analysis and figures were made using Microsoft Word and Excel (Microsoft Corp). We present the number of statements and their percentage distribution in the identified themes.

To define the interrater reliability of the coding template, we calculated Fleiss’ Kappa using R (version 4.0.5; R Foundation for Statistical Computing). We calculated every statement's median and IQR for the survey analysis. We used the Wilcoxon signed rank test to determine the difference between the median and neutral answers. Statistical significance was indicated as P<.05.

 Results Study and Participant Characteristics

Detailed information on the study and participants is provided in Table 2. Residents and nurses were the dominant participants in the interviews. The most experienced participant had 33 years of experience in anesthesia. The least experienced had less than 1 year. Residents and nurses also dominated the survey.

Study and participant characteristics.

Characteristics Values
Study characteristics
Total number of interviewed participants, n 77
Total number of participants completed the survey, n 23
Participant characteristics
Interview participants
Staff physicians, n (%) 8 (10.4)
Residents, n (%) 35 (45.5)
Anesthesiology nurses, n (%) 34 (44.2)
Anesthesia experience in years, median (IQR) 8 (3-10)
Number of ROTEMa interpretations per year, median (IQR) 26 (5-41)
Survey participants
Staff physicians, n (%) 7 (30.4)
Residents, n (%) 8 (34.8)
Anesthesiology nurses, n (%) 8 (34.8)

aROTEM: rotational thromboelastometry.

 Part I: Qualitative Analysis of Interview Answers Word Count Analysis

The most frequently used words and word combinations used to describe the advantages of Visual Clot were: easier or easy (26/77, 33.8%), interpret or interpretation (23.4%, 18/77 participants), quick or quickly (19.5%, 15/77 participants), visual, visualize, visualized, or visualization (19.5%, 15/77 participants), good (16.9%, 13/77 participants), faster or fast (15.6%, 12/77 participants). In the group of statements describing the limitations of Visual Clot, the words and word groups most frequently used were: ROTEM (23.4%, 18/77 participants), missing (information or values or numbers; 16.9%, 13/77 participants), quantitative or quantification (16.9%, 13/77 participants). Table 1 visually represents the most commonly used words in positive and negative perceptions.

 Coding Tree

Figure 2 shows the generated coding tree, including 2 main domains and 9 themes. The interrater reliability of the tree raters was 0.856 (95% CI 0.831-0.880), indicating almost perfect agreement [33].

 Statements Describing Visual Clot

Table 3 demonstrates examples of statements assigned to particular subtopics with participant counts and percentages.

A total of 4 comments were defined as positive but not assigned to any themes. There was 1 such statement in the negative group. A total of 19 comments were not assigned to any theme and were described as noncodable.

Statements examples assigned to particular domain and subtopics with participant count and percentages.

Major domain and subtopics Examples
Positive statements describing Visual Clot (179/319, 56.1%)
Positive design features (63/295, 21.4%)

“Very simplified” (Participant 13).

“Visual presentation” (Participant 21).

“Tells figuratively what to do” (Participant 26).
Positive usability features (30/295, 10.2%)

“It can be perfectly integrated in the clinic” (Participant 24).

“A good tool to get an overview” (Participant 32).

“You can see at-a-glance what is missing” (Participant 70).
Intuitive and easy to learn (61/295, 20.7%)

“Directly applicable and does not require long training” (Participant 5).

“Very intuitive” (Participant 75).

“Easy to understand” (Participant 76).
Time saving (21/295, 7.1%)

“2-3 seconds to a quick overview” (Participant 22).

“Immediate detection of the problem” (Participant 5).

“Quick to interpret” (Participant 27).
Negative statements describing Visual Clot (113/319, 35.4%)
Design problems (23/295, 7.8%)

“Confusing, blinking” (Participant 57).

“Quality of hyperfibrinolysis difficult to demonstrate” (Participant 22).

“Not everything you see is relevant” (Participant 24).
Usability problems (12/295, 4.1%)

“Quantity of change is not visible” (Participant 2).

“You have to know the pictures first” (Participant 30).

“No prioritization possible” (Participant 76).
Incompleteness: a lack of a quantitative component (62/295, 21.0%)

“Also values that are in normal range—is it close to the limit or not?” (Participant 54).

“No graduation ‘all or nothing’” (Participant 60).

“Exact quantification not possible” (Participant 4).
Need for training (15/295, 5.1%)

“Not yet established” (Participant 29).

“Needs to get used to it” (Participant 45).

“Needs habituation (not used by default yet)” (Participant 50).
Combination: Visual Clot and ROTEMa (8/295, 2.7%)

“Would be nice to have it together with ROTEM” (Participant 50).

“Ideal solution if could be combined with ROTEM” (Participant 49).

“Combination of both necessary” (Participant 74).

aROTEM: rotational thromboelastometry.

 Positive Statements Describing Visual Clot Positive Design Features

Most comments were made on this topic, emphasizing that a “pictorially summarized” (participant 2) and “visually appealing” (participant 3) data presentation allows one to see “the relevant ROTEM information at-a-glance” (participant 9). Such a design supports health care professionals in making clinical decisions. It is essential in emergencies because the actual coagulation status is immediately visible (participant 14) and it is instantly apparent which hemostasis components are missing (participant 12).

 Positive Usability Features

Visual Clot is “a good tool for broad application,” stated participant 72. It enables “pre-interpretation of the complex information” (participant 3) and focuses “on the essential” (participant 65). The benefits of the Visual Clot in urgent situations were also highlighted: the technology is “very good for emergencies,” stated participant 13.

 Intuitive and Easy to Learn

As in the previous study [24], the Visual Clot was also described here as intuitive and easy to learn. “Very intuitive, short time needed to understand it,”—pointed out participant 6. It was underlined that visualizations provided by the Visual Clot are “quickly recognizable even by untrained persons or with little knowledge of coagulation” (participant 13).

 Time Saving

The Visual Clot provides an “overview at-a-glance,” as participant 76 said. “I immediately saw what was missing,” stated participant 16. These features lead to quicker diagnosis—“focus is faster on the problem”—as participant 46 said, and thus to faster initiation of treatment.

 Negative Statements Describing Visual Clot Design Problems

Several ideas that could potentially enhance Visual Clot's design were identified. Participant 47 pointed out that the presentation of platelets and fibrinogen are similar, and thus it is difficult to distinguish. Participant 48 also agreed: “I did not notice that platelets were missing because it was white and dashed like fibrinogen.” Some participants found that the Visual Clot is too dynamic—too much movement on the screen, which can lead to distraction and make the interpretation of the results difficult “Even if coagulation status is fine, everything is moving, and you can poorly differentiate what is missing” (participant 53), “moves too much, even if everything is fine—distraction” (participant 55).

 Usability Problems

Visual Clot is “confusing at the beginning”—stated participant 31 and added that it is “difficult to use without routine.” Visual Clot provides “too much information at once,”—participant 53 pointed out.

 Incompleteness: Lack of a Quantitative Component

The central Visual Clot aspect criticized was the technology's incompleteness in terms of lacking a quantitative component. Several participants stated that the Visual Clot is “not precise” (participant 1), which can be explained in the words of participants 53 and 9, respectively, who said that in the Visual Clot “quantitative is missing” and that one “can get more information with the ROTEM.”

 Need for Training

The main point identified in the participants’ opinions on this topic was the lack of experience working with this technology and that it is a very new tool not yet established in clinical practice.

 Combination of Visual Clot and ROTEM

Several participants said they could benefit from combining the Visual Clot and ROTEM when interpreting coagulation assays. “A combination of Visual Clot and ROTEM would be perfect,” pointed out participant 19, while participant 74 said, “a combination of both is necessary.” There was no difference in positive and negative statements based on participants' specialty or level of experience.

 Part II: Analysis of Statements Assessed in the Survey

Figure 3 shows the detailed evaluation of the statements rated in the survey.

Pie charts presenting survey results with the number of participants who chose a particular category (N=23). ROTEM: rotational thromboelastometry.

All sample medians differed statistically significantly from neutral (P<.05). The number of participants in the quantitative part of the evaluation differs from the qualitative part because not all participants completed the questionnaire. The results are presented as medians and IQR. P values are provided to indicate a statistically significant difference between the median of the sample and the neutral value.

 Discussion Principal Findings

This mixed qualitative-quantitative study analyzed the perceptions of anesthesiology personnel regarding Visual Clot—a new situation-awareness and user-oriented visualization technology for viscoelastic hemostatic resuscitation—after the high-fidelity simulation study. User perceptions enable us to identify the positive aspects of the technology and reveal the potential for improvement in the future. After computer-based studies, this is the first time that Visual Clot has been evaluated in a high-fidelity simulation study, a validated process for testing a noncertified product in an environment that closely resembles clinical reality [34,35].

The principal findings demonstrate that the design features of Visual Clot have received the most positive comments. As in the previous computer-based Visual Clot study [24], the participants of this high-fidelity simulation study emphasized that the way this technology is designed provides a good overview of the clotting situation and is an additional help in the decision-making process during acute bleeding situations. Further, Visual Clot was described as intuitive and easy to learn. Participants repeatedly mentioned that the results of Visual Clot are quickly recognizable and understandable even by inexperienced clinicians. The main criticism concerned the lack of quantitative information.

Previous Visual Clot studies [22-24,36,37] underline the benefits of additional visualization technology, simplifying standard ROTEM data interpretation [20]. Anesthesia providers using Visual Clot in a high-fidelity simulation study were more likely to correctly administer targeted coagulation therapy and to give the first targeted coagulation product faster. In addition, participants demonstrated greater decision-making confidence with Visual Clot [23]. Moreover, the correctness of the clinical decisions was independent of previous rotational thromboelastometry knowledge and experience.

The superior participants’ performance when working with Visual Clot may be explained by its design supporting the strengths of human sensory perception. The Visual Clot was developed to assist care providers in managing highly complex coagulation situations, presenting the data in an awareness-oriented interface design. The main aim of this design is to convey the information as quickly as possible and with the lowest cognitive effort [25].

Principles of situation awareness-oriented and user-centered design enables effective data management and a comprehensive understanding of what is happening and thus help to stay situationally aware. This concept is essential in many domains, including medicine, where managing complex and dynamic situations is fundamental [38,39].

Its definition breaks down into three separate phases (1) the perception of environmental elements in the current situation within a volume of time and space, (2) understanding their meaning, and (3) their projection in the near future. Based on this, the Visual Clot data are visually represented, preprocessed, and simplified. The results of coagulation parameters are divided into 3 categories: too low, normal, or too high. Such information presentation increases diagnostic confidence, but numeric indicators are needed for precise data analysis and targeted treatment initiation. As previously indicated, the lack of quantitative information is reflected in user responses. It also explains the participants’ considerations that combining Visual Clot and ROTEM would be helpful in clinical decision-making.

Some other technologies based on situation awareness and user-centered design principles include Philips Visual Patient Avatar (Philips) [40], AlertWatch (AlertWatch Inc), Dynamic Lung Panel and PulmoSight (Hamilton Medical AG), HemoSight and Physiology Screen (Mindray Medical International Limited), and Alarm Status Visualizer (Masimo Corp) [41,42].

This study showed user perceptions regarding the new situation awareness-based, user-oriented technology for thromboelastometry data presentation—Visual Clot. It makes us aware of the user’s needs and could help us simplify information processing and decision-making in the future. An integral facet of advancing the technological framework informed by the results of this study lies in the prospect of merging quantitative data into the Visual Clot platform and presenting this merged information in a consolidated interface. This concerted integration promises to align both quantitative and qualitative data to provide a more complete and accurate representation of prevailing conditions. This integration can be achieved in a variety of ways, including the direct overlay of numerical values onto the Visual Clot visualization, or the parallel juxtaposition of a complementary graphical representation alongside the numerical data set.

 Strengths and Limitations

This study has several strengths and limitations. The interview part of the study has the typical limitations of qualitative research. The findings of qualitative analysis cannot be extrapolated to larger populations with the same certainty as quantitative results because the findings are on the subjective basis and not tested for statistical significance [43]. However, the quantitative survey helped to provide greater insight into the importance of the main themes identified. Moreover, the interviewed participants were selected according to their availability in the clinical praxis and not randomly.

Furthermore, the number of participants in the survey was lower than in the interviews because not all participants in the simulation study completed the survey. Finally, it is a single-center study performed in a university hospital with high care standards in Europe. User perceptions may vary across diverse clinical settings in different parts of the world.

 Conclusions

After previous studies investigating user perceptions of Visual Clot in computer-based simulation studies, this is the first study to analyze the user perceptions of Visual Clot in a high-fidelity simulation—the intermediate step between computer-based simulation studies in a laboratory and real-life use. In this study, Visual Clot appeared to be a well-accepted additional tool supporting health care professionals working with ROTEM. Based on participants’ perceptions, user-centered and situation awareness-oriented design, as shown in Visual Clot, can simplify the presentation of complex information and thus make critical decision-making quicker and more efficient. The benefits of this technology have been particularly highlighted in emergencies and even for care providers with little experience in coagulation management. Participants described Visual Clot as intuitive and easy to learn. The lack of a quantitative component has been identified as a significant limitation. These findings highlight the advantages of Visual Clot and its potential for improvement may help further develop this and other situation awareness-based technologies.

Educational Visual Clot video.

Complete translated field notes of participant interviews.

Translated announcement of the survey invitation.

 Abbreviations NASA

National Aeronautics and Space Administration

 ROTEM

rotational thromboelastometry

The authors are thankful to the study participants for their time and effort. The Institute of Anesthesiology of the University Hospital of Zurich, Zurich, Switzerland and the University of Zurich, Zurich, Switzerland funded this study.

 Data Availability

The data sets used and analyzed during this study are available from the corresponding author on reasonable request.

GG, AM, CC, ADB, GS, MK, BG, CBN, TRR, DWT, and SA contributed to the conceptualization; GG, AM, CC, ADB, GS, MK, BG, CBN, TRR, DWT, and SA contributed to the methodology; GG, GS, and SA performed the formal analysis; AM, CC, ADB, GS, TRR, and DWT contributed to the investigation; GG, GS, and SA performed data curation; GG and DWT contributed to writing—original draft preparation; GG, DRS, CBN, DWT, SA, and DF contributed to writing—review and editing; GG and DWT contributed to visualization; DWT and SA performed supervision; and DWT performed project administration.

DRS’s academic department is receiving grant support from the Swiss National Science Foundation, Berne, Switzerland, the Swiss Society of Anesthesiology and Perioperative Medicine, Berne, Switzerland, the Swiss Foundation for Anesthesia Research, Zurich, Switzerland, Vifor SA, Villars-sur-Glâne, Switzerland and Vifor (International) AG, St. Gallen, Switzerland. DRS is cochair of the ABC-Trauma Faculty, sponsored by unrestricted educational grants from Novo Nordisk Health Care AG, Zurich, Switzerland, CSL Behring GmbH, Marburg, Germany, LFB Biomédicaments, Courtaboeuf Cedex, France and Octapharma AG, Lachen, Switzerland. DRS received honoraria or travel support for consulting or lecturing from Alliance Rouge, Bern, Switzerland, Danube University of Krems, Austria, European Society of Anesthesiology and Intensive Care, Brussels, BE, International Foundation for Patient Blood Management, Basel, Switzerland, Korean Society of Anesthesiologists, Seoul, Korea, Network for the Advancement of Patient Blood Management, Haemostasis and Thrombosis, Paris, France, Society for the Advancement of Blood Management, Mount Royal NJ, Alexion Pharmaceuticals Inc, Boston, MA, AstraZeneca AG, Baar, Switzerland, Bayer AG, Zürich, Switzerland, B. Braun Melsungen AG, Melsungen, Germany, Baxter AG, Glattpark, Switzerland, CSL Behring GmbH, Hattersheim am Main, Germany and Berne, Switzerland, CSL Vifor (Switzerland) Villars-sur-Glâne, Switzerland, CSL Vifor (International), St Gallen, Switzerland, Celgene International II Sàrl, Couvet, Switzerland, Daiichi Sankyo AG, Thalwil, Switzerland, Haemonetics, Braintree, Massachusetts, United States, LFB Biomédicaments, Courtaboeuf Cedex, France, Merck Sharp & Dohme, Kenilworth, New Jersey, United States, Novo Nordisk Health Care AG, Zurich, Switzerland, Octapharma AG, Lachen, Switzerland, Pharmacosmos A/S, Holbaek, Denmark, Pierre Fabre Pharma, Alschwil, Switzerland, Portola Schweiz GmbH, Aarau, Switzerland, Roche Diagnostics International Ltd, Reinach, Switzerland, Sarstedt AG & Co, Sevelen, Switzerland and Nümbrecht, Germany, Shire Switzerland GmbH, Zug, Switzerland, Takeda, Glattpark, Switzerland, Werfen, Bedford, MA, Zuellig Pharma Holdings, Singapore, Singapore. CBN is an inventor of Visual Patient and Visual Patient Predictive technologies, for which the University of Zurich and Koninklijke Philips N.V. hold patents, patent applications, design protections, and trademarks. Joint-development and licensing agreements exist with Philips Medizin Systeme Böblingen GmbH, Böblingen, Germany; Koninklijke Philips N.V., Amsterdam, The Netherlands; Philips Research/Philips Electronics Nederland BV, Eindhoven, The Netherlands; and Philips USA, Cambridge, Massachusetts, United States. Within the framework of these agreements, CBN receives travel support, lecturing and consulting honoraria, and may potentially receive royalties in the event of successful commercialization. CBN is an inventor of Visual Clot technology, with patent applications, design protections, and trademarks held by the University of Zurich. In case of successful commercialization, CBN may receive royalties. CBN is an inventor of Visual Blood technology, for which the University of Zurich holds patent applications and design protections; potential royalties may follow successful commercialization. CBN received travel support, lecturing, and consulting honoraria from Instrumentation Laboratory—Werfen, Bedford, Massachusetts, United States. DWT is the first named inventor of Visual Patient and Visual Patient Predictive technologies, for which the University of Zurich and Koninklijke Philips N.V. hold patents, patent applications, design protections, and trademarks. Joint-development and licensing agreements exist with Philips Medizin Systeme Böblingen GmbH, Böblingen, Germany; Koninklijke Philips N.V., Amsterdam, The Netherlands; Philips Research/Philips Electronics Nederland BV, Eindhoven, The Netherlands; and Philips USA, Cambridge, Massachusetts, United States. Within the framework of these agreements, DWT receives research funding, travel support, lecturing and consulting honoraria, and may potentially receive royalties in the event of successful commercialization. DWT also holds a position on the Philips Patient Safety Advisory Board. DWT is the first named inventor of Visual Clot technology, with patent applications, design protections, and trademarks held by the University of Zurich. In case of successful commercialization, DWT may receive royalties. DWT is the first named inventor of Visual Blood technology, for which the University of Zurich holds patent applications and design protections; potential royalties may follow successful commercialization. Additionally, DWT received travel support, lecturing, and consulting honoraria from Instrumentation Laboratory—Werfen, Bedford, Massachusetts, United States, the Swiss Foundation for Anaesthesia Research in Zurich, Switzerland, and the International Symposium on Intensive Care and Emergency Medicine in Brussels, Belgium. No other funding or competing interests declared.

 Spahn DR Bouillon B Cerny V Duranteau J Filipescu D Hunt BJ Komadina R Maegele M Nardi G Riddez L Samama CM Vincent JL Rossaint R The European guideline on management of major bleeding and coagulopathy following trauma: fifth edition Crit Care 2019 23 1 98 10.1186/s13054-019-2347-3 30917843 10.1186/s13054-019-2347-3 PMC6436241 Weber CF Zacharowski K [Point of care 2.0: coagulation monitoring using Rotem® Sigma and Teg® 6S] Anasthesiol Intensivmed Notfallmed Schmerzther 2018 53 6 412 424 10.1055/s-0043-107755 29945283 Riehl K Lefering R Maegele M Caspers M Migliorini F Schenker H Hildebrand F Fröhlich M Driessen A Is ROTEM diagnostic in trauma care associated with lower mortality rates in bleeding patients?-A retrospective analysis of 7461 patients derived from the TraumaRegister DGU® J Clin Med 2022 11 20 6150 10.3390/jcm11206150 36294471 jcm11206150 PMC9605144 American Society of Anesthesiologists Task Force on Perioperative Blood Management Practice guidelines for perioperative blood management: an updated report by the American Society of Anesthesiologists Task Force on perioperative blood management* Anesthesiology 2015 122 2 241 275 10.1097/ALN.0000000000000463 25545654 Tibi P McClure RS Huang J Baker RA Fitzgerald D Mazer CD Stone M Chu D Stammers AH Dickinson T Shore-Lesserson L Ferraris V Firestone S Kissoon K Moffatt-Bruce S STS/SCA/AmSECT/SABM update to the clinical practice guidelines on patient blood management Ann Thorac Surg 2021 112 3 981 1004 10.1016/j.athoracsur.2021.03.033 34217505 S0003-4975(21)00556-7 Collins PW Lilley G Bruynseels D Laurent DBS Cannings-John R Precious E Hamlyn V Sanders J Alikhan R Rayment R Rees A Kaye A Hall JE Paranjothy S Weeks A Collis RE Fibrin-based clot formation as an early and rapid biomarker for progression of postpartum hemorrhage: a prospective study Blood 2014 124 11 1727 1736 10.1182/blood-2014-04-567891 25024304 S0006-4971(20)35539-7 McNamara H Kenyon C Smith R Mallaiah S Barclay P Four years' experience of a ROTEM® -guided algorithm for treatment of coagulopathy in obstetric haemorrhage Anaesthesia 2019 74 8 984 991 10.1111/anae.14628 30950521 Wikkelsø A Wetterslev J Møller AM Afshari A Thromboelastography (TEG) or thromboelastometry (ROTEM) to monitor haemostatic treatment versus usual care in adults or children with bleeding Cochrane Database Syst Rev 2016 2016 8 CD007871 10.1002/14651858.CD007871.pub3 27552162 PMC6472507 Hawkins RB Raymond SL Hartjes T Efron PA Larson SD Andreoni KA Thomas EM Review: the perioperative use of thromboelastography for liver transplant patients Transplant Proc 2018 50 10 3552 3558 10.1016/j.transproceed.2018.07.032 30577236 S0041-1345(18)31061-3 Weber CF Görlinger K Meininger D Herrmann E Bingold T Moritz A Cohn LH Zacharowski K Point-of-care testing: a prospective, randomized clinical trial of efficacy in coagulopathic cardiac surgery patients Anesthesiology 2012 117 3 531 547 10.1097/ALN.0b013e318264c644 22914710 00000542-201209000-00021 Görlinger K Dirkmann D Hanke AA Kamler M Kottenberg E Thielmann M Jakob H Peters J First-line therapy with coagulation factor concentrates combined with point-of-care coagulation testing is associated with decreased allogeneic blood transfusion in cardiovascular surgery: a retrospective, single-center cohort study Anesthesiology 2011 115 6 1179 1191 10.1097/ALN.0b013e31823497dd 21970887 Kvint S Schuster J Kumar MA Neurosurgical applications of viscoelastic hemostatic assays Neurosurg Focus 2017 43 5 E9 10.3171/2017.8.FOCUS17447 29088950 Welling H Ostrowski SR Stensballe J Vestergaard MR Partoft S White J Johansson PI Management of bleeding in major burn surgery Burns 2019 45 4 755 762 10.1016/j.burns.2018.08.024 30292526 S0305-4179(18)30754-X Sahli SD Pedrazzi N Braun J Spahn DR Kaserer A Plock JA Effect of a factor-based coagulation management on blood product use after major burn injury: a retrospective cohort study Burns 2021 47 7 1486 1494 10.1016/j.burns.2021.08.015 34465509 S0305-4179(21)00234-5 Treliński J Misiewicz M Robak M Smolewski P Chojnowski K Assessment of rotation thromboelastometry (ROTEM) parameters in patients with multiple myeloma at diagnosis Thromb Res 2014 133 4 667 670 10.1016/j.thromres.2014.01.011 24451990 S0049-3848(14)00035-8 Young GA Carmona R Garcia VC Thromboelastography and thrombin generation assay in inherited afibrinogenemia Haemophilia 2018 24 6 e410 e416 10.1111/hae.13620 30345592 Chitlur M Rivard GE Lillicrap D Mann K Shima M Young G Factor VIII, Factor IX, and Rare Coagulation Disorders Subcommittee of the Scientific and Standardisation Committee of the International Society on Thrombosis and Haemostasis Recommendations for performing thromboelastography/thromboelastometry in hemophilia: communication from the SSC of the ISTH J Thromb Haemost 2014 12 1 103 106 10.1111/jth.12458 24261669 S1538-7836(22)04161-7 Young G Sørensen B Dargaud Y Negrier C Brummel-Ziedins K Key NS Thrombin generation and whole blood viscoelastic assays in the management of hemophilia: current state of art and future perspectives Blood 2013 121 11 1944 1950 10.1182/blood-2012-08-378935 23319573 S0006-4971(20)47466-X PMC3645054 Srivastava A Kelleher A Point-of-care coagulation testing Contin Educ Anaesth Crit Care Pain 2013 13 1 12 16 10.1093/bjaceaccp/mks049 Gasciauskaite G Malorgio A Castellucci C Budowski A Schweiger G Kolbe M Grande B Noethiger CB Spahn DR Roche TR Tscholl DW Akbas S User perceptions of ROTEM-guided haemostatic resuscitation: a mixed qualitative-quantitative study Bioengineering (Basel) 2023 10 3 386 10.3390/bioengineering10030386 36978777 bioengineering10030386 PMC10044818 Dixon A Underwood S Schreiber M Implementing thrombelastography: experiences from a level I trauma institution Transfusion 2020 60 Suppl 6 S29 S32 10.1111/trf.16070 33089931 Rössler J Meybohm P Spahn DR Zacharowski K Braun J Nöthiger CB Tscholl DW Improving decision making through presentation of viscoelastic tests as a 3D animated blood clot: the visual clot Anaesthesia 2020 75 8 1059 1069 10.1111/anae.14985 32030729 Castellucci C Malorgio A Budowski AD Akbas S Kolbe M Grande B Braun J Noethiger CB Spahn DR Tscholl DW Roche TR Coagulation management of critically bleeding patients with viscoelastic testing presented as a 3D-animated blood clot (the visual clot): randomized controlled high-fidelity simulation study J Med Internet Res 2023 25 e43895 10.2196/43895 37824182 v25i1e43895 PMC10603564 Roche TR Said S Rössler J Gozdzik M Meybohm P Zacharowski K Spahn DR Nöthiger CB Tscholl DW Physicians' perceptions of a situation awareness-oriented visualization technology for viscoelastic blood coagulation management (visual clot): mixed methods study JMIR Serious Games 2020 8 4 e19036 10.2196/19036 33172834 v8i4e19036 PMC7748952 Endsley MR Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition 2011 Boca Raton, FL, USA CRC Press Inc Wittgenstein L Tractatus Logico-Philosophicus 1922 London, UK Routledge & Kegan Paul Degani A Jorgensen C Iverson D Shafto M Olson L On Organization of Information: Approach and Early Work 2009 Moffett Field, California National Aeronautics and Space Administration, Ames Research Center Symon G Cassell C Qualitative Organizational Research: Core Methods and Current Challenges 2012 Thousand Oaks, CA SAGE Publications Guetterman TC Fetters MD Creswell JW Integrating quantitative and qualitative results in health science mixed methods research through joint displays Ann Fam Med 2015 13 6 554 561 10.1370/afm.1865 26553895 13/6/554 PMC4639381 Smajic E Avdic D Pasic A Prcic A Stancic M Mixed methodology of scientific research in healthcare Acta Inform Med 2022 30 1 57 60 10.5455/aim.2022.30.57-60 35800901 AIM-30-57 PMC9226784 Kaur N Vedel I El Sherif R Pluye P Practical mixed methods strategies used to integrate qualitative and quantitative methods in community-based primary health care research Fam Pract 2019 36 5 666 671 10.1093/fampra/cmz010 30888015 5388858 PMC6781936 Webster CS McKillop A Bennett W Bagg W A qualitative and semiquantitative exploration of the experience of a rural and regional clinical placement programme Med Sci Educ 2020 30 2 783 789 10.1007/s40670-020-00949-6 34457735 949 PMC8368300 Landis JR Koch GG The measurement of observer agreement for categorical data Biometrics 1977 33 1 159 174 843571 Merry AF Hannam JA Webster CS Edwards KE Torrie J Frampton C Wheeler DW Gupta AK Mahajan RP Evley R Weller JM Retesting the hypothesis of a clinical randomized controlled trial in a simulation environment to validate anesthesia simulation in error research (the VASER study) Anesthesiology 2017 126 3 472 481 10.1097/ALN.0000000000001514 28079566 Kurup V Matei V Ray J Role of in-situ simulation for training in healthcare: opportunities and challenges Curr Opin Anaesthesiol 2017 30 6 755 760 10.1097/ACO.0000000000000514 28968283 Castellucci C Braun J Said S Roche TR Nöthiger CB Spahn DR Tscholl DW Akbas S Faster time to treatment decision of viscoelastic coagulation test results through improved perception with the animated visual clot: a multicenter comparative eye-tracking study Diagnostics (Basel) 2022 12 5 1269 10.3390/diagnostics12051269 35626425 diagnostics12051269 PMC9140857 Said S Roche TR Braun J Ganter MT Meybohm P Herrmann J Zacharowski K Raimann FJ Piekarski F Rivas E López-Baamonde M Spahn DR Nöthiger CB Tscholl DW Effects of an animated blood clot technology (visual clot) on the decision-making of users inexperienced in viscoelastic testing: multicenter trial J Med Internet Res 2021 23 5 e27124 10.2196/27124 33843602 v23i5e27124 PMC8129883 Schulz C Endsley MR Kochs EF Gelb AW Wagner KJ Situation awareness in anesthesia: concept and research Anesthesiology 2013 118 3 729 742 10.1097/ALN.0b013e318280a40f 23291626 Kang J Hu J Yan C Xing X Tu S Zhou F Development and applications of the anaesthetists' non-technical skills behavioural marker system: protocol for a systematic review BMJ Open 2022 12 12 e065519 10.1136/bmjopen-2022-065519 36517093 bmjopen-2022-065519 PMC9756218 Patient monitoring: visual patient avatar Philips 2023 2023-12-22 https://www.philips.co.uk/healthcare/technology/visual-patient-avatar Products mindray 2023 2023-12-22 https://www.mindray.com/uk/products Gasciauskaite G Lunkiewicz J Roche TR Spahn DR Nöthiger CB Tscholl DW Human-centered visualization technologies for patient monitoring are the future: a narrative review Crit Care 2023 27 1 254 10.1186/s13054-023-04544-0 37381008 10.1186/s13054-023-04544-0 PMC10308796 Atieno OA An analysis of the strengths and limitation of qualitative and quantitative research paradigms Probl Educ 21st Century 2009 13 13 38