Skip to main content
The Ultrasound Journal
The Ultrasound Journal Cover Image
Download PDF

Feasibility of cardiac output measurements in critically ill patients by medical students

The Ultrasound Journal volume 12, Article number: 1 (2020) Cite this article

Abstract

Background

Critical care ultrasonography (CCUS) is increasingly applied also in the intensive care unit (ICU) and performed by non-experts, including even medical students. There is limited data on the training efforts necessary for novices to attain images of sufficient quality. There is no data on medical students performing CCUS for the measurement of cardiac output (CO), a hemodynamic variable of importance for daily critical care.

Objective

The aim of this study was to explore the agreement of cardiac output measurements as well as the quality of images obtained by medical students in critically ill patients compared to the measurements obtained by experts in these images.

Methods

In a prospective observational cohort study, all acutely admitted adults with an expected ICU stay over 24 h were included. CCUS was performed by students within 24 h of admission. CCUS included the images required to measure the CO, i.e., the left ventricular outflow tract (LVOT) diameter and the velocity time integral (VTI) in the LVOT. Echocardiography experts were involved in the evaluation of the quality of images obtained and the quality of the CO measurements.

Results

There was an opportunity for a CCUS attempt in 1155 of the 1212 eligible patients (95%) and in 1075 of the 1212 patients (89%) CCUS examination was performed by medical students. In 871 out of 1075 patients (81%) medical students measured CO. Experts measured CO in 783 patients (73%). In 760 patients (71%) CO was measured by both which allowed for comparison; bias of CO was 0.0 L min−1 with limits of agreement of − 2.6 L min−1 to 2.7 L min−1. The percentage error was 50%, reflecting poor agreement of the CO measurement by students compared with the experts CO measurement.

Conclusions

Medical students seem capable of obtaining sufficient quality CCUS images for CO measurement in the majority of critically ill patients. Measurements of CO by medical students, however, had poor agreement with expert measurements. Experts remain indispensable for reliable CO measurements.

Trial registration Clinicaltrials.gov; http://www.clinicaltrials.gov; registration number NCT02912624

Background

Critical care ultrasonography (CCUS) is a deliberately focused examination, aimed at rapidly answering straightforward clinical questions [1]. In the field of emergency and critical care medicine, CCUS is increasingly used to guide interventions in critically ill patients in various settings by experts and novices [2,3,4,5,6,7,8,9,10,11,12,13,14]. The training process required for users to attain competency in CCUS has varied widely between studies, reflecting the diversity in CCUS training between centers. Similarly, there is variability among statements from stakeholders regarding the type of training, the required number of hours spent and examinations performed by the trainee to achieve competency in CCUS [15,16,17]. However, besides these disparities, individual physicians struggle with barriers to its use, such as perceived difficulty in obtaining adequate technical skills [13], limitations in training, need (perceived and real), and costs [6, 14].

One valuable CCUS hemodynamic measurement is the determination of the cardiac output (CO), especially if the patient is in circulatory shock [18]. Circulatory shock occurs in one-third of patients admitted to the ICU [19], so being able to perform CCUS and measure CO is of importance. However, CO measurement by CCUS is considered an advanced level CCUS skill [20, 21]. Whether trained novices (e.g., medical students or other less experienced physicians) are able to obtain reliable CO measurements has not yet been investigated. In a convenience sample of 100 adult patients in the emergency department (ED), two ultrasound-naive ED physicians were able to measure CO by ultrasonography accurately [22]. Another study in the ED with a convenience sample of 80 patients, however, showed poor agreement in CO measurement by an emergency ultrasound fellow compared to an emergency cardiology fellow [23]. At the start of our study there were no data on medical students performing CO measurements by CCUS in critically ill patients, although medical students have been shown to be capable of performing CCUS after limited training [24]. To our knowledge, only one small study investigated CCUS by medical students on a (cardiac) intensive care unit, and CO was not measured (see Additional file 1) [3].

The aim of this study was to explore the feasibility of a limited CCUS examination, consisting of CO measurements, performed by medical students in a protocolized manner, in critically ill patients. In addition, the quality of images required to calculate CO and the accuracy of CO measurements compared to those obtained by echocardiography experts were analyzed.

Methods

The Simple Intensive Care Studies (SICS)-I was a prospective, observational cohort study which followed a published protocol and statistical analysis plan (Clinicaltrials.gov; NCT02912624). The SICS-I was developed to unravel the diagnostic and prognostic value of a comprehensive selection of clinical, hemodynamic, and biochemical variables in critically ill patients, and details have been described elsewhere [25, 26]. All acutely admitted adults with an expected ICU stay over 24 h were included. Patients were excluded when admission was planned and if clinical care interfered with acquiring research data (e.g., mechanical circulatory support). The local institutional review board approved the study (M15.168207).

Data collection and training

All patients underwent CCUS within 24 h of ICU admission. Detailed information on the CCUS performed can be found in Additional file 1. Patients were enrolled by 4th-year to 6th-year medical students of a 6-year medical school program. The training consisted of self-study on theoretical fundamentals and two practical sessions of at least 2 h in total to learn how to operate the General Electric Vivid-S6 mobile ultrasonography machine using the cardiac phased-array probe (see Appendix in Additional file 1 for detailed information). The theoretical self-study on how to perform CCUS and measure the CO consisted of study of the protocol (Additional file 1), a website on the principles of echocardiography [27], and international guidelines [28, 29]. This information became available 2 weeks before participation of the medical students. During the practical sessions, medical students learned to obtain the parasternal long axis (PLAX), apical four-chamber (AP4CH), and apical five-chamber (AP5CH) views, among others. The medical students alternated with obtaining the views and measurements of CO during the practical sessions. All medical students received at least 2 h hands-on training from cardiologist-intensivists (GK and IVDH).

Views and images were obtained randomly during the respiratory cycle and/or phase of mechanical ventilation. In case of any arrhythmias, the average of multiple measurements over five heartbeats was taken.

The first 20 CCUS images and measurements of each medical student were supervised by medical students who had independently performed more than 50 CCUS examinations. After 20 scans, CCUS medical students were allowed to conduct/perform CCUS unsupervised, since previous studies showed acceptable capability for acquiring images beyond 20 exams [30].

Validation and definitions

For quality control, echocardiography technicians from an independent core laboratory (Groningen Image Core Lab, UMCG, Groningen, the Netherlands, http://www.g-icl.com) assessed all CCUS images and measurements obtained by the medical students according to the study protocol. If the images were obtained according to guideline standards, the LVOTd and VTI were independently remeasured and CO recalculated [28, 29]. Core laboratory technicians, who we refer to as experts throughout this report, were blinded to all other clinical measurements. The experts did not perform any CCUS examination.

Outcomes, index test and reference standard

The number of patients where CCUS could not be performed and reasons for unobtainable images by the medical students were reported. Patients were excluded from the analysis if, for research purposes, experts would also not be able to perform CCUS (i.e., drains, subcutaneous emphysema, surgical dressing/wounds). The number of patients in which CCUS images of PLAX or AP5CH were obtained was analyzed [28, 29]. Proportion of patients was reported wherein the CCUS images assessed by the experts was of insufficient quality for CO measurement.

We also evaluated the accuracy of CO measurements by medical students (COmedical student) compared to CO measurements by experts (COexpert). Moreover, the two components needed for CO calculation (i.e., LVOTd or VTI) were assessed to determine possible differences between medical students’ and experts’ measurements.

Sensitivity analyses were done with baseline characteristics to investigate reasons why experts could not measure a CO.

Sample size and missing data

Due to the observational nature of this study, no formal power calculation was performed. For the accuracy analysis on CO measurements, we only included patients if CO was measured by both medical students and experts.

Statistical analysis

Data were presented as mean with standard deviation (SD) when normally distributed or as median with interquartile ranges (IQR) in case of skewed data. Dichotomous and categorical data were presented in proportions. Intraclass correlation coefficients (ICC) were calculated to assess the concordance between the measurements made by the medical students and the experts. Bland–Altman analysis was performed to assess agreement of medical student versus expert measurements by calculating mean and SD of the differences, the 95% limits of agreement (LOA) (= mean of the difference ± 1.96 × SD of the difference), and the percentage error [31]. In method comparison studies, a percentage error of 30% is considered acceptable if the error of the test and the reference method is 20%, which is the case when using the thermodilution method to calculate CO [32]. Since there is no reference for CCUS, and only one method was used with comparison between the observers, a percentage error of less than 20% was defined as clinically acceptable. This would mean that the CO difference between medical students and experts would be less than 0.5 L min−1 in the lower end of the CO spectrum (e.g., when the experts measured a CO of 2.5 L min−1, a CO of 2.0–3.0 L min−1 by the medical student would be clinically acceptable). An alpha error of 0.05 was used to indicate statistical significance. Statistical analyses were conducted using STATA version 15.0 (StataCorp, College Station, USA).

Results

CCUS acquisition and images

Between March 27th, 2015 and July 22nd, 2017, 16 medical students were involved in the study and 1212 patients fulfilled inclusion criteria. Of these, in a total of 1155 patients CCUS was performed, as in 40 patients there was interference with clinical care during the first 24 h of admission (e.g., the patient was in severe hemodynamic instability or an intervention was being performed) and 17 patients had isolation restriction measures. Of these 1155 patients, in 80 patients, clinical conditions (i.e., thoracic drains, wounds, or subcutaneous emphysema) prohibited the image acquisition by CCUS, leaving 1075 patients with ultrasonography data (Fig. 1).

Fig. 1
figure1

Flow diagram of the Simple Intensive Care Studies-I (SICS-I). ICU intensive care unit, CCUS critical care ultrasonography, CO cardiac output, LVOT left ventricular outflow tract, VTI velocity time interval

Full size image

The medical students deemed both LVOTd and VTI unmeasurable (i.e., images were of too low a quality and no or few structures could be identified) in 129 patients (12%), the LVOTd in 46 patients (4.2%), and the VTI in 29 patients (2.6%). The parasternal short axis view did not provide any additional measurements when the LVOTd was unmeasurable in the PLAX view. Thus, 204 patients (19%) out of 1075 had no CO measurement, leaving a total of 871 patients (81%) with a measured CO by medical students.

CCUS quality of images

The experts used the images obtained by the medical students and were unable to measure both the LVOTd and VTI in 152/1075 (14%), LVOTd in 76/1075 (7.1%), and VTI in 64/1075 (6.0%). While the experts deemed more measurements to be impossible in the obtained images compared to the medical students, the experts were also able to add 23 CO measurements in patients where medical students judged the images to be of too poor a quality and consequently did not perform the measurements. In total, the experts measured CO in 783 patients (73%). Comparisons of CO measurements by medical students and experts were possible in 760 (71%) out of 1075 patients in case of adequate image quality (Fig. 1).

Differences in patient baseline characteristics were found between the group in which experts could measure a CO and the group in which experts could not measure a CO (see Table 1). Patients without CO measured by experts were characterized by older age, greater illness severity (reflected in higher APACHE IV scores), higher heart rate, greater prevalence of chronic obstructive pulmonary disease (COPD), higher rates of mechanical ventilation, greater likelihood of being post-operative, and higher vasopressor dose.

Table 1 Patient characteristics separated on the presence or absence of an expert-measured cardiac output (n = 1075)
Full size table

Comparison of CO measurement by medical students and experts

The mean COmedical student was 5.2 ± 2.0 L min−1 and COexpert was 5.2 ± 1.8 L min−1 (p = 0.44). Bland–Altman analysis demonstrated a bias of − 0.0 L min−1 (95% CI − 0.06 to 0.13) with limits of agreement of − 2.6 L min−1 (95% CI − 2.7 to − 2.4) to 2.7 L min−1 (95% CI 2.5–2.8) (Fig. 2). Plotting a regression line in the Bland–Altman plot showed a proportional bias of 2%. The percentage error was 50% (95% CI 47–53). The ICC was 0.75 (95% CI 0.72–0.78).

Fig. 2
figure2

Bland–Altman plot showing the comparison between cardiac output measured by medical students (COmedical student) and core lab experts (COexpert). The mean bias between COexpert and COmedical student and the upper and lower limits of agreement (LOA) are presented. The figure clearly shows the widening of the LOA in both directions with increasing CO

Full size image

Comparison of LVOTd and VTI measurements by medical students and experts

The medical students measured 900 LVOTd and the experts 847. There were 815 paired LVOTd measurements. Mean LVOTd by medical students (LVOTdmedical student) was 2.06 ± 0.24, whereas the mean of the LVOTd measured by experts (LVOTdexpert) was 2.09 ± 0.18 (p < 0.001). Bland–Altman analysis showed a bias of 0.0 cm (95% CI 0.0–0.0) with limits of agreement of − 0.5 cm (95% CI − 0.5 to − 0.4) to 0.4 cm (95% CI 0.4–0.4) (see Additional file 1). The percentage error was 21% (95% CI 20–23). There was a proportional bias of 20% (0.41 cm). The ICC was 0.43 (95% CI 0.37–0.48).

The medical students measured 917 VTI and the experts 859. There were 840 paired VTI measurements. Mean VTI by medical students (VTImedical student) was 19.0 ± 5.6 cm compared to 18.5 ± 5.4 cm of the experts (VTIexpert) (p < 0.001). Bland–Altman analysis showed a bias of 0.5 cm (95% CI 0.4–0.7) with limits of agreement of − 5.0 cm (95% CI − 5.3 to − 4.6) to 6.1 cm (95% CI 5.7–6.4) (see Additional file 1). The percentage error was 30% (95% CI 28–31). The ICC was 0.86 (95% CI 0.84–0.88).

Discussion

In this large prospective ICU cohort study with CCUS, we found that, after dedicated training, medical students were able to acquire a CO measurement in three out of every four patients (871 of 1155 patients). This finding is of interest considering that the medical students were ultrasound naïve, the CO measurement is considered an advanced CCUS skill, and the ICU population is known for technical difficulties in acquiring ultrasound images. In a minority of ICU patients (80 of the 1155 patients) CCUS was not possible due to clinical conditions hampering image acquisition, leaving 1075 patients with ultrasonography data. The CCUS images obtained by medical students were assessed by experts and rated to be of adequate quality in 73%. Patients (292 of 1075 patients) in which no adequate image quality could be obtained were more often mechanically ventilated, admitted after cardiothoracic surgery or were more severely ill.

Although the students reached a reasonable percentage on image acquisition/quality, our data do not support CO measurements by medical students (after limited training), as comparison to CO measurements by experts showed poor agreement. CCUS concerns more than acquiring the required images and any operator should be aware of the potential errors that can be made with ultrasonography, especially in complex critically ill patients [33]. It is important to note that education on ultrasonography should focus on specific training and quality control on all aspects of ultrasonography in order to achieve accurate measurements [17]. Our results are in line with recommendations by the European Association of Cardiovascular Imaging (EACVI) on point-of-care, problem-oriented focus cardiac ultrasound examination (FoCUS), which state that supervision and quality control by experts are essential for proper and complete examination. Quality control in our study was performed by an accredited echocardiographic laboratory as is recommended in this viewpoint [15].

To be able to compare our results to those of other studies, it is of utmost importance that every step, from eligible patients to the number of patients in which a reliable CO measurement by CCUS is obtained, is presented. Currently these numbers are often lacking, and this leads to varying success rates on the feasibility of CCUS. If reported, results may vary based on differences in ultrasonography training and experience, which impedes a comparison of image acquisition and quality. We found four studies, on measuring CO in critically ill patients by non-experts to compare with our study (see Additional file 1) [22, 23, 34, 35]. In two out of the four studies the operators had previous experience with ultrasonography, but training varied [23, 34]. The setting, sampling, and exclusion criteria may explain the reported high success rate in one study over another [22]. Whether images obtained are of sufficient quality should preferably be judged by independent experts, as two out of four studies did [22, 34]. In one study independent investigators assessed the quality, however, it is not clear if these were experts or not [35]. The percentage of adequate/good-quality images in our study was comparable with Dinh et al. In the study of Betcher et al. and Villavicencio et al., image quality was generally (judged) overall lower. Duration of training or differences in baseline characteristics might explain part of these differences.

The final step to obtain a reliable CO measurement is to measure LVOTd and VTI on images of sufficient quality. Dinh et al. and Lee et al. reported data on measurement quality, and, furthermore, Dinh et al. reported a low bias between sonographers and independent experts. These studies and ours showed lack in precision for CO measurement by novices. Villavicencio et al. compared ultrasonography-derived CO with the transpulmonary thermodilution technique and concluded that there was an acceptable level of agreement between the techniques. Furthermore, they found a high inter- and intra-observer reliability.

Ultrasonography in the acute setting remains challenging, and data regarding novice-based CCUS are limited (see Additional file 1). In our study we chose for medical students as novices (i.e., non-experts), since non-experts constitute the majority of ultrasound trained personnel in an IC and as students would not interfere with daily ICU care. Five studies reported on medical students performing CCUS in critically ill patients (3 in ED setting, 1 in operating theater and 1 in ICU) [3, 7,8,9,10]. Four out of the five studies showed that images could be acquired in a promising 82–98% of cases. The studies reporting on image quality showed percentages of (at least) adequate imaging ranging from 89 to 98%, unfortunately by non-independent judging [3, 7]. Furthermore, after training, medical students can adequately interpret images with a very simplified or binary assessment [36]. A number of previous studies employed training curricula for medical students on ultrasonography protocols [37,38,39]. Four other studies used a point-of-care ultrasonography training program to determine diagnostic performance in various clinical scenarios [36, 40,41,42]. All studies showed feasibility to train medical students to perform ultrasonography after a relatively short amount of training, which is comparable to the training medical students received in our study.

In previous manuscripts on SICS study data we reported a higher percentage of images judged to be of sufficient quality [25, 26]. The current results showed the percentage of measurements of CO considered of sufficient quality by a core-laboratory and not images with a LVOT and VTI. The high(er) level of quality considered necessary is according to internal protocol and is independently monitored.

Limitations

First, the proportion of patients with an acoustic window was based on the results of CCUS by medical students only. We did not check if more experienced sonographers were able to retrieve images in these cases, because the design of our study was to obtain images outside patient care. We believe image quality can only be assessed if the observers are blinded for all other study data and are not involved in the patient’s clinical care. Ideally, independent experts perform ultrasonography themselves and make a direct comparison with the medical student. The availability of time and staff outside clinical care in our center was limited, leading us to include all consecutive patients and allow trained medical students to run the study.

Second, we did not check for interindividual variation of skills and quality of CCUS in each medical student who participated in the study, mainly to limit the time of investigation at the bedside.

Third, CCUS of the heart was limited to 2D imaging of the LVOTd, the AP5CH and pulse wave Doppler imaging of the LVOT. Therefore, valvular disease could have been missed.

Conclusions

Medical students as novices were capable of performing CCUS with adequate image acquisition in the majority of an ICU population of acutely admitted critically ill patients. However, they cannot accurately measure a CCUS-derived cardiac output after limited training. Cardiac output measurements with CCUS in research and daily care should be interpreted with caution if not validated by experts; this is in concordance with the viewpoint of the EACVI on CCUS.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request

Abbreviations

AP5CH:

apical five-chamber view

CCUS:

critical care ultrasonography

CO:

cardiac output

EACVI:

European Association of Cardiovascular Imaging

ICU:

intensive care unit

IQR:

interquartile ranges

LOA:

limits of agreement

LVOT(d):

left ventricular outflow tract (diameter)

PLAX:

parasternal long axis

SD:

standard deviation

SICS:

Simple Intensive Care Studies

VTI:

velocity time integral

References

  1. 1.

    Mayo PH, Beaulieu Y, Doelken P, Feller-Kopman D, Harrod C, Kaplan A, Oropello J, Vieillard-Baron A, Axler O, Lichtenstein D, Maury E, Slama M, Vignon P (2009) American College of Chest Physicians/La Société de Réanimation de Langue Française statement on competence in critical care ultrasonography. Chest 135:1050–1060. https://doi.org/10.1378/chest.08-2305

    Article  PubMed  Google Scholar 

  2. 2.

    Koster G, Van Der Horst ICC (2017) Critical care ultrasonography in circulatory shock. Curr Opin Crit Care 23:326–333. https://doi.org/10.1097/MCC.0000000000000428

    Article  PubMed  Google Scholar 

  3. 3.

    Filipiak-Strzecka D, John B, Kasprzak J, Michalski B, Lipiec P (2013) Pocket-size echocardiograph—a valuable tool for non-experts or just a portable device for echocardiographers? Adv Med Sci 58:67–72. https://doi.org/10.2478/v10039-012-0054-2

    CAS  Article  PubMed  Google Scholar 

  4. 4.

    AlEassa EM, Ziesmann MT, Kirkpatrick AW, Wurster CL, Gillman LM (2016) Point of care ultrasonography use and training among trauma providers across Canada. Can J Surg 59:6–8. https://doi.org/10.1503/cjs.010215

    Article  PubMed  PubMed Central  Google Scholar 

  5. 5.

    Funcke S, Sander M, Goepfert MS, Groesdonk H, Heringlake M, Hirsch J, Kluge S, Krenn C, Maggiorini M, Meybohm P, Salzwedel C, Saugel B, Wagenpfeil G, Wagenpfeil S, Reuter DA (2016) Practice of hemodynamic monitoring and management in German, Austrian, and Swiss intensive care units: the multicenter cross-sectional ICU-CardioMan Study. Ann Intensive Care 6:49. https://doi.org/10.1186/s13613-016-0148-2

    Article  PubMed  PubMed Central  Google Scholar 

  6. 6.

    Yang Y, Royse C, Royse A, Williams K, Canty D (2016) Survey of the training and use of echocardiography and lung ultrasound in Australasian intensive care units. Crit Care 20:339. https://doi.org/10.1186/s13054-016-1444-9

    Article  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Panoulas VF, Daigeler A-L, Malaweera ASN, Lota AS, Baskaran D, Rahman S, Nihoyannopoulos P (2013) Pocket-size hand-held cardiac ultrasound as an adjunct to clinical examination in the hands of medical students and junior doctors. Eur Hear J Cardiovasc Imaging 14:323–330. https://doi.org/10.1093/ehjci/jes140

    Article  Google Scholar 

  8. 8.

    Ho AM-H, Critchley LAH, Leung JYC, Kan PKY, Au SS, Ng SK, Chan SKC, Lam PKN, Choi GYS, Wai JKM, Lee APW, Chan SO (2015) Introducing final-year medical students to pocket-sized ultrasound imaging: teaching transthoracic echocardiography on a 2-week anesthesia rotation. Teach Learn Med 27:307–313. https://doi.org/10.1080/10401334.2015.1044657

    Article  PubMed  Google Scholar 

  9. 9.

    Krause C, Krause R, Krause R, Gomez N, Jafry Z, Dinh VA (2017) Effectiveness of a 1-hour extended focused assessment with sonography in trauma session in the medical student surgery clerkship. J Surg Educ 74:968–974. https://doi.org/10.1016/j.jsurg.2017.03.007

    Article  PubMed  Google Scholar 

  10. 10.

    Udrea DS, Sumnicht A, Lo D, Villarreal L, Gondra S, Chyan R, Wisham A, Dinh VA (2017) Effects of student-performed point-of-care ultrasound on physician diagnosis and management of patients in the emergency department. J Emerg Med 53:102–109. https://doi.org/10.1016/j.jemermed.2017.01.021

    Article  PubMed  Google Scholar 

  11. 11.

    Bobbia X, Chabannon M, Chevallier T, de La Coussaye JE, Lefrant JY, Pujol S, Claret P-G, Zieleskiewicz L, Roger C, Muller L (2018) Assessment of five different probes for lung ultrasound in critically ill patients: a pilot study. Am J Emerg Med 36:1265–1269. https://doi.org/10.1016/j.ajem.2018.03.077

    Article  PubMed  Google Scholar 

  12. 12.

    Rice BT, Vu H, Tran LD, Vo QX, Mowafi H (2015) Survey of point of care ultrasound usage in emergency medicine by Vietnamese physicians. Emerg Med Australas 27:580–583. https://doi.org/10.1111/1742-6723.12476

    Article  PubMed  Google Scholar 

  13. 13.

    Nielsen K, Lauridsen JRM, Laursen CB, Brabrand M (2015) Physicians using ultrasound in Danish emergency departments are mostly summoned specialists. Scand J Trauma Resusc Emerg Med 23:51. https://doi.org/10.1186/s13049-015-0131-1

    Article  PubMed  PubMed Central  Google Scholar 

  14. 14.

    Sanders J, Noble V, Raja A, Sullivan A, Camargo C (2015) Access to and use of point-of-care ultrasound in the emergency department. West J Emerg Med 16:747–752. https://doi.org/10.5811/westjem.2015.7.27216

    Article  PubMed  PubMed Central  Google Scholar 

  15. 15.

    Neskovic AN, Skinner H, Price S, Via G, De Hert S, Stankovic I, Galderisi M, Donal E, Muraru D, Sloth E, Gargani L, Cardim N, Stefanidis A, Cameli M, Habib G, Cosyns B, Lancellotti P, Edvardsen T, Popescu BA, Reviewers: This document was reviewed by members of the 2016–2018 EACVI Scientific Documents Committee (2018) Focus cardiac ultrasound core curriculum and core syllabus of the European Association of Cardiovascular Imaging. Eur Heart J Cardiovasc Imaging 19:475–481. https://doi.org/10.1093/ehjci/jey006

    Article  PubMed  Google Scholar 

  16. 16.

    Expert Round Table on Ultrasound in ICU (2011) International expert statement on training standards for critical care ultrasonography. Intensive Care Med 37:1077–1083. https://doi.org/10.1007/s00134-011-2246-9

    Article  Google Scholar 

  17. 17.

    Price S, Via G, Sloth E, Guarracino F, Breitkreutz R, Catena E, Talmor D (2008) Echocardiography practice, training and accreditation in the intensive care: document for the World Interactive Network Focused on Critical Ultrasound (WINFOCUS). Cardiovasc Ultrasound 6:49. https://doi.org/10.1186/1476-7120-6-49

    Article  PubMed  PubMed Central  Google Scholar 

  18. 18.

    Cecconi M, De Backer D, Antonelli M, Beale R, Bakker J, Hofer C, Jaeschke R, Mebazaa A, Pinsky MR, Teboul JL, Vincent JL, Rhodes A (2014) Consensus on circulatory shock and hemodynamic monitoring. Task force of the European Society of Intensive Care Medicine. Intensive Care Med 40:1795–1815. https://doi.org/10.1007/s00134-014-3525-z

    Article  PubMed  PubMed Central  Google Scholar 

  19. 19.

    Sakr Y, Reinhart K, Vincent J-L, Sprung CL, Moreno R, Ranieri VM, De Backer D, Payen D (2006) Does dopamine administration in shock influence outcome? Results of the Sepsis Occurrence in Acutely Ill Patients (SOAP) Study. Crit Care Med 34:589–597. https://doi.org/10.1097/01.CCM.0000201896.45809.E3

    CAS  Article  PubMed  Google Scholar 

  20. 20.

    Vieillard-Baron A, Mayo PH, Vignon P, Cholley B, Slama M, Pinsky MR, McLean A, Choi G, Beaulieu Y, Arntfield R, Koenig S, Colreavy F, Canivet JL, De Backer D (2014) International consensus statement on training standards for advanced critical care echocardiography. Intensive Care Med 40:654–666. https://doi.org/10.1007/s00134-014-3228-5

    Article  Google Scholar 

  21. 21.

    Millington SJ, Goffi A, Arntfield RT (2018) Critical care echocardiography: a certification pathway for advanced users. Can J Anesth 65:345–349. https://doi.org/10.1007/s12630-018-1061-y

    Article  PubMed  Google Scholar 

  22. 22.

    Dinh VA, Ko HS, Rao R, Bansal RC, Smith DD, Kim TE, Nguyen HB (2012) Measuring cardiac index with a focused cardiac ultrasound examination in the ED. Am J Emerg Med 30:1845–1851. https://doi.org/10.1016/j.ajem.2012.03.025

    Article  PubMed  Google Scholar 

  23. 23.

    Lee L, Tewalde S, Allison M, Witting M, Euerle B (2014) Inter-rater reliability of doppler echocardiography assessment of cardiac output by emergency physicians. Ann Emerg Med 64:S126. https://doi.org/10.1016/j.annemergmed.2014.07.384

    Article  Google Scholar 

  24. 24.

    Andersen GN, Viset A, Mjølstad OC, Salvesen Ø, Dalen H, Haugen BO (2014) Feasibility and accuracy of point-of-care pocket-size ultrasonography performed by medical students. BMC Med Educ 14:156. https://doi.org/10.1186/1472-6920-14-156

    Article  PubMed  PubMed Central  Google Scholar 

  25. 25.

    Hiemstra B, Eck RJ, Koster G, Wetterslev J, Perner A, Pettilà V, Snieder H, Hummel YM, Wiersema R, de Smet AMGA, Keus F, van der Horst ICC (2017) Clinical examination, critical care ultrasonography and outcomes in the critically ill: cohort profile of the Simple Intensive Care Studies-I. BMJ Open 7:e017170. https://doi.org/10.1136/bmjopen-2017-017170

    Article  PubMed  PubMed Central  Google Scholar 

  26. 26.

    Hiemstra B, Koster G, Wiersema R, Hummel YM, van der Harst P, Snieder H, Eck RJ, Kaufmann T, Scheeren TWL, Perner A, Wetterslev J, de Smet AMGA, Keus F, van der Horst ICC (2019) The diagnostic accuracy of clinical examination for estimating cardiac index in critically ill patients: the Simple Intensive Care Studies-I. Intensive Care Med 45:190–200. https://doi.org/10.1007/s00134-019-05527-y

    Article  PubMed  Google Scholar 

  27. 27.

    Qasim A. Echocardiographer.org. http://echocardiographer.org/. Accessed 25 Oct 2019

  28. 28.

    Baumgartner H, Hung J, Bermejo J, Chambers JB, Edvardsen T, Goldstein S, Lancellotti P, LeFevre M, Miller F, Otto CM (2017) Recommendations on the echocardiographic assessment of aortic valve stenosis: a focused update from the European Association of Cardiovascular Imaging and the American Society of Echocardiography. Eur Heart J Cardiovasc Imaging 18:254–275. https://doi.org/10.1093/ehjci/jew335

    Article  Google Scholar 

  29. 29.

    Quiñones MA, Otto CM, Stoddard M, Waggoner A, Zoghbi WA, Doppler Quantification Task Force of the Nomenclature and Standards Committee of the American Society of Echocardiography (2002) Recommendations for quantification of Doppler echocardiography: a report from the Doppler Quantification Task Force of the Nomenclature and Standards Committee of the American Society of Echocardiography. J Am Soc Echocardiogr 15:167–184

    Article  Google Scholar 

  30. 30.

    Royse CF, Seah JL, Donelan L, Royse AG (2006) Point of care ultrasound for basic haemodynamic assessment: novice compared with an expert operator. Anaesthesia 61:849–855. https://doi.org/10.1111/j.1365-2044.2006.04746.x

    CAS  Article  PubMed  Google Scholar 

  31. 31.

    Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8:135–160. https://doi.org/10.1177/096228029900800204

    CAS  Article  PubMed  Google Scholar 

  32. 32.

    Critchley LAH, Critchley JAJH (1999) A meta-analysis of studies using bias and precision statistics to compare cardiac output measurement techniques. J Clin Monit Comput 15:85–91. https://doi.org/10.1023/A:1009982611386

    CAS  Article  PubMed  Google Scholar 

  33. 33.

    Orde S, Slama M, Hilton A, Yastrebov K, McLean A (2017) Pearls and pitfalls in comprehensive critical care echocardiography. Crit Care 21:279. https://doi.org/10.1186/s13054-017-1866-z

    Article  PubMed  PubMed Central  Google Scholar 

  34. 34.

    Betcher J, Majkrzak A, Cranford J, Kessler R, Theyyunni N, Huang R (2018) Feasibility study of advanced focused cardiac measurements within the emergency department. Crit Ultrasound J 10:10. https://doi.org/10.1186/s13089-018-0093-4

    Article  PubMed  PubMed Central  Google Scholar 

  35. 35.

    Villavicencio C, Leache J, Marin J, Oliva I, Rodriguez A, Bodí M, Soni NJ (2019) Basic critical care echocardiography training of intensivists allows reproducible and reliable measurements of cardiac output. Ultrasound J 11:5. https://doi.org/10.1186/s13089-019-0120-0

    Article  PubMed  PubMed Central  Google Scholar 

  36. 36.

    Lebeau R, Sas G, El Rayes M, Serban A (2015) Left ventricular ejection fraction assessment by non-cardiologists from transverse views using a simplified wall motion score index. Echo Res Pract 2:1–8. https://doi.org/10.1530/ERP-14-0003

    Article  PubMed  PubMed Central  Google Scholar 

  37. 37.

    Heiberg J, Hansen LS, Wemmelund K, Sørensen AH, Ilkjaer C, Cloete E, Nolte D, Roodt F, Dyer R, Swanevelder J, Sloth E (2015) Point-of-care clinical ultrasound for medical students. Ultrasound Int open 1:E58–E66. https://doi.org/10.1055/s-0035-1565173

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  38. 38.

    Kobal SL, Lior Y, Ben-Sasson A, Liel-Cohen N, Galante O, Fuchs L (2017) The feasibility and efficacy of implementing a focused cardiac ultrasound course into a medical school curriculum. BMC Med Educ 17:94. https://doi.org/10.1186/s12909-017-0928-x

    Article  PubMed  PubMed Central  Google Scholar 

  39. 39.

    Wong I, Jayatilleke T, Kendall R, Atkinson P (2011) Feasibility of a focused ultrasound training programme for medical undergraduate students. Clin Teach 8:3–7. https://doi.org/10.1111/j.1743-498X.2010.00416.x

    Article  PubMed  Google Scholar 

  40. 40.

    Parks AR, Verheul G, Leblanc-duchin D, Atkinson P (2019) Effect of a point-of-care ultrasound protocol on the diagnostic performance of medical learners during simulated cardiorespiratory scenarios. 17:263–269. https://doi.org/10.1017/cem.2014.41

    Article  Google Scholar 

  41. 41.

    Arora S, Cheung AC, Tarique U, Agarwal A, Firdouse M, Ailon J (2017) First-year medical students use of ultrasound or physical examination to diagnose hepatomegaly and ascites: a randomized controlled trial. J Ultrasound 20:199–204. https://doi.org/10.1007/s40477-017-0261-6

    Article  PubMed  PubMed Central  Google Scholar 

  42. 42.

    Ang J, Doyle B, Allen P, Cheek C (2018) Teaching bedside ultrasound to medical students. Clin Teach 15:331–335. https://doi.org/10.1111/tct.12692

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to thank all medical students and coordinators from the SICS Study Group for their devoted involvement with patient inclusions: R. Bleijendaal, Y.F. Cavale, R.P. Clement, R.J. Eck, W. Dieperink, A. Haker, D.H. Hilbink, M. Klasen, M. Klaver, L.J. Schokking, V.W. Sikkens and J. Woerlee.

Furthermore, we want to express a special thanks to: A. Baron, BParaPrac, BSc Hons, GcertClinUS and Dr. M. Peck, MBBS for their input.

Funding

This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Author information

Affiliations

  1. Department of Critical Care, University of Groningen, University Medical Center Groningen, P.O. Box 30.001, 9700 RB, Groningen, The Netherlands

    Geert Koster, Bart Hiemstra, Renske Wiersema, Madelon E. Vos, Devon Dijkhuizen, Frederik Keus & Iwan C. C. van der Horst

  2. Department of Anaesthesiology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands

    Thomas Kaufmann & Thomas W. L. Scheeren

  3. Department of Anaesthesia and Intensive Care, Royal Surrey Hospital, Guildford, UK

    Adrian Wong

  4. Department of Cardiology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands

    Yoran M. Hummel

  5. Department of Intensive Care, Maastricht University Medical Center+, University Maastricht, Maastricht, The Netherlands

    Iwan C. C. van der Horst

Authors
  1. Geert Koster
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas Kaufmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bart Hiemstra
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Renske Wiersema
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Madelon E. Vos
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Devon Dijkhuizen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Adrian Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Thomas W. L. Scheeren
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Yoran M. Hummel
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Frederik Keus
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Iwan C. C. van der Horst
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

GK and BH drafted the manuscript and conducted the analyses. TK critically reviewed the manuscript and recalculated the analyses. IVDH created the idea of the study. GK developed the education platform. RW contributed substantially to the data collection. YMH validated all cardiac output measurements blinded for all other measurements. All authors critically reviewed the manuscript and agreed with the final version and findings. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Geert Koster.

Ethics declarations

Ethics approval and consent to participate

Medisch Ethische Toetsingscommissie, University Medical Center Groningen; METc M15.168207.

Consent for publication

All authors give consent for publication.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Figure S1. Scatter plot of cardiac output measurements of medical students (COmedical student) versus core lab (COexpert). Figure S2. Bland–Altman plot showing the comparison between cardiac output measured by medical students (COmedical student) and core lab (COexpert). Figure S3. Scatter plot of left ventricular outflow tract diameter measurements of medical students (LVOTmedical students) versus core lab (LVOTexpert). Figure S4. Bland–Altman plot showing the comparison between left ventricular outflow tract diameter measured by medical students (LVOTmedical students) and core lab (LVOTexpert). Figure S5. Scatter plot of velocity time interval measurements of medical students (VTImedical students) versus core lab (VTIexpert). Figure S6. Bland–Altman plot showing the comparison between VTI measured by medical students (VTImedical students) and core lab (VTIexpert). Table S1. Overview of existing recent literature on medical students-based ultrasonography in critically ill patients. Table S2. Overview of existing recent literature on CO derived ultrasonography in critically ill patients compared to our study. Additional – appendix CCUS protocol.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Koster, G., Kaufmann, T., Hiemstra, B. et al. Feasibility of cardiac output measurements in critically ill patients by medical students. Ultrasound J 12, 1 (2020). https://doi.org/10.1186/s13089-020-0152-5

Download citation

Keywords

  • Ultrasonography
  • Medical students
  • Critical care
  • Intensive care unit
  • Cardiac output