- Original article
- Open Access
- Published:
Diagnostic accuracy of lung ultrasound for SARS-CoV-2: a retrospective cohort study
The Ultrasound Journal volume 13, Article number: 12 (2021)
Abstract
Background
As medical infrastructures are strained by SARS-CoV-2, rapid and accurate screening tools are essential. In portions of the world, reverse transcription polymerase chain reaction (RT-PCR) testing remains slow and in limited supply, and computed tomography is expensive, inefficient, and involves exposure to ionizing radiation. Multiple studies evaluating the efficiency of lung point-of-care ultrasound (POCUS) have been published recently, but include relatively small cohorts and often focus on characteristics associated with severe illness rather than screening efficacy. This study utilizes a retrospective cohort to evaluate the test characteristics (sensitivity, specificity, likelihood ratios, predictive values) of lung POCUS in the diagnosis of SARS-CoV-2, and to determine lung score cutoffs that maximize performance for use as a screening tool.
Results
Lung POCUS examinations had sensitivity 86%, specificity 71.6%, NPV 81.7%, and PPV 77.7%. The Lung Ultrasound Score had an area under the curve of 0.84 (95% CI 0.78, 0.90). When including only complete examinations visualizing 12 lung fields, lung POCUS had sensitivity 90.9% and specificity 75.6%, with NPV 87.2% and PPV 82.0% and an area under the curve of 0.89 (95% CI 0.83, 0.96). Lung POCUS was less accurate in patients with a history of interstitial lung disease, severe emphysema, and heart failure.
Conclusions
When applied in the appropriate patient population, lung POCUS is an inexpensive and reliable tool for rapid screening and diagnosis of SARS-CoV-2 in symptomatic patients with influenza-like illness. Adoption of lung POCUS screening for SARS-CoV-2 may identify patients who do not require additional testing and reduce the need for RT-PCR testing in resource-limited environments and during surge periods.
Introduction
A pandemic of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes the syndrome known as COVID-19 has led to over 75 million infections and over 1 million deaths as of December 2020 [1]. Early diagnosis is vital to enable early isolation, reduce ongoing transmission, and facilitate clinical decision-making. SARS-CoV-2 RT-PCR is the current diagnostic gold standard but has an estimated sensitivity of 75% [2, 3], and may take multiple days to result in some high-demand areas [4]. In the absence of sufficient RT-PCR availability, thoracic computed tomography (CT) has been used to detect the characteristic peripheral ground-glass opacities of COVID-19 pneumonia [5,6,7,8]. However, CT is not an optimal screening tool as it exposes patients to ionizing radiation, requires extensive decontamination, and is not readily available in many resource-limited situations [9,10,11].
Lung point-of-care-ultrasound (POCUS) has been proposed as a screening tool for COVID-19, and may offer several advantages. For non-SARS-CoV-2 interstitial syndromes, lung ultrasound has better sensitivity and specificity than chest radiograph and CT [5, 12, 13]. In confirmed cases of SARS-CoV-2 infection, lung POCUS evaluation of disease severity has correlated well with CT chest [14]. In addition to superior performance, lung POCUS is cost-effective [15, 16], portable, provides real-time data, and does not require ionizing radiation. POCUS supports infection control efforts by minimizing the number of healthcare workers exposed to patients under investigation (PUI) for COVID-19, and decontamination of ultrasound machines is relatively quick and easy compared with other imaging modalities [17]. Thus, if proven reliable, lung POCUS would allow for expedited and cost-efficient diagnosis of COVID-19 in hospitals, in the community, in resource-limited settings, and in surge situations when RT-PCR or CT chest availability is limited.
Preliminary studies have prompted the World Health Organization (WHO) to endorse ultrasound for use in the diagnosis of COVID-19, although this endorsement is noted as being based on weak preliminary evidence [18,19,20]. Characteristic findings of the COVID-19 syndrome on lung POCUS include a thickened or irregular pleural line, confluent B-lines, and subpleural consolidations [19, 21,22,23]. These findings correlate closely with those observed on CT [22], and demonstrate promise in trending clinical progression from onset to peak to resolution [21, 24]. Descriptive studies [25,26,27,28,29,30,31] have revealed the potential utility of lung POCUS but are limited by small sample sizes, lack of in-depth statistical analysis, and limited evaluation of patient characteristics that impact the utility of lung POCUS. To facilitate optimal application of lung POCUS for the diagnosis of COVID-19, we report the diagnostic accuracy of lung POCUS compared the criterion standard of SARS-CoV-2 RT-PCR test.
Materials and methods
A convenience sample of COVID-19 PUI > 18 years old evaluated between March 16, 2020 and May 16, 2020 who had lung POCUS recorded as part of their routine emergency department or inpatient care were included in this retrospective cohort study conducted at two urban academic tertiary care centers. PUI designation was identified by the presence of a SARS-CoV-2 RT-PCR order by the treating physician. Criteria for SARS-CoV-2 testing during the study period included either exposure to COVID-19 or report of at least two of the following symptoms: fever, acute cough, sore throat, dyspnea, myalgias, or loss of taste or smell. Details of all patients included in the study as well as alternate diagnoses are in Additional file 1: Figure S1. This study was performed in accordance with the Declaration of Helsinki. This human study was approved by Johns Hopkins Institutional Review Board—approval: IRB00255571. Adult participant consent was not required because this was a retrospective study.
The institutional POCUS database (Qpath Ultrasound Manager, Telexy Healthcare, Blaine WA) was queried to identify all lung POCUS examinations performed on COVID-19 PUI during the study period. All lung examinations performed during routine evaluation for COVID-19 by residents and faculty credentialed in the use of lung POCUS in the departments of Emergency Medicine and Internal Medicine were included. Study team members performed 89.1% of ultrasound studies, and all studies were evaluated for image adequacy by study team members blinded to clinical information. No dedicated training in lung POCUS or COVID-19-specific ultrasound was provided. A 12-field protocol was encouraged for POCUS users across the institution, including views of the bilateral anterior lung (L1–L2/R1–R2), lateral lung (L3–L4/R3–R4), and posterior lung (L5–L6/R5–R6) (Fig. 1). Ultrasound scans were acquired using equipment from Sonosite (Bothell WA), GE Healthcare (Waukesha WA), Philips (Bothell WA), and EchoNous (Redmond WA) (Additional file 2: Table S1).
Test characteristics and distribution of findings in lung POCUS for the evaluation of SARS-CoV-2. Upper panels: Lung fields are labeled in yellow across the thorax. Green numbers represent the sensitivity and black numbers represent the specificity for SARS-CoV-2 infection of each lung field. Lower panels: Green numbers represent the percentage of patients with negative RT-PCR test for SARS-CoV-2 who had abnormal findings in each lung window. Black numbers represent the percentage of patients with positive RT-PCR test for SARS-CoV-2 who had abnormal findings in each lung window
Demographic characteristics including age, gender, race, duration of symptoms before POCUS examination, duration of symptoms before RT-PCR, RT-PCR result, body mass index (BMI), and history of comorbid conditions were recorded in a REDCap database (Vanderbilt University, Nashville TN). Two study team members credentialed in lung POCUS and blinded to all clinical information interpreted the lung POCUS studies. Reviewers did not evaluate POCUS examinations that they acquired. The blinded reviewers recorded their assessments in a separate REDCap tool based on a Lung Ultrasound Score described for use in COVID-19 pneumonia [21]. Each lung field was assessed for abnormal findings including pleural irregularity (0 points), multiple discrete B-lines (1 point), confluent B-lines (2 points), subpleural consolidations (3 points), and pleural effusion (0 points). Examples of these findings are presented in Additional file 3: Video S1, Additional file 4: Video S2, Additional file 5: Video S3, Additional file 6: Video S4, Additional file 7: Video S5, Additional file 8: Video S6. The reviewers also provided a summary assessment of whether the POCUS examination was consistent with COVID-19. A third blinded reviewer adjudicated any disagreements between reviewers. The reviewer whose ultrasound COVID-19 determination was concordant with the adjudicator was retained in the analysis.
The test characteristics and discriminative power of the Lung Ultrasound Score relative to the SARS-CoV-2 RT-PCR result were calculated. The point totals for all lung fields were summed to yield a total Lung Ultrasound Score for each reviewer. Mean Lung Ultrasound Score was calculated as the mean score between the two ultrasound reviewers. POCUS examinations were compared with the institutional gold standard RT-PCR test. A secondary analysis of complete examinations (12 acquired lung fields) was also performed. Means and proportions were compared using Student’s T test and Chi-squared testing. Inter-rater reliability of lung POCUS interpretation was assessed using percent agreement, percent positive agreement, and kappa statistics. The sensitivity, specificity, negative predictive value, and positive predictive value associated with overall COVID-19 status determination by ultrasound and individual lung fields were also calculated. Agreement between SARS-CoV-2 RT-PCR testing and lung POCUS was evaluated using kappa statistics. The area under the receiver operator curve was then calculated for the Lung Ultrasound Score, and a cutoff proposed based on the Youden J statistic [32]. Scoring frameworks assigning negative points for pleural effusions were assessed, and the framework with the highest discriminative power (pleural effusion − 3 points) was included for analysis.
Results
Patients included in the cohort (n = 174) had mean age of 53.1 years, were 52.9% male, and 53% had positive RT-PCR testing for SARS-CoV-2 (Table 1). 77% were admitted to the hospital, 26.4% were admitted to the intensive care unit, 5.7% required high-flow nasal cannula oxygen support, and 14.4% required intubation (Table 1, Additional file 2: Table S2). Other details of hospital admission and level of care are reported in Additional file 2: Table S2. Pathological lung findings were identified more frequently in all lung fields in patients who tested positive for SARS-CoV-2 RNA compared to those who tested negative (p < 0.001). Bilateral lung involvement was more common among those with a positive RT-PCR result (78%), compared to those with a negative RT-PCR result (26%).
Test characteristics for lung POCUS in the diagnosis of COVID-19 are detailed in Table 2. Compared to the standard of RT-PCR testing, lung POCUS had a sensitivity 86.0% and specificity 71.6%, with negative predictive value (NPV) 81.7% and positive predictive value (PPV) 77.7%. Test characteristics for the involvement of more than one lung field, posterior lung field involvement, and bilateral lung field involvement are also reported in Table 2. Examinations with multiple discrete B-lines had a sensitivity 86.0%, specificity 54.3%, NPV 77.2%, and PPV 68.4% while examinations with confluent B-lines had a sensitivity 43.0%, specificity 98.8%, NPV 60.2%, PPV 97.6%. Lung POCUS was more accurate in patients with more significant oxygen requirement or requiring higher level of care (Table 3).
Patients with positive SARS-CoV-2 RT-PCR testing had higher Lung Ultrasound Scores than those with negative tests (9.4 ± 5.5 versus 2.6 ± 3.2). There was high discrimination (AUC 0.84, 95% CI 0.78, 0.90) of the Lung Ultrasound Score for COVID-19 syndrome (Fig. 2). The test characteristics associated with various cutoff points are reported in Fig. 2. A Lung Ultrasound Score of 2 points maximized sensitivity (sensitivity 88%, specificity 55%, positive likelihood ratio (+ LR) 1.98, negative likelihood ratio (− LR) 0.21, PPV 80.4%, NPV 69.5%). A Lung Ultrasound Score of 8 points maximized specificity (sensitivity 59%, specificity 91%, + LR 6.84, − LR 0.45, PPV 66.1%, NPV 88.7%). A Lung Ultrasound Score of 6 points optimized a balance of sensitivity and specificity (sensitivity 77%, specificity 84%, + LR 4.82, − LR 0.27, PPV 76.4%, NPV 84.7%) are also reported in Fig. 2. A grey zone analysis in Fig. 3 demonstrates that Lung Ultrasound Scores under 4 have sensitivity over 90% of SARS-CoV-2 infection, and that scores over 6 have over 90% specificity for the detection of SARS-CoV-2 infection. A modified version of the Lung Ultrasound Score that scored the presence of pleural effusion as − 3 points had improved discrimination compared to the standard Lung Ultrasound Score (Fig. 2; AUC 0.90, 95% CI 0.84, 0.96), and improved test characteristics (Fig. 2). Using pleural effusions as a negative prognostic factor improved the performance of the Lung Ultrasound Score in the grey zone analysis, narrowing the area of uncertain diagnosis (Fig. 3).
Receiver operator curves for Lung Ultrasound Score for all examinations (top left), examinations with all 12 views (top right), examinations with 12 views including pleural effusions as a negative prognostic factor for SARS-CoV-2 diagnosis (bottom left), and excluding confounding pre-existing comorbidities (bottom right)
Grey zone analysis for Lung Ultrasound Score for all examinations (top left), examinations with all 12 views (top right), examinations with 12 views including pleural effusions as a negative prognostic factor for SARS-CoV-2 diagnosis (bottom left), and excluding confounding pre-existing comorbidities (bottom right)
Patient-related factors associated with decreased lung POCUS accuracy were also investigated. Patients with false-negative lung POCUS scans (n = 13) had higher average BMI compared to patients with true-positive scans (36.5 kg/m2 ± 9.4 versus 29.3 kg/m2 ± 8.1; p < 0.001) (Table 4). Patients with false-positive lung POCUS scans (n = 23) were more likely to have pre-existing ILD than patients with true negative scans (26% versus 0%, p < 0.001; Table 4). Patients with false-positive lung POCUS scans were also more likely to have systolic heart failure (57% versus 24% p < 0.001) and heart failure with ejection fraction (EF) under 35% (30% vs 3% p < 0.001; Table 4). There was no difference in the prevalence of asthma, COPD, HIV with CD4 < 200, immunosuppression, or end-stage renal disease in patients with discordance between lung POCUS and RT-PCR result (Table 4).
Exclusion of patients with these comorbid conditions associated improved the diagnostic performance of lung POCUS for COVID-19 (Table 2). In patients without these confounding conditions, the sensitivity was 89.3%, specificity was 83.3%, NPV 84.7%, and PPV 88.2%. These exclusions also improved the discriminative ability of the Lung Ultrasound Score (Fig. 2; AUC 0.91, 95% CI 0.85, 0.98) and narrowed the grey zone area of uncertain diagnosis (Fig. 3). The test characteristics associated with cutoff points maximizing sensitivity (2 points: PPV 84.0%), specificity (8 points: NPV 97.1%), or statistically optimizing a balance of sensitivity and specificity (6 points: PPV 81.6%, NPV 91.7%) are also reported in Fig. 2.
A secondary analysis including only complete lung POCUS examinations with all 12 lung fields was performed. Participants with complete POCUS lung evaluation (n = 100) had a mean age of 51.3 years, were 54% male, and 55% had positive RT-PCR testing for SARS-CoV-2 (Additional file 2: Table S3). Complete examinations had improved test characteristics and better discriminative ability (Additional file 9: Figure S2) compared to examinations that did not include all lung fields (AUC 0.89, 95% CI 0.83, 0.96. Sensitivity 90.9%, specificity 75.6%, NPV 87.2%, PPV 82.0%) (Fig. 2).
Discussion
These data demonstrate that lung POCUS provides rapid information regarding COVID-19 status that is consistent with results of the current gold standard RT-PCR test. In our patient cohort, there was also anecdotal evidence that lung POCUS could outperform the RT-PCR test. At least three patients in this study with initially negative RT-PCR testing but lung POCUS examinations suggestive of COVID-19 were subsequently diagnosed with SARS-CoV-2 infection through more invasive testing.
While descriptive studies of lung POCUS findings in COVID-19 are numerous [19, 22, 25], this is most thorough investigation of a quantitative lung POCUS score to diagnose COVID-19 with data allowing maximization of sensitivity, specificity, and discriminative ability. Other studies do provide information on the test characteristics of lung POCUS in the diagnosis of COVID-19, but are limited by much smaller cohorts and unable to demonstrate the performance in populations with various comorbidities [26, 27, 29, 31]. The present study provides a more comprehensive assessment of the diagnostic power of lung POCUS in a large heterogenous population, and provides vital information for properly applying lung POCUS in the diagnosis of COVID-19.
These data suggest that a Lung Ultrasound Score cutoff of 2 points maximizes sensitivity for use in screening of symptomatic patients. Using this approach, any POCUS examination with three or more discrete B-lines in two distinct lung fields, or any examination with confluent B-lines or subpleural consolidation in any single lung field is concerning for COVID-19, requires isolation, and may benefit from additional testing. Any lung POCUS examination with a Lung Ultrasound Score of 0 points or 1 point is very unlikely to be associated with COVID-19, and can be triaged out of PUI workflows and investigated for other etiologies of their symptoms. At any point during the examination, if the cumulative Lung Ultrasound Score is equal to or greater than 2 points, the clinician can stop and order confirmatory testing, and move on to the next patient. This approach deliberately maximizes the sensitivity and negative predictive value at the expense of the specificity and positive predictive value, and will need to be externally validated. Additionally, while this approach may be advantageous for efficiency, the secondary analysis strongly suggests that complete examinations with 12 lung fields have improved diagnostic power compared to abbreviated examinations. Other cutoffs maximizing specificity (8 points) or balancing between sensitivity and specificity (6 points) can be considered in the appropriate clinical contexts.
The accuracy of lung POCUS may be impacted by patient factors. Elevated BMI reduced the sensitivity of lung POCUS for COVID-19, consistent with prior studies that have reported similar effects of obesity [33]. Pre-existing interstitial lung disease reduced the specificity of lung POCUS for COVID-19. This confounder may be due to the pre-existing pathology of interstitial inflammation, scarring, and thickening leading to a similar ultrasonographic appearance. It is also challenging to differentiate between pulmonary edema due to heart failure [34] or end-stage renal disease and the interstitial inflammation caused by COVID-19. In patients with B-lines on lung POCUS, a concurrent cardiac POCUS may help differentiate between COVID-19 and cardiac etiologies [35]. Other tools such as M-mode evaluation for pleural irregularities [35] and the presence of "spared areas" [36] have been used to differentiate interstitial syndrome from pulmonary edema in the past, but have not been validated for use with COVID-19. Avoiding the use of lung POCUS in patients with these confounding comorbidities (morbid obesity, interstitial lung disease, heart failure) improves the diagnostic performance for COVID-19.
Study limitations
The retrospective design predisposes to recruitment bias. This study is somewhat insulated from this limitation since the RT-PCR testing often had not resulted when the POCUS images were acquired and when the patients were identified for inclusion in the review. The inclusion of patients with variable duration of symptoms and illness severity as well as in different practice environments raises concerns for spectrum bias, but also demonstrates the accuracy that can be expected with real-world application of this diagnostic test.
The majority (77%) of the patients evaluated in this study were admitted to the hospital, which may limit the applicability of these findings in patients who do not require hospitalization. Several factors contribute to this bias, including triage of less severe, outpatient-appropriate patients to a treatment tent without ultrasound equipment, absence of clear guidelines for safe discharge early in the pandemic, and the nature of the tertiary hospital study site as a transfer center for care of the majority of admitted COVID-19 patients in the health system. Despite the preponderance of hospitalized patients, the variable lengths of stay (interquartile range 1–11 days) hint at a wide spectrum of illness severity and resource requirement and suggest that the lung POCUS findings may be broadly generalizable.
Another limitation is the dependence on POCUS operator skill and experience. Less-experienced point-of-care ultrasonographers tended to more aggressively label mild abnormalities in a single lung field as evidence COVID-19 even though the data suggest that most patients with positive SARS-CoV-2 RT-PCR tests have bilateral pathological findings. Undergained or overgained images could also lead to false-negative or false-positive POCUS interpretations, although all images for this study were assessed for quality prior to inclusion. Mimics such as Z-lines (short, comet-tail artifacts arising from the pleural line that do not reach the distal end of the screen or erase A-lines) [37] and E-lines (long comet-tail artifacts that do erase A-lines but arise from the subcutaneous tissue rather than the pleura) [37] can easily be confused with B-lines and lead to false-positive diagnoses. The development of training resources will be crucial for widespread implementation of lung POCUS as a screening tool for COVID-19.
As this study only included PUI for COVID-19, it is unknown whether lung POCUS can be used as a screening tool for asymptomatic SARS-CoV-2 carriers. It is also unclear whether lung POCUS can be used for the diagnosis of COVID-19 in patients with primarily gastrointestinal [38] or neurological [39] symptoms. Additional studies will be necessary before lung POCUS can be applied for the screening and diagnosis of COVID-19 in these situations.
The results of this study are also applicable only during the current clinical environment, with high prevalence of SARS-CoV-2. In future periods with lower prevalence, lung POCUS may not perform well enough to use as a screening tool.
Finally, the use of RT-PCR as the reference standard is a significant limitation. Although RT-PCR is currently the gold standard for diagnosis, its sensitivity is known to be relatively limited [2]. Future, prospective studies will be needed to test whether lung POCUS provides improved sensitivity over RT-PCR testing in certain circumstances.
Conclusions
Lung POCUS is a rapid, inexpensive tool that provides results that are concordant with RT-PCR testing in patients under investigation for COVID-19. The low cost, rapid assessment, lack of ionizing radiation, and applicability to a variety of practice environments make it an appealing option for use when other diagnostic tests such RT-PCR or CT chest are unavailable.
Availability of data and materials
The dataset used during the current study are available from the corresponding author on reasonable request, subject to approval from the institutional review board.
Abbreviations
- POCUS:
-
Point of care ultrasound
- SARS-CoV-2:
-
Severe Acute Respiratory Syndrome Coronavirus 2
- RT-PCR:
-
Reverse transcription polymerase chain reaction
- CT :
-
Computed tomography
- PUI:
-
Patient under investigation
- +LR :
-
Positive likelihood ratio
- -LR :
-
Negative likelihood ratio
- PPV :
-
Positive predictive value
- NPV :
-
Negative predictive value
- AUC :
-
Area under the curve
- HIV :
-
Human immunodeficiency virus
- BMI :
-
Body mass index
- COPD:
-
Chronic obstructive pulmonary disease
- ESRD:
-
End stage renal disease
References
Dong E, Du H, Gardner L (2020) An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis 20:533–534. https://doi.org/10.1016/S1473-3099(20)30120-1
Woloshin S, Patel N, Kesselheim AS (2020) False negative tests for SARS-CoV-2 infection—challenges and implications. N Engl J Med. 382:e38. https://doi.org/10.1056/NEJMp2015897
Feng H, Liu Y, Lv M, Zhong J (2020) A case report of COVID-19 with false negative RT-PCR test: necessity of chest CT. Jpn J Radiol 38:409–410. https://doi.org/10.1007/s11604-020-00967-9
Goldstein J, McKinley J (2020) 9-Day waits for test results threaten N.Y.C.’s ability to contain virus. The New York Times A1
Zhao W, Zhong Z, Xie X et al (2020) Relation between chest CT findings and clinical conditions of coronavirus disease (Covid-19) pneumonia: a multicenter study. Am J Roentgenol 214:1072–1077. https://doi.org/10.2214/AJR.20.22976
Ai T, Yang Z, Xia L (2020) Correlation of chest CT and RT-PCR testing in coronavirus disease. Radiology. https://doi.org/10.14358/PERS.80.2.000
Caruso D, Zerunian M, Polici M et al (2020) Chest CT features of COVID-19 in Rome. Italy Radiol 77:201237. https://doi.org/10.1148/radiol.2020201237
Li B, Li X, Wang Y et al (2020) Diagnostic value and key features of computed tomography in Coronavirus Disease 2019. Emerg Microbes Infect 9:787–793. https://doi.org/10.1080/22221751.2020.1750307
Organization WH Computed tomography (CT) units per million. https://www.who.int/diagnostic_imaging/collaboration/ctpermill_14.jpg?ua=1
Sippel S, Muruganandan K, Levine A, Shah S (2011) Review article: Use of ultrasound in the developing world. Int J Emerg Med 4:1–11. https://doi.org/10.1186/1865-1380-4-72
Peyrony O, Marbeuf-Gueye C, Truong V et al (2020) Accuracy of Emergency Department clinical findings for diagnostic of coronavirus disease-2019. Ann Emerg Med. https://doi.org/10.1016/j.annemergmed.2020.05.022
Lichtenstein D, Goldstein I, Mourgeon E et al (2004) Comparative diagnostic performances of auscultation, chest radiography, and lung ultrasonography in acute respiratory distress syndrome. Anesthesiology 100:9–15. https://doi.org/10.1097/00000542-200401000-00006
Tierney DM, Huelster JS, Overgaard JD et al (2020) Comparative performance of pulmonary ultrasound, chest radiograph, and CT among patients with acute respiratory failure. Crit Care Med. https://doi.org/10.1097/CCM.0000000000004124
Zieleskiewicz L, Markarian T, Lopez A et al (2020) Comparative study of lung ultrasound and chest computed tomography scan in the assessment of severity of confirmed COVID-19 pneumonia. Intensive Care Med 46:1707–1713. https://doi.org/10.1007/s00134-020-06186-0
Zieleskiewicz L, Cornesse A, Hammad E et al (2015) Implementation of lung ultrasound in polyvalent intensive care unit: impact on irradiation and medical cost. Anaesth Crit Care Pain Med 34:41–44. https://doi.org/10.1016/j.accpm.2015.01.002
Jones BP, Tay ET, Elikashvili I et al (2016) Feasibility and safety of substituting lung ultrasonography for chest radiography when diagnosing pneumonia in children: a randomized controlled trial. Chest 150:131–138. https://doi.org/10.1016/j.chest.2016.02.643
Wimalasena Y, Kocierz L, Strong D et al (2018) Lung ultrasound: a useful tool in the assessment of the dyspnoeic patient in the emergency department. Fact or fiction? Emerg Med J 35:258–266. https://doi.org/10.1136/emermed-2016-205937
Poggiali E, Dacrema A, Bastoni D et al (2020) Can lung US help critical care clinicians in the early diagnosis of novel coronavirus (COVID-19) pneumonia? Radiology 295:E6–E6. https://doi.org/10.1148/radiol.2020200847
Peng Q-Y, Wang X-T, Zhang L-N (2020) Findings of lung ultrasonography of novel corona virus pneumonia during the 2019–2020 epidemic. Intensive Care Med. https://doi.org/10.1007/s00134-020-05996-6
Akl EA, Blazic I, Yaacoub S et al (2020) Use of chest imaging in the diagnosis and management of COVID-19: a WHO rapid advice guide. Radiology. https://doi.org/10.1148/radiol.2020203173
Volpicelli G, Lamorte A, Villén T (2020) What’s new in lung ultrasound during the COVID-19 pandemic. Intensive Care Med. https://doi.org/10.1007/s00134-020-06048-9
Huang Y, Wang S, Liu Y, et al (2020) A preliminary study on the ultrasonic manifestations of peripulmonary lesions of non-critical novel coronavirus pneumonia (COVID-19). SSRN
Volpicelli G, Gargani L (2020) Sonographic signs and patterns of COVID-19 pneumonia. Ultrasound J 12:20–22. https://doi.org/10.1186/s13089-020-00171-w
Duggan NM, Shokoohi H, Liteplo AS et al (2020) Best practice recommendations for point-of-care lung ultrasound in patients with suspected COVID-19. J Emerg Med 59:515–520. https://doi.org/10.1016/j.jemermed.2020.06.033
Mohamed MFH, Al-Shokri S, Yousaf Z et al (2020) Frequency of abnormalities detected by point-of-care lung ultrasound in symptomatic COVID-19 patients: systematic review and meta-analysis. Am J Trop Med Hyg. https://doi.org/10.4269/ajtmh.20-0371
Bar S, Lecourtois A, Diouf M et al (2020) The association of lung ultrasound images with COVID-19 infection in an emergency room cohort. Anaesthesia. https://doi.org/10.1111/anae.15175
Favot M, Malik A, Rowland J et al (2020) Point-of-care lung ultrasound for detecting severe presentations of coronavirus disease 2019 in the emergency department: a retrospective analysis. Crit Care Explor 2:e0176. https://doi.org/10.1097/cce.0000000000000176
Alharthy A, Faqihi F, Abuhamdah M et al (2020) Prospective longitudinal evaluation of point-of-care lung ultrasound in critically ill patients with severe COVID-19 pneumonia. J Ultrasound Med. https://doi.org/10.1002/jum.15417
Deng Q, Zhang Y, Wang H et al (2020) Semiquantitative lung ultrasound scores in the evaluation and follow-up of critically ill patients with COVID-19: a single-center study. Acad Radiol. https://doi.org/10.1016/j.acra.2020.07.002
Perrone T, Soldati G, Padovini L et al (2020) A new lung ultrasound protocol able to predict worsening in patients affected by severe acute respiratory syndrome coronavirus 2 pneumonia. J Ultrasound Med 2:1–9. https://doi.org/10.1002/jum.15548
Sahu AK, Mathew R, Bhoi S et al (2020) Lung sonographic findings in COVID-19 patients. Am J Emerg Med. https://doi.org/10.1016/j.ajem.2020.08.080
Youden WJ (1950) Index for rating diagnostic tests. Cancer 3:32–35. https://doi.org/10.1002/1097-0142(1950)3:1%3c32::aid-cncr2820030106%3e3.0.co;2-3
Brainin P, Claggett B, Lewis EF et al (2020) Body mass index and B-lines on lung ultrasonography in chronic and acute heart failure. ESC Heart Fail. https://doi.org/10.1002/ehf2.12640
Maw AM, Hassanin A, Ho PM et al (2019) Diagnostic accuracy of point-of-care lung ultrasonography and chest radiography in adults with symptoms suggestive of acute decompensated heart failure: a systematic review and meta-analysis. JAMA Netw Open 2:e190703. https://doi.org/10.1001/jamanetworkopen.2019.0703
Singh AK, Mayo PH, Koenig S et al (2018) The use of M-Mode ultrasonography to differentiate the causes of B lines. Chest 153:689–696. https://doi.org/10.1016/j.chest.2017.10.019
Copetti R, Soldati G, Copetti P (2008) Chest sonography: a useful tool to differentiate acute cardiogenic pulmonary edema from acute respiratory distress syndrome. Cardiovasc Ultrasound 6:1–10. https://doi.org/10.1186/1476-7120-6-16
Lee FCY (2016) Lung ultrasound-a primary survey of the acutely dyspneic patient. J Intensive Care. https://doi.org/10.1186/s40560-016-0180-1
D’Amico F, Baumgart DC, Danese S, Peyrin-Biroulet L (2020) Diarrhea during COVID-19 infection: pathogenesis, epidemiology, prevention, and management. Clin Gastroenterol Hepatol 18:1663–1672. https://doi.org/10.1016/j.cgh.2020.04.001
Helms J, Kremer S, Merdji H et al (2020) Neurologic features in severe SARS-CoV-2 infection. N Engl J Med. https://doi.org/10.1056/NEJMc2008597
Acknowledgements
We thank Matthew Sullivan for the use of his artwork.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Contributions
DB: Conceptualization, methodology, validation, investigation, writing—original draft, writing—review and editing, visualization, supervision, and project administration. GL: Conceptualization, methodology, investigation, writing—review and editing, and supervision. TF: Conceptualization, methodology, investigation, writing—review and editing, and supervision. OT: Formal analysis and writing—review and editing. BG and RO: Conceptualization, methodology, investigation, and writing—review and editing. All authors read and approved the final manuscript.
Corresponding authors
Ethics declarations
Ethics approval and consent for publication
This study was approved by the Johns Hopkins Institutional Review Board (IRB00255571) and did not require patient consent.
Consent for publication
Not applicable.
Competing interests
GL is an unpaid consultant for EchoNous, an ultrasound device company. EchoNous machines were used for four of the examinations used in the study. EchoNous was not involved in the design, execution, analysis or writing of this work. The other authors have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1: Figure S1.
Flowsheet of patients that were included, results of testing, and associated confounding factors.
Additional file 2:
Table S1. Ultrasound machines, probes, and parameters. Table S2. Disposition of included patients. Table S3. Characteristics of ultrasound cohort with complete examinations (NÂ =Â 100). Table S4. Characteristics of ultrasound cohort with complete examinations (NÂ =Â 100) by ultrasound and RT-PCR SARS-CoV-2 diagnosis.
Additional file 3: Video S1.
Normal lung POCUS findings.
Additional file 4: Video S2.
Lung POCUS findings from a patient diagnosed with COVID-19, including discrete B-lines, confluent B-lines, irregular pleural line, and small subpleural consolidations
Additional file 5:
Video S3. Lung POCUS findings from a patient diagnosed with COVID-19, including subpleural consolidation.
Additional file 6: Video S4.
Lung POCUS findings from a patient with CHF consistent with cardiogenic pulmonary edema. These findings lead to a false-positive lung POCUS interpretation.
Additional file 7: Video S5.
Lung POCUS findings demonstrating a large pleural effusion from a patient with heart failure.
Additional file 8:
Video S6. Lung POCUS findings from a patient with interstitial lung disease. These findings lead to a false-positive lung POCUS interpretation.
Additional file 9: Figure S2.
Test characteristics and distribution of findings in complete 12-field lung POCUS examinations for the evaluation of SARS-CoV-2. Upper panels: Lung fields are labeled in yellow across the thorax. Green numbers represent the sensitivity and black numbers represent the specificity for SARS-CoV-2 infection of each lung field. Lower panels: Green numbers represent the percentage of patients with negative RT-PCR test for SARS-CoV-2 who had abnormal findings in each lung window. Black numbers represent the percentage of patients with positive RT-PCR test for SARS-CoV-2 who had abnormal findings in each lung window.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Brenner, D.S., Liu, G.Y., Omron, R. et al. Diagnostic accuracy of lung ultrasound for SARS-CoV-2: a retrospective cohort study. Ultrasound J 13, 12 (2021). https://doi.org/10.1186/s13089-021-00217-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13089-021-00217-7
Keywords
- POCUS
- Ultrasound
- COVID-19
- SARS-CoV-2
- Triage
- Diagnosis
- RT-PCR