Skip to main content

Inter-rater reliability of optic nerve sheath diameter measurement using real-time ultrasonography

Abstract

Objectives

Ultrasound measurement of the optic nerve sheath diameter (ONSD) is a rapid, non-invasive means to indirectly assess intracranial pressure. Previous research has demonstrated the ability of emergency physicians to measure ONSD accurately with bedside ultrasound when compared to CT scan or MRI, however the reliability of this measurement between two or more operators has been called into question (Hassen et al. in J Emerg Med 48:450–457, 2015; Shirodkar et al. in Ind J Crit Care Med 19:466–470, 2015). Given the need for accurate and precise measurement to use this as a screening exam, we sought to determine the inter-rater reliability between ONSD measurements obtained in real time by fellowship-trained emergency ultrasound physicians.

Methods

Three ultrasound fellowship-trained emergency physicians measured bilateral ONSD of 10 healthy volunteers using a high-frequency linear transducer. The physicians were blinded to the other scanners’ measurements, and no instructions were given other than to obtain the ONSD. Each sonographer measured the ONSD in real time and it was recorded by a research coordinator. All measurements were recorded in millimeters. Intraclass correlation coefficients (ICCs) were calculated to estimate the inter-rater reliability.

Results

A total of 60 measurements of ONSD were obtained. The average measurement was 4.3 mm (3.83–4.77). Very little variation was found between the three physicians, with a calculated ICC of 0.82 (95% confidence interval 0.63–0.92).

Conclusions

ONSD measurement obtained by ultrasound fellowship-trained emergency medicine physicians is a reliable measurement with a high degree of correlation between scanners.

Introduction

The recent spread of ultrasound technology and its adaptation at the bedside by emergency physicians has led to the exploration of a wide number of potential clinical applications [3]. Ocular ultrasonography is a relatively new application in emergency medicine. In 2002, Blaivas et al. published the first series of emergency department patients presenting with ocular symptoms who were evaluated by bedside emergency department ultrasonography [4]. The ability of ultrasound to evaluate the eye and the adjacent structures in a rapid and non-invasive manner is of tremendous value in the setting of a busy emergency department, where subspecialty consultation is not always available and physical exam may be limited by the patient’s condition. For example, a neurologic exam may be unobtainable in the unconscious, intubated and chemically paralyzed patient. The ocular exam may also be limited by severe facial and head trauma. Emergency department ultrasound provides a quick, accurate, well-tolerated and non-invasive tool for evaluating potentially vision-threatening and life-threatening conditions at the bedside [5].

Elevated intracranial pressure is a potentially devastating condition. Rapid detection and subsequent management of elevated intracranial pressure is critical as increased intracranial pressure is associated with increased morbidity, mortality and poor neurologic outcome. The gold standard for measurement of intracranial pressure is invasive and fraught with risk, requiring placement of intraventricular catheters and/or intraparenchymal probes [6].

Ultrasound measurement of the optic nerve sheath diameter (ONSD) is a rapid, non-invasive means to indirectly assess intracranial pressure [7]. The optic nerve is part of and continuous with the central nervous system via the meninges of the brain. Increases in intracranial pressure are transmitted to the retrobulbar region of the optic nerve sheath via cerebrospinal fluid. The ONSD is measured 3 mm posterior to the globe for both eyes. Though various cutoffs have been proposed, an ONSD greater than 5.8 mm is generally considered abnormal and elevated intracranial pressure should be considered [8,9,10,11,12]. Given the need for accurate and precise measurement to use this as a screening exam, we sought to determine the inter-rater reliability between ONSD measurements obtained in real time by fellowship-trained ultrasound physicians.

Methods

Study design

A prospective study with a single-measure design was used. Measurements were obtained by three ultrasound fellowship-trained emergency medicine physicians, who had each completed a one-year-long ultrasound fellowship at two different institutions. Each operator obtained ONSD measurements of both the left and right eye of each participant in either an axial or sagittal plane. The measurements took place on August 8, 2018, at the Virginia Commonwealth University Hospital. The Virginia Commonwealth University Office of Research and Innovation approved the research proposal (HM20011526).

Participants

A convenience sample of healthy young adults was used. The sample consisted of 10 healthy volunteers recruited from the emergency medicine residency at Virginia Commonwealth University. All volunteers were informed about the study and asked to participate. Before participating, all volunteers were required to read and sign an informed consent form. The inclusion criteria for participating were the following: all volunteers were between the ages of 21–65 years and had no known medical conditions. The exclusion criteria were minors and pregnant volunteers. Ten individuals agreed to participate.

Measurement procedures

Participants who met the inclusion criteria and agreed to participate were assessed. Three physicians performed ONSD measurements independently. All 10 participants were measured on the same day. A single measurement of the ONSD of the left and right eye of each participant was measured in the supine position using a closed-eye technique. A large amount of standard water-soluble ultrasound transmission gel was applied to the participant’s closed eyelids. The participant was asked to look straight ahead with eyes closed. The diameter was measured at 3 mm behind the globe in the transverse imaging plane using a SonoSite Xporte ultrasound machine and a high-resolution 13–6 MHz linear array ultrasound transducer (Fujifilm Bothell, WA). Each measurement was recorded in millimeters by the research coordinator.

Statistical analyses

Intraclass correlation coefficient estimates and their 95% confidence intervals were calculated using SPSS statistical package version 25 (SPSS Inc., Chicago, IL) based on an absolute-agreement, 2-way random-effects model. An average, mean and standard deviation were also calculated.

Results

The estimated intraclass correlation coefficient was 0.822 (0.625–0.924, 95% CI). Of the 30 measurements that were obtained, the average optic nerve sheath measurement was 4.34 mm, median was 4.30 mm and the standard deviation was 0.47. The measurements ranged from 3.5 mm to 5.2 mm.

Discussion

In order for ocular ultrasound to serve as a sensitive screening tool in the assessment of elevated ICP, confidence and reliability of the measurement are of paramount importance. While multiple prior studies have detailed the correlation between increased ONSD and elevated ICP, no studies to our knowledge have assessed the ability of emergency physicians to obtain reliable measurements in real time. Oboerfell et al. described the ICC among a large group of emergency physicians at various stages of training measuring ONSD of static images [13]. They found an ICC among ultrasound fellowship-trained emergency physicians of 0.73, while resident emergency physicians had an ICC of 0.50. Because these measurements were based on static, previously obtained images, the ability of emergency physicians to both obtain and interpret ONSD measurements in a reliable manner was not addressed.

In our study, we assessed the ability of three ultrasound fellowship-trained emergency physicians to obtain measurements of ONSD independently and in real time on healthy volunteers. We found a high degree of measurement agreement with an ICC of 0.822. ICC is typically interpreted as optimal (>  0.8), strong (0.7–0.8), moderate (0.5–0.6), fair (0.3–0.4), or poor (0–0.2) [14, 15]. Our results suggest that ultrasound-trained emergency physicians can obtain images and measurements of the ONSD with a high degree of inter-rater reliability.

Our study is limited in its generalizability by the use of ultrasound operators who were fellowship trained in emergency ultrasound. It remains unclear how much specific training in ocular ultrasound is necessary for non-fellowship-trained physicians to accurately measure the ONSD. Additional research is necessary to assess whether non-fellowship-trained physicians can accurately image and measure the ONSD with a high degree of reliability.

Conclusion

Ultrasonographic measurement of ONSD has the potential to serve as a non-invasive screening tool for elevated intracranial pressure. ONSD obtained by ultrasound fellowship-trained emergency medicine physicians is a reliable measurement with a high degree of correlation between scanners.

Availability of data and materials

Data are available for review upon request.

References

  1. 1.

    Hassen GW, Bruck I, Donahue J et al (2015) Accuracy of optic nerve sheath diameter measurement by emergency physicians using bedside ultrasound. J Emerg Med 48:450–457

    Article  Google Scholar 

  2. 2.

    Shirodkar CG, Munta K, Rao SM, Mahesh MU (2015) Correlation of measurement of optic nerve sheath diameter using ultrasound with magnetic resonance imaging. Ind J Crit Care Med 19:466–470

    CAS  Article  Google Scholar 

  3. 3.

    Blaivas M (2000) Bedside emergency department ultrasonography in the evaluation of ocular pathology. Acad Emerg Med 7:947–950

    CAS  Article  Google Scholar 

  4. 4.

    Blaivas M, Theodoro D, Sierzenski P (2002) A study of bedside ocular ultrasonography in the emergency department. Acad Emer Med 9:791–799

    Article  Google Scholar 

  5. 5.

    Blaivas M, Theodoro D, Sierzenski P (2003) Elevated intracranial pressure detected by bedside emergency ultrasonography of the optic nerve sheath. Acad Emer Med 10:376–381

    Article  Google Scholar 

  6. 6.

    Zeng T, Gao L (2010) Management of patients with severe traumatic brain injury guided by intraventricular intracranial pressure monitoring: a report of 136 cases. Chin J Traumatol 13(3):146–151

    PubMed  Google Scholar 

  7. 7.

    Geeraerts T, Duraneau J, Benhamou D (2008) Ocular sonography in patients with raised intracranial pressure: the papilloedema revisited. Crit Care 12:150

    Article  Google Scholar 

  8. 8.

    Fernando SM, Tran A, Cheng W et al (2019) Diagnosis of elevated intracranial pressure in critically ill adults: systematic review and meta-analyses. BMJ 366:4225

    Article  Google Scholar 

  9. 9.

    Kimberly HH, Shah S, Marill K, Noble V (2008) Correlation of optic nerve sheath diameter with direct measurement of intracranial pressure. Acad Emer Med 15(2):201–204

    Article  Google Scholar 

  10. 10.

    Raffiz M, Abdullah JM (2017) Optic nerve sheath diameter measurement: a means of detecting raised ICP in adult traumatic and non-traumatic neurosurgical patients. Am J Emerg Med 35:150–153

    Article  Google Scholar 

  11. 11.

    Amini A, Kariman H, Arhami Dolatabadi A et al (2013) Use of the sonographic diameter of optic nerve sheath to estimate intracranial pressure. Am J Emerg Med 31(1):236–239

    Article  Google Scholar 

  12. 12.

    Montorfano L, Yu Q, Bordes SJ et al (2021) Mean value of B-mode optic nerve sheath diameter as an indicator of increased intracranial pressure: a systematic review and meta analysis. Ultrasound J 13:35

    Article  Google Scholar 

  13. 13.

    Oberfoell S, Murphy D, French A, Trent S, Richards D (2017) Inter-rater reliability of sonographic optic nerve sheath diameter measurements by emergency medicine physicians. J Ultrasound Med 36:1579–1584

    Article  Google Scholar 

  14. 14.

    McGraw KO, Wong SP (1996) Forming inferences about some intraclass correlation coefficients. Psych Methods 1:30–46

    Article  Google Scholar 

  15. 15.

    Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiro Med 15:155–163

    Google Scholar 

Download references

Acknowledgements

None

Funding

None.

Author information

Affiliations

Authors

Contributions

Project was conceptualized and designed by JJ, CO, DE and MJ. Data acquisition performed by JJ, CO, MV, and JT. Data analysis performed by MJ. Manuscript drafted by JJ and CO with substantive revisions by DE and LT. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Jason B. Jennings.

Ethics declarations

Ethics approval and consent to participate

The Virginia Commonwealth University Office of Research and Innovation approved the research proposal (HM20011526).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Jennings, J.B., Oliva, C., Joyce, M. et al. Inter-rater reliability of optic nerve sheath diameter measurement using real-time ultrasonography. Ultrasound J 14, 6 (2022). https://doi.org/10.1186/s13089-021-00255-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13089-021-00255-1

Keywords

  • Optic nerve sheath diameter
  • Inter-rater reliability
  • Emergency medicine
  • Point-of-care ultrasound