- Original article
- Open Access
The CLOSED protocol to assess optic nerve sheath diameter using color-Doppler: a comparison study in a cohort of idiopathic normal pressure hydrocephalus patients
The Ultrasound Journal volume 14, Article number: 43 (2022)
Sonographic assessment of the optic nerve sheath diameter represents a promising non-invasive technique for estimation of the intracranial pressure. A wide inter-observer variability, along with a lack of a standardized protocol for the optic nerve sheath diameter measurements, could lead to over- or under-estimation. The present study was aimed at evaluating feasibility of color-Doppler for better delineating optic nerve sheath borders, comparing it to B-mode imaging, using the magnetic resonance measurements as a comparison.
Optic nerve sheath diameters were evaluated using magnetic resonance by an expert radiologist in a cohort of patients with suspected idiopathic normal pressure hydrocephalus. Magnetic resonance findings were evaluated twice. In the first half of this cohort, optic nerve sheath diameters were measured using B-mode only, in the second half applying color-Doppler. Measurements obtained using these two techniques were compared to magnetic resonance imaging measurements. The Bland–Altman analysis and concordance correlation coefficient were computed to quantify the strength of agreement between the two magnetic resonance assessments. Box plots and average (± SD) were used to compare assessments by sonographic and magnetic resonance methods.
Fifty patients were included. MRI assessment showed a moderate concordance correlation coefficient. Optic nerve sheath diameters measured applying color-Doppler were lower (p < 0.001) and less scattered compared to B-mode assessment, which approached more to magnetic resonance measurements.
In this cohort of patients, magnetic resonance showed high intra-rater variability in optic nerve sheath diameter assessments. Optic nerve sheath diameter assessments using color-Doppler yielded lower and less scattered diameters compared to B-mode only.
The optic nerve sheath diameter (ONSD) measurement has been reported as a tool for the non-invasive assessment of intracranial pressure (ICP) [1,2,3,4]. The explanation for this use is based on anatomical continuity of the optic nerve (ON) sheath with the intracranial dura mater and cerebrospinal fluid movement according to pressure gradients. ICP variations are detectable measuring the diameter of the ON sheath which varies with thickening of the subarachnoid spaces . The increase in ONSD occurs a few seconds after the increase in ICP and can be correctly detected even with ultrasound (US) [2, 5].
Physiological ONSD values of post-mortem human adults measure 4 mm , while the ON without sheath has a diameter of about 3 mm . In healthy subjects, the optic nerve sheath instead has an average thickness of about 0.4 mm and the subarachnoid space between the nerve and the sheath measures approximately 0.1 mm [4, 6].
Recently, Ertl et al. studied in 187 healthy volunteers a range of physiological ONSD between 4.9 e 5.3 mm assessed by US .
Despite many methodological comparison studies of non-invasive methods, a validated gold standard for the ONSD assessment is unavailable. Nevertheless, recent evidence confirmed that a high-resolution magnetic resonance image (MRI) allows measuring ONSD accurately [8,9,10]. In a dedicated study, focusing on children and adolescents, using both MRI and B-mode US, a good reproducibility and repeatability of the ONSD measurement, with a repeatability coefficient between 0.34 and 0.46 mm, was described . Conversely, other papers have disputed those findings because of a lacking standardized ONSD sonographic methodology . Our group previously presented a dedicated bundle , based on US mode and the identification of some anatomical landmarks also using color Doppler, to improve the reliability and standardize the ONSD assessment. This so-called CLOSED protocol has recently been applied by other authors (Pansell et al.) with promising results . Trying to shed some light about this debated topic, the following study has been designed. More precise indications regarding the landmarks to be used for the measurement with US come from a recent systematic review of 63 articles .
The present study hypothesizes that ONSD assessment using a US standard bundle implemented by color Doppler may yield a more accurate measurement than simple B-mode imaging. The aim of the present study was to evaluate feasibility of ONSD sonographic assessment applying color-Doppler and using B-mode only comparing them with MRI ONSD assessment.
Materials and methods
Study design, participants and setting
A single-center cross-sectional cohort study was conducted between February 2018 and April 2019. The authors selected an idiopathic Normal Pressure Hydrocephalus (iNPH) population for this study, such as a homogeneous consecutive cohort without intracranial hypertension. Participants had to be I) older than 18 years and II) with suspected iNPH diagnosis after a multidisciplinary evaluation (PRO-Hydro) based on clinical and radiological findings . Patients with ON diseases, the presence of a central nervous system mass, other primary causes of possible altered ICP and those who declined participation in the present study, were excluded. Eligible patients underwent a specific 3-Tesla brain MRI, using a protocol described below, and an immediate subsequent ONSD sonographic assessment. The study was conducted in accordance with the declaration of Helsinki and the principles of Good Clinical Practice. The study protocol was approved by the local ethics committee (Cod. CE 17115). All patients gave their written informed consent to participate. We used Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines for cohort studies as reporting guidelines .
The same MRI and US equipment were used to limit a systematic error in ONSD measurements, and the two measurements were obtained in rapid sequence to minimize ICP orthostatic changes. Same neuroradiologist and neurosonologists performed all measurements. Patients with iNPH require a complex process of differential diagnosis, therefore the population that can be recruited for the duration of the study, albeit in a reference center, is small.
Demographic and clinical variables
The age and gender of patients were recorded for each enrollment. iNPH was suspected according to criteria established by Relkin et al. .
A 3-Tesla whole-body scanner MRI (Magnetom Skyra, Siemens Healthcare, Erlangen, Germany) used a 32-channel phased-array head coil. The neuroradiologist selected the best sequence available within the specific protocol, using a sagittal T1-weighted rapid three-dimensional gradient echo technique (Repetition Time, 2300 ms; Echo Time, 2.98 ms; flip angle, 9°; thickness, 1 mm; 160 slices; field of view, 256 × 248 mm; matrix, 256 × 248: 1 mm × 1 mm) which showed contrasts between endo-orbital fat and sheath providing optimal morphological imaging for ONSD evaluation. The measurements were performed on reconstructions carried out parallel and orthogonal to the ON. The assessments were performed twice, blindly, on the same images, at 2 weeks from each other.
US settings and ONSD evaluation were performed according to the CLOSED protocol, a bundle which includes safety measures and technical procedures already reported in a previous paper . US was performed disjunctively in B-mode and color-Doppler mode, using a MyLab™Twice US system (Esaote, Italy) equipped with a 11–3 MHz linear transducer (Fig. 1).
ONSD was measured 3 mm behind the optic disc on MRI and US imaging. All measurements were performed bilaterally and on the two planes (transverse and sagittal), named right and left transverse diameter (TDR and TDL, respectively) and right and left sagittal diameter (SDR and SDL, respectively). All the investigators were blinded to the other measurements. One experienced neuroradiologist (FT) performed ONSD measurements two times on MRI, to determine the intra-agreement. Sonographic ONSD assessments were performed by one expert neurosonologist (RA) supported by a further expert physician proficient in neurosonology (GB).
Demographical variables were compared between US subgroups (US B-mode group vs. US color-Doppler mode group): Mann–Whitney U test and Chi-square test were used to compare age and sex, respectively.
The evaluation of intra-reliability of ONSD assessment using MRI was performed calculating Bland–Altman plots : the agreement between the two-consecutive assessment of the same neuroradiologist (intra-observer) were quantified by plotting the difference between measurements against their mean and by constructing limits of agreement. Mean and the standard deviations of the differences between two measurements were used for statistical limits; they represent the maximum deviation expected for the 95% of the differences between the two measurements. In addition, the Lin’s Concordance Correlation Coefficient (CCC)  with 95% confidence intervals (CI) was computed to quantify the strength of intra-observer agreement: this coefficient provided indications on a standardized relationship scale about precision (how close the data are about the line of best fit) and accuracy (how far the line of best fit is from the 45-degree line through the origin, which represents perfect agreement). Lin’s CCC values < 0.20 were considered as “poor” while values > 0.80 were considered as “excellent”, values between > 0.20 and < 0.80 were considered “moderate”.
The two different US methods (B-mode group and color-Doppler mode) were described using median and interquartile (IQR) range; differences in distribution were graphically displayed by box-plot and compared using Mann–Whitney U test. Then, differences between each of the two US methods and MRI were described by box-plot and evaluated by calculating average differences and their standard deviations.
Statistical analysis was performed using Stata statistical software version 14 (Stata Corp LLC, College Station, 101 TX, USA).
Fifty consecutive patients, 29 males and 21 females, fulfilled the eligibility criteria with a mean age [± standard deviation (SD)] of 76 ± 8 years. MRI was performed in all 50 patients. In 27 patients ONSD assessment was performed using US B-mode, while in 23 using US color-Doppler mode. No differences in demographic variables were observed in the two US subgroups analyzed (Table 1).
MRI variables—intra-rater agreement
For each of the two different diameters for each eye, first and second assessments were compared. Table 2 shows intra-rater reliability using Lin’s CCC: the neuroradiologist only in TDL has an excellent CCC: 0.808. Bland–Altman plots show the difference of the two assessments by the neuroradiologist against their mean for each diameter (Fig. 2).
Two different sonographic modalities (B-mode and color-Doppler mode) versus MRI
There are substantial and statistically significant differences between measurements made by the two different ultrasound methods: for all four diameters, median values statistically differ (p < 0.001) (Table 3). Moreover, color-Doppler measurements are less scattered and significantly lower than those in B-mode (Fig. 3a). Finally, MRI measurements were compared to B-mode (27 patients) and to color-Doppler (23 patients). Box-plot shows the distribution of MRI measurements compared to US B-mode (Fig. 3b) and US color Doppler (Fig. 3c): ONSD measurements by US were always lower than those by MRI. Main differences between US color Doppler and MRI compared to US B-mode are reported in Table 4.
Our analysis showed poor accuracy of ONSD measurements by MRI with moderate intra-rater variability. Our previous proof-of-concept study  suggested a possible discrepancy between B-mode and color-Doppler US measurements. The comparison results between MRI and US methods are reported in Table 4 and Fig. 3b and c. Our data showed poor agreement between MRI and US regardless of the ultrasound modality. However, color-Doppler based measurements appear less scattered and significantly lower than using B-mode only and MRI (Fig. 3b, c).
B-mode and MRI measurements were substantially higher than clinically expected (> 5 mm). On the other hand, measurements yielded by color-Doppler application were lower and more reliable than clinically expected.
Other studies compared ONSD values of US assessment with MRI assessment. Steinborn et al.  demonstrated moderate CCC agreement in a pediatric population. However, the results were obtained using an ultra-high frequency (17 MHz) linear array transducer and compared to a heavily turbo spin echo sequence T2-weighted. Likewise, Bäuerle et al.  found an agreement between US and MRI in 15 healthy volunteers, but also this discrepancy could be attributed to the use of non-standard resolution MRI sequences. Moreover, even Patterson et al.  reported an ONSD agreement in a cohort of intracranial hypertension patients. However, in a more recent paper, Raval et al.  did not find significant agreement in transverse, inferior or sagittal US views and MRI in the axial view of ONSD, raising concerns about this association because of different US ocular plane orientation, different image quality and different angle of transection.
Unfortunately, the lack of agreement is a recurrent element in US assessment, partially due to the intrinsic user- and technique-dependence of those findings. Despite ONSD measurement, as non-invasive estimator of intracranial pressure, is widely discussed by numerous prospective studies and meta-analysis [24,25,26,27], very few studies discuss how to properly interpret a different echogenicity between confining structures and correctly identify the real margin of the ONSD.
As proposed in the CLOSED protocol , we defined a technique based on standardized setting and identification of some new anatomical landmarks even adding color-Doppler (central retinal artery, central retinal vein and ophthalmic artery) in order to obtain more accurate and reliable images and consequent measurements (Fig. 1). Interestingly, performing a measurement comparison between the US B-mode on gray-scale and color-Doppler mode, we noticed that the measurements performed with MRI and US B-mode are more similar to each other, compared to those performed with US color-Doppler (Table 4). Considering a comparison to the neuroanatomical post-mortem reference , a possible explanation for these findings could be that MRI such as B-mode ultrasound could overestimate the diameter, since a clear distinction between the nerve sheath and perineural vessels is not easily identifiable. At the same time the color-Doppler US could underestimate the diameter itself for excessive representation of the vessels (Fig. 4). MRI without and with contrast enhancement does not clearly display perineural vessels . US color-Doppler seems to discriminate better, using perineural vascular components as landmark structures, leading to a more accurate measurement of the ONSD. The CLOSED protocol, with its simple indications on settings, image quality and implementation of color-Doppler mode, could reduce operator-dependency of the ONSD measurements, as Pansell et al. demonstrated by finding an excellent inter- and intra-rater reliability and low risk of inter-rater bias. Pansell also added an anthropomorphic correction, as eyeball diameter and ON diameter, that can represent a further implementation of the protocol mentioned above. 
First of all, the two sonographic methods (B-mode and color-Doppler US) were not assessed in the same group of patients. Therefore, a direct correlation between the US modality and the differences in the ONSD measurements could not be confirmed. Finally, our results cannot be generalized due to the small sample size and iNPH population studied, which could be highly selective.
Our data suggest that application of color-Doppler using a standardized safety bundle may allow a more accurate assessment of ONSD than the B-mode only. Surprisingly, MRI did not reach enough accuracy and reproducibility for ONSD diameter measurements. This may be because the application of color-Doppler allows better delineating ON sheath border, yielding more reliable and accurate measurements. These findings offer an interesting scenario that might warrant further investigation.
Availability of data and materials
The data that support the findings of this study are available from the corresponding author, RA, upon reasonable request.
A specific custom code will be given by the corresponding author, RA, upon reasonable request.
Helmke K, Hansen HC (1996) Fundamentals of transorbital sonographic evaluation of optic nerve sheath expansion under intracranial hypertension I. Experimental study. Pediatr Radiol 26(10):701–705
Hansen HC, Helmke K (1997) Validation of the optic nerve sheath response to changing cerebrospinal fluid pressure: ultrasound findings during intrathecal infusion tests. J Neurosurg. https://doi.org/10.3171/jns.1997.87.1.0034
Albert DM (1986) Ophthalmic pathology: an atlas and textbook. Arch Ophthalmol. https://doi.org/10.1001/archopht.1986.01050170036013
Liu D, Kahn M (1993) Measurement and relationship of subarachnoid pressure of the optic nerve to intracranial pressures in fresh cadavers. Am J Ophthalmol 116(5):548–556
Helmke K, Hansen HC (1996) Fundamentals of transorbital sonographic evaluation of optic nerve sheath expansion under intracranial hypertension II. Patient study. Pediatr Radiol 26(10):706–710
Steinborn M, Fiegler J, Kraus V et al (2011) High resolution ultrasound and magnetic resonance imaging of the optic nerve and the optic nerve sheath: anatomic correlation and clinical importance. Ultraschall der Medizin 32(6):608–613
Ertl M, Knüppel C, Veitweber M, Wagner A, Pfister K, Wendl C, Baldaranov D, Beck J, Linker RA, Schlachetzki F (2020) Normal age- and sex-related values of the optic nerve sheath diameter and its dependency on position and positive end-expiratory pressure. Ultrasound Med Biol 46(12):3279–3285. https://doi.org/10.1016/j.ultrasmedbio.2020.08.025 (Epub 2020 Sep 19)
Özgen A, Aydingöz S (2000) Normative measurements of orbital structures using MRI. J Comput Assist Tomogr 24(3):493–496
Weigel M, Lagrèze WA, Lazzaro A, Hennig J, Bley TA (2006) Fast and quantitative high-resolution magnetic resonance imaging of the optic nerve at 3.0 tesla. Invest Radiol 41(2):83–86
Lagrèze WA, Lazzaro A, Weigel M, Hansen HC, Hennig J, Bley TA (2007) Morphometry of the retrobulbar human optic nerve: comparison between conventional sonography and ultrafast magnetic resonance sequences. Investig Ophthalmol Vis Sci 48(5):1913–1917
Steinborn M, Friedmann M, Hahn H et al (2015) Normal values for transbulbar sonography and magnetic resonance imaging of the optic nerve sheath diameter (ONSD) in children and adolescents. Ultraschall Med 36(1):54–58
Raval R, Shen J, Lau D et al (2020) Comparison of three point-of-care ultrasound views and MRI measurements for optic nerve sheath diameter: a prospective validity study. Neurocrit Care 33(1):173–181
Aspide R, Bertolini G, Albini Riccioli L, Mazzatenta D, Palandri G, Biasucci DG (2020) A proposal for a new protocol for sonographic assessment of the optic nerve sheath diameter: the CLOSED protocol. Neurocrit Care 32(1):327–332
Pansell J, Bell M, Rudberg P, Friman O, Cooray C (2021) Optic nerve sheath diameter measurement by ultrasound: evaluation of a standardized protocol. J Neuroimaging. https://doi.org/10.1111/jon.12936
Stevens RRF, Gommer ED, Aries MJH et al (2021) Optic nerve sheath diameter assessment by neurosonology: a review of methodologic discrepancies. J Neuroimaging 31(5):814–825
Giannini G, Palandri G, Ferrari A et al (2019) A prospective evaluation of clinical and instrumental features before and after ventriculo-peritoneal shunt in patients with idiopathic Normal pressure hydrocephalus: the Bologna PRO-Hydro study. Park Relat Disord 66:117–124
von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP (2007) The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 370(9596):1453–1457
Relkin N, Marmarou A, Klinge P, Bergsneider M, Black PML (2005) INPH guidelines, part II: diagnosing idiopathic normal-pressure hydrocephalus. Neurosurgery 57(3 Suppl):S4-16
Martin Bland J, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 327(8476):307–310
Lin LI-K (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45(1):255–268
Steinborn M, Fiegler J, Ruedisser K et al (2012) Measurement of the optic nerve sheath diameter in children: comparison between transbulbar sonography and magnetic resonance imaging. Ultraschall Med 33(6):569–573
Bäuerle J, Schuchardt F, Schroeder L, Egger K, Weigel M, Harloff A (2013) Reproducibility and accuracy of optic nerve sheath diameter assessment using ultrasound compared to magnetic resonance imaging. BMC Neurol 13:187
Patterson DF, Ho ML, Leavitt JA et al (2018) Comparison of ocular ultrasonography and magnetic resonance imaging for detection of increased intracranial pressure. Front Neurol 24(9):278
Wang LJ, Chen LM, Chen Y et al (2018) Ultrasonography assessments of optic nerve sheath diameter as a noninvasive and dynamic method of detecting changes in intracranial pressure. JAMA Ophthalmol 136(3):250–256
Robba C, Santori G, Czosnyka M et al (2018) Optic nerve sheath diameter measured sonographically as non-invasive estimator of intracranial pressure: a systematic review and meta-analysis. Intensive Care Med 44(8):1284–1294
Dubourg J, Javouhey E, Geeraerts T, Messerer M, Kassai B (2011) Ultrasonography of optic nerve sheath diameter for detection of raised intracranial pressure: a systematic review and meta-analysis. Intensive Care Med 37(7):1059–1068
Lochner P, Czosnyka M, Naldi A et al (2019) Optic nerve sheath diameter: present and future perspectives for neurologists and critical care physicians. Neurol Sci 40(12):2447–2457
Blitz AM, Macedo LL, Chonka ZD et al (2014) High-resolution CISS MR imaging with and without contrast for evaluation of the upper cranial nerves. Segmental anatomy and selected pathologic conditions of the cisternal through extraforaminal segments. Neuroimaging Clin N Am 24(1):17–34
The authors thank Sara Cambi (graphic illustrator) for the CLOSED protocol logotype; Fondazione Policlinico Universitario “A.Gemelli” IRCCS, Rome, Italy and their Medical Writer (Franziska M. Lohmeyer) for their support revising the manuscript; the Institute of Anatomy, University of Bologna, Bologna, Italy, and Dr. Ernersto Pasquini and Dr. Giacomo Sollini for the anatomical image.
The author(s) have not received any financial support for the research, authorship, and/or publication of this article.
Ethics approval and consent to participate
The study was conducted in accordance with the declaration of Helsinki and the principles of good clinical practice. The study protocol was approved by the local Ethics Committee (Cod. CE 17115). Informed consent was obtained from all individual participants.
Consent for publication
Patients signed informed consent regarding the publishing of their data.
The authors declare that the article content was composed in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Aspide, R., Bertolini, G., Belotti, L.M.B. et al. The CLOSED protocol to assess optic nerve sheath diameter using color-Doppler: a comparison study in a cohort of idiopathic normal pressure hydrocephalus patients. Ultrasound J 14, 43 (2022). https://doi.org/10.1186/s13089-022-00291-5
- Optic nerve sheath diameter
- Point-of-care ultrasound
- Intracranial pressure
- Neurocritical care