Skip to main content
The Ultrasound Journal
Download PDF

A survey demonstrating that the procedural experience of residents in internal medicine, critical care and emergency medicine is poor: training in ultrasound is required to rectify this

The Ultrasound Journal volume 13, Article number: 20 (2021) Cite this article

Abstract

Background

Training in procedural skills is often suboptimal. The aim of this study was to quantify the needs of residents in internal medicine (IM), critical care (CC), and emergency medicine (EM) for instruction in ultrasound-guided procedures.

Methods

All IM, EM and CC residents (n = 200) at King Abdulaziz Medical City, Riyadh, Saudi Arabia, were invited to participate in a questionnaire-based survey to identify skill and experience gaps. The contribution of procedural skills to patient care (i.e. applicability) and proficiency in the sterile technique required to perform ultrasound-guided procedures were rated on Likert scales. Data on training, accreditation, and experience with and without ultrasound were collected.

Results

The overall response rate was 72% (IM 91%, CC 100%, EM 40%). Although the sample reported that procedural skills were very applicable, 19% (IM n = 25, EM n = 2) had not performed any procedures. However, five residents were accredited in point-of-care ultrasound, 61% of the sample had performed ultrasound-guided procedures and 65% had used landmark techniques. Whilst more internists had performed procedures using landmark techniques, CC and EM residents had performed more ultrasound-guided procedures. Whilst CC residents had not missed any opportunities to perform procedures because supervisors were less available, EM (6) and IM (89) residents had. Whilst skill gaps were only identified in the IM residency programme, experience gaps were present in all three residency programmes. The IM residency programme had larger experience gaps than the CC and EM programmes for all procedural skills.

Discussion

Residents in IM, CC and EM perceive that ultrasound-guided procedures are relevant to their practice. However, the IM residents performed fewer procedures than CC residents and EM residents at least partly because internists also lack skills in ultrasound. Training in ultrasound-guided procedures may reduce the use of landmark techniques and improve patient safety. Residents in IM, CC and EM therefore require training in ultrasound-guided procedures.

Background

The procedural skills training of internists, intensivists and emergency medicine (EM) physicians are suboptimal worldwide [1,2,3]. In this context, little is known of internal medicine (IM), critical care (CC), and EM residents’ opinions on how much these skills contribute to patient care in these specialties (i.e. the applicability of bedside procedural skills).

The Saudi Commission for Health Specialties has developed specialty-specific curricula for residency training programmes in IM, CC, and EM [4,5,6]. These curricula include lists of procedures which residents in IM, CC and EM should be able to perform either independently or under supervision [4,5,6]. The training programmes at our institution implement these curricula and aim to provide the procedural skills training required.

However, to ensure patient safety, procedures must be performed by competent practitioners [7,8,9,10,11]. Ultrasound guidance reduces the risk of complications of many invasive procedures [8,9,10,11]. So its use is strongly recommended in many evidence-based guidelines [8,9,10,11]. However, in our setting, besides radiologists, very few clinicians are experienced with the use of ultrasound. Thus, extensive education in ultrasound to would be required to ensure safe and effective performance of procedures [12,13,14,15].

Whilst consensus documents, curricula and pathways for non-radiologists to accredit in ultrasound-guided procedures have been developed [16,17,18], the uptake of accreditation in point-of-care ultrasound (POCUS) has been relatively poor [19]. Thus, the aim of this study was to quantify the requirements of IM, CC and EM residents training in the twenty-first century for instruction in procedural skills by exploring their perceived needs and quantifying their training, proficiency and experience in procedural skills.

Methods

Ethical approval

The institutional review board of King Abdulaziz Medical City, Riyadh (KAMC) at the King Abdullah International Medical Research Center, Riyadh, Saudi Arabia, approved this study.

Sample size calculation

Assuming a response distribution of 50%, it was estimated that 132 responses would be required from the target population (n = 200; IM 85/108, CC 16/16, EM 64/76) to achieve an error margin of 5% at a confidence level of 95%.

Participants

The academic year for residency programmes in Saudi Arabia begins on 1st October. In August 2019, the IM and EM residents training at KAMC during the academic year 2018/2019 were invited to participate. In May 2020 the CC residents training at KAMC during the academic year 2019/2020 were invited to participate. Informed consent was obtained.

Survey development

A validated questionnaire investigating procedural skills was developed with input from the curricula for residency training in IM, CC and EM in Saudi Arabia [4,5,6], the literature on procedural skills training [12, 19] and the applications [7,8,9,10,11] and competencies for the performance of procedures with and without ultrasound [16,17,18, 20,21,22]. The initial questionnaire had five sections:

  • 1. Demographic information (i.e. gender, specialty, postgraduate year of training [PGY]).

  • 2. Applicability of 10 procedural skills (i.e. needs assessment). These were chosen from the Saudi Commission for Health Specialties’ curricula which include lists of procedures which residents in IM, CC and EM should be able to perform either independently or under supervision [4,5,6].

  • 3. Experience (i.e. number of procedures performed with and without ultrasound guidance).

  • 4. Training in ultrasound-guided procedures, accreditation in POCUS, and missed opportunities to perform ultrasound-guided procedures (i.e. situations when a procedure which could have been performed safely at the bedside by the participant was instead performed by a radiologist).

  • 5. Self-reported proficiency in each procedure with and without ultrasound guidance.

To obtain input on length, content, and clarity, the questionnaire was pre-tested with four paediatric residents. The pre-test highlighted that the questionnaire was too long, so it was shortened in response to the feedback. At our institution IM, CC, and EM are not credentialed to perform peripherally inserted central catheters or drain superficial abscesses. Lumbar punctures are only performed by or under the supervision of, the neurologists at our institution. Arterial line placement is similar to venous cannulation, but is rarely performed by IM and EM. So, the questions on experience in these four procedures were removed from “Results” section. However, the questions on the applicability of these four procedures were retained for the needs assessment.

Whilst the performance of any invasive procedure requires a standard preparatory process, ultrasound-guided procedures also require the sterile preparation of an ultrasound probe. Thereafter, the steps required for most procedures with and without ultrasound guidance are broadly similar. So, “Strengths and limitations” section was replaced with a single question on proficiency in the sterile technique required to perform ultrasound-guided procedures (a surrogate marker of procedural proficiency). “Background”, “Methods” and “Discussion” sections were not changed.

The final version of the questionnaire (Additional file 1: Appendix 1) was reviewed by the paediatric residents who had pre-tested the first questionnaire. It was deemed acceptable and so it was administered to the residents in IM, CC and EM as a paper-based questionnaire.

Study outcomes

Perceived applicability was assessed on a Likert scale (1 very poor, 2 poor, 3 fair, 4 good, 5 very good). Proficiency in the sterile technique required to perform ultrasound-guided procedures (i.e. a surrogate for ability) was self-reported on the same scale. Training and accreditation were determined using closed questions (i.e. Y/N). Experience was reported on an incremental scale (0, 1–2, 3–5, 6–9, ≥ 10). Missed opportunities were also reported on an incremental scale (never, a few times, many times, most of the time, not applicable). The skill gaps were determined by comparing applicability with proficiency, training and accreditation in POCUS. The experience gaps were determined by comparing applicability with procedural experience.

Statistical analysis

Data were analysed using standard descriptive statistical techniques. The responses of the IM, CC, and EM residents were analysed separately and as a cohort. The IM residents’ responses stratified by PGY and gender are presented in Additional file 2: Appendix 2. Meaningful stratification of the responses of the CC residents and the EM residents was not possible because of the small numbers of responses from residents in specialties. Interval data described on a 5-point Likert scales were presented as both frequency and mean (± standard deviation (SD)) as described previously [12, 23, 24]. These data were compared using a t-test or analysis of variance (ANOVA) as appropriate to enable comparison with previous studies [12]. Categorical data were compared using a Chi-squared test if unpaired or McNemar’s test if paired. All analyses were performed using Excel version 2016 (Microsoft, USA).

Results

Demographics and response rates

Participants’ demographic data and the response rates are shown in Table 1. The overall response rate was high (72.0%). A total of 98 IM residents (90.7%), 16 CC residents (100%) and 30 EM residents (41.7%) participated. All 144 participants completed the questionnaire and all responses were included in the final analysis.

Table 1 Demographics and response rates
Full size table

The response rates of the male (M) and female (F) CC and EM residents did not differ significantly (CC, 100%; EM M 44.9%, F 29.6%, χ2 1.7, P = 0.29); but women's response rates were significantly lower than men’s in IM (M 96%, F 77.4%; χ2 9.1836, P = 0.002) and in the whole cohort (M 78.8%, F 57.1%, χ2 10.1, P = 0.0015). Differences between male and female responses were not statistically significant.

Training and accreditation

Table 2 shows the sample’s training in ultrasound-guided procedures and accreditation in POCUS. Only 12 residents (8.3%) had received training in POCUS as undergraduates. Forty-six (30%) had received instruction in ultrasound-guided procedures during their residency. Whilst all CC residents and most EM residents (90%) had received postgraduate training, significantly fewer IM residents had (3%; χ2 111.5, P < 0.00001). Five residents (CC n = 3, EM n = 2) had accreditation in POCUS.

Table 2 Physicians’ self-reported accreditation and training in POCUS as undergraduates and postgraduates
Full size table

Applicability

Of the 10 procedural skills considered in the present study, the sample reported the highest applicability for central venous catheterization (CVC) and pericardiocentesis (Table 3 and Fig. 1). The IM and EM residents considered lumbar puncture to be least relevant. The CC residents perceived that the drainage of superficial abscesses was the least relevant.

Table 3 Applicability of procedural skills and proficiency in the sterile technique required to perform ultrasound-guided procedures
Full size table
Fig. 1
figure 1

Applicability of four procedural skills, physicians’ proficiency in the sterile technique required to perform ultrasound-guided procedures, and the skill gaps. The perceived applicability of each procedure to the practice of each specialty was assessed using a Likert scale (1 very poor, 2 poor, 3 fair, 4 good, 5 very good). The proficiency in the sterile technique required to perform ultrasound-guided was self-reported on the same Likert scale. Data stratified by specialty are presented as mean ± standard deviation. The skill gap is calculated as the difference between the average applicability and the proficiency. The data from which this figure is derived are also presented in Table 3. CC critical care, EM emergency medicine, IM internal medicine

Full size image

Proficiency and the skill gaps in ultrasound-guided procedures

Internal medicine residents’ self-reported proficiency in the sterile technique required to perform ultrasound-guided procedures was poor (mean 1.9 ± SD 1.2; Table 3, Fig. 1) and significantly lower than the combined mean applicability score of all procedures (3.9 ± SD 1.3, P < 0.00001). In contrast, CC (mean 3.6 ± SD 1.1) and EM (mean 3.9 ± SD 1.1) reported good proficiency in the sterile technique required. This was not significantly different from the combined mean applicability score of all procedures (CC mean 4.1 ± SD 1.4, P = 0.2; EM mean 4.0 ± SD 1.3, P = 0.43). These data suggest the presence of a large skill gap in IM and its absence in EM and CC (Fig. 1). However, procedural experience must also be considered.

Procedural experience

The number of residents without any procedural experience is shown in Table 4. Whilst 27 residents (19%; IM n = 25, and EM n = 2) had not performed any procedures whatsoever, 51 (35%; IM n = 36, CC n = 6, and EM n = 9) had not performed a drainage procedure (i.e. thoracentesis, pericardiocentesis, paracentesis, or arthrocentesis).

Table 4 Residents’ procedural experience: combined procedural experience with and without ultrasound guidance
Full size table

The number of residents with any procedural experience is also shown in Table 4. Tables 5 and 6 show the self-reported numbers of vascular access procedures (Table 5) and drainage procedures (Table 6). The procedure that the most residents had performed with ultrasound guidance was CVC (n = 78, 54%). Paracentesis was the procedure that the most residents had performed without ultrasound guidance (n = 62, 43%).

Table 5 Number of procedures performed: vascular access
Full size table
Table 6 Number of procedures performed: drainage procedures
Full size table

Whilst fewer IM residents had performed any procedures with ultrasound guidance (n = 44) than without it (n = 66, McNemar χ2 13.4, P = 0.00025), 37 had performed procedures both with and without ultrasound guidance. In contrast, all CC residents had performed ultrasound-guided procedures. Only two PGY1 EM residents (7%) had not performed any ultrasound-guided procedures. Significantly fewer CC residents (n = 10, 62.5%, McNemar χ2 6.0, P = 0.014) and EM residents (n = 18, 60%, McNemar χ2 10, P = 0.002) had performed procedures without ultrasound guidance.

In the whole cohort, fewer residents (n = 47, 33%; IM n = 17, CC n = 9, EM n = 21) had performed at least one drainage procedure with ultrasound guidance, than had performed at least one drainage procedure without it (n = 70, 49%; IM n = 57, CC n = 3, EM n = 10; McNemar χ2 6.9, P = 0.0085). This observation was skewed by IM. More IM residents had performed drainage procedures without ultrasound guidance (McNemar χ2 29.8; P < 0.00001). Fewer CC residents (McNemar χ2 4.5, P = 0.034) and EM residents (McNemar χ2 11, P = 0.0009) had done this.

These data suggest the presence of a large procedural experience gap in IM and imply its absence in CC and EM.

Experience gap

Although 82 IM residents reported that the applicability of CVC was good or very good, only 44 had ever performed ultrasound-guided CVC (53.6%; χ2 32.09; P < 0.00001). All CC residents and 27 EM residents described the applicability of CVC as either good or very good. All the CC and 26 EM residents had performed ultrasound-guided CVC. These observations suggest that IM has an experience gap in vascular access procedures, but CC and EM do not.

Most IM residents reported that the applicability of thoracentesis (n = 77), pericardiocentesis (n = 87), paracentesis (n = 75), and arthrocentesis (n = 63) was either good or very good, but only 19 had performed an ultrasound-guided drainage procedure. These observations suggest that internists’ experience gap in ultrasound-guided drainage procedures is even greater than that in vascular access.

The majority of CC and EM residents reported that the applicability of thoracentesis (CC n = 13, EM n = 14), pericardiocentesis (CC n = 16, EM n = 27), paracentesis (CC n = 11, EM n = 24), and arthrocentesis (CC n = 12, EM n = 13) was good or very good. Similar numbers had performed an ultrasound-guided drainage procedure (CC n = 9, EM n = 21). Whilst these data suggest that CC and EM do not have an experience gap for ultrasound-guided drainage procedures, consideration of the volume of experience is illuminating.

Tables 5 and 6 show the numbers of residents who had performed over five of each specified procedure. Whilst most CC residents (n = 14, 87.5%) and many EM residents (n = 13, 43%) had performed over five ultrasound-guided CVC, few internists had (2, 2%, χ2 75, P < 0.00001). Few residents had performed over five thoracocenteses (n = 2), pericardiocenteses (n = 0), paracenteses (n = 8) or arthrocenteses (n = 1) with ultrasound guidance. Similar numbers had performed these procedures without ultrasound guidance. Thus, the majority of the sample had very little procedural experience, if any. These observations suggest the presence of large procedural experience gaps in the IM, CC, and EM residency programmes.

Missed opportunities to perform ultrasound-guided procedures

One hundred and nine residents (76%; IM n = 89, EM n = 20) reported that they had missed opportunities to perform ultrasound-guided procedures because a supervisor was unavailable. Whilst CC residents were never in this situation, 66 residents (IM n = 61, EM n = 5) reported that this was common. Only nine IM (1 PGY1, 3%; 3 PGY2, 12%; 3 PGY3, 12%; 2 PGY4, 12%) and 10 EM (4 PGY1, 25%; 1 PGY2, 17%; 3 PGY3, 43%; 2 PGY4, 40%) residents reported that they had never missed an opportunity to perform an ultrasound-guided procedure.

Of these 19 residents, five (3.5%; IM 1 PGY1, 2 PGY2, 1 PGY4; EM 1 PGY1) reported that they had not performed any procedures despite stating that the applicability of the procedures to their practice was very good. It is unlikely that this cohort did not manage any patients who required procedures. So, this suggests that these five trainees did not want to perform procedures. The corollary of this is that the vast majority (96.5%) would like to learn practical procedures, but often miss opportunities to do them.

Discussion

Procedural skills and experience are poor

Whilst most of the CC and EM residents had performed procedures, alarmingly, five PGY3 (20%) IM residents and three PGY4 (17.6%) IM residents had not performed any procedures whatsoever (Additional file 2: Appendix 2: Table 8). Of the senior IM residents, only one PGY3 and three PGY4 IM residents had performed thoracentesis; a core skill for internists. As the IM and EM residents were surveyed towards the end of the academic year, the PGY4 residents had almost completed their residency training. Our observations are, therefore, representative of fellows’ technical skills at the start of their fellowships.

In 2018, Watson and colleagues [12] reported that 91, 84, and 86% of Canadian IM trainees had performed ultrasound-guided paracentesis, thoracentesis, and CVC, respectively. In the present study, significantly fewer Saudi IM residents had performed these procedures under ultrasound guidance (paracentesis 12%, thoracentesis 5%, CVC 37%; P < 0.00001). Even if all procedures performed with and without ultrasound guidance are included; fewer of our IM residents had performed procedures (paracentesis 62%, thoracentesis 12%, CVC 44%; P < 0.00001).

International guidelines consistently recommend the performance of procedures under ultrasound guidance. Thus, this paucity of procedural skills is likely to be a global phenomenon affecting all centres where physicians are not trained in procedural ultrasound. The skill gaps should be considered to determine whether the finite resources available for medical education should be used to rectify this.

Skill gaps and missed opportunities for procedural skills training

Unless a physician is proficient in the generic sterile technique required to perform ultrasound-guided procedures, they cannot perform any ultrasound-guided procedure safely. Thus, the nursing staff at our institution are empowered to stop a physician performing a procedure if sterility is compromised.

The sample’s self-reported proficiency in this skill suggests the presence of a large procedural skill gap in the IM residency training programme, but its absence in CC and EM. This is probably because all CC residents and most EM residents had received postgraduate training in ultrasound-guided procedures, whilst very few internists had been trained.

The performance of ultrasound-guided procedures by IM residents without any formal postgraduate training raises governance issues and patient safety concerns. These issues must be addressed by a training programme and formal processes for supervision, governance and accreditation.

Experience in procedures with and without ultrasound

Tables 4, 5, 6 show the sample’s self-reported procedural experience. All CC residents and most EM residents (n = 28) had performed ultrasound-guided procedures. Ultrasound-guided procedures are safer than landmark techniques [8,9,10,11]. However, significantly more IM residents (n = 66) had performed procedures without ultrasound guidance than with it (n = 44) and none are accredited in POCUS. In contrast, significantly fewer CC (n = 10) and EM (n = 18) residents had performed procedures using landmark techniques.

This observation suggests that training in ultrasound-guided procedures decreases the use of landmark techniques. So, instructing residents in the use of procedural ultrasound may increase patient safety. Furthermore, whilst almost all of the CC and EM residents had performed procedures, nearly 25% of IM residents had not performed any procedures. So, training in ultrasound guidance may increase the bedside performance of procedures.

Volume of procedural experience and the experience gap

At our institution, procedural competence is not solely defined by successful performance of a minimum number of procedures under supervision. It must be determined through simulation, direct observation, and other relevant criteria outlined by the curriculum of each specialty and the residency programme directors. However, many North American residency programmes still use the historical threshold of 5 procedures to define competency [25].

Although this threshold is not used to define competence at our institution, we do believe that it provides a useful marker of residents’ exposure to procedural skills (i.e. volume of experience). As mastery of any skill requires experience, the threshold of five procedures can be used to define an experience gap.

All CC residents and most EM residents had performed over five ultrasound-guided CVC (Table 5). That only two IM residents had achieved this suggests the presence of a large experience gap in the IM residency programme in this skill. Furthermore, few residents, in any specialty, had performed over five drainage procedures with or without ultrasound (Tables 5 and 6). These observations provide evidence of large experience gaps in the performance of drainage procedures within all three residency programmes.

Our data demonstrate that training in ultrasound-guided procedures in Saudi Arabia has been variable. Whilst the residents are interested in learning this skill, IM has clearly lagged behind CC and EM. To advance, the physicians, medical educators and the regulatory bodies for medical education must fully commit to training in ultrasound-guided procedures. All stakeholders must be engaged for this endeavour to be successful. To unambiguously signal the importance of competencies in ultrasound-guided procedures, it is important that the relevant regulatory bodies make an executive decision to incorporate this into undergraduate training and reinforce its importance during postgraduate training.

Our data demonstrate that untrained residents are performing procedures with and without ultrasound guidance. Learners may erroneously believe that studies describing better outcomes with ultrasound guidance in the hands of trained operators are applicable to untrained learners [26]. However, as these skills are operator dependent [17, 18, 26], inadequate training in procedural ultrasound may increase complications [17, 18, 26].

So, healthcare systems cannot ignore the potential dangers from untrained users [18, 26]. Thus, to improve patient outcomes, there is an urgent need for qualified educators to develop a curriculum and provide appropriate training in ultrasound-guided procedures.

Development of a curriculum and training programme for ultrasound-guided procedures

Ideally, the curriculum should include mandatory theoretical and practical training beginning with part-task trainers (i.e. simulation) [16]. If this training begins in medical school, specialty-specific training in residency and fellowship programmes could refine pre-existing skills before allowing trainees to perform procedures in patients [27]. To ensure patient safety close supervision of practice will be required.

Mastery learning is a model of competency-based training, which ensures learners achieve a learning objective before progressing to the next stage of training [28]. Given, the potential risks to patients, this is probably the most appropriate approach for procedural skills training. The Thoracentesis Assessment Tool is an example of a validated tool which can be used in a mastery learning model for procedural skills [28].

Whilst recommendations, competencies and curricula for training in ultrasound-guided procedures are available [16, 17] these must be adapted for each setting. So, every medical school and specialty must task a panel of experts with the relevant competencies to develop local curricula for ultrasound-guided procedures with clearly defined competencies and objectives.

During this process some basic principles must be followed [26]:

  • 1. The curricula must be easily teachable and reliably learnable [26]. Skills must also be assessed to ensure competency and allow progression through each stage of the mastery learning process.

  • 2. The use of procedural ultrasound must have clear indications (e.g. to achieve a defined goal, such as performing thoracentesis for pleural effusion).

  • 3. Scopes of practice and institutional privileges must be defined [26]. Physicians must be made fully aware of their limitations [26]. When performing ultrasound-guided procedures, it is important to recognize when assistance from an expert (e.g. interventional radiologist) must be obtained.

The next challenge is implementation of the curriculum.

Implementation of a curriculum and training programme for ultrasound-guided procedures

To facilitate this, each institution delivering the training requires champions for POCUS and ultrasound-guided procedures [26]. These individuals must ensure that regular didactic sessions are provided, appropriate equipment is available, and most importantly, hands-on training is offered [26].

To deliver this, faculty with sufficient theoretical, clinical, and practical knowledge and skills must be engaged [26]. The faculty must be fully trained, institutionally credentialed and ideally accredited [26]. These individuals must commit to training and assessing learners. Unfortunately, our data revealed that opportunities to perform procedures were missed because supervisors were not available. This observation is consistent with previous data highlighting that few general internists are able to teach procedural skills [29] and that many programmes lack trained faculty [30].

Institutional support for faculty training and the infrastructure for ongoing quality assurance processes with a secure system for archiving images must be prioritized [30]. This will require the support of the radiology department and fully certified interventional radiologists.

Curriculum implementation clearly requires substantial resources and organizational engagement. To facilitate this and ensure that important aspects are not forgotten quality metrics for medical education must be used [31]. The execution of this process in Saudi Arabia may also be guided by the previous experience of the implementation of training in ultrasound-guided procedures in other countries. Indeed, our IM residents’ perceptions of the applicability of procedural skills (Table 3, Fig. 1) were similar to those reported by IM residents training in Canada [12]. So, international standardization of basic training for ultrasound-guided procedures may be possible.

Strengths and limitations

The accuracy of self-reported data on procedural experience can be questioned [32]. Furthermore, participants’ proficiency in the sterile technique required for ultrasound-guided procedures was investigated rather than proficiency in specific procedures. However, the reports of limited procedural experience and poor proficiency by the IM residents, and the reports of greater experience and proficiency by the residents training in CC and EM are consistent with our personal observations.

Whilst our sample perceived that the applicability of lumbar puncture was only fair, a Canadian study reported that the applicability of lumbar puncture to internists was high [12]. This difference probably reflects our institutional practices. Lumbar punctures are usually performed by neurologists at our institution. This observation highlights the critical importance of performing local needs assessments during curriculum development. Indeed, the survey instrument described in the present study could be replicated to conduct needs assessments in other centres worldwide.

Critical care residents were surveyed 7 months after the IM and EM residents. However, this is unlikely to have affected the conclusions drawn from the data as responses were received from PGY1 to PGY4 residents in all three specialties. Furthermore, the overall response rate and that of IM and CC residents was excellent. So, the desired margin of error and level of confidence were achieved. Although the EM residents’ response rate was not as good, 93.3% of EM residents had performed ultrasound-guided procedures. Thus, considering the response distribution of 93.3%, the number of responses from the EM residents was sufficient to achieve a 7% error margin at a confidence level of 83%.

The study was performed in only one hospital, so generalizability may be limited. However, international guidelines strongly recommend the performance of procedures under ultrasound guidance [8,9,10,11]. Furthermore, the IM, CC, and EM residency programmes at our institution are amongst the largest in Saudi Arabia. Our sample is therefore likely to be representative of trainees in these specialties throughout Saudi Arabia.

Conclusion

Our study demonstrates the applicability of procedural skills to the current scope of IM, CC, and EM practice. Internists have large skill gaps in this domain whilst the CC and EM residency programmes apparently do not. However, all three specialties have experience gaps in the performance of drainage procedures. The experience gaps in IM are larger than those in EM and CC and also include CVC.

International guidelines recommend the use of ultrasound guidance rather than traditional landmark techniques. Therefore, IM, CC and EM physicians must learn ultrasound in order to perform procedures. At our institution, IM has clearly lagged behind CC and EM in this domain. Our findings are likely to reflect the situation in centres where these physicians are not trained to perform ultrasound-guided procedures. Therefore, there is an urgent need to develop curricula for training internists in procedural ultrasound. Despite regional differences in diseases, our IM residents’ responses were similar to those of Canadians. So, international standardization of training in procedural skills may be possible.

Availability of data and materials

All authors affirm that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned have been explained. The data that support the findings of this study are available from King Abdulaziz Medical City (KAMC), Ministry of National Guard—Health Affairs, Riyadh, Saudi Arabia. But restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are, however, available from the authors upon reasonable request and with the permission of KAMC.

Abbreviations

CC:

Critical care

CVC:

Central venous catheterization

EM:

Emergency medicine

F:

Female

IM:

Internal medicine

KAMC:

King Abdulaziz Medical City

M:

Male

POCUS:

Point-of-care ultrasound

PGY:

Postgraduate year of training

SD:

Standard deviation

References

  1. Mourad M, Kohlwes J, Maselli J, Auerbach AD (2010) Supervising the supervisors–procedural training and supervision in internal medicine residency. J Gen Intern Med 25:351–356

    Article  Google Scholar 

  2. Roux D, Reignier J, Thiery G, Boyer A, Hayon J, Souweine B, Papazian L, Mercat A, Bernardin G, Combes A, Chiche J-D, Diehl J-L, du Cheyron D, L’her E, Perrotin D, Schneider F, Thuong M, Wolff M, Zeni F, Dreyfuss D, Ricard J-D (2014) Acquiring procedural skills in ICUs: a prospective multicenter study. Crit Care Med 42:886–895

    Article  Google Scholar 

  3. Petrosoniak A, Herold J, Woolfrey K (2013) Emergency medicine procedural skills: what are residents missing? CJEM 15:241–248

    Article  Google Scholar 

  4. Saudi Commission for Health Specialties (2015) Saudi Board Critical Care Medicine Curriculum. https://www.scfhs.org.sa/MESPS/TrainingProgs/TrainingProgsStatement/Documents/Critical%20Care%20Medicine%20new.pdf

  5. Saudi Commission for Health Specialties (2014) Saudi Board Emergency Medicine Curriculum. https://www.scfhs.org.sa/MESPS/TrainingProgs/TrainingProgsStatement/Documents/EM%20Curriculum.pdf

  6. Saudi Commission for Health Specialties (2015) Saudi Board Internal Medicine Curriculum. https://www.scfhs.org.sa/en/MESPS/TrainingProgs/List%20graduate%20programs/Documents/INTERNAL%20MEDICINE.pdf

  7. Pietersen PI, Madsen KR, Graumann O, Konge L, Nielsen BU, Laursen CB (2018) Lung ultrasound training: a systematic review of published literature in clinical lung ultrasound training. Crit Ultrasound J 10:23

    Article  Google Scholar 

  8. Franco-Sadud R, Schnobrich D, Matthews BK, Candotti C, Abdel-Ghani S, Perez MG, Rodgers SC, Mader MJ, Haro EK, Dancel R, Cho J, Grikis L, Lucas BP, Soni NJ (2019) Recommendations on the use of ultrasound guidance for central and peripheral vascular access in adults: a position statement of the society of hospital medicine. J Hosp Med 14:E1–E22

    Article  Google Scholar 

  9. Soni NJ, Franco-Sadud R, Kobaidze K, Schnobrich D, Salame G, Lenchus J, Kalidindi V, Mader MJ, Haro EK, Dancel R, Cho J, Grikis L, Lucas BP, Soni N, Franco-Sadud R, Bates J, Dancel R, Schnobrich D, Puri N, Franco R, Matthews B, Abdel-Ghani S, Rodgers S, Perez M, Schnobrich D, Cho J, Matthews B, Reierson K, Bhagra A, Trevor P et al (2019) Recommendations on the use of ultrasound guidance for adult lumbar puncture: a position statement of the society of hospital medicine. J Hosp Med 14:591–601

    PubMed  PubMed Central  Google Scholar 

  10. Cho J, Jensen TP, Reierson K, Mathews BK, Bhagra A, Franco-Sadud R, Grikis L, Mader M, Dancel R, Lucas BP, Soni NJ, Abdel-Ghani S, Arntfield R, Bates J, Blaivas M, Brotman D, Candotti C, Hoppmann R, Hunt S, Kalidindi V, Kobaidze K, Lenchus J, Mayo P, Nichani S, Noble V, Perez M, Puri N, Pustavoitau A, Rodgers S, Salame G et al (2019) Recommendations on the use of ultrasound guidance for adult abdominal paracentesis: a position statement of the society of hospital medicine. J Hosp Med 14:E7–E15

    Article  Google Scholar 

  11. Dancel R, Schnobrich D, Puri N, Franco-Sadud R, Cho J, Grikis L, Lucas BP, El-Barbary M, Abdel-Ghani S, Arntfield R, Bates J, Bhagra A, Blaivas M, Brotman D, Candotti C, Hoppmann R, Hunt S, Jensen TP, Kalidindi V, Kobaidze K, Lenchus J, Mathews B, Paul M, Nichani S, Noble V, Perez M, Pustavoitau A, Reierson K, Rodgers S, Salame G et al (2018) Recommendations on the use of ultrasound guidance for adult thoracentesis: a position statement of the society of hospital medicine. J Hosp Med 13:126–135

    Article  Google Scholar 

  12. Watson K, Lam A, Arishenkoff S, Halman S, Gibson NE, Yu J, Myers K, Mintz M, Ma IWY (2018) Point of care ultrasound training for internal medicine: a Canadian multi-centre learner needs assessment study. BMC Med Educ 18:1–8

    Article  Google Scholar 

  13. Beaulieu Y, Laprise R, Drolet P, Thivierge RL, Serri K, Albert M, Lamontagne A, Bélliveau M, Denault AY, Patenaude JV (2015) Bedside ultrasound training using web-based e-learning and simulation early in the curriculum of residents. Crit Ultrasound J 7:1

    Article  Google Scholar 

  14. Via G, Hussain A, Wells M, Reardon R, ElBarbary M, Noble VE, Tsung JW, Neskovic AN, Price S, Oren-Grinberg A, Liteplo A, Cordioli R, Naqvi N, Rola P, Poelaert J, Guliĉ TG, Sloth E, Labovitz A, Kimura B, Breitkreutz R, Masani N, Bowra J, Talmor D, Guarracino F, Goudie A, Xiaoting W, Chawla R, Galderisi M, Blaivas M, Petrovic T et al (2014) International evidence-based recommendations for focused cardiac ultrasound. J Am Soc Echocardiogr 27:683.e1-683.e33

    Article  Google Scholar 

  15. Price S, Via G, Sloth E, Guarracino F, Breitkreutz R, Catena E, Talmor D (2008) Echocardiography practice, training and accreditation in the intensive care: document for the World Interactive Network Focused on Critical Ultrasound (WINFOCUS). Cardiovasc Ultrasound 6:49

    Article  Google Scholar 

  16. American Institute of Ultrasound in Medicine (2019) Curriculum for the Performance of Ultrasound-Guided Procedures. J Ultrasound Med 38:1951–1969

    Article  Google Scholar 

  17. Brown GM, Otremba M, Devine LA, Gray C, Millington SJ, Ma IWY (2016) Defining competencies for ultrasound-guided bedside procedures: consensus opinions from Canadian Physicians. J Ultrasound Med 35:129–141

    Article  Google Scholar 

  18. The Royal College of Radiologists (2017) Ultrasound training recommendations for medical and surgical specialties, Third edition. https://www.rcr.ac.uk/system/files/publication/field_publication_files/bfcr173_ultrasound_training_med_surg.pdf.

  19. Smallwood N, Matsa R, Lawrenson P, Messenger J, Walden A (2015) A UK wide survey on attitudes to point of care ultrasound training amongst clinicians working on the Acute Medical Unit. Acute Med 14:159–164

    PubMed  Google Scholar 

  20. Ma IWY, Arishenkoff S, Wiseman J, Desy J, Ailon J, Martin L, Otremba M, Halman S, Willemot P, Blouw M, Azzam K, Balan M, Card SE, Cessford T, Chan B, Cotton D, Gebhardt CR, Gibson NE, Gray CJ, Hanmiah R, Haroon BA, Jayaraman D, Lafleur A, Lam A, Lipes J, Mayette M, Montague SJ, Mustafa H, Reimche L, Ringrose J et al (2017) Internal Medicine Point-of-Care Ultrasound Curriculum: Consensus Recommendations from the Canadian Internal Medicine Ultrasound (CIMUS) Group. J Gen Intern Med 32:1052–1057

    Article  Google Scholar 

  21. Alber KF, Dachsel M, Gilmore A, Lawrenson P, Matsa R, Smallwood N, Stephens J, Tabiowo E, Walden A (2018) Focused acute medicine ultrasound (FAMUS). Acute Med 17:164–167

    CAS  PubMed  Google Scholar 

  22. Vusse LV, Shepherd A, Bergam B, Andros J, Morris A (2020) Procedure training workshop for internal medicine residents that emphasizes procedural ultrasound: logistics and teaching materials. MedEdPORTAL J Teach Learn Resour 16:10897

    Google Scholar 

  23. Mahmood N, Souleymane M, Rajendram R, Ghazi AMT, Kharal M, AlQahtani M (2020) Focused cardiac ultrasound is applicable to internal medicine and critical care but skill gaps currently limit use. J Saudi Hear Assoc 32:1

    Article  Google Scholar 

  24. Jarwan W, Alshamrani AA, Alghamdi A, Mahmood N, Kharal YM, Rajendram R, Hussain A (2020) Point-of-Care ultrasound training: an Assessment of Interns’ needs and barriers to training. Cureus 12:e11209

    PubMed  PubMed Central  Google Scholar 

  25. Ricotta DN, Smith CC, McSparron JI, Chaudhry SI, McDonald FS, Huang GC (2017) When old habits train a new generation: findings from a National Survey of Internal Medicine Program Directors on Procedural training. Am J Med Qual 33:383–390

    Article  Google Scholar 

  26. Hussain A, Ma IWY. Internal medicine point of care ultrasound in the 21st century: a ‘FoCUS’ on the Middle East. J Saudi Hear Assoc. 2020. (in press).

  27. Promes SB, Chudgar SM, Grochowski CO, Shayne P, Isenhour J, Glickman SW, Cairns CB (2009) Gaps in procedural experience and competency in medical school graduates. Acad Emerg Med 16(2):S58-62

    Article  Google Scholar 

  28. Rasmussen KMB, Hertz P, Laursen CB, Arshad A, Saghir Z, Clementsen PF, Konge L (2019) Ensuring basic competence in thoracentesis. Respiration 97:463–471

    Article  Google Scholar 

  29. Wickstrom GC, Kelley DK, Keyserling TC, Kolar MM, Dixon JG, Xie SX, Lewis CL, Bognar BA, DuPre CT, Coxe DR, Hayden J, Williams MV (2000) Confidence of academic general internists and family physicians to teach ambulatory procedures. J Gen Intern Med 15:353–360

    Article  CAS  Google Scholar 

  30. Wong J, Montague S, Wallace P, Negishi K, Liteplo A, Ringrose J, Dversdal R, Buchanan B, Desy J, Ma IWY (2020) Barriers to learning and using point-of-care ultrasound: a survey of practicing internists in six North American institutions. Ultrasound J 12:19

    Article  Google Scholar 

  31. Ambasta A, Balan M, Mayette M, Goffi A, Mulvagh S, Buchanan B, Montague S, Ruzycki S, Ma IWY (2019) Education Indicators for Internal Medicine Point-of-Care Ultrasound: a Consensus Report from the Canadian Internal Medicine Ultrasound (CIMUS) Group. J Gen Intern Med 34:2123–2129

    Article  Google Scholar 

  32. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L (2006) Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. J Am Med Assoc. 296:1094–1102

    Article  CAS  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

None.

Author information

Author notes

  1. Mamdouh Souleymane and Rajkumar Rajendram contributed equally to this study and are joint first authors

Authors and Affiliations

  1. Department of Medicine, King Abdulaziz Medical City, King Abdulaziz International Medical Research Center, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia

    Mamdouh Souleymane, Rajkumar Rajendram & Naveed Mahmood

  2. College of Medicine, King Saud Bin Abdulaziz University of Health Sciences, Riyadh, Saudi Arabia

    Rajkumar Rajendram & Naveed Mahmood

  3. Department of Intensive Care, King Abdulaziz Medical City, King Abdulaziz International Medical Research Center, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia

    Amro M. T. Ghazi

  4. College of Medicine, Alfaisal University, Riyadh, Saudi Arabia

    Yousuf M. S. Kharal

  5. Department of Cardiac Sciences, King Abdulaziz Medical City, King Abdulaziz International Medical Research Center, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia

    Arif Hussain

Authors
  1. Mamdouh Souleymane
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rajkumar Rajendram
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Naveed Mahmood
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Amro M. T. Ghazi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yousuf M. S. Kharal
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Arif Hussain
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RR conceptualised the study. All authors were involved in literature searches and the study design. RR, MS and AMTG designed the questionnaire for the survey. MS and AMTG collected the data. RR performed the statistical analysis. All authors were involved in interpretation of the data. RR prepared the initial draft of the manuscript. All authors critically revised the scientific content of the manuscript, reviewed the manuscript and approved the final version of the manuscript for publication.

Corresponding author

Correspondence to Rajkumar Rajendram.

Ethics declarations

Ethics approval and consent to participate

This prospective, observational study was approved by the institutional review board (IRB) of the King Abdullah International Medical Research Center, Riyadh, Arabia (Reference RC20/296/R). Informed consent was obtained from all participants.

Consent for publication

No identifiable data from individual subjects are included in this paper.

Competing interests

AH is the serving president of WINFOCUS, but there are no financial disclosures related to this study. All other authors affirm that they have no conflicts of interest to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Appendix 1.

Survey instrument.

Additional file 2: Appendix 2.

Supplemental data tables.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Souleymane, M., Rajendram, R., Mahmood, N. et al. A survey demonstrating that the procedural experience of residents in internal medicine, critical care and emergency medicine is poor: training in ultrasound is required to rectify this. Ultrasound J 13, 20 (2021). https://doi.org/10.1186/s13089-021-00221-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13089-021-00221-x

Keywords

  • Ultrasound-guided procedures
  • Education needs assessment
  • Curriculum development
  • Internal medicine
  • Procedural skills training
  • Emergency medicine
  • Critical care