Introduction
The ease, accuracy and safety of ultrasonography (US) have led to an increase in the number of requests for its use in the emergency setting1-7. The aims of the present study were to assess and measure the impact of emergency US on clinical practice.
Materials and Methods
The present prospective study was performed during the period between March 2012 and December 2012. The Hospitals research Ethics Committee approved the present study. Data on all patients referred to the Department of Radiology for emergency US during the present study period were collected. Emergency US was defined as an US requested on an emergency basis by he referring or primary physician. US for biopsy purposes or for emergency interventions, such as US-guided loculated pleural effusion drainage, were excluded.
US was performed by experienced staff radiologists during the working hours (8.30 to 16.00 oclock). Data collection forms were filled by experience staff radiologists. The final discharge diagnoses were obtained from medical charts and computerized records.
Data collected for the present study included age, gender, admitting or provisional diagnosis, ultrasonographic findings and diagnosis, the final (discharge) diagnosis, time of US, other radiologic investigations, and therapeutic interventions. No attempt was made to elicit the opinion of referring physicians or residents on whether results of US influenced or had an impact on clinical decision making.
All diagnoses were categorized according to organ-systems. A positive US result was defined as a clear abnormality detected by US. A negative US was defined as unclear findings or finding of no obvious abnormality. A negative final diagnosis was one that was vague, non-specific and not of clear clinical significance (for example, dyspepsia, abdominal pain, muscle pain, testicular pain and cramps). The final diagnosis was assumed to represent the true status of the patient at discharge.
The concordance or agreement between provisional diagnosis and US for a particular patient was defined as the same or practically the same diagnoses for both (for example, acute appendicitis, appendicitis, and consistent with appendicitis were considered practically the same diagnoses). US can disagree with or exclude the provisional diagnosis or were unclear. US could reveals an alternative diagnosis as well as demonstrated other, anatomically or pathologically unrelated but clinically important.
The concordance or agreement between US and final diagnoses was also called diagnostic accuracy. If US and final diagnoses were both the same, this was considered a true positive finding for the US. If both US and the final diagnoses were negative then this was considered a true negative finding. Otherwise, the disagreement between US and final diagnoses was either a false positive or a false negative finding for the US.
US had an impact if the US diagnosis agreed with the final diagnosis. However, if, following US, further radiologic investigations were performed for the same provisional diagnosis (that is, he US results seemed to have been ignored), then US had no impact. US had a therapeutic impact if, following US, a therapeutic maneuver consistent with the US findings was immediately instituted. In this situation, no further radiologic investigations to confirm or exclude the US diagnosis should have been done. Other situations apart from those described above, defined no impact of US.
As a check on the accuracy of US, the sensitivity and specificity of the US in the diagnosis of two common conditions were measured. The accuracy of US in the diagnosis of two common conditions were measured. The accuracy of US in diagnosing acute appendicitis and acute cholecystitis was obtained from the present data using a combination of operative findings, clinical follow-up, and other radiologic investigations as the comparative gold standard.
US was performed using Xario XG SSA-680A (Toshiba Co. Ltd., CMC Biotech Co. Ltd, Japan). Transducer were 3.5 -5.0 MHz convex type for abdominal examinations and 8.0 to 12.0 MHz linear array transducers were used for examining the vascular systems or musculoskeletal system.
Each US study was the unit analysis. As a first approximation, different studies performed on a single patient were assumed to be uncorrelated. Continuous-type variables in the data were summarized as mean and standard deviation (SD) or median and range as appropriate. Categorical variables were summarized as counts and percentages. Chi-square test or Fishers exact test was used for comparing categorical variables between independent groups. All statistical analyses were performed using the SPSS statistics version 10.0.1. Statistical significance was defined as a two-sided p-value of 0.05 or less.
Results
Three hundred sixty three patients underwent emergency US examinations at the Department of Radiology between March and December 2012. Missing data due to incomplete record from medical charts and medical records, so only 285 patients had sufficient data to make the judgment.
The vast majority of patients in the present study were adults (83%). The median age was 46 years. Male and female patients were equally represented (50% and 50% respectively). The most common anatomical region examined was abdominal (77%). Most of the examinations took place out of hours (67%).
Table 1- 3 present data on characteristics of patients, anatomical regions suspected of harboring disease, and provisional ultrasound, and the final disease categories. Table 4 presents the main outcomes of the present study : agreement, impact and accuracy of US. Factors associated with the impact of US on clinical diagnosis and treatment are given in Table 5.
According to the present study, age, gender, and timing of US had no relationship with the impact of US. There was a significant association between the anatomical region of US examination and impact: there was a greater chance of impact if the region examined was KUB (kidney, ureter and bladder) or if MSK US was performed, and a greater chance of no impact if the region examined was abdominal (upper and whole) (Table 5). US had a greater chance of having an impact if the provisional diagnosis was related to vascular or other (chest, cranial) systems, and less chance of impact for suspected appendicitis or intraabdominal infection and collection. There was also less chance of impact if the US diagnosis was intraabdominal infection or mass.
The impact of US was greater when the final diagnosis was related to vascular problems, skin and soft tissue infections, or biliary obstruction and infection. US was least likely to impact on the final diagnoses of intraabdominal diseases, with the exception of gallstone disease.
Agreement between provisional and US diagnoses had no association with the impact of US. It was to be expected, according to the present definition of impact, that further investigations were associated with less impact. Similarly, it was expected that the more accurate the US examination, the more it would have an impact.
The results of the check on the accuracy of US in diagnosing acute appendicitis and acue cholecystitis were as follows. For acute appendicitis, in 23 patients with available data, the sensitivity was 65.4% (95% CI: 45.6% to 82.1%) and the specificity was 95.4% (95% CI: 84.5% to 99.4%). For acute cholecystitis, in 66 patients with available data, the sensitivity was 86.7% (95% CI: 71.9%to 95.6%) and the specificity was 88.5% (95% CI: 78.7% to 94.9%).
Table 1 Provisional disease categories at presentation (n=285)
Characteristics & diagnoses |
Summary: number(%)
(unless otherwise stated) |
Anatomical area examined using US |
|
Upper abdomen |
123 (43) |
Whole abdomen |
89 (31) |
KUB system |
8 (3) |
Lower abdomen |
8 (3) |
Vascular (Doppler US) |
33 (12) |
Musculoskeletal system |
4 (1) |
Testes |
3 (1) |
Others |
17 (6) |
Disease categories according to provisional diagnoses |
|
KUB disease and condition |
17 (6) |
Cholecystitis |
70 (25) |
Intraabdominal infection or fluid collection |
31 (11) |
Appendicitis and related conditions |
28 (10) |
Vascular problems (aneurysms , DVT , occlusion) |
31 (11) |
Liver disease and condition (tumors and infection) |
12 (4) |
Biliary tract obstruction and/or infection |
14 (5) |
Skin & musculoskeletal system |
10 (3) |
Abdominal pain and/or mass |
36 (13) |
Pancreatic disease (pancreatitis, pseudocyst, tumor) |
13 (4) |
Others |
23 (8) |
US = ultrasongraphy; KUB = kidney, ureter, bladder; DVT = deep vein thrombosis
Table 2 Disease categories according to ultrasound diagnosis (n=285)
Diagnoses |
Summary: number (%) |
Disease categories from ultrasound examination |
|
KUB disease and condition (obstruction, tumor, infection) |
20 (7) |
Gall stones and/or cholecystitis |
70 (25) |
Intraabdominal infection or fluid collection or mass |
41 (15) |
Appendicitis and related conditions |
22 (8) |
Vascular problems (aneurysms, DVT, occlusion) |
20 (7) |
Liver disease and condition (tumors and infection ) |
26 (9) |
Biliary tract obstruction and/or infection |
13 (4) |
Skin & musculoskeletal system |
13 (4) |
Pancreatic disease (pancreatitis, pseudocyst, tumor) |
9 (3) |
Negative findings (none or incidental findings ) |
28 (10) |
Others |
23 (8) |
KUB =kidney, ureter, bladder; DVT = deep vein thrombosis
Table 3 Disease categories according to final diagnosis (n= 285)
Diagnoses |
Summary: number (%) |
Disease categories according to final diagnoses |
|
KUB disease and condition (obstruction, tumor, infection ) |
20 (7) |
Gall stones and/or cholecystitis |
66 (23) |
Intraabdominal infection or fluid collection or cancer |
25 (9) |
GI tract or splenic or other abdominal conditions |
20 (7) |
Appendicitis and related conditions |
23 (8) |
Vascular problems (aneurysms, DVT, occlusion) |
20 (7) |
Liver disease and condition (tumors and infection ) |
27 (10) |
Biliary tract obstruction and/or infection |
16 (6) |
Skin & musculoskeletal system |
13 (4) |
Pancreatic disease (pancreatitis, pseudocyst, tumor) |
14 (5) |
Negative findings (none or incidental findings) |
18 (6) |
Others |
23 (8) |
KUB = kidney, ureter, bladder; DVT = deep vein thrombosis
Table 4 Agreement, impact and accuracy of US, and further investigations
Outcomes and investigations Outcomes of US |
Summary: number (%) |
Agreement between provisional diagnosis and US (n= 275)* |
|
- Confirmation |
253 (92) |
- Exclusion |
12 (4) |
- Exclusion with alternative diagnosis |
10 (4) |
Impact of US (n=267)* |
|
- Impact on either diagnosis or treatment |
249 (93) |
- No impact |
18 (7) |
Diagnostic accuracy of US (n=250)* |
|
- True positive and true negative diagnosis |
225 (90) |
- False positive and false negative diagnosis |
25 (10) |
Further investigations (n=69) |
|
- CT scan |
35 (51) |
- MRI scan |
2 (3) |
- Others (Doppler US, repeat US, BE ,IVP,ERCP) |
32 (46) |
*Include only cases with sufficient information
US = ultrasonography; CT = computerized tomography; MRI = magnetic resonance imaging ; BE = barium enema; IVP = intravenous pyelography
Table 5 Factors associated with the impact of US (n= 285)
Factors
|
Impact (n= 267)
Number (%)
Unless otherwise stated |
No impact (n=18)
Number (%)
Unless otherwise stated |
P-value*
|
Anatomical region |
|
|
|
- Doppler US |
32 (12) |
1 (5) |
0.04 |
- KUB system |
8 (3) |
0 |
|
- Upper abdomen |
118 (44) |
5 (28) |
|
- Lower abdomen |
8 (3) |
0 |
|
- Whole abdomen |
78 (29) |
11 (62) |
|
- MSK system |
4 (2) |
0 |
|
- Testes |
2 (1) |
1 (5) |
|
- Others |
17 (6) |
0 |
|
Provisional diagnosis |
|
|
|
- Appendicitis |
24 (9) |
4 (22) |
0.03 |
- Cholecystitis |
67 (25) |
3 (17) |
|
- KUB diseases |
17 (6) |
0 |
|
- Vascular problems |
30 (11) |
1 (5) |
|
- Liver & pancreatic diseases |
22 (8) |
3 (17) |
|
- Intraabdominal infection & collection |
29 (11) |
2 (12) |
|
- Biliary tract obtstruction & infection |
14 (5) |
0 |
|
- Abdominal pain & mass |
32 (12) |
4 (22) |
|
- Skin & MSK infection & problems |
10 (5) |
0 |
|
- Others |
22 (8) |
1 (5) |
|
Ultrasound diagnosis |
|
|
|
- Negative findings |
23 (9) |
5 (28) |
0.02 |
- Gall stones or cholecystitis |
67 (25) |
3 (17) |
|
- Appendicitis |
21 (8) |
1 (5) |
|
- Intraabdominal infection or mass |
37 (14) |
4 (22) |
|
- Liver & pancreatic problems |
33 (12) |
2 (12) |
|
- Biliary tract obstruction & infection |
13 (5) |
0 |
|
- KUB disease |
18 (7) |
2 (12) |
|
- Vascular problems |
20 (7) |
0 |
|
- Skin & MSK infection & problems |
13 (5) |
0 |
|
- Others |
22 (8) |
1 (5) |
|
Final diagnosis |
|
|
|
- Negative |
17 (6) |
1 (5) |
<0.001 |
- Gall stone or cholecystitis |
64 (24) |
2 (12) |
|
- Appendicitis |
21 (8) |
2 (12) |
|
- Intraabdominal infection or cancer |
24 (9) |
1 (5) |
|
- GI, splenic & abdominal problems |
16 (6) |
4 (22) |
|
- Liver & pancreatic problems |
37 (14) |
4 (22) |
|
- Bilary tract obstruction & infection |
16 (6) |
0 |
|
- KUB disease |
18 (7) |
2 (12) |
|
- Vascular problems |
19 (7) |
1 (5) |
|
- Skin & MSK problems |
13 (5) |
0 |
|
- Others |
22 (8) |
1 (5) |
|
Further investigations |
|
|
|
- Yes |
60 (50) |
9 (4) |
<0.001 |
Accuracy of US |
|
|
|
- Accurate |
215 (95) |
10 (40) |
<0.001 |
US = ultrasongraphy; KUB = kidney, ureter, bladder; MSK = musculosketal;GI = gastrointestinal *Chi-Square test p-values
Discussion
A study of the impact of a radiologic test on the clinicians decision to perform further diagnostic procedures or to treat patients is best done by directly eliciting the clinicians opinion at the appropriate time. Therefore, any indirect measure of impact will necessarily be limited by the unknown validity of that measure. Nonetheless, a recent study which directly assessed the impact of US by means of a questionnaire filled in by clinicians before and after abdominal US8 found similar results to another study which indirectly measured the impact of abdominal US by using the criteria of high concordance between postimaging and the discharge diagnoses9.
The accuracy of US in the diagnosis of certain common conditions, such as acute appendicitis and acute cholecystitis, was consistent with that of previous studies. For example, the sensitivity of the US in acute appendicitis ranged from 80 to 88.5% and specificity range from 95 to 98%10-12. The sensitivity and specificity in the diagnosis of acute cholecystitis were 81 to 100% and 60 to 100%, respectively13. The overall accuracy of US in the present study was also reasonable (90%; Table 4). This was encouraging because it could be claimed that the impact of US was determined in the setting of competent US use.
The measures of impact on clinical management in the present study were consistent with the criteria of construct validity14. It seemed reasonable to expect that US should have a larger impact for problems specifically relate to vascular or other (chest, cranial) systems, compared to suspected abdominal abscess. Although the absolute measures of impact (94% impact) would very likely depend on the definitions used, qualitatively the findings in the present study seemed reasonable. For example, the apparently large impact of US on clinical practice was consistent with the ever-increasing use of US (otherwise, the use should decrease).
The use of emergency US in the present institution seemed to have a large impact (94%) on clinical practice, comparable to the impact of US on 80.9% of the discharge diagnoses as reported by Siegel et al9. Suspected abdominal abscess (as a provisional diagnosis) was related to lower US impact (Table 5) possibly because some of these cases would proceed to CT scans. Similarly, the US findings of abdominal masses had less impact because a CT scan would be performed subsequently. Management of suspected acute appendicitis was influenced more by clinical rather than radiologic findings, also leading to a lower US impact. Conversely, KUB (kidney-ureter-bladder), vascular, musculoskeletal problems and regions were associated with higher impact, because US was a sufficiently accurate diagnostic procedure for these systems, especially for ruling out diseases. The fact that the final diagnosis of negative findings was also associated with higher US impact, because the clinicians felt that US could confidently rule out certain diseases, seemed to confirm this.
The use of US in the emergency setting is still necessary and will continue to have an impact on clinical practice. Similarly, to confirm the high prevalence of US impact, a study directly eliciting the impressions of emergency department physicians concerning the clinical impact of emergency US should be performed in the future.
Conclusion
The use of emergency US at a tertiary care hospital seemed to have a high impact. The accuracy of US in the emergency setting was good. Impact on clinical management was most likely when US was performed for suspected vascular, KUB and musculoskeletal problems. Further refinement in the use of emergency US to improve efficiency is still possible, especially for patients with abdominal conditions.
References
1. Durston W, Carl ML, Guerra W. Patient satisfaction and diagnostic accuracy with ultrasound by emergency physicians. Am J Emerg Med 1999; 17: 642-6.
2. Schlager D, Lazzareschi G, Whitten D, Sanders AB. A prospective study in ED by emergency physicians. Am J Emerg Med 1994; 12: 185-9.
3. De Manzoni G, Furlan F, Guglielmi A, Brunelli G, Laterza E, Ricci F, et al. Acute cholecystitis; ultrasonographic staging and percutaneous cholecystostomy. Eur J 1992; 15: 175-9.
4. Soiva M, Haveri M, Taavitsainen M, Suramo I. The value of routine sonography in clinically suspected acute cholecystitis. Scand J Gastroenterol 1986; 21: 70-4.
5. Middleton WD, Dodds WJ, Lawson TL, Foley WD. Renal calculi: sensitivity for detection with US. Radiology 1988; 167: 239-44.
6. Labropoulos N, Leon M, Kalodiki E, al Kutoubi A, Chan P, Nicolaides AN. Colour flow duplex scanning in suspected acute deep vein thrombosis; experience with routine use. Eur J Vasc Endovasc Surg 1995; 9: 49-52.
7. Kessler N, Cyteval C, Gallix B, Lesnik A, Blayac PM, Pujol J, et al. Appendicitis: evaluation of sensitivity, specificity, and predictive values of US, Doppler US and laboratory findings. Radiology 2004; 230: 472-8.
8. Speets AM, Hoes AW, van der GY, Kalmijn S, de Wit NJ, van Swijndregt AD, et al. Upper abdominal ultrasound in general practice: indications, diagnostic yield and consequences for patient management. Fam Pract 2006; 23: 507-11.
9. Siegel Y, Grubstein A, Postnikov V, Morech O, Yussim E, Cohen M. Ultrasonography in patients without trauma in the emergency department: impact on discharge diagnosis. J Ultrasound Med 2005; 24: 1371-6.
10. Puylaert JB. Acute appendicitis: US evaluation using graded compression. Radiology 1986; 158: 355-60.
11. Schwerk WB, Wichtrup B, Rothmund M, Ruschoff J. Ultrasonography in the diagnosis of acute appendicitis: a prospective study. Gastroenterology 1989; 97: 630-9.
12. Fa EM, Cronan JJ. Compression ultrasonography as an aid in the differential diagnosis of appendicitis. Surg Gynecol Obstet 1989; 169: 290-8.
13. Rosen CL, Brown DF, Chang Y, Moore C, Averill NJ, Arkoff LJ, et al. Ultrasonography by emergency physicians in patients with suspected cholecystitis. Am J Emerg Med 2001; 19: 32-6.
14. Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 4th ed. Oxford: Oxford University Press; 2008:10-1.
|