Iranian Journal of Radiology

Published by: Kowsar

Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)

Youn Joo Lee 1 , So Young Choi 2 , Kyu Sun Kim 2 and Po Song Yang 1 , *
Authors Information
1 Department of Radiology, Daejeon St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Daejeon, Republic of Korea
2 Department of Radiology, Eulji University Hospital, Daejeon, Republic of Korea
Article information
  • Iranian Journal of Radiology: July 01, 2016, 13 (3); e28281
  • Published Online: January 9, 2016
  • Article Type: Research Article
  • Received: May 26, 2015
  • Revised: September 7, 2015
  • Accepted: October 14, 2015
  • DOI: 10.5812/iranjradiol.28281

To Cite: Lee Y J, Choi S Y, Kim K S, Yang P S. Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013), Iran J Radiol. 2016 ; 13(3):e28281. doi: 10.5812/iranjradiol.28281.

Copyright © 2016, Tehran University of Medical Sciences and Iranian Society of Radiology. This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License ( which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.
1. Background
2. Objectives
3. Patients and Methods
4. Results
5. Discussion
  • 1. Mendelson EB, Berg WA, Merritt CR. Toward a standardized breast ultrasound lexicon, BI-RADS: ultrasound. Semin Roentgenol. 2001; 36(3): 217-25[PubMed]
  • 2. Arger PH, Sehgal CM, Conant EF, Zuckerman J, Rowling SE, Patton JA. Interreader variability and predictive value of US descriptions of solid breast masses: pilot study. Acad Radiol. 2001; 8(4): 335-42[DOI][PubMed]
  • 3. Heinig J, Witteler R, Schmitz R, Kiesel L, Steinhard J. Accuracy of classification of breast ultrasound findings based on criteria used for BI-RADS. Ultrasound Obstet Gynecol. 2008; 32(4): 573-8[DOI][PubMed]
  • 4. Kim EK, Ko KH, Oh KK, Kwak JY, You JK, Kim MJ, et al. Clinical application of the BI-RADS final assessment to breast sonography in conjunction with mammography. AJR Am J Roentgenol. 2008; 190(5): 1209-15[DOI][PubMed]
  • 5. American College of Radiology. . Breast imaging reporting and data system, Breast imaging atlas. 2003;
  • 6. Hong AS, Rosen EL, Soo MS, Baker JA. BI-RADS for sonography: positive and negative predictive values of sonographic features. AJR Am J Roentgenol. 2005; 184(4): 1260-5[DOI][PubMed]
  • 7. Elverici E, Zengin B, Nurdan Barca A, Didem Yilmaz P, Alimli A, Araz L. Interobserver and Intraobserver Agreement of Sonographic BIRADS Lexicon in the Assessment of Breast Masses. Iran J Radiol. 2013; 10(3): 122-7[DOI][PubMed]
  • 8. Berg WA, Blume JD, Cormack JB, Mendelson EB. Operator dependence of physician-performed whole-breast US: lesion detection and characterization. Radiology. 2006; 241(2): 355-65[DOI][PubMed]
  • 9. Baker JA, Kornguth PJ, Soo MS, Walsh R, Mengoni P. Sonography of solid breast lesions: observer variability of lesion description and assessment. AJR Am J Roentgenol. 1999; 172(6): 1621-5[DOI][PubMed]
  • 10. Lee HJ, Kim EK, Kim MJ, Youk JH, Lee JY, Kang DR, et al. Observer variability of Breast Imaging Reporting and Data System (BI-RADS) for breast ultrasound. Eur J Radiol. 2008; 65(2): 293-8[DOI][PubMed]
  • 11. Park CS, Lee JH, Yim HW, Kang BJ, Kim HS, Jung JI, et al. Observer agreement using the ACR Breast Imaging Reporting and Data System (BI-RADS)-ultrasound, First Edition (2003). Korean J Radiol. 2007; 8(5): 397-402[PubMed]
  • 12. Calas MJ, Almeida RM, Gutfilen B, Pereira WC. Interobserver concordance in the BI-RADS classification of breast ultrasound exams. Clinics (Sao Paulo). 2012; 67(2): 185-9[PubMed]
  • 13. American College of Radiology. . Breast imaging reporting and data system, Breast imaging atlas. 2013;
  • 14. Raza S, Goldkamp AL, Chikarmane SA, Birdwell RL. US of breast masses categorized as BI-RADS 3, 4, and 5: pictorial review of factors influencing clinical management. Radiographics. 2010; 30(5): 1199-213[DOI][PubMed]
  • 15. Sedgwick E. The breast ultrasound lexicon: breast imaging reporting and data system (BI-RADS). Semin Roentgenol. 2011; 46(4): 245-51[DOI][PubMed]
  • 16. Costantini M, Belli P, Lombardi R, Franceschini G, Mule A, Bonomo L. Characterization of solid breast masses: use of the sonographic breast imaging reporting and data system lexicon. J Ultrasound Med. 2006; 25(5): 649-59[PubMed]
  • 17. Carney E, Kempf J, DeCarvalho V, Yudd A, Nosher J. Preliminary interpretations of after-hours CT and sonography by radiology residents versus final interpretations by body imaging radiologists at a level 1 trauma center. AJR Am J Roentgenol. 2003; 181(2): 367-73[DOI][PubMed]
  • 18. Bechtold RE, Chen MY, Ott DJ, Zagoria RJ, Scharling ES, Wolfman NT, et al. Interpretation of abdominal CT: analysis of errors and their causes. J Comput Assist Tomogr. 1997; 21(5): 681-5[PubMed]
  • 19. Erly WK, Berger WG, Krupinski E, Seeger JF, Guisto JA. Radiology resident evaluation of head CT scan orders in the emergency department. AJNR Am J Neuroradiol. 2002; 23(1): 103-7[PubMed]
  • 20. Yoon LS, Haims AH, Brink JA, Rabinovici R, Forman HP. Evaluation of an emergency radiology quality assurance program at a level I trauma center: abdominal and pelvic CT studies. Radiology. 2002; 224(1): 42-6[DOI][PubMed]
  • 21. Albano MC, Ross GW, Ditchek JJ, Duke GL, Teeger S, Sostman HD, et al. Resident interpretation of emergency CT scans in the evaluation of acute appendicitis. Acad Radiol. 2001; 8(9): 915-8[PubMed]
  • 22. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982; 143(1): 29-36[DOI][PubMed]
  • 23. Park SH, Goo JM, Jo CH. Receiver operating characteristic (ROC) curve: practical review for radiologists. Korean J Radiol. 2004; 5(1): 11-8[PubMed]
  • 24. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33(1): 159-74[PubMed]
  • 25. Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005; 37(5): 360-3[PubMed]
  • 26. Filippi CG, Schneider B, Burbank HN, Alsofrom GF, Linnell G, Ratkovits B. Discrepancy rates of radiology resident interpretations of on-call neuroradiology MR imaging studies. Radiology. 2008; 249(3): 972-9[DOI][PubMed]
  • 27. Wysoki MG, Nassar CJ, Koenigsberg RA, Novelline RA, Faro SH, Faerber EN. Head trauma: CT scan interpretation by radiology residents versus staff radiologists. Radiology. 1998; 208(1): 125-8[DOI][PubMed]
  • 28. Yavas US, Calisir C, Ozkan IR. The interobserver agreement between residents and experienced radiologists for detecting pulmonary embolism and DVT with using CT pulmonary angiography and indirect CT venography. Korean J Radiol. 2008; 9(6): 498-502[DOI][PubMed]
  • 29. Abdullah N, Mesurolle B, El-Khoury M, Kao E. Breast imaging reporting and data system lexicon for US: interobserver agreement for assessment of breast masses. Radiology. 2009; 252(3): 665-72[DOI][PubMed]
  • 30. Rahbar G, Sie AC, Hansen GC, Prince JS, Melany ML, Reynolds HE, et al. Benign versus malignant solid breast masses: US differentiation. Radiology. 1999; 213(3): 889-94[DOI][PubMed]
  • 31. Stavros AT, Thickman D, Rapp CL, Dennis MA, Parker SH, Sisney GA. Solid breast nodules: use of sonography to distinguish between benign and malignant lesions. Radiology. 1995; 196(1): 123-34[DOI][PubMed]
  • 32. Harper AP, Kelly-Fry E, Noe JS, Bies JR, Jackson VP. Ultrasound in the evaluation of solid breast masses. Radiology. 1983; 146(3): 731-6[DOI][PubMed]
  • 33. Heywang SH, Lipsit ER, Glassman LM, Thomas MA. Specificity of ultrasonography in the diagnosis of benign breast masses. J Ultrasound Med. 1984; 3(10): 453-61[PubMed]
  • 34. Lazarus E, Mainiero MB, Schepps B, Koelliker SL, Livingston LS. BI-RADS lexicon for US and mammography: interobserver variability and positive predictive value. Radiology. 2006; 239(2): 385-91[DOI][PubMed]
Creative Commons License Except where otherwise noted, this work is licensed under Creative Commons Attribution Non Commercial 4.0 International License .

Search Relations:



Create Citiation Alert
via Google Reader

Readers' Comments