Characterizing search, recognition, and decision in the detection of lung nodules on CT scans: elucidation with eye tracking
- PMID: 25325324
- DOI: 10.1148/radiol.14132918
Characterizing search, recognition, and decision in the detection of lung nodules on CT scans: elucidation with eye tracking
Abstract
Purpose: To determine the effectiveness of radiologists' search, recognition, and acceptance of lung nodules on computed tomographic (CT) images by using eye tracking.
Materials and methods: This study was performed with a protocol approved by the institutional review board. All study subjects provided informed consent, and all private health information was protected in accordance with HIPAA. A remote eye tracker was used to record time-varying gaze paths while 13 radiologists interpreted 40 lung CT images with an average of 3.9 synthetic nodules (5-mm diameter) embedded randomly in the lung parenchyma. The radiologists' gaze volumes ( GV gaze volume s) were defined as the portion of the lung parenchyma within 50 pixels (approximately 3 cm) of all gaze points. The fraction of the total lung volume encompassed within the GV gaze volume s, the fraction of lung nodules encompassed within each GV gaze volume (search effectiveness), the fraction of lung nodules within the GV gaze volume detected by the reader (recognition-acceptance effectiveness), and overall sensitivity of lung nodule detection were measured.
Results: Detected nodules were within 50 pixels of the nearest gaze point for 990 of 992 correct detections. On average, radiologists searched 26.7% of the lung parenchyma in 3 minutes and 16 seconds and encompassed between 86 and 143 of 157 nodules within their GV gaze volume s. Once encompassed within their GV gaze volume , the average sensitivity of nodule recognition and acceptance ranged from 47 of 100 nodules to 103 of 124 nodules (sensitivity, 0.47-0.82). Overall sensitivity ranged from 47 to 114 of 157 nodules (sensitivity, 0.30-0.73) and showed moderate correlation (r = 0.62, P = .02) with the fraction of lung volume searched.
Conclusion: Relationships between reader search, recognition and acceptance, and overall lung nodule detection rate can be studied with eye tracking. Radiologists appear to actively search less than half of the lung parenchyma, with substantial interreader variation in volume searched, fraction of nodules included within the search volume, sensitivity for nodules within the search volume, and overall detection rate.
Similar articles
-
Variations in the functional visual field for detection of lung nodules on chest computed tomography: Impact of nodule size, distance, and local lung complexity.Med Phys. 2017 Jul;44(7):3483-3490. doi: 10.1002/mp.12277. Epub 2017 May 23. Med Phys. 2017. PMID: 28419484
-
Evaluation of computer-aided diagnosis (CAD) software for the detection of lung nodules on multidetector row computed tomography (MDCT): JAFROC study for the improvement in radiologists' diagnostic accuracy.Acad Radiol. 2008 Dec;15(12):1505-12. doi: 10.1016/j.acra.2008.06.009. Acad Radiol. 2008. PMID: 19000867
-
Lung nodule and cancer detection in computed tomography screening.J Thorac Imaging. 2015 Mar;30(2):130-8. doi: 10.1097/RTI.0000000000000140. J Thorac Imaging. 2015. PMID: 25658477 Free PMC article. Review.
-
Small pulmonary nodules: effect of two computer-aided detection systems on radiologist performance.Radiology. 2006 Nov;241(2):564-71. doi: 10.1148/radiol.2412051139. Radiology. 2006. PMID: 17057074
-
Follow-up of small (4 mm or less) incidentally detected nodules by computed tomography in oncology patients: a retrospective review.J Thorac Oncol. 2010 Dec;5(12):1958-62. doi: 10.1097/JTO.0b013e3181f2636e. J Thorac Oncol. 2010. PMID: 20978449 Review.
Cited by
-
Targeted Training Reduces Search Errors but Not Classification Errors for Hepatic Metastasis Detection at Contrast-Enhanced CT.Acad Radiol. 2024 Feb;31(2):448-456. doi: 10.1016/j.acra.2023.06.017. Epub 2023 Aug 9. Acad Radiol. 2024. PMID: 37567818
-
The Influence of Experience on Gazing Patterns during Endovascular Treatment: Eye-Tracking Study.J Neuroendovasc Ther. 2022;16(6):294-300. doi: 10.5797/jnet.oa.2021-0053. Epub 2021 Oct 8. J Neuroendovasc Ther. 2022. PMID: 37501896 Free PMC article.
-
A 2D Synthesized Image Improves the 3D Search for Foveated Visual Systems.IEEE Trans Med Imaging. 2023 Aug;42(8):2176-2188. doi: 10.1109/TMI.2023.3246005. Epub 2023 Aug 1. IEEE Trans Med Imaging. 2023. PMID: 37027767 Free PMC article.
-
Multiple expressions of "expert" abnormality gist in novices following perceptual learning.Cogn Res Princ Implic. 2023 Feb 1;8(1):10. doi: 10.1186/s41235-023-00462-5. Cogn Res Princ Implic. 2023. PMID: 36723822 Free PMC article.
-
Changes in Radiologists' Gaze Patterns Against Lung X-rays with Different Abnormalities: a Randomized Experiment.J Digit Imaging. 2023 Jun;36(3):767-775. doi: 10.1007/s10278-022-00760-2. Epub 2023 Jan 9. J Digit Imaging. 2023. PMID: 36622464 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Medical