Effect of training on resident inter-reader agreement with American College of Radiology Thyroid Imaging Reporting and Data System

Table 6 The relative sensitivity, specificity, positive predictive value, and negative predictive value per Thyroid Imaging Reporting and Data System Level on the post-training assessment compared to the reference standard

Post-training, Statistics	TI-RADS 1, %	TI-RADS 2, %	TI-RADS 3, %	TI-RADS 4, %	TI-RADS 5, %
Sensitivity
R1	45.5 (16.8-76.6)	44.4 (13.7-78.8)	55.6 (21.2-86.3)	38.5 (13.9-68.4)	50 (15.7-84.3)
R2	63.6 (30.8-89.1)	44.4 (13.7-78.8)	66.7 (29.9-92.5)	69.2 (38.6-90.9)	62.5 (24.5-91.5)
R3	72.7 (39-94)	33.3 (7.5-70.1)	66.7 (29.9-92.5)	38.5 (13.9-68.4)	37.5 (8.5-75.5)
Pooled	60.6 (42.1-77.1)	40.7 (22.4-61.2)	63 (42.4-80.6)	48.7 (32.4-65.2)	50 (29.1-70.9)
Specificity
R1	92.3 (79.1-98.4)	97.6 (87.1-99.9)	90.2 (76.9-97.3)	70.3 (53-84.1)	81 (65.9-91.4)
R2	94.9 (82.7-99.4)	97.6 (87.1-99.9)	95.1 (83.5-99.4)	73 (38.6-90.9)	90.5 (77.4-97.3)
R3	66.7 (49.8-80.9)	95.1 (83.5-99.4)	97.6 (87.1-99.9)	86.5 (71.2-95.5)	90.5 (77.4-97.3)
Pooled	84.6 (76.8-90.6)	96.8 (91.9-99.1)	94.3 (88.6-97.7)	76.6 (67.6-84.1)	87.3 (80.2-92.6)
Positive predictive value
R1	62.5 (32-85.5)	80 (33.6-96.9)	55.6 (29.4-79)	31.3 (16.3-51.5)	33.3 (16.5-56)
R2	77.8 (45.8-93.6)	80 (33.6-96.9)	75 (41.8-92.6)	47.4 (32.2-63.1)	55.6 (29.9-78.6)
R3	38.1 (25.8-52.2)	60 (22.6-88.5)	85.7 (45.1-97.8)	50 (25.6-74.4)	42.9 (17.1-73.2)
Pooled	52.6 (40.1-64.8)	73.3 (48.6-88.9)	70.8 (52.8-84.1)	42.2 (31.5-53.8)	42.9 (29-57.9)
Negative predictive value
R1	85.7 (77.6-91.2)	88.9 (81.7-93.5)	90.2 (81.6-95.1)	76.5 (66.8-84)	89.5 (80.7-94.5)
R2	90.2 (80.8-95.3)	88.9 (81.7-93.5)	92.9 (83.7-97)	87.1 (74.5-94)	92.7 (83.7-96.9)
R3	89.7 (76.3-95.9)	86.7 (80.3-91.2)	93 (84.1-97.1)	80 (71.9-86.2)	88.4 (81.5-92.9)
Pooled	88.4 (83.2-92.1)	88.2 (84.5-91.1)	92.1 (87.6-95)	81 (75.5-85.4)	90.2 (85.9-93.2)

TI-RADS: Thyroid Imaging Reporting and Data System; RS: Reference standard; R1: Reader 1; R2: Reader 2; R3: Reader 3.