Copyright
©The Author(s) 2022.
World J Radiol. Sep 28, 2022; 14(9): 319-328
Published online Sep 28, 2022. doi: 10.4329/wjr.v14.i9.319
Published online Sep 28, 2022. doi: 10.4329/wjr.v14.i9.319
Table 1 Sensitivity, specificity, positive predictive value and negative predictive value per ovarian-adnexal reporting and data system category for each reader on the pre-training assessment
| Pre training | ORADS 1, % | ORADS 2, % | ORADS 3, % | ORADS 4, % | ORADS 5, % |
| Sensitivity | |||||
| R1 | 90 (55.5 to 99.8) | 100 (69.5 to 100) | 100 (59.0 to 100) | 92 (61.5 to 99.8) | 55 (23.4 to 83.3) |
| R2 | 90% (55.5 to 99.8) | 100% (69.2 to 100) | 71 (29.0 to 96.3) | 92 (61.5 to 99.8) | 82 (48.2 to 97.7) |
| R3 | 90 (55.5 to 99.8) | 100 (69.2 to 100) | 100 (59.0 to 100) | 75 (42.8 to 94.5) | 55 (23.4 to 83.3) |
| Specificity | |||||
| R1 | 100 (91.2 to 100) | 85 (70.2 to 94.3) | 98 (87.7 to 99.4) | 100 (90.8 to 100) | 100 (91.0 to 100) |
| R2 | 100 (91.2 to 100) | 90 (76.3 to 97.2) | 98 (87.7 to 99.4) | 97 (86.2 to 99.9) | 100 (91.0 to 100) |
| R3 | 98 (86.8 to 99.9) | 90 (76.3 to 97.2) | 95 (84.2 to 99.4) | 95 (82.3 to 99.4) | 100 (91.0 to 100) |
| PPV | |||||
| R1 | 100 | 63 (44.4 to 77.7) | 88 (50.2 to 98.0) | 100 | 100 |
| R2 | 100 | 71 (49.7 to 86.4) | 83 (40.5 to 97.4) | 92 (61.2 to 98.7) | 100 |
| R3 | 90 (56.2 to 98.4) | 71 (49.7 to 86.4) | 78 (47.5 to 93.1) | 82 (52.9 to 94.8) | 100 |
| NPV | |||||
| R1 | 98 (86.2 to 99.6) | 100 | 100 | 97 (85.3 to 99.6) | 89 (80.3 to 93.7) |
| R2 | 98 (86.2 to 99.6) | 100 | 96 (86.7 to 98.6) | 97 (85.0 to 99.6) | 95 (84.8 to 98.6) |
| R3 | 98 (85.9 to 99.6) | 100 | 100 | 93 (81.8 to 97.0) | 89 (80.3 to 93.7) |
Table 2 The sensitivity, specificity, positive predictive value and negative predictive value per Ovarian-Adnexal Reporting and Data System category for each reader on the post-training assessment
| Post training | ORADS 1, % | ORADS 2, % | ORADS 3, % | ORADS 4, % | ORADS 5, % |
| Sensitivity | |||||
| R1 | 100 (69.2 to 100) | 100 (69.2 to 100) | 100 (59 to 100) | 92 (61.5 to 99.8) | 73 (39 to 94) |
| R2 | 90 (55.5 to 99.8) | 90 (55.5 to 99.8) | 86 (42.1 to 99.6) | 92 (61.5 to 99.8) | 82 (48.2 to 97.7) |
| R3 | 100 (69.2 to 100) | 100 (69.2 to 100) | 100 (59 to 100) | 75 (42.8 to 94.5) | 64 (30.8 to 89.1) |
| Specificity | |||||
| R1 | 100 (91.2 to 100) | 95 (83.1 to 99.4) | 98 (87.7 to 99.9) | 97 (86.2 to 99.9) | 100 (91 to 100) |
| R2 | 100 (91.2 to 100) | 98 (86.8 to 99.9) | 93 (80.9 to 98.5) | 95 (82.3 to 99.4) | 100 (91 to 100) |
| R3 | 100 (91.2 to 100) | 95 (83.1 to 99.4) | 91 (77.9 to 97.4) | 97 (86.2 to 99.9) | 100 (91 to 100) |
| PPV | |||||
| R1 | 100 | 83 (56.4 to 95.1) | 88 (50.2 to 98) | 92 (61.2 to 98.7) | 100 |
| R2 | 100 | 90 (56.2 to 98.4) | 67 (39.2 to 86.1) | 85 (58.5 to 95.5) | 100 |
| R3 | 100 | 83 (56.4 to 95.1) | 64 (40.8 to 81.7) | 90 (55.9 to 98.5) | 100 |
| NPV | |||||
| R1 | 100 | 100 | 100 | 97 (85 to 99.6) | 93 (83.2 to 97.2) |
| R2 | 98 (86.2 to 99.6) | 98 (85.9 to 99.6) | 98 (86.7 to 99.6) | 97 (84.6 to 99.6) | 95 (84.8 to 98.6) |
| R3 | 100 | 100 | 100 | 93 (82.2 to 97.1) | 91 (81.7 to 95.5) |
Table 3 Misclassified ovarian-adnexal reporting and data system categories by readers in pre-training and post-training assessment
| ORADS category | Reference standard lexicon descriptor | Misclassification category | Reader lexicon descriptor | Frequency of error in pre-training | Frequency of error in post-training |
| ORADS 1 | Follicle defined as a simple cyst ≤ 3 cm | ORADS 2 | Follicle defined as a simple cyst ≤ 3 cm | 1 | 1 |
| Follicle defined as a simple cyst ≤ 3 cm | ORADS 2 | Simple cyst > 5 cm but < 10 cm | 1 | 0 | |
| Follicle defined as a simple cyst ≤ 3 cm | ORADS 3 | Multilocular cyst with smooth inner walls/septations < 10 cm, CS1-3 | 1 | 0 | |
| ORADS 2 | simple cyst > 3 cm to 5 cm | ORADS 3 | Unilocular cyst with irregular inner wall < 3mm height, any size | 0 | 1 |
| ORADS 3 | Multilocular cyst with smooth inner walls/septations, < 10 cm, CS1-3 | ORADS 2 | Simple cyst > 5 cm but < 10 cm | 1 | 0 |
| Multilocular cyst with smooth inner walls/septations, < 10 cm, CS1-3 | ORADS 4 | Multilocular cyst, irregular inner wall ± irregular septation | 0 | 1 | |
| Unilocular cyst (simple or non-simple) ≥ 10 cm | ORADS 4 | Unilocular cyst with 1-3 papillary projections | 1 | 0 | |
| ORADS 4 | Multilocular cyst, irregular inner wall ± irregular septation | ORADS 1 | Follicle defined as a simple cyst ≤ 3 cm | 1 | 0 |
| Multilocular cyst, irregular inner wall ± irregular septation | ORADS 2 | Classic benign lesion (hemorrhagic cyst < 10 cm) | 1 | 0 | |
| Multilocular cyst, irregular inner wall ± irregular septation | ORADS 3 | Typical dermoid cyst, endometrioma, hemorrhagic cyst ≥ 10 cm | 0 | 1 | |
| Multilocular cyst, irregular inner wall ± irregular septation | ORADS 3 | Multilocular cyst with smooth inner walls/septations < 10 cm, CS1-3 | 3 | 4 | |
| ORADS 5 | Solid lesion with irregular outer contour | ORADS 2 | Classic benign lesion (dermoid cyst < 10 cm) | 10 | 4 |
| Solid lesion with irregular outer contour | ORADS 3 | Solid lesion with smooth outer contour, any size, CS = 1 | 0 | 1 | |
| Solid lesion with irregular outer contour | ORADS 3 | Typical dermoid cyst, endometrioma, hemorrhagic cyst ≥ 10 cm | 0 | 1 | |
| Solid lesion with irregular outer contour | ORADS 4 | Unilocular cyst with solid component | 1 | 1 | |
| Solid lesion with irregular outer contour | ORADS 4 | Solid lesion with smooth outer contour, any size, CS = 2-3 | 0 | 2 | |
| Multilocular cyst with solid component, CS3-4 | ORADS 4 | Multilocular cyst with solid component, CS1-2 | 1 | 0 |
- Citation: Katlariwala P, Wilson MP, Pi Y, Chahal BS, Croutze R, Patel D, Patel V, Low G. Reliability of ultrasound ovarian-adnexal reporting and data system amongst less experienced readers before and after training. World J Radiol 2022; 14(9): 319-328
- URL: https://www.wjgnet.com/1949-8470/full/v14/i9/319.htm
- DOI: https://dx.doi.org/10.4329/wjr.v14.i9.319