Skip to main content

Table 2 Diagnostic testing accuracies

From: Validating the accuracy of deep learning for the diagnosis of pneumonia on chest x-ray against a robust multimodal reference diagnosis: a post hoc analysis of two prospective studies

 

Accuracy

Sensitivity

Specificity

PPV

NPV

LR + 

LR-

DOR

PneumOld-CT cohort

 Clinicians (CXR)

64.0% (57.1–70.3)

76.7% (68.8–83.1)

38.8% (28.0–50.8)

71.3% (63.4–78.1)

45.6% (33.4–58.4)

1.253 (0.956–1.688)

0.601 (0.334–1.112)

2.087

 Radiol. 1 (CXR)

75.5% (69.1–80.9)

69.9% (61.7–77.1)

86.6% (76.4–92.8)

91.2% (84.1–95.3)

59.2% (49.3–68.4)

5.206 (2.613–10.658)

0.347 (0.247–0.502)

14.983

 Radiol. 2 (CXR)

71.0% (64.4–76.8)

67.7% (59.3–75.0)

77.6% (66.3–85.9)

85.7% (77.8–91.1)

54.7% (44.7–64.4)

3.023 (1.760–5.335)

0.417 (0.291–0.614)

7.256

 AI (CXR)

71.0% (64.4–76.8)

74.4% (66.4–81.1)

64.2% (52.2–74.6)

80.5% (72.6–86.5)

55.8% (44.7–66.4)

2.078 (1.390–3.193)

0.398 (0.253–0.643)

5.217

 LDCT

79.0% (72.8–84.1)

72.9% (64.8–79.8)

91.0% (81.8–95.8)

94.2% (87.9–97.3)

62.9% (53.0–71.8)

8.144 (3.563–19.131)

0.297 (0.211–0.430)

27.394

PACSCAN cohort

 Clinicians (CXR)

63.0% (56.6–69.0)

61.4% (53.2–69.1)

65.6% (55.3–74.6)

73.5% (64.9–80.7)

52.2% (43.1–61.2)

1.783 (1.189–2.715)

0.588 (0.415–0.847)

3.031

 Radiol. (CXR)

70.9% (64.7–76.4)

67.9% (59.7–75.0)

75.6% (65.8–83.3)

81.2% (73.2–87.2)

60.2% (51.0–68.7)

2.776 (1.744–4.484)

0.425 (0.300–0.612)

6.525

 AI (CXR)

72.6% (66.5–78.0)

72.1% (64.2–78.9)

73.3% (63.4–81.4)

80.8% (73.0–86.7)

62.9% (53.3–71.5)

2.705 (1.753–4.237)

0.380 (0.259–0.565)

7.122

 CT (LDCT/full–dose)

89.6% (84.9–92.9)

87.1% (80.6–91.7)

93.3% (86.2–96.9)

95.3% (90.2–97.8)

82.4% (73.8–88.5)

13.071 (5.844–29.67)

0.138 (0.086–0.225)

94.889

  1. Results are reported in percent along with their 95% confidence intervals. The radiologists in both cohorts are senior radiologists specialized in thoracic imaging. AI, Artificial intelligence; CT, Computed tomography; CXR, Chest-x-ray; LDCT, Low-dose computed tomography; LR + , Positive likelihood ratio; LR-, Negative likelihood ratio; DOR, Diagnostic odd radio; PPV, Positive predicting value; NPV, Negative predicting value; Radiol., Radiologist; ROC-AUC, Area under the receiver operating characteristic curve