Table 4 Stratified performance metrics of the ALK fusion prediction model on the test and holdout sets

From: Predicting ROS1 and ALK fusions in NSCLC from H&E slides with a two-step vision transformer approach

 

Test

Holdout

 

AUC

Acc

PPA

PPV

F1

NPA

AUC

Acc

PPA

PPV

F1

NPA

ALL

0.85

0.90

0.59

0.12

0.20

0.91

0.84

0.90

0.54

0.11

0.19

0.91

Bx

0.85

0.90

0.56

0.11

0.19

0.91

0.84

0.90

0.50

0.10

0.16

0.91

Rx

0.86

0.91

0.64

0.14

0.23

0.91

0.85

0.90

0.60

0.14

0.23

0.90

  1. Results are reported for all cases (ALL), biopsy samples (Bx), and resection samples (Rx). Metrics include area under the ROC curve (AUC), accuracy (Acc), positive percent agreement (PPA), positive predictive value (PPV), F1-score (F1), and negative percent agreement (NPA). Values represent the average performance across five cross-validation folds. A positive class weight factor of 5 was used in the loss function.
  2. Bx biopsy, Rx resection.