Fig. 5: Our model extraction framework demonstrates advantages in performance and bias mitigation.
a The comparison of our methods with linear regression and BERT on the synthetic test set. Results show that our methods can achieve the lowest error rate. b BERT model performance on original and racial bias datasets. c Our model performance on original and racial bias datasets. d A study on the performance degradation of the model on racial bias and gender bias datasets shows a significant performance decline of the supervised model, as indicated by the Wilcoxon test (p = 4.5e−3). e A study on the performance degradation of the model on dependency error datasets shows a significant performance decline of the supervised model.
