Table 1 Performance of different backbones before and after applying various methods on COCO.
Backbone | Method | mAP | R@K | AUROC | |||||
|---|---|---|---|---|---|---|---|---|---|
All | Known | Unknown | Large | Medium | Small | All | All | ||
MoCo57 | Baseline | 26.05 | 24.04 | 31.61 | 34.01 | 23.35 | 17.80 | 28.09 | 81.77 |
FT | \(29.78_{{\textbf {+3.73}}}\) | \(35.78_{{\textbf {+11.74}}}\) | \(13.16_{\underline{-18.45}}\) | \(34.31_{{\textbf {+0.30}}}\) | \(28.21_{{\textbf {+4.86}}}\) | \(25.13_{{\textbf {+7.33}}}\) | \(30.39_{{\textbf {+2.30}}}\) | \(74.03_{\underline{-7.74}}\) | |
TFA51 | \(28.89_{{\textbf {+2.84}}}\) | \(27.77_{{\textbf {+3.73}}}\) | \(31.99_{{\textbf {+0.38}}}\) | \(37.06_{{\textbf {+3.05}}}\) | \(26.24_{{\textbf {+2.89}}}\) | \(20.27_{{\textbf {+2.47}}}\) | \(30.78_{{\textbf {+2.69}}}\) | \(83.32_{{\textbf {+1.55}}}\) | |
Ours | \(33.73_{{\textbf {+7.68}}}\) | \(34.02_{{\textbf {+9.98}}}\) | \(32.92_{{\textbf {+1.31}}}\) | \(42.75_{{\textbf {+8.74}}}\) | \(31.25_{{\textbf {+7.90}}}\) | \(23.65_{{\textbf {+5.85}}}\) | \(35.22_{{\textbf {+7.13}}}\) | \(86.21_{{\textbf {+4.44}}}\) | |
RN5058 | Baseline | 29.36 | 27.37 | 34.88 | 36.74 | 27.63 | 20.75 | 30.84 | 82.73 |
FT | \(27.37_{\underline{-1.99}}\) | \(30.32_{{\textbf {+2.95}}}\) | \(19.20_{\underline{-15.68}}\) | \(34.96_{\underline{-1.78}}\) | \(24.38_{\underline{-3.25}}\) | \(20.04_{\underline{-0.71}}\) | \(28.80_{\underline{-2.04}}\) | \(81.79_{\underline{-0.94}}\) | |
TFA51 | \(31.68_{{\textbf {+2.32}}}\) | \(30.50_{{\textbf {+3.13}}}\) | \(34.96_{{\textbf {+0.08}}}\) | \(39.22_{{\textbf {+2.48}}}\) | \(29.92_{{\textbf {+2.29}}}\) | \(22.87_{{\textbf {+2.12}}}\) | \(33.04_{{\textbf {+2.20}}}\) | \(83.96_{{\textbf {+1.23}}}\) | |
Ours | \(34.55_{{\textbf {+5.19}}}\) | \(33.92_{{\textbf {+6.55}}}\) | \(36.30_{{\textbf {+1.42}}}\) | \(42.65_{{\textbf {+5.91}}}\) | \(32.93_{{\textbf {+5.03}}}\) | \(24.72_{{\textbf {+3.97}}}\) | \(35.54_{{\textbf {+4.70}}}\) | \(86.02_{{\textbf {+3.29}}}\) | |
Relabel59 | Baseline | 34.44 | 32.67 | 39.36 | 41.79 | 33.53 | 24.84 | 35.37 | 86.14 |
FT | \(30.32_{\underline{-4.12}}\) | \(33.41_{{\textbf {+0.74}}}\) | \(21.73_{\underline{-17.63}}\) | \(34.80_{\underline{-6.99}}\) | \(29.62_{\underline{-3.91}}\) | \(24.62_{\underline{-0.22}}\) | \(31.85_{\underline{-3.52}}\) | \(86.61_{{\textbf {+0.47}}}\) | |
TFA51 | \(36.96_{{\textbf {+2.52}}}\) | \(36.26_{{\textbf {+3.59}}}\) | \(38.90_{\underline{-0.46}}\) | \(44.46_{{\textbf {+2.67}}}\) | \(35.86_{{\textbf {+2.33}}}\) | \(27.37_{{\textbf {+2.53}}}\) | \(37.72_{{\textbf {+2.35}}}\) | \(86.63_{{\textbf {+0.49}}}\) | |
Ours | \(40.75_{{\textbf {+6.31}}}\) | \(41.15_{{\textbf {+8.48}}}\) | \(39.65_{{\textbf {+0.29}}}\) | \(49.06_{{\textbf {+7.27}}}\) | \(39.72_{{\textbf {+6.19}}}\) | \(29.87_{{\textbf {+5.30}}}\) | \(40.96_{{\textbf {+5.59}}}\) | \(88.46_{{\textbf {+2.32}}}\) | |
ViT-B60 | Baseline | 32.15 | 30.76 | 36.00 | 39.79 | 30.56 | 22.96 | 33.36 | 84.29 |
FT | \(32.61_{{\textbf {+0.46}}}\) | \(39.19_{{\textbf {+8.43}}}\) | \(14.36_{\underline{-21.64}}\) | \(35.65_{\underline{-4.14}}\) | \(31.71_{{\textbf {+1.15}}}\) | \(29.28_{{\textbf {+6.32}}}\) | \(33.44_{{\textbf {+0.08}}}\) | \(69.95_{\underline{-14.34}}\) | |
TFA51 | \(34.73_{{\textbf {+2.58}}}\) | \(34.86_{{\textbf {+4.10}}}\) | \(34.36_{\underline{-1.64}}\) | \(42.68_{{\textbf {+2.89}}}\) | \(32.88_{{\textbf {+2.32}}}\) | \(25.41_{{\textbf {+2.45}}}\) | \(35.94_{{\textbf {+2.58}}}\) | \(83.59_{\underline{-0.70}}\) | |
Ours | \(37.81_{{\textbf {+5.66}}}\) | \(38.21_{{\textbf {+7.45}}}\) | \(36.73_{{\textbf {+0.73}}}\) | \(45.72_{{\textbf {+5.93}}}\) | \(36.14_{{\textbf {+5.58}}}\) | \(28.34_{{\textbf {+5.38}}}\) | \(38.38_{{\textbf {+5.02}}}\) | \(86.52_{{\textbf {+2.23}}}\) | |
DeiT-B61 | Baseline | 35.94 | 35.26 | 37.82 | 44.85 | 34.72 | 24.42 | 37.91 | 79.21 |
FT | \(37.84_{{\textbf {+1.90}}}\) | \(46.19_{{\textbf {+10.93}}}\) | \(14.71_{\underline{-23.11}}\) | \(40.54_{\underline{-4.31}}\) | \(36.92_{{\textbf {+2.20}}}\) | \(35.07_{{\textbf {+10.65}}}\) | \(39.20_{{\textbf {+1.29}}}\) | \(72.38_{\underline{-6.83}}\) | |
TFA51 | \(38.77_{{\textbf {+2.83}}}\) | \(40.46_{{\textbf {+5.20}}}\) | \(34.09_{\underline{-3.73}}\) | \(46.60_{{\textbf {+1.75}}}\) | \(37.56_{{\textbf {+2.84}}}\) | \(28.85_{{\textbf {+4.43}}}\) | \(40.40_{{\textbf {+2.49}}}\) | \(80.78_{{\textbf {+1.57}}}\) | |
Ours | \(46.20_{{\textbf {+10.26}}}\) | \(48.73_{{\textbf {+13.47}}}\) | \(39.20_{{\textbf {+1.38}}}\) | \(54.04_{{\textbf {+9.19}}}\) | \(45.30_{{\textbf {+10.58}}}\) | \(35.85_{{\textbf {+11.43}}}\) | \(46.04_{{\textbf {+8.13}}}\) | \(88.41_{{\textbf {+9.20}}}\) | |
Swin-B62 | Baseline | 46.18 | 45.80 | 47.25 | 55.53 | 44.80 | 34.25 | 46.49 | 85.75 |
FT | \(38.50_{\underline{-7.68}}\) | \(45.69_{\underline{-0.11}}\) | \(18.56_{\underline{-28.69}}\) | \(40.94_{\underline{-14.59}}\) | \(37.81_{\underline{-6.99}}\) | \(35.80_{{\textbf {+1.84}}}\) | \(39.20_{\underline{-7.29}}\) | \(72.28_{\underline{-13.47}}\) | |
TFA51 | \(47.48_{{\textbf {+1.30}}}\) | \(49.25_{{\textbf {+3.45}}}\) | \(42.59_{\underline{-4.66}}\) | \(55.26_{\underline{-0.27}}\) | \(46.15_{{\textbf {+1.35}}}\) | \(37.76_{{\textbf {+3.51}}}\) | \(47.89_{{\textbf {+1.40}}}\) | \(84.21_{\underline{-1.54}}\) | |
Ours | \(52.17_{{\textbf {+5.99}}}\) | \(53.05_{{\textbf {+7.25}}}\) | \(49.73_{{\textbf {+2.48}}}\) | \(60.75_{{\textbf {+5.22}}}\) | \(51.18_{{\textbf {+6.38}}}\) | \(40.86_{{\textbf {+6.61}}}\) | \(50.90_{{\textbf {+4.41}}}\) | \(91.35_{{\textbf {+5.60}}}\) | |
