Table 2 Results of AULC-MZE , AULC-MAE, and AULC-MI for the twelve compared methods on the nine datasets.

From: Active learning for ordinal classification based on expected cost minimization

Metric

Dataset

Random

USME

USLC

USMS

MCSVMA

McPAL

iGS

FISTA

ALCE

LogitA

ALOR

AOCECM

AULC-MZE

Newthyroid

7.82±2.85\(*\)

7.08±3.02\(*\)

6.43±2.64\(*\)

6.57±2.72\(*\)

5.82±3.00

6.71±3.90\(*\)

6.69±3.40\(*\)

8.07±2.68\(*\)

6.23±3.00\(*\)

7.51±3.08\(*\)

6.98±2.63\(*\)

5.38±2.83

Balance-scale

15.24±3.33\(*\)

16.03±3.35\(*\)

14.01±3.18\(*\)

12.19±3.14

12.56±2.87

12.55±2.36

14.94±2.58\(*\)

15.45±3.13\(*\)

12.68±2.65

17.83±5.06\(*\)

11.79±2.70

12.43±2.65

Thyroid

8.21±2.53

15.17±8.50\(*\)

10.55±5.32\(*\)

8.79±2.66

9.60±3.82\(*\)

18.03±10.09\(*\)

19.95±11.06\(*\)

8.43±2.42

13.55±8.01\(*\)

15.20±10.51\(*\)

7.42±2.54\(*\)

8.17±2.89

Knowledge

13.40±3.87\(*\)

13.58±3.84\(*\)

11.90±3.60

12.18±3.52\(*\)

12.56±3.74\(*\)

11.84±3.58

14.60±3.52\(*\)

12.95±3.69\(*\)

13.36±3.92\(*\)

14.15±3.97\(*\)

11.99±3.38\(*\)

11.14±3.12

Machine

49.85±6.02\(*\)

48.01±6.64\(*\)

48.68±7.18\(*\)

48.86±6.63\(*\)

49.35±6.44\(*\)

46.55±6.73

47.11±7.01\(*\)

49.49±6.87\(*\)

49.94±6.74\(*\)

49.93±6.43\(*\)

48.58±6.73\(*\)

45.66±6.88

Housing

50.20±5.92\(*\)

50.98±4.56\(*\)

49.58±5.31\(*\)

50.59±5.41\(*\)

49.94±5.04\(*\)

49.39±6.00\(*\)

48.08±5.40

50.67±5.65\(*\)

51.60±5.53\(*\)

53.56±5.19\(*\)

50.77±5.49\(*\)

47.43±5.11

Computer

52.71±2.88\(*\)

57.04±5.06\(*\)

53.94±4.28\(*\)

52.42±2.96\(*\)

54.31±3.62\(*\)

60.05±4.64\(*\)

59.62±4.42\(*\)

52.67±2.99\(*\)

55.64±4.20\(*\)

57.23±5.00\(*\)

52.65±3.18\(*\)

49.63±2.72

Obesity

67.69±4.79\(*\)

67.80±6.07\(*\)

64.22±4.58\(*\)

64.31±4.81\(*\)

70.25±4.62\(*\)

91.30±5.20\(*\)

86.39±5.84\(*\)

68.13±4.72\(*\)

74.40±6.44\(*\)

83.12±6.31\(*\)

64.42±4.86\(*\)

62.45±4.36

Stock

81.81±5.95\(*\)

78.06±5.91\(*\)

77.58±6.23\(*\)

77.32±6.00

83.11±7.66\(*\)

82.02±7.19\(*\)

76.96±6.08

81.87±6.25\(*\)

80.30±6.44\(*\)

78.89±5.79\(*\)

78.56±6.35\(*\)

75.56±6.32

AvgRank

7.44

8.11

4.78

4.33

6.56

7.11

7.44

7.89

8.11

10.33

4.56

1.33

AULC-MAE

Newthyroid

7.82±2.85\(*\)

7.09±3.04\(*\)

6.44±2.64\(*\)

6.58±2.73\(*\)

5.82±3.01

6.72±3.91\(*\)

6.70±3.42\(*\)

8.08±2.69\(*\)

6.24±3.01\(*\)

7.51±3.09\(*\)

7.00±2.66\(*\)

5.38±2.83

Balance-scale

17.80±4.06\(*\)

17.64±4.00\(*\)

15.58±3.57\(*\)

13.94±3.80

14.47±3.47

14.03±2.72

16.52±2.99\(*\)

18.07±3.96\(*\)

15.14±3.45

21.45±7.49\(*\)

13.56±3.15

14.09±3.19

Thyroid

8.66±2.59

16.01±9.26\(*\)

11.01±5.44\(*\)

9.20±2.71

10.11±4.13\(*\)

18.70±10.49\(*\)

20.52±11.17\(*\)

8.84±2.50

14.22±8.09\(*\)

15.64±10.54\(*\)

7.81±2.69\(*\)

8.52±2.95

Knowledge

13.49±3.97\(*\)

13.71±3.95\(*\)

12.04±3.73

12.30±3.63\(*\)

12.65±3.83\(*\)

11.92±3.65

14.69±3.61\(*\)

13.06±3.79\(*\)

13.45±3.99\(*\)

14.24±4.07\(*\)

12.11±3.48\(*\)

11.22±3.20

Machine

59.44±8.75\(*\)

56.19±9.22\(*\)

57.09±9.93\(*\)

57.61±9.66\(*\)

57.61±8.95\(*\)

54.13±9.37

54.73±9.52\(*\)

59.33±10.59\(*\)

57.39±9.30\(*\)

58.70±9.08\(*\)

57.63±9.78\(*\)

52.78±9.74

Housing

60.84±8.75\(*\)

62.37±7.31\(*\)

60.94±8.32\(*\)

61.92±8.50\(*\)

58.66±7.50\(*\)

57.94±9.26\(*\)

57.00±7.99

61.83±9.48\(*\)

61.68±8.56\(*\)

64.17±8.05\(*\)

61.60±8.47\(*\)

56.01±7.74

Computer

63.84±4.97\(*\)

70.92±8.64\(*\)

65.29±6.67\(*\)

63.71±5.10\(*\)

65.77±6.92\(*\)

77.37±10.87\(*\)

77.36±11.07\(*\)

63.56±4.84\(*\)

66.66±7.27\(*\)

69.96±9.96\(*\)

63.86±5.37\(*\)

59.62±4.62

Obesity

90.74±8.06\(*\)

88.68±8.89\(*\)

85.57±6.86\(*\)

85.89±7.39\(*\)

94.33±7.96\(*\)

129.51±9.81\(*\)

118.48±10.88\(*\)

91.04±7.71\(*\)

98.52±10.38\(*\)

111.97±10.23\(*\)

86.16±7.98\(*\)

80.28±6.84

Stock

95.15±9.12\(*\)

88.08±8.66\(*\)

87.86±8.32\(*\)

87.51±8.17

97.83±11.82\(*\)

94.43±9.98\(*\)

86.59±8.59

95.60±8.98\(*\)

92.61±9.80\(*\)

88.60±7.89\(*\)

89.89±9.18\(*\)

84.22±8.01

AvgRank

7.78

8.11

4.89

4.89

6.33

6.78

7.44

8.22

7.11

9.89

5.11

1.44

AULC-MI

Newthyroid

25.26±6.72\(*\)

28.79±7.07\(*\)

29.83±6.77\(*\)

29.34±6.75\(*\)

32.88±6.70

33.79±6.44\(*\)

33.46±6.05\(*\)

24.51±6.56\(*\)

32.35±6.44\(*\)

26.89±7.05\(*\)

28.21±6.31\(*\)

33.52±6.87

Balance-scale

26.53±4.87\(*\)

30.23±4.64\(*\)

31.12±4.11\(*\)

31.73±4.95

31.13±4.51

31.75±3.51

28.85±4.01\(*\)

26.17±4.89\(*\)

30.05±4.27

23.80±7.95\(*\)

32.06±4.18

30.87±4.34

Thyroid

3.65±1.18

3.53±1.00\(*\)

4.25±0.94\(*\)

3.79±1.04

4.10±1.01\(*\)

3.33±1.01\(*\)

3.51±0.87\(*\)

3.99±1.16

3.57±0.87\(*\)

2.78±1.36\(*\)

4.49±1.07\(*\)

4.42±0.96

Knowledge

72.22±8.42\(*\)

73.06±7.75\(*\)

75.73±8.20

75.17±7.77\(*\)

74.16±8.56\(*\)

75.89±8.25

71.25±6.42\(*\)

73.33±7.85\(*\)

72.37±8.50\(*\)

72.89±7.20\(*\)

75.39±7.55\(*\)

76.78±7.25

Machine

64.20±8.35\(*\)

68.21±9.50\(*\)

66.78±9.54\(*\)

66.43±9.19\(*\)

65.92±8.63\(*\)

71.44±9.00

70.21±9.39\(*\)

65.30±10.00\(*\)

66.42±9.57\(*\)

67.38±9.16\(*\)

66.08±8.89\(*\)

72.59±9.42

Housing

55.52±8.40\(*\)

53.66±6.96\(*\)

55.27±8.29\(*\)

54.63±7.99\(*\)

58.53±7.57\(*\)

61.35±7.95\(*\)

61.33±7.69

54.76±8.57\(*\)

55.43±8.34\(*\)

53.51±8.17\(*\)

54.71±8.39\(*\)

61.44±7.74

Computer

47.50±4.59\(*\)

43.37±7.13\(*\)

47.01±5.66\(*\)

47.84±4.42\(*\)

46.71±6.01\(*\)

41.42±6.91\(*\)

41.77±6.63\(*\)

47.91±4.29\(*\)

46.55±6.18\(*\)

44.84±7.93\(*\)

47.68±5.14\(*\)

52.80±4.14

Obesity

129.63±8.26\(*\)

130.69±9.86\(*\)

135.04±8.24\(*\)

134.62±7.64\(*\)

127.17±7.43\(*\)

92.56±8.44\(*\)

101.46±9.19\(*\)

130.41±8.21\(*\)

120.20±9.67\(*\)

108.64±8.84\(*\)

134.93±7.98\(*\)

137.76±8.08

Stock

280.21±9.53\(*\)

286.94±10.07\(*\)

288.01±10.33\(*\)

288.72±10.24

278.42±11.86\(*\)

281.62±10.16\(*\)

289.16±10.35

279.56±9.87\(*\)

282.99±11.14\(*\)

287.85±9.18\(*\)

286.57±10.65\(*\)

293.74±9.67

AvgRank

8.67

7.56

4.67

5.33

6.56

5.89

7.11

8.11

7.78

9.33

5.22

1.78

Back to article page