Table 13 Accuracy and AUC for Anti-pattern 1: ensemble Classifiers and Deep-Learning.

From: An empirical analysis on webservice antipattern prediction in different variants of machine learning perspective

 

Accuracy

AUC

BAG

RF

EXTR

AdaB

GraB

DL1

DL2

DL3

DL4

BAG

RF

EXTR

AdaB

GraB

DL1

DL2

DL3

DL4

ORG-DATA

OD

90.71

91.15

92.48

90.27

91.59

92.92

92.04

92.04

92.92

0.81

0.82

0.84

0.85

0.67

0.88

0.87

0.86

0.88

SIGF

89.82

89.82

91.59

91.59

90.71

91.59

92.04

92.04

92.04

0.82

0.80

0.80

0.78

0.66

0.88

0.87

0.86

0.87

AG1

91.59

92.48

91.59

92.92

92.04

90.71

90.71

90.71

90.71

0.85

0.84

0.73

0.82

0.62

0.89

0.87

0.86

0.86

AG2

90.71

89.38

89.82

88.94

89.38

90.71

90.71

90.71

90.71

0.76

0.75

0.75

0.76

0.8

0.69

0.75

0.76

0.76

AG3

90.71

90.71

91.15

89.82

91.15

90.71

90.71

90.71

90.71

0.77

0.82

0.81

0.82

0.68

0.81

0.84

0.83

0.83

AG4

90.27

89.82

91.59

89.82

91.15

89.82

90.71

90.71

90.71

0.77

0.85

0.81

0.82

0.68

0.83

0.84

0.83

0.83

AG5

90.71

88.05

89.38

89.82

90.71

90.71

90.71

90.71

90.71

0.70

0.71

0.68

0.70

0.64

0.41

0.44

0.42

0.40

AG6

90.71

88.94

86.73

89.38

89.38

90.71

90.71

90.71

90.71

0.74

0.67

0.55

0.73

0.69

0.44

0.50

0.63

0.40

AG7

91.59

91.59

92.04

90.27

89.82

92.92

89.38

90.27

90.71

0.82

0.83

0.76

0.85

0.59

0.87

0.84

0.84

0.84

AG8

90.71

90.27

91.59

91.59

91.59

92.04

90.27

90.71

90.71

0.86

0.82

0.81

0.82

0.60

0.83

0.86

0.87

0.86

AG9

90.27

89.82

91.59

91.59

89.38

90.71

90.71

90.71

90.71

0.80

0.71

0.77

0.85

0.83

0.68

0.60

0.61

0.59

AG10

90.71

91.15

90.71

91.15

87.61

90.71

90.71

90.71

90.71

0.81

0.75

0.74

0.83

0.75

0.71

0.75

0.73

0.73

AG11

88.50

91.59

90.71

90.27

90.27

90.71

90.71

90.71

90.71

0.83

0.73

0.79

0.82

0.83

0.75

0.81

0.80

0.79

AG12

91.59

90.71

90.71

90.71

88.94

90.71

90.71

90.71

90.71

0.86

0.77

0.79

0.84

0.61

0.69

0.87

0.75

0.77

AG13

89.82

91.59

92.48

89.82

90.27

90.71

90.71

90.71

90.71

0.84

0.79

0.74

0.82

0.83

0.75

0.83

0.81

0.80

INFG

91.15

92.48

91.59

92.92

92.04

91.59

91.59

91.59

91.15

0.82

0.85

0.84

0.85

0.73

0.88

0.88

0.87

0.86

GNR

91.59

92.04

91.15

92.92

89.38

90.71

90.71

90.71

90.71

0.91

0.88

0.83

0.87

0.52

0.85

0.80

0.89

0.88

CORR

90.71

92.48

93.81

92.92

88.94

91.15

90.71

90.71

90.71

0.88

0.80

0.85

0.87

0.64

0.86

0.84

0.84

0.82

CFS

90.71

92.48

92.92

92.48

92.04

91.15

91.15

90.71

90.71

0.92

0.86

0.83

0.84

0.71

0.94

0.91

0.89

0.88

OneR

92.04

91.59

92.04

92.92

92.92

91.15

90.71

90.71

90.71

0.9

0.85

0.83

0.79

0.64

0.79

0.84

0.86

0.83

GA

92.04

92.04

91.15

91.15

91.59

91.15

90.71

90.27

90.71

0.91

0.86

0.84

0.87

0.65

0.87

0.84

0.87

0.81

PCA

90.71

90.27

90.27

90.27

88.94

90.71

90.71

90.71

90.71

0.82

0.81

0.78

0.75

0.75

0.47

0.53

0.52

0.44

SMOTE-DATA

OD

90.00

95.12

96.1

91.71

91.46

93.17

95.12

94.15

94.63

0.97

0.98

0.98

0.97

0.97

0.97

0.98

0.98

0.98

SIGF

89.76

94.15

96.34

92.93

93.90

94.39

94.88

95.61

95.12

0.96

0.98

0.99

0.97

0.97

0.97

0.97

0.97

0.98

AG1

89.27

90.49

92.93

90.00

89.02

85.85

86.59

87.56

86.59

0.96

0.96

0.97

0.94

0.96

0.92

0.90

0.93

0.93

AG2

86.34

92.68

93.41

87.80

88.05

76.83

81.71

81.46

82.68

0.93

0.97

0.97

0.94

0.95

0.83

0.87

0.86

0.86

AG3

89.27

92.93

96.1

88.54

90.73

83.90

86.34

88.54

87.56

0.96

0.98

0.98

0.95

0.95

0.90

0.92

0.92

0.92

AG4

89.27

95.61

95.12

91.71

90.98

82.20

85.12

88.78

89.51

0.95

0.97

0.98

0.96

0.95

0.90

0.92

0.94

0.94

AG5

80.00

84.88

85.37

74.15

78.05

72.44

70.00

67.32

54.63

0.88

0.92

0.91

0.83

0.84

0.77

0.74

0.71

0.53

AG6

81.95

85.61

87.32

80.24

80.98

70.49

54.39

48.29

51.22

0.87

0.90

0.92

0.88

0.87

0.70

0.56

0.49

0.57

AG7

91.71

92.20

94.63

89.76

91.22

86.34

89.51

89.76

89.51

0.97

0.97

0.97

0.95

0.94

0.93

0.94

0.94

0.94

AG8

90.49

93.90

95.61

87.56

87.80

87.80

90.24

90.49

91.22

0.96

0.98

0.98

0.96

0.95

0.93

0.94

0.95

0.94

AG9

85.37

93.66

95.37

90.73

90.00

77.80

78.05

77.80

64.63

0.95

0.98

0.98

0.96

0.96

0.82

0.81

0.81

0.73

AG10

84.88

88.78

92.93

83.66

83.90

79.27

81.71

81.46

74.63

0.92

0.93

0.96

0.91

0.89

0.87

0.87

0.85

0.82

AG11

87.07

89.02

93.41

85.85

84.39

82.93

84.88

86.10

85.85

0.94

0.97

0.97

0.93

0.93

0.90

0.90

0.90

0.89

AG12

87.07

91.71

93.66

88.05

87.80

81.22

83.17

84.39

85.61

0.95

0.97

0.97

0.93

0.93

0.91

0.91

0.90

0.89

AG13

84.88

91.71

93.17

86.34

83.90

82.44

84.15

85.61

85.37

0.94

0.96

0.98

0.92

0.91

0.90

0.90

0.90

0.90

INFG

88.29

91.71

94.15

91.46

90.73

90.00

93.17

93.17

94.39

0.96

0.97

0.97

0.97

0.96

0.96

0.97

0.97

0.96

GNR

88.05

88.05

90.49

85.85

86.10

86.83

87.56

88.78

81.22

0.95

0.96

0.96

0.93

0.94

0.93

0.92

0.93

0.86

CORR

89.27

91.22

91.46

88.29

88.05

85.85

85.85

86.59

86.10

0.95

0.96

0.96

0.94

0.93

0.91

0.90

0.88

0.89

CFS

86.34

89.51

91.46

89.76

89.02

83.90

85.12

86.10

78.54

0.93

0.95

0.96

0.93

0.94

0.91

0.90

0.91

0.88

OneR

89.02

89.51

92.44

90.00

90.00

86.83

87.07

78.54

78.78

0.96

0.96

0.96

0.95

0.95

0.92

0.93

0.89

0.89

GA

89.76

92.44

91.46

90.49

89.27

86.83

86.59

86.34

79.76

0.95

0.96

0.96

0.94

0.94

0.92

0.93

0.92

0.90

PCA

88.05

91.95

91.71

85.85

86.83

75.85

74.39

64.88

56.10

0.94

0.97

0.97

0.92

0.93

0.81

0.88

0.76

0.64

SMOTE-DATA

BLSMOTE-DATA

OD

89.27

94.63

96.34

93.17

91.46

92.93

93.90

93.66

95.12

0.97

0.98

0.98

0.96

0.96

0.97

0.97

0.97

0.97

SIGF

89.51

92.93

95.85

91.22

90.00

92.68

92.93

93.17

93.66

0.96

0.98

0.98

0.97

0.96

0.97

0.98

0.97

0.98

AG1

91.71

93.41

94.88

91.22

92.93

88.78

89.02

91.22

90.24

0.97

0.97

0.98

0.97

0.97

0.94

0.94

0.94

0.94

AG2

90.24

95.37

96.34

93.41

94.63

85.85

88.78

90.00

92.44

0.97

0.97

0.97

0.97

0.96

0.90

0.91

0.93

0.94

AG3

91.22

94.63

96.1

92.20

92.68

87.56

89.76

90.49

91.22

0.97

0.97

0.98

0.96

0.97

0.94

0.95

0.95

0.95

AG4

91.95

93.41

96.1

93.17

93.66

88.54

90.49

90.73

91.71

0.97

0.98

0.98

0.97

0.97

0.94

0.95

0.95

0.95

AG5

79.27

85.37

84.63

73.90

80.73

73.41

69.27

70.24

48.54

0.90

0.91

0.90

0.82

0.85

0.74

0.73

0.72

0.49

AG6

82.93

86.10

87.8

80.98

78.05

72.68

60.49

63.17

54.63

0.88

0.92

0.93

0.90

0.87

0.76

0.67

0.69

0.55

AG7

89.76

91.71

94.63

88.54

88.29

88.05

89.27

89.27

90.49

0.96

0.96

0.97

0.94

0.93

0.92

0.93

0.93

0.93

AG8

89.02

93.90

95.12

88.05

88.29

85.37

87.32

87.56

87.32

0.96

0.96

0.98

0.94

0.94

0.89

0.90

0.90

0.91

AG9

87.32

95.85

95.37

91.22

92.44

83.66

83.90

76.34

76.59

0.96

0.98

0.98

0.97

0.97

0.85

0.85

0.83

0.83

AG10

87.07

91.46

92.93

88.29

85.12

81.46

84.63

85.12

78.05

0.94

0.96

0.96

0.94

0.89

0.88

0.88

0.88

0.86

AG11

88.29

92.93

94.39

86.10

86.59

84.88

87.07

88.05

87.80

0.95

0.97

0.98

0.94

0.94

0.92

0.92

0.93

0.92

AG12

89.76

92.68

92.68

89.76

90.00

83.17

86.83

87.56

87.32

0.95

0.96

0.98

0.95

0.93

0.92

0.92

0.92

0.92

AG13

87.32

90.73

93.66

85.61

86.83

81.71

83.66

84.39

77.07

0.93

0.96

0.97

0.91

0.92

0.89

0.90

0.90

0.86

INFG

89.51

94.39

95.61

93.41

92.20

92.20

92.20

92.93

92.68

0.97

0.98

0.98

0.97

0.96

0.96

0.97

0.98

0.97

GNR

91.71

94.63

94.63

92.20

92.68

91.95

91.95

91.71

90.73

0.97

0.98

0.98

0.96

0.96

0.95

0.95

0.94

0.93

CORR

89.02

92.93

93.66

92.68

91.95

86.34

86.34

86.83

85.37

0.96

0.97

0.97

0.96

0.95

0.92

0.93

0.92

0.91

CFS

87.07

90.00

92.2

87.07

88.78

82.44

84.15

84.63

75.61

0.93

0.94

0.95

0.93

0.92

0.89

0.89

0.89

0.86

OneR

91.95

92.20

92.68

88.05

91.71

86.10

86.10

90.00

77.32

0.97

0.96

0.97

0.95

0.96

0.93

0.94

0.95

0.87

GA

93.17

93.66

94.15

92.20

92.68

87.07

87.56

89.76

90.24

0.97

0.98

0.97

0.96

0.96

0.94

0.94

0.95

0.94

PCA

88.05

91.71

94.39

87.80

87.07

79.51

80.98

59.02

51.22

0.94

0.97

0.97

0.93

0.94

0.88

0.90

0.69

0.52

  1. Best performance value in bold.