Table 2 Different factors associated with the item analysis

From: Faculty development programs improve the quality of Multiple Choice Questions items' writing

  

Respiratory

Cardiovascular

Renal

All three courses

 
  

Pre*

Post**

Pre*

Post**

Pre*

Post**

Pre

Post

 

Factors

Categories

n(%)

n(%)

n(%)

n(%)

n(%)

n(%)

n(%)

n(%)

χ2(p)

Difficulty Index (P)

Difficult (<20%)

1(1.3)

0(0)

0(0)

2(2.5)

1(1.3)

1(1.3)

2(0.8)

3(1.3)

11.61(0.003)

Moderated (20–70%)

55(68.8)

61(76.3)

59(73.8)

68(85.0)

36(45.0)

54(67.5)

150(62.5)

183(76.3)

Easy (>70%)

24(30.0)

19(23.8)

21(26.3)

10(12.5)

43(53.8)

25(31.3)

88(36.7)

54(22.5)

Total

80(100)

80(100)

80(100)

80(100)

80(100)

80(100)

240(100)

240(100)

 

Discrimination Index (DI)

Non-DI(≤0.15)

6(7.5)

3(3.80)

7(8.8)

4(5.0)

6(7.5)

4(5.0)

19(7.9)

11(4.6)

2.27 (0.13)

DI(>0.15)

74(92.5)

77(96.3)

73(91.3)

76(95.0)

74(92.5)

76(95.0)

221(92.1)

229(95.4)

Total

80(100)

80(100)

80(100)

80(100)

80(100)

80(100)

240(100)

240(100)

 

Non-function distractors (NFD)

NFD

4(5.0)

2(2.5)

8(10.0)

7(8.8)

16(20.0)

4(5.0)

28(11.7)

13(5.4)

6.00 (0.02)

FD***

76(95.0)

78(97.5)

72(90.0)

73(91.3)

64(80.0)

76(95.0)

212(88.3)

227(94.6)

Total

80(100)

80(100)

80(100)

80(100)

80(100)

80(100)

240(100)

240(100)

 

Bloom's taxonomy levels

K1

45(56.3)

40(50.0)

54(67.5)

40(50.0)

57(71.3)

37(46.3)

156(65.0)

117(48.8)

12.91 (<0.0001)

K2

35(43.8)

40(50.0)

26(32.5)

40(50.0)

23(28.8)

43(53.8)

84(35.0)

123(51.3)

Total

80(100)

80(100)

80(100)

80(100)

80(100)

80(100)

240(100)

240(100)

 

Items writing flaws (IWFs)

IWF

22(27.5)

1(1.3)

15(18.8)

0(0.0)

10(12.5)

4(5.0)

47(19.6)

5(2.1)

38.04 (0.<0001)

Without-IWF

58(72.5)

79(98.8)

65(81.3)

80(100)

70(87.5)

76(95.0)

193(80.4)

235(97.9)

Total

80(100)

80(100)

80(100)

80(100)

80(100)

80(100)

240(100)

240(100)

  1. *Pre-training, **Post-training, ***Functional distractor, K1 = Non-scenario bases, K2 = Scenario bases.