MICHIGAN LIFE AND HEALTH EXAMINATIONS Statistical Report for 2015 Candidate Performance

MICHIGAN LIFE AND HEALTH EXAMINATIONS Statistical Report for 2015 REQUIRED by Public Act 494 of 2008 Candidate Performance Table 1. Candidate Performance in the MI Life Producer Exam
1665 MI Life Producer Exam
# Exams Given
# Total Examinees
# Total Examinees Passed
% Total Examinees Passed
# First-Time Examinees
# First-Time Examinees Passed
% First-Time Examinees Passed
Mean % Score
Standard Deviation % Score
01/01/15 to 12/31/15
3,192
2,308
1,829
79.25%
2,231
1,457
65.31%
72.53%
12.17%
Table 2. Candidate Performance in the MI Accident and Health Producer Exam
1666 MI Accident and Health Producer Exam
# Exams Given
# Total Examinees
# Total Examinees Passed
% Total Examinees Passed
# First-Time Examinees
# First-Time Examinees Passed
% First-Time Examinees Passed
Mean % Score
Standard Deviation % Score
01/01/15 to 12/31/15
1,455
983
785
79.86%
953
572
60.02%
74.38%
8.72%
Table 3. Candidate Performance in the MI Life, Accident and Health Producer Exam
1680 MI Life and Health Producer Exam
# Exams Given
# Total Examinees
# Total Examinees Passed
% Total Examinees Passed
# First-Time Examinees
# First-Time Examinees Passed
% First-Time Examinees Passed
Mean % Score
Standard Deviation % Score
01/01/15 to 12/31/15
3,820
2,651
2,287
86.27%
2,570
1,784
69.42%
74.37%
9.66%
Data provided by PSI Services LLC, examination development and administration vendor.
1
Table 4. Descriptive Test Statistics 1/1/15 to 12/31/15
Exam MI ACCIDENT AND HEALTH PRODUCER MI ACCIDENT AND HEALTH PRODUCER MI ACCIDENT AND HEALTH PRODUCER MI LIFE PRODUCER MI LIFE PRODUCER MI LIFE PRODUCER MI LIFE PRODUCER MI LIFE, ACCIDENT AND HEALTH PRODUCER MI LIFE, ACCIDENT AND HEALTH PRODUCER MI LIFE, ACCIDENT AND HEALTH PRODUCER Form #Active Items in Test Mean Raw Score Standard Deviation
Raw Score Reliability* MIAHP1JUN14 MIAHP2JUN14 MIAHP3JUN14 100 100 100 75.18 73.18 74.69 8.27 9.02 8.77 0.73 0.77 0.76 (LOFT) MILIP1JUN14 MILIP2JUN14 MILIP3JUN14 100 100 100 100 72.31 77.17 73.83 77.24 12.24 9.00 10.85 11.13 0.88 0.79 0.84 0.87 MILAH1JUN14 MILAH2JUN14 MILAH3JUN14 150 150 150 110.30 111.69 112.66 14.75 14.10 14.53 0.87 0.86 0.87 *Represents the probability of getting the same score if one took the examination twice without any change in knowledge (no further education). Probability is a
value from 0 to 1; 0.7 or above is desired.
2
Table 5. Descriptive Item Statistics 1/1/15 to 12/31/15
# Items in
Test Item Bank
Average
Percent Correct
Average
Point-biserial
Correlation
MI LIFE PRODUCER
265
73.51%
0.279
MI ACCIDENT AND HEALTH PRODUCER
228
74.65%
0.213
MI LIFE, ACCIDENT AND HEALTH PRODUCER
316
73.54%
0.237
OVERALL ITEM BANK
522
73.70%
0.196
Exam
3
Table 6. Life Producer; Accident and Health Producer; and Life, Accident and Health Producer Combined Item Information for 01-01-2015 to 12-31-2015 Item ID Item0001 Item0002 Item0003 Item0004 Item0005 Item0006 Item0007 Item0008 Item0009 Item0010 Item0011 Item0012 Item0013 Item0014 Item0015 Item0016 Item0017 Item0018 Item0019 Item0020 Item0021 Item0022 Item0023 Item0024 Item0025 Item0026 Item0027 Item0028 Item0029 Item0030 Item0031 Item0032 Item0033 Item0034 Item0035 Item0036 Item0037 Item0038 Item0039 Item0040 Item0041 Item0042 Item0043 Item0044 Percent Correct 89.6% 85.3% 82.0% 86.3% 89.3% 90.2% 77.8% 91.9% 96.4% 56.9% 52.3% 74.1% 75.4% 54.4% 74.1% 64.2% 32.7% 86.0% 86.3% 79.4% 97.3% 88.4% 68.0% 61.0% 61.5% 83.9% 84.8% 59.8% 94.7% 75.7% 75.0% 86.5% 74.5% 83.6% 81.7% 62.0% 74.3% 77.9% 86.4% 69.0% 64.3% 66.6% 52.9% 94.7% 4
Item Correlation 0.3143 0.2104 0.0185 0.4195 0.2682 0.1679 0.1611 0.3381 0.4359 0.3862 0.0951 0.3999 0.2189 0.1184 0.3336 0.0944 0.1979 0.1431 0.1767 0.1518 0.1434 0.0513 0.3538 0.0923 0.4521 0.1756 0.2780 0.1029 0.1526 0.2352 0.0625 0.2529 0.5047 0.1383 0.3025 0.2930 0.2200 0.3360 0.1248 0.2944 0.0301 0.1327 0.3729 0.2281 Item ID Item0045 Item0046 Item0047 Item0048 Item0049 Item0050 Item0051 Item0052 Item0053 Item0054 Item0055 Item0056 Item0057 Item0058 Item0059 Item0060 Item0061 Item0062 Item0063 Item0064 Item0065 Item0066 Item0067 Item0068 Item0069 Item0070 Item0071 Item0072 Item0073 Item0074 Item0075 Item0076 Item0077 Item0078 Item0079 Item0080 Item0081 Item0082 Item0083 Item0084 Item0085 Item0086 Item0087 Item0088 Item0089 Item0090 Item0091 Percent Correct 95.7% 66.3% 71.5% 73.6% 84.5% 59.8% 85.1% 89.7% 84.3% 98.2% 63.2% 64.3% 79.3% 86.5% 64.5% 83.9% 82.6% 86.9% 93.8% 53.5% 89.2% 57.0% 45.0% 70.3% 72.0% 80.6% 68.2% 52.7% 61.0% 79.4% 97.4% 93.7% 69.6% 51.5% 91.2% 87.7% 92.4% 47.6% 94.5% 78.4% 77.1% 71.1% 71.2% 88.2% 75.6% 85.8% 99.0% 5
Item Correlation 0.0625 0.2178 0.3286 0.2334 0.1127 0.1119 0.2360 0.2536 0.2576 0.6078 0.2890 0.1938 0.1748 0.1319 0.3887 0.1122 0.3121 0.3375 0.2700 0.2647 0.2382 0.3478 0.3652 0.1488 0.1913 0.1374 0.2022 0.2919 0.1866 0.1788 0.3390 0.2150 0.2469 0.2275 0.2203 0.1424 0.1477 0.0494 0.1663 0.1921 0.0946 0.1506 0.2508 0.2412 0.2404 0.2062 0.0780 Item ID Item0092 Item0093 Item0094 Item0095 Item0096 Item0097 Item0098 Item0099 Item0100 Item0101 Item0102 Item0103 Item0104 Item0105 Item0106 Item0107 Item0108 Item0109 Item0110 Item0111 Item0112 Item0113 Item0114 Item0115 Item0116 Item0117 Item0118 Item0119 Item0120 Item0121 Item0122 Item0123 Item0124 Item0125 Item0126 Item0127 Item0128 Item0129 Item0130 Item0131 Item0132 Item0133 Item0134 Item0135 Item0136 Item0137 Item0138 Percent Correct 67.3% 58.7% 77.7% 78.6% 85.7% 95.2% 84.5% 85.9% 80.0% 82.5% 96.8% 54.5% 57.2% 58.8% 90.9% 84.2% 81.6% 63.8% 89.1% 69.1% 74.3% 81.6% 58.6% 97.0% 93.8% 37.8% 51.6% 56.4% 89.1% 62.1% 90.4% 57.8% 88.4% 93.5% 61.5% 54.1% 76.4% 54.1% 73.1% 64.1% 47.9% 48.0% 83.7% 78.8% 72.4% 97.4% 92.2% 6
Item Correlation 0.1521 0.1375 0.0613 0.1238 0.1986 0.1569 0.2950 0.1637 0.2365 0.3094 0.1279 0.2270 0.2563 0.2184 0.2716 0.3133 0.2209 0.2573 0.3049 0.1356 0.3463 0.1162 0.1647 0.1566 0.2551 0.1842 0.2272 0.1914 0.2025 0.2025 0.2105 0.2144 0.1420 0.3317 0.1758 0.1312 0.1452 0.1628 0.3120 0.1423 0.1221 0.1734 0.0906 0.2026 0.0933 0.1956 0.0490 Item ID Item0139 Item0140 Item0141 Item0142 Item0143 Item0144 Item0145 Item0146 Item0147 Item0148 Item0149 Item0150 Item0151 Item0152 Item0153 Item0154 Item0155 Item0156 Item0157 Item0158 Item0159 Item0160 Item0161 Item0162 Item0163 Item0164 Item0165 Item0166 Item0167 Item0168 Item0169 Item0170 Item0171 Item0172 Item0173 Item0174 Item0175 Item0176 Item0177 Item0178 Item0179 Item0180 Item0181 Item0182 Item0183 Item0184 Item0185 Percent Correct 76.7% 59.0% 39.2% 50.0% 65.3% 71.8% 86.9% 84.2% 83.8% 57.6% 85.0% 91.3% 87.8% 60.4% 81.7% 70.5% 96.6% 72.8% 89.3% 83.3% 26.8% 67.1% 46.9% 87.8% 83.9% 94.1% 58.4% 65.4% 69.1% 66.0% 77.9% 66.4% 79.0% 51.4% 95.4% 89.1% 85.4% 90.7% 94.3% 50.9% 51.0% 68.6% 84.6% 78.7% 72.7% 74.4% 86.0% 7
Item Correlation 0.1263 0.2043 0.1914 0.1649 0.1643 0.2864 0.2074 0.2563 0.2116 0.1874 0.2069 0.3866 0.2196 0.3571 0.1359 0.3947 0.2167 0.2040 0.3411 0.1305 0.1808 0.2491 0.1275 0.1659 0.3489 0.2941 0.0796 0.0784 0.1999 0.1405 0.1059 0.2557 0.1343 0.1793 0.2538 0.2244 0.2639 0.2441 0.1398 0.2696 0.1836 0.2240 0.1966 0.2184 0.0878 0.4439 0.3382 Item ID Item0186 Item0187 Item0188 Item0189 Item0190 Item0191 Item0192 Item0193 Item0194 Item0195 Item0196 Item0197 Item0198 Item0199 Item0200 Item0201 Item0202 Item0203 Item0204 Item0205 Item0206 Item0207 Item0208 Item0209 Item0210 Item0211 Item0212 Item0213 Item0214 Item0215 Item0216 Item0217 Item0218 Item0219 Item0220 Item0221 Item0222 Item0223 Item0224 Item0225 Item0226 Item0227 Item0228 Item0229 Item0230 Item0231 Item0232 Percent Correct 84.9% 69.6% 84.2% 51.2% 75.7% 92.8% 97.6% 70.9% 73.8% 73.7% 75.3% 65.3% 46.4% 58.4% 88.2% 46.5% 87.5% 66.6% 93.8% 67.4% 91.0% 78.2% 75.0%
75.9% 63.0% 79.6% 70.1% 81.0% 50.7% 82.7% 64.0% 61.6% 89.2% 82.4% 58.7% 49.7% 83.6% 87.0% 85.7% 79.8% 86.2% 78.2% 72.9% 83.6% 83.7% 86.9% 55.5% 8
Item Correlation 0.3100 0.3958 0.2474 0.1844 0.1825 0.2003 0.0726 0.0718 0.0319 0.1023 0.0307 0.3466 0.1476 0.0976 0.2466 0.2224 0.2848 0.2992 0.0335 0.1365 0.2100 0.2675 ‐0.0021 0.2462 0.0229 0.0704 0.2263 0.0340 0.2626 0.1613 0.1341 0.2067 0.2226 0.2766 0.2078 0.1898 0.3189 0.0819 0.2061 0.0954 0.1501 0.1049 0.2806 0.0393 0.2967 0.0847 0.1551 Item ID Item0233 Item0234 Item0235 Item0236 Item0237 Item0238 Item0239 Item0240 Item0241 Item0242 Item0243 Item0244 Item0245 Item0246 Item0247 Item0248 Item0249 Item0250 Item0251 Item0252 Item0253 Item0254 Item0255 Item0256 Item0257 Item0258 Item0259 Item0260 Item0261 Item0262 Item0263 Item0264 Item0265 Item0266 Item0267 Item0268 Item0269 Item0270 Item0271 Item0272 Item0273 Item0274 Item0275 Item0276 Item0277 Item0278 Item0279 Percent Correct 65.0% 44.5% 84.9% 67.2% 32.9% 84.5% 83.7% 42.3% 53.6% 72.2% 97.1% 95.9% 80.0% 89.7% 94.8% 91.5% 90.3% 67.9% 92.3% 89.0% 59.5%
73.9% 42.0% 66.7% 77.4% 73.7% 94.0% 94.6% 76.1% 68.6% 61.8% 59.8% 98.0% 97.6% 68.8% 93.0% 91.1% 90.9%
70.8% 87.8% 83.2% 85.1% 80.5% 81.7% 89.5% 87.7% 75.6% 9
Item Correlation 0.1332 0.2392 0.1265 0.1860 0.0526 0.0062 0.0576 0.1042 0.2012 0.1443 0.0524 0.1118 0.0785 0.1178 0.1205 0.1041 0.1324 0.0601 0.1385 0.1188 ‐0.0053 0.0946 0.1832 0.0528 0.0499 0.2123 0.1578 0.0631 0.3843 0.2171 0.3759 0.3072 0.1083 0.1229 0.0585 0.1683 0.1964 ‐0.0793 0.1950 0.1976 0.2230 0.1516 0.2505 0.2423 0.2461 0.1617 0.2076 Item ID Item0280 Item0281 Item0282 Item0283 Item0284 Item0285 Item0286 Item0287 Item0288 Item0289 Item0290 Item0291 Item0292 Item0293 Item0294 Item0295 Item0296 Item0297 Item0298 Item0299 Item0300 Item0301 Item0302 Item0303 Item0304 Item0305 Item0306 Item0307 Item0308 Item0309 Item0310 Item0311 Item0312 Item0313 Item0314 Item0315 Item0316 Item0317 Item0318 Item0319 Item0320 Item0321 Item0322 Item0323 Item0324 Item0325 Item0326 Percent Correct 59.5% 57.9% 66.7% 85.5% 51.5% 86.0% 45.7% 67.2% 95.2% 87.6% 76.0% 51.2% 93.9% 65.2% 92.1% 87.2% 73.2% 72.5% 89.4% 90.5% 81.4% 88.3%
74.9% 43.7% 71.5% 30.0%
84.8% 76.2% 39.1% 37.8% 38.1% 85.0% 88.7% 76.3% 60.3% 66.9% 41.5% 14.5%
17.9% 74.9% 56.7% 59.3% 54.0% 57.8% 49.4% 64.6% 67.3% 10
Item Correlation 0.2030 0.1952 0.2069 0.2376 0.3054 0.2890 0.1625 0.1645 0.1835 0.1624 0.2980 0.1868 0.1525 0.1827 0.1607 0.1503 0.0501 0.2153 0.1630 0.1049 0.2533 ‐0.0181 0.1288 0.1548 0.2468 ‐0.0606 0.3695 0.2404 0.0959 0.0319 0.1280 0.2964 0.1791 0.2496 0.2513 0.2754 0.2415 ‐0.1352 0.1193 0.1735 0.1594 0.1095 0.0117 0.4584 0.1040 0.2434 0.3757 Item ID Item0327 Item0328 Item0329 Item0330 Item0331 Item0332 Item0333 Item0334 Item0335 Item0336 Item0337 Item0338 Item0339 Item0340 Item0341 Item0342 Item0343 Item0344 Item0345 Item0346 Item0347 Item0348 Item0349 Item0350 Item0351 Item0352 Item0353 Item0354 Item0355 Item0356 Item0357 Item0358 Item0359 Item0360 Item0361 Item0362 Item0363 Item0364 Item0365 Item0366 Item0367 Item0368 Item0369 Item0370 Item0371 Item0372 Item0373 Percent Correct 60.4% 82.0% 73.1% 82.9% 76.1% 61.9% 58.0% 61.7% 63.2% 95.2% 94.5% 94.6% 93.2% 98.2% 88.4% 50.8% 73.3% 93.6% 85.0% 85.3% 71.0% 50.6%
63.6% 60.5% 75.7% 86.2% 63.7% 55.8% 79.5% 67.2% 61.8% 47.3% 67.9% 77.2% 47.6% 85.6% 34.1% 53.6% 60.9% 67.8% 67.1% 86.7% 75.5% 76.2% 72.3% 69.0% 94.0% 11
Item Correlation 0.3361 0.2872 0.1016 0.2464 0.0831 0.2956 0.2316 0.1053 0.0596 0.1692 0.2284 0.2062 0.1853 0.6078 0.0952 0.2242 0.0698 0.2430 0.2134 0.1860 0.2130 ‐0.0305 0.0360 0.1940 0.2591 0.2070 0.1993 0.2171 0.2530 0.3563 0.1969 0.2377 0.0505 0.2399 0.2835 0.1596 0.1256 0.2571 0.0568 0.1952 0.1784 0.3655 0.1583 0.1352 0.1121 0.3941 0.2066 Item ID Item0374 Item0375 Item0376 Item0377 Item0378 Item0379 Item0380 Item0381 Item0382 Item0383 Item0384 Item0385 Item0386 Item0387 Item0388 Item0389 Item0390 Item0391 Item0392 Item0393 Item0394 Item0395 Item0396 Item0397 Item0398 Item0399 Item0400 Item0401 Item0402 Item0403 Item0404 Item0405 Item0406 Item0407 Item0408 Item0409 Item0410 Item0411 Item0412 Item0413 Item0414 Item0415 Item0416 Item0417 Item0418 Item0419 Item0420 Percent Correct 54.9% 96.8% 93.4% 93.3% 77.2% 70.8% 80.5% 60.0% 85.7% 98.8% 74.4% 97.0% 87.9% 89.9% 79.7% 73.0% 93.6% 88.3% 86.4%
91.0% 45.8% 87.1% 92.3% 97.5% 91.8% 78.7% 75.2% 65.4% 70.7% 87.2% 45.8% 51.1% 12.9% 13.8% 62.8% 32.8% 88.0% 32.6% 88.2% 91.7% 61.9% 63.1%
30.8%
75.5% 86.9% 92.2% 74.4% 12
Item Correlation 0.2745 0.2091 0.2366 0.2154 0.3142 0.1829 0.1838 0.4192 0.2549 0.1373 0.0931 0.2443 0.1190 0.2174 0.2019 0.1284 0.1107 0.1722 ‐0.0136 0.1096 0.0947 0.0796 0.1800 0.1007 0.0452 0.1258 0.1046 0.1779 0.1517 0.1834 0.2562 0.1953 0.0241 0.0167 0.2288 0.0228 0.2765 0.2517 0.0481 0.3397 0.1164 ‐0.0229 ‐0.0236 0.2050 0.1959 0.1541 0.1949 Item ID Item0421 Item0422 Item0423 Item0424 Item0425 Item0426 Item0427 Item0428 Item0429 Item0430 Item0431 Item0432 Item0433 Item0434 Item0435 Item0436 Item0437 Item0438 Item0439 Item0440 Item0441 Item0442 Item0443 Item0444 Item0445 Item0446 Item0447 Item0448 Item0449 Item0450 Item0451 Item0452 Item0453 Item0454 Item0455 Item0456 Item0457 Item0458 Item0459 Item0460 Item0461 Item0462 Item0463 Item0464 Item0465 Item0466 Item0467 Percent Correct 86.4% 51.0%
88.2% 82.4% 94.2% 43.1% 66.8% 94.2% 84.9% 74.2%
49.3% 91.0% 43.5% 11.1%
75.2% 71.6% 49.7% 83.4% 47.7% 47.7% 43.6% 38.3% 55.4% 96.8% 84.9% 63.1% 69.1% 91.7% 80.3% 85.8% 76.6% 89.3% 95.4% 56.9% 47.8% 77.7% 86.7% 89.4% 86.6% 71.7% 85.6% 84.0% 61.7% 53.3% 70.3% 95.6% 91.7% 13
Item Correlation 0.2335 ‐0.0198 0.2406 0.3388 0.1789 0.1981 0.2360 0.1459 0.0769 ‐0.0284 0.0846 0.1916 0.2720 ‐0.0198 0.3345 0.0599 0.1348 0.0469 0.1906 0.0823 0.2169 0.2251 0.2318 0.1351 0.2119 0.2216 0.4286 0.2865 0.3360 0.3043 0.1990 0.2492 0.1788 0.0505 0.2303 0.3020 0.3193 0.3022 0.2173 0.2116 0.3015 0.3398 0.1683 0.2663 0.2313 0.1833 0.3037 Item ID Item0468 Item0469 Item0470 Item0471 Item0472 Item0473 Item0474 Item0475 Item0476 Item0477 Item0478 Item0479 Item0480 Item0481 Item0482 Item0483 Item0484 Item0485 Item0486 Item0487 Item0488 Item0489 Item0490 Item0491 Item0492 Item0493 Item0494 Item0495 Item0496 Item0497 Item0498 Item0499 Item0500 Item0501 Item0502 Item0503 Item0504 Item0505 Item0506 Item0507 Item0508 Item0509 Item0510 Item0511 Item0512 Item0513 Item0514 Percent Correct 75.3% 87.2% 77.2% 63.8% 71.7% 52.1% 89.1% 82.0% 56.6% 40.0% 45.5% 20.0% 38.5% 38.2%
85.0% 84.1% 74.6% 78.2% 26.6% 47.9% 88.4% 90.5% 89.1% 81.3% 78.5% 98.5% 79.7% 84.1% 93.8%
92.4% 95.7% 60.9% 57.3% 65.2% 73.6% 80.0% 86.6% 84.6% 33.3% 31.0% 89.1% 95.0% 86.3% 84.8% 70.2% 96.4% 90.9%
14
Item Correlation 0.2637 0.0410 0.1514 0.1435 0.0469 0.0865 0.2548 0.2506 0.3786 0.2283 0.1926 0.1295 0.3197 ‐0.1119 0.2649 0.1988 0.3399 0.4586 0.2364 0.1944 0.5279 0.3267 0.5577 0.3240 0.3786 0.1843 0.3147 0.3128 ‐0.0310 0.2125 0.1351 0.3096 0.3403 0.3668 0.3876 0.3065 0.2312 0.4090 0.0942 0.2235 0.1559 0.2001 0.2113 0.1706 0.2477 0.2042 ‐0.0056 Item ID Item0515 Item0516 Item0517 Item0518 Item0519 Item0520 Item0521 Item0522 Percent Correct 97.9% 97.2% 90.8% 93.5% 94.0% 51.9% 84.7% 99.3% 15
Item Correlation 0.1445 0.1741 0.2020 0.3242 0.2363 0.2005 0.1190 0.1013