Test Field | Form | Number of Tests Taken | Total Test Scaled Score Indices | Multiple-Choice Section | Open Response Section | Pearson Corr. of MC & OR Section Scores | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Mean | SEM | Decision Consistency | Stratified Alpha | G Coefficient | ||||||||||
Fixed | Random | Length | Keats' SEM | Computed SEM | KR20 | I Fixed | I Random | |||||||
01 TestName01 | A | 227 | 253 | 7.4 | 0.93 | 0.92 | 0.90 | 85 | 4.3 | 3.9 | 0.89 | 0.89 | 0.61 | 0.66 |
B | 221 | 254 | 7.3 | 0.91 | 0.92 | 0.89 | 85 | 4.3 | 3.8 | 0.87 | 0.89 | 0.63 | 0.63 |
- Test Field. The test field code and name.
- Form (A, B, C, etc.). For each test field, a letter code designates the different test forms—each comprising a different set of scorable multiple-choice items—that were administered during the reporting period. Test forms are considered to be identical if they contain identical sets of scorable multiple-choice items, regardless of the order of the items.
- Number of Tests Taken. The number of tests taken during the reporting period, including those tests retaken by the same candidate.
- Total Test Scaled Score Indices
- Mean. The mean of the total test scaled scores achieved by the candidates taking the test form, reported for each test form taken by 10 or more candidates.
- SEM. The standard error of measurement of the total test scaled scores (Brennan 2001), reported for each test form with at least 100 attempts.
- Decision Consistency. The total test decision consistency index of the total test scaled score (Breyer and Lewis 1994), reported for each test form with at least 100 attempts.
- Stratified Alpha (Fixed and Random). Stratified coefficient alpha (with items as a fixed facet and with items as a random facet), reported for each test form with at least 100 attempts.
Multiple-Choice Section
- Length. The number of scorable items in the multiple-choice section.
- Keats' SEM (Keats 1957). The estimated standard error of measurement of the multiple-choice section (on the raw score metric), reported for each test form with at least 100 attempts.
- Computed SEM. The computed standard error of measurement for the multiple-choice section (on the raw score metric), reported for each test form with at least 100 attempts
- KR20. The Kuder-Richardson index of item homogeneity.
G Coefficient (I Fixed and I Random). The Generalizability coefficient (with I fixed and I random) (reported for each test form with at least 100 attempts).
Pearson Corr. of MC and OR Section Scores. Pearson Correlation of Multiple-Choice and Open-Response Section Scores, reported for each test form with at least 100 attempts.