Differentiated assessment of mathematical competence with multidimensional adaptive testing. - Deutscher Bildungsserver

Differentiated assessment of mathematical competence with multidimensional adaptive testing.

h t t p : / / w w w . p s y c h o l o g i e - a k t u e l l . c o m / f i l e a d m i n / d o w n l o a d / p t a m / 4 - 2 0 1 6 _ 2 0 1 6 1 2 1 9 / 0 4 _ M i k o l a j e t z . p d f

[ Differentiated assessment of mathematical competence with multidimensional adaptive testing.Link defekt? Bitte melden! ]

The theoretical frameworks of large-scale assessments (LSAs) typically describe complex competence constructs. However, due to restrictions in testing time, the complexity of these competence constructs is often reduced to one or a small number of dimensions in operational LSAs. Because of its very high measurement efficiency, multidimensional adaptive testing (MAT) offers a solution to overcome this shortcoming. The present study demonstrates the capability of MAT to measure the 11 subdimensions of mathematical competence that are described in the theoretical framework of the German Educational Standards in Mathematics with sufficient precision without increasing test length. The characteristics of an empirically derived 11-dimensional competence distribution of 9,577 students and the parameters for 253 operational test items were used to simulate the application of MAT. Typical restrictions such as the usage of testlets or the fact that items in an open response format are in the item pool were taken into account in the simulation. Although the used item pool was not constructed for adaptive testing, the results show substantially higher reliability estimates for MAT compared to non-adaptive testing, especially for the subdimensions of mathematical competence, which are not as yet reported in the assessment. The results underscore the capacity of MAT to precisely measure competence constructs with many dimensions without the need to increase test length. This research therefore closes the current gap between theoretical underpinnings and actual measures in LSAs. (Orig.).