Using the Rasch model to validate a multiple choice English achievement test
Journal: International Journal of Language Studies (Vol.6, No. 4)Publication Date: 2012-10-01
Authors : Judith RUNNELS Hiroshima Bunkyo Women's University Japan;
Page : 141-153
Keywords : Rasch model; Fit Statistics; Person-Item Map; Assessment Evaluation; Validity;
Abstract
Rasch analyses have been linked by numerous scholars to the six facets of Messick’s (1989) concept of construct validity and are commonly used to evaluate pedagogical assessment. Compared to deterministic statistics from classical test theory, the Rasch model’s prescriptive methods have been argued to provide stronger validity evidence. Rasch-based methods estimate probabilities of item endorsements according to person ability and item difficulty parameters, highlighting items that produce some degree of unexpected response patterning. In the current article, a multiple-choice achievement test taken by English as a Foreign Language students at a private university in Japan was analyzed. The results show very little misfit to the Rasch model and that the level of the test was appropriately targeted to the abilities of the test-taking population, covering a range of statistically distinct difficulties. Fit statistics, an item-person map, item strata, Rasch measures, point-measure correlations and their relation to Messickian validity are discussed.
Other Latest Articles
- Rethinking face and politeness
- Stupid as a Coin: Meaning and rhyming similes in Vietnamese
- Language learning motivation: Applying the L2 Motivational Self System
- The (re)nationalization of Hong Kong: The nexus of language and social identity in 2002 and 2009
- The processing of asymmetric and symmetric sentential conjunction
Last modified: 2014-01-27 17:13:06