ASSESSING THE VALIDITY AND RELIABILITY OF SCIENCE MULTIPLE CHOICE TEST USING RASCH DICHOTOMOUS MEASUREMENT MODEL
Journal: Journal of Baltic Science Education (Vol.20, No. 6)Publication Date: 2021-12-12
Authors : Najah Hazirah Mohd Dzin; Yoon Fah Lay;
Page : 924-941
Keywords : multiple-choice test; Rasch measurement model; reliability and validity; science subject; secondary school standard curriculum;
Abstract
Multiple choice tests are widely applied to assess students' knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and the head of the science department with close reference to Secondary School Standard Curriculum (KSSM) syllabus. The test consists of 50 multiple-choice items with four options. Rasch measurement model was adopted to evaluate the quality of the Science Multiple-choice Test in terms of reliability analysis, item polarity analysis (PTMEA-CORR), item fit analysis and Principal Component Analysis of Residuals (PCAR). The reliability analysis was performed using Cronbach's Alpha, and the results of reliability and separation index respectively indicated good reliability level of the test items. In order to improve the validity of the test, two negatively worded items (Q39 and Q40) were removed. Lastly, the PCAR analysis showed the unexplained variance in the 1st contrast (5.4%) was found to be well controlled and was below the ceiling value of one-third of the variance explained by the item (18.7%). However, the positive value of the disattenuated correlations indicate no evidence of the presence of secondary dimension.
Other Latest Articles
- COMPREHENSIVE ANALYSIS OF THE FORT INSTRUMENT: USING DISTRACTOR ANALYSIS TO EXPLORE STUDENTS’ SCIENTIFIC REASONING BASED ON ACADEMIC LEVEL AND GENDER DIFFERENCE
- PRE-SERVICE SCIENCE TEACHERS’ EXPERIENCES OF HOME-BASED PRACTICAL WORK UNDER EMERGENCY REMOTE TEACHING
- STUDENTS’ ATTITUDES TOWARDS SCIENCE: THE CONTRIBUTION OF A CITIZEN SCIENCE PROJECT FOR MONITORING COASTAL WATER QUALITY AND (MICRO)PLASTICS
- THE EFFECT OF REACT STRATEGY ON ACHIEVEMENT IN SCIENCE EDUCATION: A MIXED RESEARCH SYNTHESIS
- PUBLIC SCIENCE EDUCATION: SOME MORE ROLES AND CONTRIBUTIONS
Last modified: 2021-12-12 03:08:35