Analysis of Multi Rater with Facets on Instruments HOTS of Solution Chemistry based on Tawheed

Open

A. Darmana, A. Sutiani, H.A. Nasution, N.S.A. Sylvia, N. Aminah, T. Utami

2021 Journal of Physics: Conference Series Vol. 1819 Issue 1 Conference paper Cited by 4 Quartile

Abstract

This research is part of the development research in solution chemistry-HOTS-Tawheed. The purpose of this research is to develop of instrument test Higher Order Thinking Skills (HOTS) based on Tawheed on solution chemistry. The stages of the research began by designing 40 multiple choice item with five options. The instrument assessed by five science education experts. Expert judgement analysis of the test item was carried out using the Rasch measurement model approach, facets software. The Multi-rater validation test results showed: (1) The five expert panels considered quality items 23 out of 40 (57.5%); (2) according to the five validators, the instrument items that are most difficult to fulfill from the questions are statements B4, K4, and K8 (logit>+1), while K10 (logit<-4) is the statement item that is easiest to fulfill from the questions; (3) aspect of statistical fit criteria, it can be seen that Val.A and Val.F experts are the most consistent (based on MNSQ and ZSTD); (4) the reliability of the items showed a good level (0.97); and (5) the similarity of assessment by the five experts (exact agreement) which reached 93.0% which shows that there was not much difference between the five experts in assessing all the items. © Published under licence by IOP Publishing Ltd.

Affiliations

Chemistry Department, Faculty of Mathematics and Natural Science, Medan State University, North Sumatra, Indonesia; Students of Chemistry Department, Faculty of Mathematics and Natural Science, Medan State University, North Sumatra, Indonesia