Analysis of Item Characteristics of Mathematics Test Instruments with ITEMAN 4.3 Application

Abstract

The quality of test instruments in education is very important to accurately measure students' abilities and achievements. This study aims to evaluate the quality of mathematics tests and describe the results of item analysis which includes reliability, difficulty level, discrimination, and the effectiveness of distractors. This research uses quantitative descriptive method with the help of ITEMAN 4.3 application. The tested test instrument consisted of 20 multiple choice questions with four answer choices, which were given to 70 seventh grade students. The results showed an Alpha reliability value of 0.610, indicating a high level of reliability for the instrument. In terms of difficulty level, 2 items (10%) were classified as difficult, 15 items (75%) as medium, and 3 items (15%) as easy. In terms of discrimination, 1 item (5%) was classified as very good, 6 items (30%) as good, 4 items (20%) as fair, and 9 items (45%) as not good. Regarding the effectiveness of distractors, 18 items (90%) have effective distractors, while 2 items (10%) have ineffective distractors.Overall, considering the reliability, difficulty level, discrimination, and effectiveness of disctractors, 10 items (50%) were in the good quality category, 1 item (5%) in the good enough category, and 9 items (45%) in the not good quality category. The results of this study indicate that although most of the items are of good quality, there are some items that need to be improved to improve the overall quality of the test. This analysis is important to ensure that the test instrument used is able to provide an accurate and fair assessment of students' abilities.