The Nature of an English Test: Difficulty Index and Distractor Analysis

Rusma Setiyana, Endah Anisa Rahma, Rina Syafitri

Abstract


Language assessment plays such a vital role in English teaching and learning process to measure students’ ability. Doing mistake in creating test items leads the failure in finding out presumption of the student’s achievement. This research was expected to break down the nature of English test including the difficulty index and the adequacy of distractors as a part of an english language assessment. Content analysis was utilized in this study by using two different techniques, namely check list and document analysis to collect the information data. The information from checklist were investigated by utilizing a factual method in percentage and the information from archive examination were analyzed  by using a test item analysis software. The result demonstrates that in the term of difficulty index, the english item test met 48% to be acknowledment and the presentage of distractor effectiveness of English test was 41%. It means that more than 50% of the test should be revised and removed.


Keywords


English test; difficulty index; distractor; language assessment

Full Text:

PDF

References


Arikunto, S. (2009). Dasar-dasar Evaluasi Pendidikan. Jakarta: Bumi Aksara.

Brown, H Douglas. (2000). Language Assessment: Principles and Classroom Practices. White Plains, NY: Pearson Education.

Burton, S.J, Richard R. Sudweeks, Paul F. Merril, Bud W. (1991). How to Prepare Better Multiple Choice Tests: Guidelines for University Faculty. Retrieved from https://testing.byu.edu/handbooks/betteritems.pdf

Churchill, B. (2013). Social Research Methods. Melbourne: Oxford University Press

DiBattista, David & Laura Kurzawa. (2011). Examination of the Quality of Multiple-choice Items on Classroom Tests: the Canadian Journal for the Scholarship of Teaching and Learning: Vol. 2: Iss. 2, Article 4, 1-23.

Fulcher, G, & Fred Davidson. (2007). Language Testing and Assessment. New York: Routlegde.

Gierl, M.J. (2017). Developing, Analyzing, and Using Distractors for Multiple-Choice Tests in Education: A Comprehensive Review. AERA: 87(6), 1082-1116. http://rer.aera.net

Haladyna, T. M. (2016). Item analysis for selected-response test items. New York, NY: Routledge.

Haladyna, T. M., & Rodriguez, M. C. (2013). Developing and validating test items. New York, NY: Routledge.

Jackson, K. (2003). Guidelines for Writing Multiple Choice Questions. Retrieved from http://www.education.vic.gov.au/languagesonline/games/comprehension/docs/multiple%20choice%20questions.pdf

Khalifa, H & Cyril J.W. (2009). Studies in Language Testing. Cambridge: Cambridge University Press.

Krippendorff, K. (2003). Content Analysis: An Introduction to Its Methodology 2nd Edition. Thousand Oaks: SAGE Publications.

Linn, R. L & Gronlund. (2002). Measurement and Assessment in Teaching. Upper Saddle River, NJ: Prentice Hall.

Manalu, D., Sipayung, K.T, & Lestari, F.D. (2019). An Analysis of Students Reading Final Examination by Using Item Analysis Program on Eleventh Grade of SMA Negeri 8 Medan. Journal of Eenglish Teaching & Applied Linguistic, 1(1), 13-19. https://doi.org/10.36655/jetal.v1i1.98

Mkrtchyan, A. (2011). Disctractor Quality Analyze in Multiple Choice Question Based on Information Retrieval Model. Retrieved from http://www.eqanie.eu/media/Conference%20Vienna%202011/Papers/Paper%20Mkrtchyan_Short.pdf

Moreno, R., Martínez, R. J., & Muñiz, J. (2015). Guidelines based on validity criteria for the development of multiple choice items. Psicothema, 27, 388–394. doi:10.7334/psicothema2015.110.

Sajjad, M., Iltaf, S. & Khan, R.A. (2020). Nonfunctional distractor analysis: An indicator for quality of Multiple choice questions. Pak J Med Sci. 2020;36(5):982-986. doi: https://doi.org/10.12669/pjms.36.5.2439

Stemler, S. (2001). An overview of content analysis. Practical Assessment, Research & Evaluation, 7(17). Retrieved from http://PAREonline.net/getvn.asp?v=7&n=17

Sunarya. (2003). Panduan Anates Kr-2003. Retrieved from http://file.upi.edu/Direktori/FIP/JUR._PSIKOLOGI_PEND_DAN_BIMBINGAN/195911301987031-YAYA_SUNARYA/BAHAN_EVALUASI-ASESMEN/ANALISIS.pdf




DOI: https://doi.org/10.35308/ijelr.v2i2.2781

Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 International Journal of Education, Language, and Religion

p-ISSN : 2721-429X
e-ISSN : 2721-4273

Published by Language Center of Universitas Teuku Umar
Website : http://jurnal.utu.ac.id/IJELR
Email    : ijelr@utu.ac.id

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.