COMPREHENSIVE TEST ITEMS ANALYSIS OF TEACHER-MADE ENGLISH SUMMATIVE ASSESSMENT IN THIRD GRADE PRIMARY SCHOOL

Enggar Pangesti Wibowo

Abstract


Summative test is a written test given at the middle or end of the semester. This study aims to investigate the overall quality of a teacher-made English summative test at one of private Islamic elementary school in Semarang, Central Java, using the general and specific guidelines set for constructing good test items. This research offers a document analysis of a qualitative study involving teacher-made test at primary school level that remains under-explored. The study reveals that the test instrument consists of single and complex multiple-choice questions, short answers and essays that assess the students’ ability in vocabulary, grammar, and simple sentences. The test items generally meet most of the aspects of the principles, but some aspects require further attention such as the use of correct punctuation and spelling, clear, contextualised and functional images, and appropriate grammar. In particular, the options in single-choice and complex multiple-choice questions should be organised homogeneously. For short answer questions, it is necessary to ensure that each question has one correct answer. On the essay questions, no significant problems were found. Revisions are needed to enhance the quality of the test. Accordingly, this study provides valuable insights and improvement recommendations to address aspects that become concerns.


Full Text:

PDF

References


Afriyanti, R. (2015). An analysis of English tests at pilot international standard school in 2010/2011 – 2011 /2012 academic year. Teaching English Linguistics Literature Usage (TELL-US) Journal, 1(1).

Ahmed, F., Ali, S., & Shah, R. . (2019). Exploring variation in summative assessment: Language teachers’ knowledge of students’ formative assessment and its effect on their summative assessment. Bulletin of Education and Research , 41(2), 109–119.

American Educational Research Association, American Psychological Association, & the National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Amer Educational Research Assn.

Bachman, L., & Palmer, A. (1996). Language testing in practice. Oxford University Press.

Barnes, N., Fives, H., & Dacey, C. M. (2017). U.S. teachers’ conceptions of the purposes of assessment. Teaching and Teacher Education, 65, 107–116. https://doi.org/10.1016/j.tate.2017.02.017

Beach, R. (1993). A teacher’s introduction to: Reader-response theories. NCTE.

Benigno, V., & de Jong, J. (2016). The “Global scale of English learning objectives for young learners”: A CEFR-based inventory of descriptors. In M. Nikolov (Ed.), Assessing young learners of English: Global and local perspectives (Vol. 25, pp. 43–64). Springer. https://doi.org/10.1007/978-3-319-22422-0_3

Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40. https://doi.org/10.3316/QRJ0902027

Brown, H., & Abeywickrama, P. (2019). Language assessment : Principles and classroom practices (3rd ed.). Pearson Education.

Brown, H. D. (2003). Language Assessment: Principles of language learning and teaching. Longman.

Burke, K. (2009). How to assess authentic learning (5th ed.). Corwin .

Butterfield, J. (Ed.). (2015). Fowler’s dictionary of modern English usage (4th ed.). Oxford University Press.

Creswell, J. W. (2015). A concise introduction to mixed methods research. SAGE Publications.

Cunningham, G. K. (1998). Assessment in the classroom: Constructing and interpreting texts. The Falmer Press.

Dann, R. (2020). Formative assessment. In Promoting assessment as learning (pp. 36–54). Routledge. https://doi.org/10.4324/9780203470152-8

De Silva, R. (2021). Assessment literacy and assessment practices of teachers of English in a South-Asian context: Issues and possible washback. In B. Lanteigne, C. Coombe, & J. D. Brown (Eds.), Challenges in language testing around the world (pp. 433–446). Springer Singapore. https://doi.org/10.1007/978-981-33-4232-3_31

Dixson, D. D., & Worrell, F. C. (2016). Formative and summative assessment in the classroom. Theory Into Practice, 55(2), 153–159. https://doi.org/10.1080/00405841.2016.1148989

Drummond, N. (2022). Formative and summative assessment in English language teaching: An explorative case study. Malmö University.

Erna, N., Jabu, B., & Salija, K. (2018). An analysis of English teacher-made tests. Makassar State University.

García Laborda, J., Sampson, D. ., Hambleton, R. ., & Guzman, E. (2015). Guest editorial: Technology supported assessment in formal and informal learning. Journal of Educational Technology & Society, 18, 1–2.

Garner, B. A. (2016). Garner’s modern English usage (4th ed.). Oxford University Press.

Glaser, R. (1994). Criterion-referenced tests: Part I origins. Educational Measurement: Issues and Practice , 13(4), 9–11.

Harris, D. (1969). Testing English as a second language. McGraw-Hill Book Company.

Hasselgreen, A., & Caudwell, G. (2016). Assessing the language of young learners. Equinox.

Hughes, A. (2002). Testing for Language Teachers. Cambridge University Press. https://doi.org/10.1017/CBO9780511732980

Jang, E., & Wagner, M. (2014). Diagnostic feedback in the classroom. In A.J. Kunnan (Ed.), The companion to language assessment. Volume II: Approaches and development (pp. 157–175). John Wiley & Sons, Inc.

Jin, Y., Wu, Z., Alderson, C., & Song, W. (2017). Developing the China standards of English: Challenges at macropolitical and micropolitical levels. Language Testing in Asia, 7(1), 1. https://doi.org/10.1186/s40468-017-0032-5

Kansas Curriculum Center. (2001). Is this a trick question?: A short guide to writing effective test questions (B. Clay & E. Root (Eds.)). The Kansas State Department of Education.

Ketabi, S., & Ketabi, S. (2014). Classroom and formative assessment in second/foreign language teaching and learning. Theory and Practice in Language Studies, 4(2). https://doi.org/10.4304/tpls.4.2.435-440

Lebagi, D., Sumardi, S., & Sudjoko, S. (2017). The quality of teacher-made test in EFL classroom at the elementary school and its washback in the learning. Journal of English Education, 2(2), 97–104. https://doi.org/10.31327/jee.v2i2.289

Lestari, R., Asrori, M., & Sulistyawati, H. (2019). The English teaching strategies for young learners in an international primary school in Surakarta. English Education Journal, 7(2), 151–163.

Lok, B., Mcnaught, C., & Young, K. (2015). Criterion-referenced and norm-referenced assessments: Compatibility and complementarity. Assessment & Evaluation in Higher Education, 41(3), 450–465.

Lundahl, B. (2014). Texts, topics and tasks: Teaching English in years 4-6. Malmö University Electronic Publishing.

Malloy, A. (2015). Seven essential considerations for assessing young learners. Bio Techniques, 24(1), 20–23.

Marsevani, M. (2022). Item analysis of multiple-choice questions: An assessment of young learners. English Review: Journal of English Education, 10(2), 401–408. https://doi.org/10.25134/erjee.v10i2.6241

Mina, R., & Wijaya, B. (2014). An analysis on the English multiple-choice item test for primary students. Jurnal Pendidikan Dan Pembelajaran Khatulistiwa, 3(7), 1–12.

Özdemir-Y?lmazer, M., & Özkan, Y. (2017). Classroom assessment practices of English language instructors.

Pinter, A. (2017). Teaching young language learners. Oxford University Press.

Purpura, J. E. (2016). Second and foreign language assessment. The Modern Language Journal, 100(S1), 190–208. https://doi.org/10.1111/modl.12308

Pusmendik. (2019). Panduan penilaian tes tertulis. Kementerian Pendidikan dan Kebudayaan Republik Indonesia.

Rea-Dickins, P., & Rixon, S. (1999). Assessment of young learners’ English - Reasons and means. In S. Rixon (Ed.), Young learners of English: Some research perspectives (pp. 89–101). Longman.

Sar?göz, ?. H., & Fi?ne, F. (2018). English language assessment and evaluation practices in the 4th grade classes at main stream schools. Journal of Language and Linguistic Studies, 14(3), 380–395.

Septi, N. K. D., Paramartha, A. G., & Wahyuni, L. G. (2020). An analysis of the quality of teacher-made multiple-choice test used as summative assessment for English subject. Jurnal Imiah Pendidikan Dan Pembelajaran, 4(1), 356–368.

Shepard, L., Kagan, S., & Wurtz, E. (1998). Principles and recommendations for early childhood assessments. National Education Goals Panel.

Stiggins, R. (1988). Revitalizing classroom assessment: The highest instructional priority. Phi Delta Kappan, 69, 363–368.

Sylvén, L., & Sundqvist, P. (2016). Validation of a test measuring young learners’ general L2 English vocabulary knowledge. Novitas-ROYAL (Research on Youth and Language), 10(1), 1–23.

Timpe-Laughlin, V., & Cho, Y. (2021). Reflecting on assessing young foreign language learners. Language Testing, 38(3), 343–355. https://doi.org/10.1177/0265532221998264

Torres, J. O. (2019). Positive impact of utilizing more formative assessment over summative assessment in the EFL/ESL classroom. Open Journal of Modern Linguistics, 09(01), 1–11. https://doi.org/10.4236/ojml.2019.91001

Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018). Authentic assessment: Creating a blueprint for course design. Assessment & Evaluation in Higher Education, 43(5), 840–854. https://doi.org/10.1080/02602938.2017.1412396

Waugh, D., Waugh, R., & Warner, C. (2021). Teaching grammar, punctuation and spelling in primary schools (4th ed.). Learning Matters.

Widiastuti, I. A. M. (2023). Assessing young learners (L.Artini & I. B. Mantra (Eds.)). Unmas Press.

Wiggins, G. (1989). A true test: Toward more authentic and equitable assessment. Phi Delta Kappan, 70, 703–710.




DOI: https://doi.org/10.31932/jees.v8i1.4241

Article Metrics

Abstract view : 241 times
PDF - 138 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.