Evaluating the Construct Validity of Final Test of Grade Three of Junior High School in Iran

Mojtaba Eghlidi, Omid Tabatabaei

Abstract


Construct validity “is a fundamental requirement for the effective operation of any assessment system that everybody involved in interpreting assessment results shares at least a basic understanding of the construct or constructs involved” (Green, 2014, p. 81). The aim of the present study was to evaluate the construct validity of final test of grade three of junior high school used in Fars Province, Iran. To achieve this objective 35 EFL teachers teaching English at public schools participated. Also, 50 students’ final test sheets in 2016-2017 school year were selected. One instrument was a 17-items researcher-made checklist to evaluate the construct validity by the teachers. Data obtained from this instrument were analyzed using descriptive statistics i.e. Mean and Standard Deviation. The results revealed that participants evaluated 53% of the construct of the test as valid. It means that they evaluated the construct validity of the test as fair, but not strong. The second instrument was the students’ final test sheets. The scores were analyzed using item facility (If) and item discrimination (ID) to find the acceptable items. 36.66% of items were acceptable in the sample of the study. Another analysis refers to correlation coefficient among total score and test parts and, also, among test parts themselves. The correlation among test score and test parts was very strong (r>0.8), and it was strong among test parts (r>0.6). Because the test framework is recommended by Curriculum and Textbooks Development Office of Iranian Ministry of Education, the results of this study can be used to enhance construct validity of national-wide tests.


Keywords


construct validity, test, validation, assessment

Full Text:

PDF

References


Alderson, J. C., Clapham, C., & Wall, D. (1995). Language test construction and evaluation. England. Cambridge: Cambridge University Press.

Brown, J. (1996). Testing in language programs. Upper Saddle River, NJ: Prentice Hall Regents.

Carroll, J. B. (1987). 8 new perspectives in the analysis of abilities. The Influence of Cognitive Psychology on Testing, 13, 267-284.

Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443-507). Washington, DC: American Council on Education.

Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.

Ebel, R. L., & Frisbie, D. A. (1991). Essentials of educational measurement (5th ed.). Prentice-Hall, Englewood Cliffs.

Fallahian Sichani, E., & Tabatabaei, O. (2015). Construct Validity of MSRT Reading Comprehension Module in Iranian Context. English Language Teaching, 8(9), 173-186.

Green, A. (2014). Exploring language assessment and testing. New York: Routledge.

Heydari, P., Bagheri, M., Zamanian, M., Sadighi, F., & Yarmohammadi, L. (2014). Investigating the construct validity of “structure and written expression” section of tolimo through factor analysis. International Journal of Language Learning and Applied Linguistics World, 5(1), 430-438.

Hodson, P. (2014). Practical validation: Organisational approaches to large-scale evaluation and continuous improvement. IAEA Singapore, 1-10.

Lord, F. M. (1952). The relationship of the reliability of multiple-choice test to the distribution of item difficulties. Psychometrika, 18, 181-194.

Lynch, K. B. (2003). Language assessment and program evaluation. Edinburgh, Scotland: Edinburgh University Press.

Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-104). New York, NY American Council on education and Macmillan.

Messick, S. (1995). Validity of psychological assessment. Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. American Psychologist, 5(4), 741-749.

Miller, I., & Miller, M. (2012). John E. Freund's Mathematical Statistics with Applications (8th ed.). Prentice Hall: Pennsylvania State University.

Moore, T., & Morton, J. (2012). Construct validity in the IELTS Academic Reading Test: A comparison of reading requirements in IELTS test items and in university study. Studies in language testing. 34.

Richards, J. C., & Schmidt, R. (2010). Longman dictionary of language teaching & applied linguistics (4rd ed.). Essex: Pearson Education Limited.

Zoghi, M., Rostami, G, & Gholami, H. (2016). An evaluation of the construct validity of Iranian national test of English at high schools. Journal of Applied Linguistics and Language Research, 3(1), 185-196.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2018 Journal of Applied Linguistics and Language Research