The purpose of this study is the validation of the GA Classic IESOL examination at CEFR level B2 (Reading, Listening, Writing and Speaking), as a criterion-referenced achievement test, using the multi-trait, multi-method approach. The data analysed at the moment pertain to the Listening unit and have been studied to examine the content validity, reliability of the scores and unidimensionality of the construct. The Listening unit consists of three tasks (22 items) in four different versions (D-E-F-G). Four separate statistical analyses were performed and all revealed excellent values of internal consistency. As for unidimensionality of the construct, excellent values were revealed for versions E, F and G and acceptable for version D. Similar analyses on the reading test are planned, with the aim of reaching a multitraitmultimethod analysis of the examination as a whole.Further steps of the study will be the IRT equating procedure of the four versions

Snezana, M., Botta, E., Castellana, G. (2022). Validation of a High-Stakes Test: GA IESOL Listening Unit. In Congress UPV 8th International Conference on Higher Education Advances (HEAd’22) (pp.1001-1008). valencia : 2022, Editorial Universitat Politècnica de València [10.4995/HEAd22.2022.14514].

Validation of a High-Stakes Test: GA IESOL Listening Unit

Botta Emanuela;Castellana Giuseppina
2022-01-01

Abstract

The purpose of this study is the validation of the GA Classic IESOL examination at CEFR level B2 (Reading, Listening, Writing and Speaking), as a criterion-referenced achievement test, using the multi-trait, multi-method approach. The data analysed at the moment pertain to the Listening unit and have been studied to examine the content validity, reliability of the scores and unidimensionality of the construct. The Listening unit consists of three tasks (22 items) in four different versions (D-E-F-G). Four separate statistical analyses were performed and all revealed excellent values of internal consistency. As for unidimensionality of the construct, excellent values were revealed for versions E, F and G and acceptable for version D. Similar analyses on the reading test are planned, with the aim of reaching a multitraitmultimethod analysis of the examination as a whole.Further steps of the study will be the IRT equating procedure of the four versions
9788413960036
Snezana, M., Botta, E., Castellana, G. (2022). Validation of a High-Stakes Test: GA IESOL Listening Unit. In Congress UPV 8th International Conference on Higher Education Advances (HEAd’22) (pp.1001-1008). valencia : 2022, Editorial Universitat Politècnica de València [10.4995/HEAd22.2022.14514].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11590/423527
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact