AMBIENTUM BIOETHICA BIOLOGIA CHEMIA DIGITALIA DRAMATICA EDUCATIO ARTIS GYMNAST. ENGINEERING EPHEMERIDES EUROPAEA GEOGRAPHIA GEOLOGIA HISTORIA HISTORIA ARTIUM INFORMATICA IURISPRUDENTIA MATHEMATICA MUSICA NEGOTIA OECONOMICA PHILOLOGIA PHILOSOPHIA PHYSICA POLITICA PSYCHOLOGIA-PAEDAGOGIA SOCIOLOGIA THEOLOGIA CATHOLICA THEOLOGIA CATHOLICA LATIN THEOLOGIA GR.-CATH. VARAD THEOLOGIA ORTHODOXA THEOLOGIA REF. TRANSYLVAN
|
|||||||
The STUDIA UNIVERSITATIS BABEŞ-BOLYAI issue article summary The summary of the selected article appears at the bottom of the page. In order to get back to the contents of the issue this article belongs to you have to access the link from the title. In order to see all the articles of the archive which have as author/co-author one of the authors mentioned below, you have to access the link from the author's name. |
|||||||
STUDIA PHILOLOGIA - Issue no. 2 / 2017 | |||||||
Article: |
STATISTICAL ANALYSIS OF ROMANIAN AS A FOREIGN LANGUAGE PRETEST AND EXAM DATA. Authors: LIANA STANCA, DINA VÎLCU. |
||||||
Abstract: DOI: https://doi.org/10.24193/subbphilo.2017.2.07 Published Online: 2017-06-15 Published Print: 2017-06-30 FULL PDF Statistical Analysis of Romanian as a Foreign Language Pretest and Exam Data. In the European Union, linguistic policies have gained an essential role within the European policy in its entirety. In this context, in 2014 we started an experiment with the aim of creating an instrument for analysing the quality of tests of Romanian as a foreign language. The instrument thus created contains a succession of statistics tests including factor structure, internal consistency and convergent validity evidence, IRT and ROC analysis for validation. Our creation reached the point where it successfully fulfills the task of Reading the Mind in the process of learning Romanian, also applicable to other languages. The present article shows the manner in which the authors apply the IRT models. It will demonstrate that the IRT models can help improve test scoring and facilitate the development of superior quality tests in Reading Mind applied to the process of studying foreign languages. In the authorsʼ perspective, the present work has a significant contribution to the applicability and usability of IRT models in educational testing, as the presented results show. Furthermore, the paper brings arguments in favour of utilizing IRT and ROC curve models in common, which leads to the conclusion that the achieved results are important in the process of improving the precision of marking and the manner in which the tests are administered through the adaptive use of discriminating elements pertaining to the testing procedure, which saves time, space and impacts on the number of assigned tests. Keywords: statistical analysis, language examinations, pretest, IRT model, ROC analysis, quality language tests, reading mind aspects. Bibliography Charles Alderson, “The shape of things to come: will it be the normal distribution?” in European language testing in a global context. Proceedings of the ALTE Barcelona Conference, 2001, p. 1-27. Lyle F. Bachman, Fundamental Considerations in Language Testing, Oxford, Oxford University Press, 1990. Lyle F. Bachman, Statistical Analyses for Language Assessment, Cambridge, Cambridge University Press, 2004. Michael Corrigan, Paul Crump, “Item Analysis”, in Research Notes, issue 59, 2015, p. 4-9. Coreen Docherty, David Corkill, “Test construction: The Cambridge English Approach”, in Research Notes, issue 59, 2015, p. 10-14. Mark Elliott, Lynne Stevenson, “Grading and test equating”, in Research Notes, issue 59, 2015, p. 14-20. Ardeshir Geranpayeh, “Introduction”, in Research Notes, issue 59, 2015, p. 3-4. Manual for Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, teaching, assessment accompanied by Further Material on Maintaining Standards across Languages, Contexts and Administrations by exploiting Teacher Judgment and IRT Scaling, Strasbourg, Council of Europe, Language Policy Division, 2009. http://www.coe.int/t/dg4/linguistic/manuel1_en.asp Tim McNamara, “Language Testing”, Oxford: Oxford University Press, 2000. Roger Hawkey, “A Modular Approach to Testing English Language Skills. The development of the Certificates in English Language Skills (CELS) examinations”, Cambridge, Cambridge University Press, 2005. Vasiu Lavinia-Iunia, Arieşan Antonela, 2016, “The Role of Monitoring Raters in Ensuring Accurate and Meaningful Test Scores. Case Study: RFL Examinations”, în WLC 2016 - World LUMEN Congress. Logos Universality Mentality Education Novelty 2016 LUMEN 15th Anniversary Edition, Volume XV, p. 1068-1076, (coord. Antonio SANDU, Tomita CIULEI & Ana FRUNZA). Dina Vîlcu, “Relaționarea examenelor de limba română ca limbă străină la CECR”, în Elena Platon, Antonela Arieșan (ed.), 40 de ani de limba română ca limbă străină la UBB. 1974-2014, Cluj-Napoca, Ed. Casa Cărții de Știință, 2014, p. 20-29. Dina Vîlcu, “Romanian as a foreign language in the context of language assessment in Europe”, în Studia Universitatis Babeș-Bolyai Philologia, nr 2/2015, p. 65-76. Cyril Weir, “Three lessons from the historiography of language testing”, 2014 CRELLA Summer Research Seminar, https://www.beds.ac.uk/crella/seminars/crella-research-seminars/crella-summer-research-seminar-2014 Aiken, Lewis R. 1994. Psychological Testing and Assessment, (Eight Edition), Boston: Allyn and Bacon. Bond TG, Fox CM. Applying the Rasch model: fundamental measurement in the human sciences. Mahwah: Lawrence Erlbaum Associates; 2001. MAT S. Deviant, The Practically cheating statistics handbook, ISBN-13: 978-1449957858 Baker, F. B. (1992). Item response theory: Parameter estimation techniques. New York: Marcel Dekker. Birnbaum, A. (1968). “Some latent trait models and their use in inferring an examinee''''s ability”. În F. Lord, & M. Novick, Statistical theories of mental test scores. Reading, MA: Addison Wesley. Bock, R. (1972). “Estimating item parameters and latent ablility when responses are scored in two or more nominal categories”. Psychometrika (37), 29-51. Crocker, L., & Algina, J. (1986). Introduction to classical & modern test theory. Orlando, FL: Holt, Rinehart and Winston Drugan T., Achimas A., Tigan S. Biostatistică, Editura SRIMA, Cluj-Napoca, ISBN:973-85285-5-0. (2005) Hambleton, R., Swaminathan, H., & Rogers, J. H. (1991). Fundamentals of Item Response Theory. London: Sage Publications Inc. Ghiselli, E. E., Campbell, J. P., & Zedeck, S. (1981). Measurement theory for the behavioral sciences. San Francisco: Freeman. Google Scholar Imran Zafar. 2008. “Item Analysis Assumptions, Measure of exam internal consistency (reliability) Kuder-Richardson 20 (KR20)”. Artikel Juni 2008. Database Administrator, Assessment Unit, Dept of Medical Education. Ext. 47142 Mason, S. J. and Graham, N. E. (2002), “Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation”. Q.J.R. Meteorol. Soc. , 128: 2145–2166. doi:10.1256/003590002320603584 McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum Associates. Slinde, J, Linn, R. “The Rasch Model, Objective Measurement, Equating, and Robustness”. visit at 19.02.2016 -conservancy.umn.edu/bitstream/handle/11299/99830/1/ v03n4p437.pdf *** Item Response Theory: Simple Definition was last modified, March 14th, 2017, www.statisticshowto.com/item-response-theory/ *** Rasch Model/Rasch Analysis: Definition, Examples, www.statisticshowto.com/rasch-model/ |
|||||||