Test to evaluate knowledge in Law
analysis of the items by applying the Rasch model
Keywords:
General Knowledge Testing, Test Construction, Item bank, Item Response Theory, LawsAbstract
The evaluation of the academic performance of university students is a fundamental element to measure the quality of education in a higher education. The most direct way to obtain this qualification is through exams or probing tests, however if we consider that teachers are the ones who determine the form of evaluation, these instruments may present shortcomings in their elaboration. Therefore, in the School of Psychology of the National University of Cordoba is being built a test that attempts to estimate the academic performance of university students. Reason for which in this work the Rasch model is applied to evaluate the psychometric properties of 31 items of Level I of the knowledge domain in Laws. The sample consisted of 170 students aged between 19 and 60 years (M = 24.59, DE = 6.22). In general, the items have good psychometric properties. This work makes significant contributions in the field of measurement and evaluation in our environment, based on the need to evaluate the wide range of knowledge and skills that students must achieve in the university environment.
References
Arancibia, V. (1997). Los sistemas de medición y evaluación de la calidad de la educación.
Santiago de Chile: UNESCO.
Attorresi, H. F., Lozzia, G. S., Abal, F. J., Galibert, M. S., & Aguerri, M. E. (2009). Teoría de Respuesta al Ítem. Conceptos básicos y aplicaciones para la medición de constructos psi- cológicos. Revista Argentina de Clínica Psicológica, 18(2), 179-188. Recuperado de http:// www.redalyc.org/articulo.oa?id=281921792007
Baker, F. B. (2001). The basics of Item Response Theory. ERIC clearinghouse on assessment and evaluation(2nd ed). Recuperado de http://echo.edres.org:8080/irt/baker/final.pdf
Bond, T. G., & Fox, C. M. (2001). Apllying the Rasch Model. Mahwah, New Jersey: Lawrence Erlbaum Associates, Publishers.
Chen, W. H., Lenderking, W., Jin, Y., Wyrwich, K. W., Gelhorn, H., & Revicki, D. A. (2014). Is Rasch model analysis applicable in small sample size pilot studies for assessing item characteristics? An example using PROMIS pain behavior item bank data. Quality of Life Research, 23 (2) 485-493. doi: 10.1007/s11136-013-0487-5
Cupani, Marcos, Ghio, Fernanda Belén, Leal, María Florencia, Giraudo, Gimena Mariel, Castro Zamparella, Tatiana, Piumatti, Gisella, Casalotti, Antonella Belén, Ramírez, Juan Claudio, Arranz, María Andrés, Farías, Analía Norma, Padilla, Natalia, & Barrionuevo, Leandro. (2016). Desarrollo de un banco de ítems para medir conocimiento en estudiantes universi- tarios. Revista de psicología (Santiago), 25(2), 1-18. doi: 10.5354/0719-0581.2017.44808
Gauggel, S., Heinemann, A. W., Böcker, M., Lämmler, G., Borchelt, M., & Steinhagen- Thies- sen, E. (2004). Patient-staff agreement on Barthel index scores at admission and dischar- ge in a sample of elderly stroke patients. Rehabilitation Psychology. 49(1), 21-27. doi: 10.1037/0090-5550.49.1.21
Iraurgi, I., Lozano, O., González-Saiz, F., & Trujols, J. (2008). Valoración psicométrica de la Escala de severidad de la de-pendencia a partir de dos modelos de análisis: La Teoría Clá- sica de los Test y la Teoría de Respuesta al Ítem. Boletín de Psicología, 93, 41-57. Recupe- rado de https://www.uv.es/seoane/boletin/previos/N93-3.pdf
Linacre, J. M. (1994). Sample size and item calibrations stability. Rasch Measurement Transac- tions, 7(4), 328. Recuperado de https://www.rasch.org/rmt/rmt74m.htm
Linacre, J. M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Mea- surement, 3(1), 85-106. doi: 10.1.1.424.2811
Linacre, J. M. (2007) Winsteps (Version 3.63.2)[Software de computación]. Chicago, IL: Winsteps.
Linacre, J. M. (2018). A User’s Guide to Winsteps® Ministep Rasch-Model Computer Pro- grams: Program Manual 4.2.0. Chicago: WINSTEPS.com, 2018. [Internet] Recuperado de: http://www.winsteps.com/winman/copyright.htm
Martínez Arias, R. (2006). La metodología de los estudios PISA. Revista de Educación, 1, 111-
Recuperado de http://www.revistaeducacion.mec.es/re2006/re2006_08.pdf
Martínez Rizo, F. (2009). Evaluación formativa en aula y evaluación a gran escala: hacia un sistema más equilibrado. Revista electrónica de investigación educativa, 11(2), 1-18. Recuperado de https://redie.uabc.mx/redie/article/view/231
Martinez Rizo, F. (Coord.) (2015). Las pruebas ENLACE y Excale. Un estudio de validación. México: INNE. Recuperado de http://publicaciones.inee.edu.mx/buscadorPub/P1/C/148/ P1C148.pdf
Navas, L., Sampascual, G., & Santed M. A. (2003). Predicción de las calificaciones de los es- tudiantes: la capacidad explicativa de la inteligencia general y de la motivación. Revista de Psicología General y Aplicada, 56(2), 225-237. Recuperado de https://dialnet.unirioja.es/ servlet/articulo?codigo=760681
Olea, J., Ponsoda, V., Prieto, G. (eds.) (1999). Tests Informatizados: fundamentos y aplicacio- nes. Madrid. Pirámide.
Prieto, G. & Delgado, A. R. (2003). Análisis de un test mediante el modelo de Rasch. Psicothe- ma, 15(1), 94-100. Recuperado de http://www.psicothema.com/pdf/1029.pdf
Rodríguez-Garcés, C., Muñoz, S. M., & Castillo, R. V. (2014). Tests informatizados y su con- tribución a la acción evaluativa en educación. Revista de Educación a Distancia, 43, 1-17. Recuperado de http://www.um.es/ead/red/43/marlene.pdff
Shavelson R.J., Zlatkin-Troitschanskaia O., Mariño J.P. (2018) International Performance As- sessment of Learning in Higher Education (iPAL): Research and Development. In: Zlat- kin-Troitschanskaia O., Toepper M., Pant H., Lautenbach C., Kuhn C. (eds) Assessment of Learning Outcomes in Higher Education:Cross-National Comparisons and Perspectives (Methodology of Educational Measurement and Assessment) . Cham, CH: Springer Inter- national Publishing. doi:10.1007/978-3-319-74338-7_10
Vargas, G. M. (2007). Factores asociados al rendimiento académico en estudiantes universita- rios, una reflexión desde la calidad de la educación superior pública. Revista Educación, 31(1), 43-63. doi:10.15517/revedu.v31i1.1252
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2019 PsiqueMag
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
-
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
