Hodnocení bakalářských prací jako přijímací kritérium do navazujícího magisterského studia : psychometrická kazuistika

Warning

This publication doesn't include Faculty of Education. It includes Faculty of Social Studies. Official publication website can be found on muni.cz.

Title in English	Bachelor's thesis rating as an admission criterion to the master's program of psychology : a psychometrical case study
Authors	CÍGLER Hynek JEŽEK Stanislav ŠIRŮČEK Jan LACINOVÁ Lenka
Year of publication	2022
Type	Article in Periodical
Magazine / Source	Studia paedagogica
MU Faculty or unit	Faculty of Social Studies
Citation
Web	článek - open access
Doi	http://dx.doi.org/10.5817/SP2022-1-4
Keywords	Linear Logistic Test Model; LLTM; high-stakes testing; rating scale; entrance test; generalizability theory
Attached files	Hodnoceni_bakalarskych_praci_jako_prijimaci_kriterium_navazujiciho_mgr_studia.pdf
Description	The COVID-19 pandemic influenced admissions testing for the master's degree program of psychology at Masaryk University in 2020. The administration of the standard paper-and-pencil knowledge test was not possible; therefore, we chose the bachelor's thesis ratings instead. This paper is a psychometrical case study that covers the development of criteria related to content validity, design selection, and results. Two randomly selected raters evaluated each thesis, and we equated their severity using a linear logistic test model (LLTM) under the item response theory (IRT) paradigm. This procedure resulted in unidimensional and unbiased scores equated across 18 judges and 2 terms (n1 = 82, n2 = 48). The reliability was comparable to the standard tests, rxx' = 0.869, and judge severity and criteria difficulty did not differ across them. The resulting ratings seem to be valid and no less fair than the written exam. The proposed method can serve other departments and other goals, not only as an entrance test. We share an analytical script and all the necessary materials to enhance the use of this method.