Do local curriculum scores correlate with national residency test results? A pluriannual, nationwide survey of Italian Medical Universities

Abstract

In Italy, to match medical doctors to specialty residencies, the Minister of Education organizes a national multiple choice questions exam composed of 140 items. The curriculum grants additional points based on the candidates’ grade average and graduation mark. Both national and international policies assume that curriculum scores can be evaluated in absolute terms, irrespective of the course attended by the candidate or its University of graduation. A fair inquiry over the current criteria of selection is not available to this day. Hence, this study aimed at investigating the degree of association between results in the Italian national residency test and the score given for each candidate’s curriculum. We calculated Spearman’s correlation coefficients between the score obtained at the 2019 test and curriculum scores. A moderate/high degree of correlation (rho=0.600) was reached. Spearman’s rho ranged from 0.447 to 0.788, considering the single Universities. We thus measured a modest but non-negligible between-University variability. As differences between test and curriculum scores across institutions may determine the admission or not to the residency for many candidates, the authors call for broader attention on the topic.

Dimensions

Altmetric

PlumX Metrics

Downloads

Download data is not yet available.

References

Directive 36/EC of the European Parliament and of the Council on the recognition of professional qualifications [Internet]; Sep 30, 2005. Available from: http://data.europa.eu/eli/dir/2005/36/oj/eng

Decree n. 859 from the Minister of Education for the admission test in the Italian medical specialty schools [Internet]; May 2, 2019. Available from: https://www.universitaly.it/index.php/content/ssm1819-normativa

European Commission. Regulated professions database [Internet]; ongoing [cited 2020 Apr 16]. Available from: https://ec.europa.eu/growth/tools-databases/regprof/index.cfm?action=homepage

Enpam - Eurispes. Il termometro della salute 1° Rapporto sul Sistema sanitario [Internet]; 2017 [cited 2020 Oct 15]. Available from: https://eurispes.eu/ricerca-rapporto/enpam-eurispes-il-termometro-della-salute-1-rapporto-sul-sistema-sanitario-2017/

Messick S. Standards of validity and the validity of standards in performance assessment. Educ Meas Issues Pract 1995;14:5-8. DOI: https://doi.org/10.1111/j.1745-3992.1995.tb00881.x

R Core Team. R: A language and environment for statistical computing. [Internet]. Vienna, Austria; 2020. Available from: https://www.R-project.org

Published
2021-02-12
Info
Issue
Section
Original Articles
Keywords:
Testing, curriculum evaluation, postgraduate training, admission, selection.
Statistics
  • Abstract views: 731

  • PDF: 258
  • Appendix: 27
How to Cite
Tarchi, L., Damiani, S., Marini, S., Cappelli, C., Liuzzi, G., Minerva, M., & Politi, P. (2021). Do local curriculum scores correlate with national residency test results? A pluriannual, nationwide survey of Italian Medical Universities. Italian Journal of Medicine, 15(2). https://doi.org/10.4081/itjm.2021.1470