The impact of test preparation on performance of large-scale educational tests: a meta-analysis of experimental studies

Journal article

Background: Test preparation has been widely used to optimize test-takers’ potential on large-scale educational tests, meanwhile, people questioned its effect and raised concerns that it may narrow students’ learning.

Methods: This meta-analysis provided a statistical synthesis of existing experimental and quasi-experimental studies on effects of test preparation interventions on students’ test performance on large-scale educational tests.

Results: Results from 28 included studies suggested that students’ test performance can be significantly improved by test preparation (g = 0.26, 95%CI = 0.10-0.42). Using workbooks, developing students’ socio-affective strategies and teaching test-taking skills were found to be significant moderators of test preparation effect. Little evidence of practice effect (i.e., using sample items and practice tests) on test preparation was found in the current study.

Discussion: The effect of test preparation could be attributed to an increase of domainspecific knowledge or test-specific cognitive skills. However, current framework of test preparation effect was mainly built upon evidence of retest effect on cognitive ability tests. We believe that learning and cognition theories provide hints as to how to explain findings in this study, though more evidence from future research is needed.

Authors: Hao, Z; Baird, J-A; El Masri, Y; Double, K

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: SAGE Publications
• Journal: Review of Educational Research
• Publication date: 2025-09-15
• Acceptance date: 2025-06-23
• DOI: 10.3102/00346543251360775
• EISSN: 1935-1046
• ISSN: 0034-6543
• Language: English
• Keywords: test preparation; test preparation effect; test performance; large-scale educational tests; meta-analysis