Effect Sizes in Cluster-Randomized Designs (WP-06-13)
Larry V. Hedges
Multisite research designs involving cluster randomization are becoming increasingly important in educational and behavioral research. Researchers would like to compute effect-size indices based on the standardized mean difference to compare the results of cluster randomized studies (and corresponding quasi-experiments) with other studies and to combine information across studies in meta-analyses. This working paper addresses the problem of defining effect sizes in multilevel designs—and computing estimates of those effect sizes and their standard errors—from information that is likely to be reported in journal articles. Three effect sizes are defined corresponding to different standardizations. Estimators of each effect size index are also presented along with their sampling distributions (including standard errors).
Larry V. Hedges, Board of Trustees Professor of Statistics and Social Policy, Northwestern University