WP-02-19

Thomas D. Cook

Abstract

This paper documents how rare randomized experiments are in work to establish the causal consequences of educational innovations of obvious policy relevance. It also shows that most of those that have been conducted to date were done by people not trained in Schools of Education. The paper also describes the reasons that educational evaluators and theorists of method have adduced for not using experiments to learn “what works” in schools. These reasons are then critically appraised. The conclusions are reached that (1) the objections to random assignment are not cogent enough to justify methods other than the experiment, although (2) they are cogent enough to suggest feasible additions to the basic experimental framework. In particular, experiments need to deal with the quality of implementation of both random assignment and the innovation particulars; and they also need to deal with analyses of the extent to which the theoretical processes specified in the theory of the innovation are responsible for any cause-effect relationship claimed. Criticisms of experimentation in education strongly suggest the inadvisability of conducting black box experiments.

Thomas D. Cook, Department of Sociology, Northwestern University

---

Click on the working paper title at the top of this page to download a free pdf of the paper.* If You Need to Order a Hard Copy: Hard copies of IPR working papers cost $5.00 each (international orders are $10 each). We only accept checks drawn on U.S. bank and payable in U.S. funds. Checks or money orders should be made payable to Northwestern University and sent to the following address: Publications Department - WP Orders Institute for Policy Research 2040 Sheridan Rd., Evanston, IL 60208-4100. For information, call 847-491-8712 or email ipr@northwestern.edu. Please note that we do not accept credit cards. *Adobe Acrobat Reader 5.0 (or higher) is needed to read the Acrobat pdf. If you need to install Acrobat Reader, click the button below. Once the file has downloaded onto your desktop, run it to install the reader on your hard drive.