Improving Evaluations of R&D in STEM Education 2021 Summer Institute
July 19, 2021 - July 23, 2021
The 5-day Summer Training Institute will provide STEM education researchers with a broad introduction to contemporary evaluation methods that can be applied directly to their studies. In particular, the workshop will focus on small studies (e.g., 10 classrooms) in which large scale experimental methods are difficult to implement.
Topics will include:
- An introduction to causal inference methods, confounding, and validity concerns in research
- Methods for matching to control for selection bias
- Pretest- posttest and difference in difference designs
- Small field experiments and pilot study designs
Broader discussions of trade-offs, design sensitivity, effect size reporting, and questionable research practices (e.g., p-hacking) will also be included.
In addition to attending lectures, participants will take part in group projects, individual homework assignments, and an online community. This online community will continue after the workshop and will provide participants with ongoing resources for implementing these new methods into their research.
July 19 – 23, 2021
The Training Institute will be held online.
Inquiries about submission of the Improving
Evaluations of R&D in STEM Research
Applicants should have experience conducting evaluations of STEM interventions in schools (though not necessarily using experiments) and previous coursework in basic statistics and research design. Early career researchers and those from under-represented groups are encouraged to apply. The workshop is open to faculty, researchers and advanced doctoral students at US institutions (US citizenship not required).
Preference will be given to individuals who (a) have demonstrated their ability to conduct independent research, (b) are currently employed in a setting in which conducting research relevant to education is part of their regular responsibilities, and (c) can demonstrate that they have a need for the knowledge and skills addressed in the Training Institute.
Each application will be evaluated on its own merits. If more than 30 meritorious applications are received, other criteria such as disciplinary, geographical, and institutional diversity will be taken into account.
Instruction and materials are covered.
Please complete the online application form.
* This workshop will focus on small studies (those typically funded by NSF, or in IES as “development” studies. Applicants interested in methods for large-scale field experiments (“efficacy” studies) would be better suited for the RCT workshop instead.