A randomized experiment comparing random and cutoff-based assignment

Psychol Methods. 2011 Jun;16(2):179-91. doi: 10.1037/a0023345.

Abstract

In this article, we review past studies comparing randomized experiments to regression discontinuity designs, mostly finding similar results, but with significant exceptions. The latter might be due to potential confounds of study characteristics with assignment method or with failure to estimate the same parameter over methods. In this study, we correct the problems by randomly assigning 588 participants to be in a randomized experiment or a regression discontinuity design in which they are otherwise treated identically, comparing results estimating both the same and different parameters. Analysis includes parametric, semiparametric, and nonparametric methods of modeling nonlinearities. Results suggest that estimates from regression discontinuity designs approximate the results of randomized experiments reasonably well but also raise the issue of what constitutes agreement between the 2 estimates.

Publication types

  • Comparative Study
  • Randomized Controlled Trial
  • Research Support, Non-U.S. Gov't
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Adolescent
  • Bias
  • Computer Graphics
  • Computer-Assisted Instruction*
  • Data Interpretation, Statistical
  • Female
  • Humans
  • Internet*
  • Male
  • Mathematics / education*
  • Models, Statistical
  • Research Design / statistics & numerical data
  • Sample Size
  • Vocabulary*
  • Young Adult