Papers and Publications

Working Papers

Wong, V.C., Steiner, P.M. (under review). Replication designs for Causal Inference. Working paper.

Wong, V.C. Steiner, P.M. Anglin, K. (under review). Design-Based Approaches to Causal Replication Studies. Working paper.

Anglin, K.L., Wong, V.C. (under review) Using Semantic Similarity to Assess Adherence and Replicability of Intervention Delivery. Working Paper.

Papers, Publications, and Reports

Causal Replication Framework

Steiner, P.M., Wong, V.C. & Anglin, K. (2019). A Causal Replication Framework for Designing and Assessing Replication Efforts. Zeitschrift fur Psychologie. Vol 226, No 3.

Implementation: Quantitative Text Analysis

Kylie L. Anglin (2019) Gather-Narrow-Extract: A Framework for Studying Local Policy Variation Using Web-Scraping and Natural Language Processing, Journal of Research on Educational Effectiveness, 12:4, 685-706, DOI: 10.1080/19345747.2019.1654576

Original and Replication Studies

Coaching Effects on Teacher Candidates’ Pedagogical Skills in the Context of Mixed Reality Simulations

Cohen J, Wong V, Krishnamachari A, Berlin R. Teacher Coaching in a Simulated Environment. Educational Evaluation and Policy Analysis. 2020;42(2):208-231. doi: 10.3102/0162373720906217

Krishnamachari, A., Wong, V.C., Cohen (in progress). Robustness of Coaching Effects in Simulated Environments.

Half- versus Full-Day Preschool Evaluation

Atteberry A, Bassok D, Wong VC. The Effects of Full-Day Prekindergarten: Experimental Evidence of Impacts on Children’s School Readiness. Educational Evaluation and Policy Analysis. 2019;41(4):537-562. doi:10.3102/0162373719872197

Wong, V.C., Markowitz, A.J., Krishnamachari, A., Atteberry, A. (2019). Evaluating the Effects of Full- vs. Half Day Pre-Kindergarten: Experimental Evidence from the Pomona Unified School Districts. Commissioned Report for the W.M. Keck Foundation

Design Replication

Cook, T.D., Shadish, W.R. and Wong, V.C. (2008), Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within‐study comparisons. J. Pol. Anal. Manage., 27: 724-750. doi: 10.1002/pam.20375

Pohl S, Steiner PM, Eisermann J, Soellner R, Cook TD. (2009) Unbiased Causal Inference From an Observational Study: Results of a Within-Study Comparison. Educational Evaluation and Policy Analysis. 2009;31(4):463-479. doi:10.3102/0162373709343964

Shadish, M. H. Clark & Peter M. Steiner (2008) Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments, Journal of the American Statistical Association, 103:484, 1334-1344, DOI: 10.1198/016214508000000733
Published work.

Shadish, W. R., Galindo, R., Wong, V. C., Steiner, P. M., & Cook, T. D. (2011). A randomized experiment comparing random and cutoff-based assignment. Psychological Methods, 16(2), 179–191. https://doi.org/10.1037/a0023345

Steiner PM, Cook TD, Shadish WR. (2011) On the Importance of Reliable Covariate Measurement in Selection Bias Adjustments Using Propensity Scores. Journal of Educational and Behavioral Statistics. 2011;36(2):213-236. doi:10.3102/1076998610375835

Steiner PM, Wong VC. Assessing Correspondence Between Experimental and Nonexperimental Estimates in Within-Study Comparisons. Evaluation Review. 2018;42(2):214-247. doi: 10.1177/0193841X18773807

Wong VC, Steiner PM, Anglin KL. What Can Be Learned From Empirical Evaluations of Nonexperimental Methods? Evaluation Review. 2018;42(2): 147-175. doi: 10.1177/0193841X18776870

Wong VC, Steiner PM. Designs of Empirical Evaluations of Nonexperimental Methods in Field Settings. Evaluation Review. 2018;42(2):176-213. doi: 10.1177/0193841X18778918

Wong, Valentine & Kate Miller-Bains (2017) Empirical Performance of Covariates in Education Observational Studies, Journal of Research on Educational Effectiveness, 10:1, 207-236, DOI: 10.1080/19345747.2016.1164781