Hartley nodded. "So we keep the software, but we train Mr. Abel on it too."
Here’s a short, engaging story that captures the essence of (as in the spirit of Cook, Campbell, and Shadish’s work, often summarized in guides like Quasi-Experimentation: A Guide to Design and Analysis ). Title: The Principal’s Predicament Dr. Lena Torres, a research consultant, faced a familiar problem. The school principal, Mr. Hartley, had just spent $50,000 on a new "MindGrow" reading software. He needed to know if it worked.
But to be rigorous, she added a and used Huber-White robust standard errors (because monthly scores from the same class aren’t independent — a key point from quasi-experimental guides).
Result: The +7 points was statistically significant (p < .01) and practically meaningful. Lena presented to Hartley: "The software works, but only by 7 points, not the 15-point jump you saw in the raw comparison. The raw difference was inflated by Ms. Chen’s prior excellence."