Scott Alexander, curated
← Back to curation

Trouble Walking Down The Hallway

Quality
72
Strong
Claude Shift
54
Moderate
RWI
2
of 10

Summary

On two near-identical STEM-hiring gender-bias studies reaching opposite results (Williams & Ceci's 2:1 pro-women vs Moss-Racusin's pro-men). Scott dissects six candidate methodological differences (lab-manager vs faculty, so-so vs excellent resumes, 'who would you hire' vs 'rate hireability', Dr. X/Y vs John/Jennifer, realism, resumes vs narratives), notes neither study has an egregious howler yet both teams reliably get the result they want ('experimenter effects as a mystical curse'), and lands on the memorable indictment: climatologists get eaten by bears, but social psychologists can't settle a question that requires walking down the hallway. Calls for a joint pre-agreed protocol — an early adversarial-collaboration proposal.

Why this score

Quality 72 · Strong. 72 — Strong. A sharp, memorable meta-science piece; the 'walking down the hallway' framing and the experimenter-effect analysis are quotable and the adversarial-collaboration call is prescient. High-Strong, below the Control-Group-Is-Out-Of-Control tier because it's a focused dissection of two specific studies.

Claude’s paradigm shift 54 · Moderate. 54 — Moderate-to-Notable. The experimenter-effect + pre-registered-joint-study framing applied to this contradiction is a fresh, generative meta-science point.

Real-world impact 2 · Minor. 2 — minor/within-blog. Discourse-level; the adversarial-collaboration idea has modest downstream niche influence, but this post's own reach is contained.