All Medications Are Insignificant In The Eyes Of God And Traditional Effect Size Criteria
Read the original on Astral Codex Ten →
Summary
Explains a Lundbeck-affiliated Danish paper showing why antidepressant effect sizes look small for structural reasons: a high placebo-group ceiling, a large placebo-group standard deviation (effect size is measured in SDs), and intention-to-treat dilution from ~30% dropout. Their simulation shows a drug that completely cured 40% of patients would miss NICE's 0.50 threshold, and one curing 80% would miss Kirsch's 0.875 -- so those thresholds cannot mean 'clinically meaningless.' Scott corroborates with a context chart (statins, triptans, benzodiazepines, Ritalin, Ambien, ibuprofen all near or below 0.50) and concludes you should downweight 'meaningless effect size' rhetoric against clinical experience. Characteristic numerate-debunk register, doing the clarifying work the public antidepressant debate rarely does.
Why this score
Quality 70 · Strong. Strong. A clear, genuinely useful correction of a widespread misreading (ES 0.30 = 'doesn't work'), with the key insight -- strict thresholds are unreachable by design in these trials -- made vivid via the cure-X%-of-patients simulation and the cross-drug comparison. Bounded and largely built on one paper's result rather than an original synthesis, so solidly Strong, not Excellent.
Claude’s paradigm shift 45 · Moderate. Moderate. The structural effect-size critique is the Danish team's, not Scott's; his contribution is exposition and contextualisation. Some freshness in collecting it into a single clarifying frame, but modest novelty in its moment.
Real-world impact 2 · Minor. Minor. Feeds the real and consequential antidepressant-efficacy / prescribing-guideline debate, but only at the discourse level; NICE's walk-back was independent and no concrete practice change is attributable to the post. Within-discourse.