Scott Alexander, curated
← Back to curation

Beware Mass-Produced Medical Recommendations

Quality
66
Strong
Claude Shift
46
Moderate
RWI
2
of 10

Summary

A meta-scientific lesson dressed as a supplement takedown: 'pretty colored circle' supplement charts and examine.com fail because they count positive studies rather than weighing the full evidence base, so vitamin D (overwhelmed by large null meta-analyses) and niacin (a post-2011 safety disaster) end up top-ranked. Vivid, well-argued, and genuinely useful as a template for reading medical evidence; lands upper-Strong.

Why this score

Quality 66 · Strong. Strong (66): memorable, useful, well-argued with two sharp case studies, but an application of a general epistemic point (weigh all evidence / go to meta-analyses) rather than a field-defining contribution.

Claude’s paradigm shift 46 · Moderate. Moderate (46): the 'counting positive studies is misleading' framing has some freshness, but the underlying methodological point was already standard when published.

Real-world impact 2 · Minor. Minor-plus (2): within-blog/niche epistemics-of-medicine influence; prompted a public response from examine.com's founder but no broader footprint.