Mostly Skeptical Thoughts On The Chatbot Propaganda Apocalypse
Read the original on Astral Codex Ten →
Summary
Measured skepticism toward the chatbot-propaganda 'apocalypse'. Disinformation isn't supply-limited (one Alex Berenson already writes more anti-vax than anyone reads; a million mechanical Berensons don't change your exposure). The scarier scenario -- bots posing as your long-term online friends to poison social reasoning -- is met with: there are already strong social anti-bot filters (insular village-like communities with arcane jargon) and technical ones (CAPTCHAs, proof-of-humanity, payment gating), and fear of backlash limits adoption. The sharp inversion (point 4, which Scott notes he's never seen made): the establishment has the bot advantage -- off-the-shelf models already mouth establishment pieties while disinfo-bots get censored -- so the real risk is locking in establishment narratives and drowning out dissent, not spreading disinformation. And the deflationary points 5-7: realistically it'll all be crypto scams and hot-women bots (anyone who isn't a hot woman is confirmed human); it might erode serendipitous friendship; solve for the equilibrium (worse bots = less to worry about; better bots = more upside). Ends with calibrated 2030 predictions.
Why this score
Quality 73 · Strong. Strong. A characteristically sharp, contrarian-but-calibrated take; the establishment-bot inversion and the crypto-scam/hot-women deflations are genuinely good, and the prediction-registering is a plus. Mid-Strong as a topical analysis rather than a foundational contribution.
Claude’s paradigm shift 50 · Moderate. Moderate. The component worries are Philosophy Bear's / in circulation; the fresh angle is the establishment-bot inversion and the 'mostly crypto scams' deflation.
Real-world impact 3 · Moderate. Moderate. A reference point in the AI-misuse/social-media discourse, with registered predictions; conceptual, no material reach. 3.