The bureaucratic AI arms-race is mutually assured destruction
Source: https://pluralistic.net/2026/08/10/deep-state-wopr/
Author: Cory Doctorow
Summary (EN)
Cory Doctorow argues against using more AI and fewer procedural rights to counter AI-generated bureaucratic appeals. Drawing on political scientist Henry Farrell's analysis, he compares the dynamic to spam wars, content moderation wars, and medical claim wars: as systems increase defenses, users escalate with more aggressive automated tools, turning service delivery into a denial system. The Economist's suggestion to "prune procedural rights" and replace bureaucrats with AI would create robo-bureaucrat vs robo-lawyer arms races. Doctorow cites the US health insurance system where robo-deniers already face robo-appealers. The core insight: when a system optimizes for fraud prevention over service delivery, it stops being a service system entirely.
摘要中文
Cory Doctorow 反对用更多 AI 和更少程序权利来应对 AI 生成的行政申诉。他引用 Henry Farrell 的分析，将其类比为垃圾邮件战争、内容审核战争和医疗理赔战争：系统越加强防御，用户越要升级攻击工具，最后服务系统变成拒付系统。核心洞察：当系统为反欺诈而优化时，它就不再是服务交付系统。