With its mania for taxonomy and penchant for tidy solutions, psychiatry is ripe for reinvention. A new book takes a swing — and misses