Goodfire's Cammarata Argues Neural Networks Are Already Legible
Cammarata argues polysemanticity in early models came from fixable architectural and tooling failures, not superposition, and that most neurons in models up to trillions of parameters are legible, though thresholds vary.
Discussion summary
Cammarata's central claim is that modern neural networks, up to trillions of parameters, are far more interpretable than earlier models.









