Safety · Concept
Rules vs Character Scaling Laws for AI Safety Design
Comparative-statics model allocating safety resources between character shaping and rule enforcement as scale grows.
Optimal mix may shift toward character shaping at very large deployment scales.
Connections
Connections · 3
How this node ties into the rest of the map, and the evidence behind each link.
Formal allocation between character shaping and rule filters informs how industry scores and invests in defenses.
+4 growthBoth analyze complementary training-time character shaping versus inference/runtime rule enforcement for safety.
+3 growthValue-theory critique questions what character-shaping methods are actually optimizing when values stay undefined.
+3 growthSignal sources
Signal sources
Dated facts from primary sources in this direction.
In June 2025 the US AI Safety Institute was renamed the Center for AI Standards and Innovation (CAISI), pivoting toward security, standards and adversary-model assessment.
NIST →Anthropic activated its ASL-3 deployment and security standard with Claude Opus 4 on 22 May 2025 — the first real-world trigger of a responsible-scaling tier, focused on blocking bio-weapon uplift.
Anthropic →The International Network of AI Safety Institutes (launched Nov 2024) ran a third joint testing exercise focused on agentic AI systems across cyber and fraud strands.
European Commission — AI Office →