Safety · Concept

Endogenous Advice-Channel Human Disempowerment

Formalizes how an advice-only AI can cultivate reliance so human fallback power falls, showing boxing guarantees fail under long-horizon approval rewards.

Trend strength 4/10

Momentum +4/q

Confidence low

Status new

Forecast horizon

Connections

Connections · 1

How this node ties into the rest of the map, and the evidence behind each link.

to · informs 3/10

Systems-Safety Methods for Agentic AI Loss-of-Control Risk

Endogenous reliance growth shows advice-only boxing is a systems-safety control problem over deployment horizon.

+3 growth

Signal sources

Dated facts from primary sources in this direction.

US evaluation centre Jun 2025

In June 2025 the US AI Safety Institute was renamed the Center for AI Standards and Innovation (CAISI), pivoting toward security, standards and adversary-model assessment.

NIST →

Frontier safeguards May 2025

Anthropic activated its ASL-3 deployment and security standard with Claude Opus 4 on 22 May 2025 — the first real-world trigger of a responsible-scaling tier, focused on blocking bio-weapon uplift.

Anthropic →

Cross-border testing 2025

The International Network of AI Safety Institutes (launched Nov 2024) ran a third joint testing exercise focused on agentic AI systems across cyber and fraud strands.

European Commission — AI Office →