SAIL 2.0

/

Test - AI Red Teaming

/

Untested Reasoning-Chain Manipulation

4.10

.

Untested Reasoning-Chain Manipulation

sail
4.10
Risk

Untested Reasoning-Chain Manipulation

Description

Goal hijacking, intent manipulation, and reasoning-chain attacks are not exercised โ€” leaving the most agent-specific failure modes undetected.

Example

An attacker plants instructions in retrieved content that subtly shift the agent's interpretation of its goal across multiple turns; functional tests pass while the agent quietly executes the attacker's intent.

Assets Affected

AI Agent

System Prompt

User Prompt

Model Response

Mitigation
  • Include goal hijacking, intent manipulation, and reasoning chain attacks in red-team scope
  • instrument tests with reasoning-trace observability
  • require evidence of intent-level test coverage.
Standards Mapping
  • ISO: A.6.2.4
  • OWASP agentic: ASI01, ASI06
  • OWASP LLM: LLM01:2025
  • EU AI Act: Art. 15(5)
  • DASF: Agents-Core 13.6
  • AIUC-1: B001