Security & Reverse Engineering(3)
The security focus is shifting from model-level safety to vulnerabilities in the agent orchestration and tool-use layers, a concern echoed by Anthropic, Google DeepMind, and practitioners.
Major labs are publicly disclosing agent jailbreaks and releasing red-teaming frameworks as agents begin to see real-world pentesting and deployment.
Anthropic@AnthropicAIrising Responsible disclosure on a Claude jailbreak chain we patched last week. Full write-up including our red team timeline.
Google DeepMind@GoogleDeepMindrising New red team framework for prompt injection in autonomous agents. Covers cross-tool leakage, scanner evasion, and sandbox escape patterns.
MalwareTech@MalwareTechBlogrepeated Autonomous agent running pentest flows against a real SaaS. First real-world run: fewer false positives than I expected on the vulnerability surface.