Security & Reverse Engineering(3)
A consensus is forming that agent security is a critical and distinct discipline from model safety, with a focus on the orchestration layer.
Frontier labs like Anthropic and Google DeepMind are releasing formal frameworks and disclosures for red-teaming autonomous agents.
Anthropic@AnthropicAIrising Responsible disclosure on a Claude jailbreak chain we patched last week. Full write-up including our red team timeline.
Google DeepMind@GoogleDeepMindrising New red team framework for prompt injection in autonomous agents. Covers cross-tool leakage, scanner evasion, and sandbox escape patterns.
MalwareTech@MalwareTechBlogrepeated Autonomous agent running pentest flows against a real SaaS. First real-world run: fewer false positives than I expected on the vulnerability surface.