Security & Reverse Engineering(3)
The conversation is shifting from model-level safety (e.g., refusals) to system-level security, focusing on how agents interact with tools and external systems.
Major labs like Anthropic and DeepMind are publicly sharing research on agent vulnerabilities and red-teaming frameworks, while practitioners test them in the wild.
Anthropic@AnthropicAIrising Responsible disclosure on a Claude jailbreak chain we patched last week. Full write-up including our red team timeline.
Google DeepMind@GoogleDeepMindrising New red team framework for prompt injection in autonomous agents. Covers cross-tool leakage, scanner evasion, and sandbox escape patterns.
MalwareTech@MalwareTechBlogrepeated Autonomous agent running pentest flows against a real SaaS. First real-world run: fewer false positives than I expected on the vulnerability surface.