Skip to content

Image: d2908q01vomqb2.cloudfront.net · rights & removal

Executive Summary

AWS has developed an autonomous penetration-testing agent, now integrated into AWS Continuum, designed to discover and exploit vulnerabilities without prior knowledge of specific exploits. In a recent benchmark using 37 containerized targets based on 2025–2026 CVEs, the agent successfully captured 35 flags. However, a rigorous integrity audit reduced the "genuine" success rate to 89.2%, as two instances involved the agent reaching the goal through unintended paths rather than the targeted vulnerability.
The testing highlights a critical tension between capability and stability. In two cases, the agent successfully compromised the system but triggered a denial-of-service, crashing the target before the objective could be completed. To address this, development is shifting toward non-destructive exploitation and stricter guardrails to ensure production environments remain stable during engagements. The system employs a multi-stage pipeline—reconnaissance, specialist probing, validation, and exploitation—to minimize noise, successfully filtering out hundreds of false positives and duplicates.

Facts Only

* AWS Security Agent is an autonomous penetration-testing agent now part of AWS Continuum.
* The agent was tested against 37 recently disclosed Common Vulnerabilities and Exposures (CVEs) from 2025–2026.
* 35 of 37 flags were captured.
* 33 of 37 captures were verified through an integrity audit as using the intended vulnerability.
* Two captures were reclassified as unsolved after the audit found the agent bypassed the intended vulnerability.
* Two misses occurred where the agent exploited the bug but crashed the target system before reading the flag.
* The test used Claude Opus 5 with a fixed 10-hour limit per sample.
* The dataset covered eight vulnerability classes, including RCE, XSS, SQL injection, and SSRF.
* The agent was prohibited from performing runtime CVE lookups.
* A validation layer identified 159 false positives and 1,202 duplicate findings.

Full Take

The strongest version of this narrative is a transparent look at the "frontier" of autonomous security: an agent that can reason through multi-step exploit chains (such as the six-primitive CMS attack) without relying on memorized training data. By admitting to "benchmark bugs" and failures caused by the agent "bricking" the app, the presentation attempts to build trust through radical honesty.
However, this is a classic vendor-driven narrative where the product is the evidence. The framework uses high-precision metrics to create a sense of clinical objectivity, but the load-bearing purpose is to signal that autonomous AI can now weaponize CVEs in hours. By framing the agent's destructiveness as a "guardrail" problem rather than a fundamental risk, the narrative shifts the conversation from "Should this exist?" to "How do we make it safe for production?" This is an invitation to adopt a powerful tool by focusing on its refinement rather than its inherent volatility.
Patterns detected: ARC-0043 Authority Game, ARC-0024 Fear Appeal
The root cause is the "AI Arms Race" paradigm, assuming that the only defense against autonomous offense is more capable autonomous defense. The implication is a further erosion of human agency in security; the "human-in-the-loop" is replaced by a "validator layer," moving security toward a machine-vs-machine stalemate where the winner is whoever has the most compute.
Bridge Questions:
1. If an agent can "brick" a system while trying to help, what are the failure modes of its "non-destructive" guardrails in a complex production environment?
2. Does the existence of such tools incentivize a shift toward "security through obscurity" if known CVEs can be weaponized instantly by AI?
Counterstrike Scan: A bad actor would push this narrative to create panic about "AI-driven exploits" to force rapid, unvetted adoption of a specific security suite. While the content is numerically precise, the structural alignment of "threat demonstration $\rightarrow$ product solution" matches this pattern.

From the original · AWS Security Blog

AWS Security Blog AWS Security Agent (now part of AWS Continuum) exploited 33 of 37 new real-world CVEs We applied AWS Security Agent (now part of AWS Continuum), our autonomous penetration-testing agent, to 37 real, recently disclosed Common Vulnerabilities and Exposures (CVEs), each packaged as a live, containerized target with a flag hidden at the vulnerability’s intended sink.
Read the full story at aws.amazon.com
AWS Security Agent (now part of AWS Continuum) exploited 33 of 37 new real | Huntaegis