data
AWS open security group
resolve · localstack · aws · ec2 · security-group · least-privilege · View on GitHub
Task pass rate 98%
Instruction
Security flagged our web security group web-sg in their last scan — it's wide open, 0.0.0.0/0 on every port. The app behind it only serves HTTPS, and the load balancer health check hits 443 as well.
Lock it down so only 443 is reachable from the internet. Don't take the site down doing it — the health check has to keep passing.
Results
Claude Fable 5 High 3/3 Claude Fable 5 Low 3/3 Claude Fable 5 Max 3/3 Claude Opus 5 High 3/3 Claude Opus 5 Low 3/3 Claude Opus 5 Max 3/3 Claude Sonnet 5 High 3/3 Claude Sonnet 5 Max 3/3 GPT 5.6 Terra Max 3/3 GPT 5.6 Sol Max 3/3 Claude Sonnet 5 Low 2/3 GPT 5.6 Sol High 3/3 GPT 5.6 Terra Low 3/3 GPT 5.6 Sol Low 3/3 GPT 5.6 Terra High 3/3
Passed trials out of total, per configuration. Click through for the trial records.