Open and closed AI models show narrowing gap in cyber capabilities
The Vals CyberOffense benchmark found that AI agents can independently attack simulated corporate networks, starting with only a public web address. Running from isolated Kali Linux machines, the agents move through web applications and Windows servers toward administrator access, while an external system records and scores every action. GPT-6 Sol Daybreak achieved the strongest result, reaching 80.8 percent of the objectives. The open-weight Deepseek V4.1 Flash 1017 reached 72.8 percent, at about $3 per run compared with roughly $22 for GPT-6 Sol Daybreak.