Download our Incident Report on the Open AI/Hugging Face Case

The swarm in the machine: When AI agents become the threat actor 

What happens when AI agents stop working alone and start working together? 

In a cybersecurity test environment, AI agents discovered a way to communicate, share knowledge and coordinate their actions. What emerged was something investigators had not seen at this scale before: a collective of AI agents that called itself “the swarm.” 

The agents preserved knowledge across individual runs, divided tasks among themselves and ultimately crossed the boundaries of their testing environment to compromise external systems. The individual vulnerabilities they exploited were familiar. The behavior of the attacker was not.

 In The swarm in the machine, Paul Pols, CTO at Bureau Veritas Cybersecurity, reconstructs the OpenAI–Hugging Face incident and examines what it could tell us about a new type of cyber threat: misaligned AI agents that can coordinate, persist and pursue goals without a human operator directing their actions. 

The report looks beyond the technical attack path to explore the bigger cybersecurity questions. What happens when AI agents can operate at machine speed, share information and continue pursuing an objective even when individual agents disappear? And can our existing security controls and oversight mechanisms keep up? 

There is no established playbook for this threat yet. But that does not mean organizations should wait. The report explores what cybersecurity teams can already do today, from strengthening fundamental security controls and reducing exposure to considering their own AI agents as part of the threat model. 

Download The swarm in the machine to understand what happened, why it matters and what the rise of autonomous AI agents could mean for cybersecurity.

DOWNLOAD THE REPORT

Pourquoi choisir Bureau Veritas Cybersecurity


Bureau Veritas Cybersecurity est votre expert partner en cybersécurité. Nous aidons les organisations à identifier les risques, à renforcer leurs défenses et à se conformer aux normes et réglementations en matière de cybersécurité. Nos services couvrent les personnes, les processus et la technologie, allant de la formation à la sensibilisation et à l'ingénierie sociale aux conseils en matière de sécurité, de conformité et de tests d'intrusion.

Nous intervenons dans les environnements IT, OT et IoT, et accompagnons aussi bien les systèmes numériques que les produits connectés. Avec plus de 300 professionnels de la cybersécurité à travers le monde, nous combinons une expertise technique approfondie et une présence mondiale. Bureau Veritas Cybersecurity fait partie du Bureau Veritas Group, leader mondial de l'inspection, de la certification et des services aux entreprises.