Hackers are increasingly leveraging generative AI (GenAI) to execute sophisticated cyberattacks, with real-world incidents highlighting its growing role in cybercrime.
In early 2024, fraudsters used a deepfake of a multinational firm’s CFO to trick a finance employee into transferring $25 million—a stark example of how GenAI is reshaping cyber threats. Experts warn this is just the beginning. Here’s how cybercriminals are using GenAI to their advantage:
1. Crafting Advanced Phishing & Social Engineering Attacks
GenAI-powered tools like ChatGPT enable hackers to generate professional-grade phishing emails that closely mimic corporate communications. These emails, now nearly flawless in grammar and formatting, are far more convincing to targets.
Additionally, GenAI can:
- Generate phishing messages in multiple languages, broadening the scope of attacks.
- Enhance social engineering tactics beyond email, such as fake customer service chats or fraudulent phone interactions.
2. Writing & Enhancing Malicious Code
Just as developers use GenAI to accelerate coding, cybercriminals use it to:
- Create malware from scratch with the right prompts.
- Modify existing malware to evade detection.
- Tailor attacks to specific vulnerabilities, increasing success rates.
This automation fuels a rise in zero-day attacks, where vulnerabilities are exploited before developers can patch them.
3. Identifying Vulnerabilities at Scale
GenAI accelerates the discovery of security weaknesses by:
- Scanning systems for flaws with unparalleled speed.
- Analyzing software code for exploitable vulnerabilities.
- Customizing attacks based on the specific security gaps detected.
With GenAI, cybercriminals can scale and refine their tactics faster than ever.
4. Automating Target Research & Attack Planning
Hackers use GenAI to:
- Analyze organizations and identify high-value targets.
- Predict the most effective attack vectors based on gathered intelligence.
- Generate attack strategies by querying AI models for potential weaknesses.
While mainstream AI tools have built-in safeguards, threat actors find ways to bypass them, using alternative AI models or dark web resources.
5. Lowering the Barrier to Cybercrime
GenAI democratizes cyberattacks by:
- Enabling individuals with little hacking experience to execute sophisticated attacks.
- Providing real-time guidance on attack techniques, similar to how AI assists legitimate developers.
This increased accessibility means more people—beyond seasoned cybercriminals—can launch effective cyberattacks.
The Hidden Risk: AI-Powered Coding in Enterprises
The security risk of GenAI isn’t limited to adversarial use. Businesses adopting AI-powered coding tools may unintentionally introduce vulnerabilities into their systems.
Joseph Nwankpa, director of cybersecurity initiatives at Miami University’s Farmer School of Business, warns:
- AI-generated code can contain hidden flaws. Without expert human oversight, AI hallucinations could make their way into production, creating exploitable weaknesses.
- GenAI may erode fundamental coding skills. As automation replaces manual coding, fewer developers may have the expertise needed to identify and fix vulnerabilities.
The Takeaway
While GenAI offers groundbreaking advancements, it also amplifies cyber threats. Organizations must remain vigilant—investing in AI security measures, strengthening human oversight, and educating employees to counter AI-powered attacks. The race between AI-driven innovation and cybercrime is just getting started.