Skip to content
NetarxImpact Database
Voice Clone / Audio DeepfakeConfirmed AI-enabledConfirmedBenchmark

FBI warns criminals are using generative AI to scale voice-clone and identity fraud

US consumers, including seniors targeted by family-emergency voice clones (multi-victim campaign) · Consumer · United States · December 3, 2024

What happened

On 3 December 2024 the FBI's Internet Crime Complaint Center published an advisory titled Criminals Use Generative Artificial Intelligence to Facilitate Financial Fraud. It documents AI-generated text used for phishing, fake social media profiles and fraudulent investment sites; AI-generated images used for profile photos, fabricated identification documents and disaster imagery for fake charity appeals; and voice and video synthesis used to impersonate relatives, account holders and executives.

How the deception worked

Voice cloning is the pivotal technique for consumer harm. A short sample of a person's speech, readily available from social media video, is enough to synthesise a distressed relative calling to say they have been in an accident or arrested and need money immediately. The lever is the recognisable voice of a loved one under duress, which suppresses verification instincts far more effectively than any script. The same technology is used to satisfy bank voice authentication as an account holder, and real-time video synthesis extends it to live calls impersonating executives or providing proof of legitimacy to a romance or investment target. AI translation also strips the grammatical errors that once exposed foreign operators.

AI involvement · Confirmed AI-enabled

The entire advisory concerns criminal use of generative AI: AI text for phishing and fake profiles, AI images for fake IDs and personas, voice cloning to impersonate relatives and account holders, and real-time video synthesis to impersonate executives and authorities.

The control that would have caught it· our reading, not a claim from the sources

The FBI's own recommendation is the practical control: agree a family or organisational verification code word in advance, and independently call back on a known number before acting on any urgent request.

Sources (1)

  1. Criminals Use Generative Artificial Intelligence to Facilitate Financial Fraud
    FBI Internet Crime Complaint Center·ic3.govOpen ↗

This entry summarises public reporting. It is not a legal finding, and details can change as investigations conclude. Found an error? Send a correction.