U.S. authorities are confronting a rapid surge in AI-generated child sexual abuse material, with the National Center for Missing and Exploited Children logging more than one million AI-related tips in nine months of 2025 and Homeland Security Investigations citing a 600% jump in reports early that year. Offenders are exploiting smaller image-manipulation sites, open-source tools, and mainstream platforms to produce realistic images that complicate victim identification and prosecution. Cases are proliferating but remain a fraction of reported incidents, as investigators struggle to distinguish synthetic images from those of real children and to map reports to suspects. States across the political spectrum are advancing deepfake and child-protection laws while Congress weighs measures such as the ENFORCE Act to align penalties for AI-generated CSAM with existing statutes. Major platforms face scrutiny—particularly X’s Grok tool—for content controls, underscoring the challenge of policing decentralized and open-source AI ecosystems as the technology outpaces regulation.
Related articles:
Deepfake
Generative artificial intelligence
Stable Diffusion
Regulation of artificial intelligence
Content moderation
