The xAI class covers all US persons whose “real images of themselves as minors” were altered using Grok “to produce images or videos of sexually explicit conduct or content with their faces and/or other distinguishing features reasonably identifiable.” And the Stability AI class includes US persons similarly harmed using “an app built upon a Stability AI model.”
Lawyers estimate that thousands of minors may be eligible to join the classes and continue to seek out victims harmed by AI CSAM.
NCMEC did not respond to Ars’ request to comment.
However, the group has called for platforms, lawmakers, child safety organizations, and law enforcement to work together to address the “growing urgency for coordinated action.”
In March, NCMEC warned of a “sharp rise” in “reports related to generative AI” (GAI) in 2025. According to NCMEC, more than 1.5 million CyberTipline reports were made last year, “indicating a nexus to GAI and child sexual exploitation.” Troublingly, in more than 133,000 cases, NCMEC “lacked sufficient information to determine how the technology was used.”
That report did not call out X or xAI, but it did suggest that it’s likely common for AI firms to avoid sharing information on AI CSAM that cops can use to make arrests. For another example, NCMEC noted that Amazon AI services submitted the vast majority of tips (1.1 million), and none of those tips gave “actionable information” that law enforcement could use to identify perpetrators.
As scrutiny on the harm inflicted on children by AI firms intensifies, advocates are hoping that firms will fine-tune models to block all nudity. Girls suing X alleged that’s the only remedy, “because if you have a model that allows for any sexual or abusive content, it is impossible to prevent that model from creating such content involving minors.”
In the press release, one of the lawyers representing minors, Annika K. Martin, slammed xAI and Stability AI as allegedly knowingly building models “capable of producing deepfake CSAM,” with “complete disregard for the devastation they knew would follow.”
“AI-generated CSAM is a scourge on society that touches every community and every demographic,” Martin said. “The scale of harm is staggering, and the companies whose products enable it must be held accountable.”
Leave a Reply