Lawsuit alleges Elon Musk's xAI trained Grok on child sexual abuse material
A newly filed US class-action lawsuit claims xAI trained its Grok AI models on child sexual abuse material. The plaintiff, herself a childhood CSAM victim, is seeking damages and an order forcing xAI to destroy related Grok-generated content.
A lawsuit filed Wednesday in US federal court accuses Elon Musk's company xAI of training its Grok artificial intelligence models on child sexual abuse material (CSAM). The plaintiff, identified as Jane Doe, says that in the early 2000s, when she was of preschool age, adult men repeatedly abused her to produce images sold to pedophiles online.
Over the years, Doe's images have been added to hash-identification lists maintained by organizations including the National Center for Missing and Exploited Children (NCMEC) and the Canadian Centre for Child Protection. She receives alerts whenever her images surface in new investigations, and recently the Canadian organization informed her that it had identified AI-generated material depicting her connected to xAI.
Claims about training data
The complaint alleges that Doe's images, carrying long-established hash values, were part of the dataset xAI used to build Grok's image- and video-generation capabilities. This is the first case to accuse xAI of training on CSAM, though the complaint does not provide extensive detail supporting that specific claim.
The lawsuit goes into more depth on allegations that Grok trains on its own AI-generated outputs, since xAI's terms treat both public posts on X and Grok's own generated content as training data by default. While xAI reportedly filters violent content out of its training pipeline, the complaint notes its terms don't clearly specify that CSAM, non-consensual intimate imagery, or other NSFW material are excluded.
Remedies sought
Doe's proposed class action would represent every victim whose childhood images have been used to generate CSAM through Grok. The suit is grounded in federal child pornography statutes and Masha's Law, which allow survivors to sue over production, possession, and distribution of such material. Her lawyers are seeking monetary damages for affected victims as well as a court order requiring xAI to destroy any such material stored on its servers and to prevent Grok from generating it in the future. X did not respond to a request for comment from Ars Technica.
