xAI files first lawsuit against Grok user for generating child sexual abuse material
Elon Musk's xAI has filed its first lawsuit against a Grok user accused of creating illegal child sexual images, while arguing that only users should be liable for AI-generated content.
xAI, Elon Musk's artificial intelligence company, has filed a lawsuit against a Grok chatbot user, Terry Wayne Harwood, accusing him of using the service to generate child sexual abuse material (CSAM). Harwood was arrested earlier this year for possession and distribution of CSAM, the South Carolina attorney's office announced. xAI claims it assisted in the arrest after discovering Harwood had used two xAI accounts for months to undress or "nudify" non-sexual images of multiple victims, including a young girl who appeared to be as young as 10.
The lawsuit comes just over a week after another young girl joined a proposed class action representing several children allegedly harmed by Grok. She alleged her stepfather committed suicide after being discovered using Grok, possibly with other AI tools, to create 7,000 sexualized images of her and distribute them on the dark web. In that case, the victim alleged xAI refused to help police identify the user who uploaded her image. Her lawyers cited a 2026 National Center for Missing & Exploited Children (NCMEC) report confirming that 90% of xAI's CyberTipline reports "were not actionable by law enforcement because xAI declined to include user information."
Musk previously maintained he had not seen any examples of Grok-generated CSAM and warned users to act responsibly. Now xAI's lawsuit seeks to establish that users are solely liable for Grok outputs. The company argues Grok is "a neutral tool, subject to user control" and that each output is the result of user prompts. The complaint alleges Harwood flagrantly violated terms of service by circumventing safeguards with misleading prompts. xAI hopes the court will enforce an indemnity clause holding users responsible, not xAI. However, the Copyright Office does not view AI outputs as human-created, which could complicate xAI's position. If xAI wins, Harwood could owe substantial damages, including for third-party harm and xAI's reputational damage.
