xAI now sues a Grok user over alleged CSAM: a chatbot liability test

xAI appears to have filed its first lawsuit against a user. The defendant is South Carolina resident Terry Harwood. xAI says he used Grok to generate child sexual abuse material and to get around Grok’s safety controls.

The suit is a 12-page complaint filed in federal court in Texas. In it, xAI says Harwood violated Grok’s terms by opening multiple accounts under false identities and by repeatedly reworking prompts after Grok refused them. The company’s argument is pretty straightforward: if the chatbot tried to block the requests, then responsibility sits with the user who kept pushing until he beat those safeguards, not with the tool itself. xAI is seeking unspecified damages and a permanent ban from the platform, all in a legal area where there’s still no clear agreement on whether chatbots are products, publishers, or something else.

That’s what makes this case worth watching. xAI is already fighting separate claims from Labour MP Jess Asato in London, a consumer protection case in Baltimore, a class-action lawsuit in California, and a prosecutorial investigation in Paris, according to separate court filings and regulatory actions. At the same time, xAI says it suspended more than 52,000 accounts and filed over 73,000 reports to the National Center for Missing & Exploited Children, or NCMEC, in 2026, reports it says contributed to roughly 244 to 250 arrests.

Grok is also dealing with pressure on several other fronts. According to regulators, court filings, and published reports, it faces a European DSA investigation, an Ofcom review under the Online Safety Act, bans in Malaysia and Indonesia, a reported warning from Apple’s App Store, and a former engineer’s wrongful-termination suit over safeguards.

So the Texas case now looks like a key place for sorting out how courts assign blame when a user gets a refusal and keeps going anyway.