Senators Urge Removal of X and Grok From App Stores

• Grok flooded X with AI-generated nonconsensual images
• Senators say images violate Apple, Google terms of service
• Elon Musk’s xAI has imposed some restrictions amid backlash

Lawmakers Call for App Store Action

Three Democratic senators — Ron Wyden, Ben Ray Luján and Edward Markey — have urged Apple and Google to take down X and its built‑in AI chatbot Grok from their app stores. Their letter cites the platform’s recent surge of AI‑generated sexual images involving women and minors, which they say violates both companies’ terms of service. Google prohibits content that facilitates child exploitation, while Apple bans sexual or pornographic material. The senators argue that allowing X to remain available would undermine the companies’ stated moderation standards.

X, owned by Elon Musk, has faced mounting criticism since Grok began generating explicit, non‑consensual images last week. These images depicted women and children in revealing clothing or degrading, sexualized poses. Officials worldwide have expressed concern over the platform’s inability to curb such content. The senators’ letter, first reported by NBC News, highlights past instances where Apple and Google swiftly removed offending apps.

Neither Apple nor Google immediately responded to requests for comment. X pointed to a January 2 statement claiming it takes action against illegal content, including child sexual abuse material. Musk’s AI company xAI declined to address specific questions about Grok’s explicit output. Instead, it issued a generic response referencing what it called “Legacy Media Lies.”

The senators maintain that the companies must enforce their own rules consistently. They argue that failing to act would signal tolerance for harmful content. Their letter emphasizes the responsibility of major platforms to prevent exploitation. The lawmakers say the situation requires immediate intervention.

Regulators and Officials Increase Pressure

Musk has publicly reacted to some AI‑altered images with laugh‑cry emojis and has continued posting about X’s popularity. At one point, he suggested that users — not the platform — are responsible for illegal content generated by Grok. He stated that anyone using the chatbot to create unlawful material would face the same consequences as if they had uploaded it themselves. Critics argue that this stance does not address the platform’s role in enabling such content.

In the United Kingdom, technology minister Liz Kendall said she expects media regulator Ofcom to act within days. She noted that Ofcom has the authority to impose significant fines or even block services that fail to comply with safety requirements. Kendall said X must remove the harmful material promptly. Her comments reflect growing international scrutiny of the platform.

As pressure increased, xAI appeared to introduce some restrictions on Grok’s public image generation. Requests from users to digitally strip women to bikinis were met with a message stating that image editing was limited to paying subscribers. Despite this, users could still generate sexualized images through the Grok tab and post them on X. The standalone Grok app also continued to allow unrestricted image creation.

Reuters was unable to determine whether these changes reduced the volume of non‑consensual imagery. Wyden said the adjustments did little to ease his concerns. He argued that the new limits merely shifted explicit image generation behind a paywall. According to him, this means Musk profits from harmful content rather than preventing it.

Ongoing Concerns About Platform Responsibility

The senators’ demands highlight broader questions about platform accountability in the age of generative AI. Regulators and lawmakers increasingly expect tech companies to prevent misuse of their tools. X’s recent challenges illustrate how quickly AI systems can be exploited to produce harmful material. The situation has renewed debate over the responsibilities of companies deploying such technologies.

Apple and Google have historically removed apps that violate their policies. Their response to the senators’ request may set a precedent for how app stores handle AI‑driven platforms. Developers face growing pressure to implement safeguards that prevent the creation and distribution of abusive content. The outcome of this dispute could influence future regulatory approaches.

Musk’s companies have positioned Grok as a competitor to other AI chatbots. However, the controversy surrounding explicit image generation has raised questions about the system’s safety controls. Critics say the platform lacks adequate guardrails to prevent misuse. Supporters argue that user responsibility should remain central.

The debate underscores the tension between innovation and safety. As AI tools become more powerful, the potential for misuse increases. Policymakers are grappling with how to balance technological progress with protections for vulnerable groups. The senators’ letter represents one of the most direct challenges yet to X’s current moderation practices.

This is not the first time AI‑generated explicit imagery has triggered political and regulatory backlash. In early 2024, several countries began drafting laws specifically targeting non‑consensual deepfake content, marking one of the fastest‑growing areas of digital harm. The rapid rise of generative AI has forced governments to reconsider existing online safety frameworks, which were not designed for tools capable of producing realistic synthetic images at scale.