X says Grok, Musk’s AI chatbot, is blocked from undressing images in places where it’s illegal
BANGKOK– Grok, Elon Musk’s AI chatbot, will not be able to edit photos to depict real people by revealing clothing in places where it is illegal, according to a statement posted on X.
Wednesday’s announcement follows a global backlash against sexualized images of women and children, including bans and warnings from some governments.
The pushback included an investigation announced Wednesday by the state of California into the proliferation of nonconsensual sexually explicit material produced using Grok.
Initially, media questions about the problem were met with only responses: “legacy media lies.”
Musk’s company, xAI, now says it will geoblock content if it violates the laws of a particular location.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people wearing revealing clothing such as bikinis, underwear and other revealing outfits,” it said.
The rule applies to all users, including paid subscribers, who have access to more features.
xAI also limits the creation or editing of images to paid subscribers only “to ensure that individuals who attempt to abuse the Grok account to violate the law or our policies can be held accountable.”
Grok’s “spicy mode” had allowed users to create explicit content, sparking a backlash from governments around the world.
Malaysia and Indonesia took legal action and blocked access to Grok. The United Kingdom and the European Union were investigating possible violations of online safety laws. France and India have also issued warnings, demanding stricter controls. Brazil has called for an investigation into Grok’s misuse.
Grok’s editing features “facilitated the widespread production of non-consensual and doctored intimate images that are used to harass women and girls across the Internet, including through the social media platform X,” California’s announcement states.
“The avalanche of reports detailing the nonconsensual and sexually explicit material that xAI has produced and posted online in recent weeks is shocking. This material, which depicts women and children in nude and sexually explicit situations, has been used to harass people on the Internet,” said state Attorney General Rob Bonta.
“We have zero tolerance for the AI-driven creation and dissemination of non-consensual intimate images or child sexual abuse material,” he said.
