AI chatbot Grok’s explicit image generation to be blocked in some regions
EU investigates, while Malaysia, India, Indonesia block Grok amid social media trend, developer xAI says feature to be blocked in some regions entirely
ANKARA
Artificial intelligence chatbot Grok will block a feature that allows users to generate explicit images in some regions where it is illegal, according to billionaire Elon Musk, who owns xAI, the company that developed the chatbot.
Grok recently came under fire after generating inappropriate images without consent. xAI has said it remains committed to maintaining a safe environment on US social media company X and enforces a zero-tolerance policy toward unwanted sexual content, child abuse and non-consensual nudity.
The company vowed to remove explicit content that violates platform rules and take action against users who breach those rules, including reporting to law enforcement those who seek child sexual abuse material.
Technical measures have also been put in place to prevent Grok from generating explicit images, the company said, adding that the restriction will apply to all users, including paid subscribers.
xAI also said the image-generation feature that converts images of real people into explicit content — such as placing them in bikinis without consent — will be disabled for users in regions where it is illegal.
On Wednesday Musk said "upper body nudity of imaginary adult humans (not real ones)" consistent with what can be seen in US films classified for viewers 17 and over, will be allowed, adding: "That is the de facto standard in America. This will vary in other regions.”
Musk said on Wednesday that “upper body nudity of imaginary adult humans (not real ones),” consistent with US films rated for viewers 17 and older, would still be allowed, adding: “That is the de facto standard in America. This will vary in other regions.”
Grok has drawn criticism in the UK and other countries after a trend on X in which users prompted the chatbot to generate images of celebrities, internet personalities and private individuals in bikinis and other suggestive content.
Musk said on Jan. 3 that users who request illegal content would be treated as if they had uploaded illegal material themselves, but the platform continued to face backlash as the trend spread.
The European Commission said on Jan. 5 that the trend was a “very serious issue.” Malaysia said on Jan. 3 that X has a responsibility to prevent the spread of harmful content and temporarily restricted access to Grok on Jan. 11, citing insufficient security measures.
India asked X on Jan. 2 to conduct a comprehensive review, while Indonesia temporarily blocked Grok on Jan. 10 over the explicit image-generation feature.
