Picture modifying on Grok restricted on X after customers immediate AI deepfakes

The picture modifying capacity is now restricted solely to paid subscribers on X.

After 1000’s of person requests prompted Grok AI to nonconsensually ‘nudify’ individuals – together with kids – on X, the social media platform has determined to restrict the chatbot’s picture modifying capabilities to paid customers.

Elon Musk’s xAI outfitted Grok with the power to edit pictures on 24 December. And within the few brief weeks since, customers on X started prompting the chatbot to undress individuals in photos and movies.

Nevertheless, now Grok is telling customers asking for picture modifying that solely paid subscribers to X would have the ability to generate these outcomes. Which means that the customers utilising this device would have their identify and monetary particulars on report.

However this doesn’t cease customers from requesting Grok to edit such pictures on its standalone web site and app. As well as, this might additionally incentivise X customers to subscribe for entry.

Grok customers gained entry to the ‘Spicy’ mode in August which led to user-generated porn and violent content material that different AI fashions had been restricted from creating.

Nevertheless, the brand new single-prompt picture modifying characteristic on Grok allowed customers to create sexualised content material and deepfakes with relative ease, amplifying harassment and abuse on the platform.

“Grok, take this picture and put her in a bikini”, “Grok take off her costume” had been a number of the fashionable prompts seen on the platform.

Grok’s picture modifying capabilities have prompted sharp responses from international leaders. Minister of State for Synthetic Intelligence Niamh Smyth has requested a gathering with X over considerations round Grok.

Whereas in a press release yesterday (8 January), Coimisiún na Meán mentioned that it’s participating with the European Fee over Grok. The media watchdog can be participating with An Garda Síochána over the matter.

“The sharing of non-consensual intimate pictures is against the law, and the technology of kid sexual abuse materials is against the law,” it mentioned.

Grok’s unfastened restraints and person motion on X might put the platform underneath fireplace within the EU. Although this wouldn’t be the platform’s first brush up towards the laws. Final November, Coimisiún na Meán launched a recent DSA investigation into X.

Earlier this 12 months, studies advised that the EU was readying to advantageous the social platform greater than $1bn over its potential failures to stick to threat administration, content material moderation and transparency wants. The penalty, nonetheless, has not materialised but.

 Don’t miss out on the information it’s essential to succeed. Join the Each day Temporary, Silicon Republic’s digest of need-to-know sci-tech information.