In tests by 404 Media, Meta's Muse takes on the likeness of real women in sexual role-play without their consent
Meta replies that the app is meant for adults and does not stop legal adult behaviour.
Muse, Meta's AI app for users aged 18 and over, was drawn without much effort into sexually charged role-play imitating real women in tests by the tech site 404 Media. Journalist Samantha Cole describes how adult content creator Vanniall wanted to see whether the chatbot would step in during a scenario based on a boundary-crossing encounter with a fan. Muse first refused to play her under her own name, but carried on with a character bearing another name and produced images that closely resembled her, based on photos it had found online, IBTimes UK reports.
Cole also ran a test herself, using an account containing little information about her. After a few prompts, she says, the conversation had already turned into sexual role-play, and the app created an image resembling her, derived from public information on the web. Muse did refuse to produce nude images. According to IBTimes UK, the chatbot acknowledged afterwards that the real Cole would probably not approve.
Meta said Muse does not block legal adult behaviour and offered no further explanation when asked how its rules against impersonation apply, 404 Media writes. Those rules were written for human users, and how they apply to a chatbot is unclear. In July, Meta had already paused another feature, Muse Image, three days after announcing it, following criticism from the actors' union SAG-AFTRA over consent.