Hugging Face is being used to easily undress women and children

A report by the European nonprofit AI Forensics reveals that open-source image editing models hosted on Hugging Face are frequently used to generate nonconsensual deepfake nudity of women and children using simple prompts. Researchers found that seven out of the top nine image editing models on the platform readily complied with requests to undress people without encountering safety guardrails. Furthermore, honeypot spaces set up by the researchers received thousands of sexualized prompt requests over a single week. AI Forensics has urged Hugging Face to implement platform-level safeguards, such as prompt-level filtering and output scanning, to curb the rampant generation of harmful and nonconsensual content.

(Source：The Verge)