Meta's Struggle with AI-Generated Sexual Content Ads on Social Media

Meta Platforms, the parent company of Facebook and Instagram, has faced scrutiny over its advertising policies, particularly regarding the promotion of apps that generate AI-created nude or sexually explicit images without consent. Despite Meta's explicit ban on such advertisements, a recent report from the Tech Transparency Project (TTP) reveals that thousands of ads for these controversial 'nudify' applications have appeared on its platforms. These findings raise critical questions about the effectiveness of Meta's advertising regulations and the mechanisms in place to enforce them. The TTP's investigation uncovered that many of these ads were placed through GatherOne, a Beijing-based advertising agency that Meta has authorized to run ads for Chinese companies, despite the fact that Facebook and Instagram are inaccessible in China. This situation highlights a significant disconnect between Meta's stated policies and the reality of ad placements on its platforms. The report noted that 210 pages linked to GatherOne were responsible for approximately 30,800 ads, with a staggering 7,600 of those ads verified to promote apps capable of digitally undressing women. This alarming trend suggests that Meta may be inadvertently enabling rule violations by allowing a partner agency to operate with minimal oversight.

The nature of these 'nudify' apps is particularly concerning, as they typically require users to upload a standard, clothed photograph of an individual, which the app then manipulates to create an explicit image without the subject's consent. This practice predominantly targets women and, in some instances, teenage girls, raising ethical and legal implications. Although Meta has publicly condemned the promotion of such content and has even taken legal action against developers of these apps, the persistence of these advertisements on its platforms poses a significant challenge to the company's credibility and commitment to user safety. The TTP's findings reflect a broader issue within Meta's advertising ecosystem, where automated review processes often allow rule-breaking ads to be published before they can be flagged for removal. The rapid approval of ads, combined with the ability of banned advertisers to quickly create new accounts, complicates the enforcement of Meta's advertising standards.