Meta Platforms Inc.’s Facebook and Instagram have served thousands of advertisements promoting AI-powered “nudify” apps created in China, according to a recent report by the Tech Transparency Project, a nonprofit watchdog. These apps, which superimpose women’s faces onto nude bodies and produce sexualized deepfake videos, violate Meta’s advertising policies that prohibit sexually suggestive content and apps that depict non-consensual nudity.
The report identifies GatherOne Inc., a Beijing-based company that functions as one of Meta’s few official advertising partners in China, as responsible for distributing approximately 7,600 such ads over the past several months. GatherOne acts as an intermediary for Chinese companies seeking to advertise on Meta’s platforms outside China, where Facebook and Instagram are blocked. Among the apps flagged is “BAfter,” an Android application featuring a “ShareZone” where users could access pornographic face-swap content widely criticized as potentially including child exploitation materials. The app was removed from Google Play on July 21, and GatherOne reportedly terminated its advertising privileges for the associated entity.
Meta has repeatedly stated its commitment to barring non-consensual intimate imagery and sexually explicit advertising. “We do not allow non-consensual intimate imagery or nudify apps on our platform and we take aggressive steps to combat them,” said Cindy Southworth, Meta’s head of women’s safety policy. A Meta spokesperson emphasized that advertisers must comply with standards and that violations may result in cancellation of ads, financial penalties, or account suspension. Nevertheless, the Tech Transparency Project’s findings suggest that enforcement has been inadequate, with the company prioritizing advertising revenue, particularly from China-related sources, over effective moderation.
GatherOne maintains that it abides by Meta’s advertising standards and international law, asserting a zero-tolerance policy against deceptive and explicit content, including non-consensual AI-generated media and child exploitation. Following inquiries, the company announced it would suspend the creation of new advertising accounts promoting AI nudifying and face-swap services and undertake a comprehensive compliance upgrade to address evolving synthetic media technologies.
The report provides insight into Meta’s revenue streams from China, a market where its platforms are officially inaccessible but remain lucrative through intermediaries like GatherOne. Meta disclosed $18.4 billion in sales associated with China for 2024, accounting for 11% of its total revenue, more than doubling sales reported in 2022. Internal documents previously reviewed by other news organizations indicated that a significant portion of 2024 China-related revenue—estimated at 19%—derived from ads promoting banned content such as pornography, scams, and illegal gambling, with GatherOne’s role highlighted in facilitating some prohibited ads. Meta disputed the accuracy of those earlier reports but reaffirmed its dedication to combating fraud and illicit content.
Experts, victims, and regulators globally have increasingly urged technology companies to take stronger action against deepfake pornography and related AI-generated abuses. The Tech Transparency Project’s director, Katie Paul, criticized Meta for allegedly providing a "free pass" to one of its top Chinese advertising partners concerning these infringing ads, raising questions about the company’s enforcement rigor.
Meta has previously pursued legal action against developers of deepfake-nude apps, including a lawsuit filed last year against a Hong Kong-based developer accused of offering such services. The recent findings highlight ongoing challenges in policing AI-driven synthetic media, especially when originating from jurisdictions outside Meta’s direct control. Google, which operates the Google Play store where some offending apps were hosted, did not respond to requests for comment on the matter.
