Recent investigations have uncovered that both the Apple App Store and Google Play Store hosted dozens of AI-powered “nudify” apps, which generate nude or sexualised images of women without consent. These apps, which violate the platforms’ policies against sexual nudity, were available for download and monetised through in-app purchases, with the stores taking up to a 30% commission. Although many of these apps have since been removed, several remain accessible, raising concerns about the effectiveness of app store moderation in the face of rapidly advancing AI technology.
Details on the AI Nudify and Face Swap Apps
The Tech Transparency Project conducted a thorough search using keywords such as “nudify” and “undress” across both app stores, identifying 55 such apps on Google Play and 47 on Apple’s App Store. Among these, 38 apps were found on both platforms. These applications use artificial intelligence to create explicit images or videos from user prompts or to superimpose faces onto nude bodies, a process known as face swapping. For example, DreamFace, an AI image and video generator, allowed users to create one free video daily with lewd prompts and offered subscriptions for additional content. While it has been removed from Apple’s App Store, it remains available on Google Play and reportedly generated around $1 million in revenue.
Another app, Collart, similarly accepted explicit prompts depicting women in pornographic scenarios without restrictions. This app was also removed from Apple’s store but is still accessible on Google Play. Face swap apps, such as RemakeFace, which superimpose faces onto nude images, continue to be available on both platforms, presenting even greater risks of misuse and non-consensual image creation.
Context and Platform Policies
Both Google and Apple explicitly prohibit apps that depict sexual nudity or exploit users. Despite these policies, the presence of these AI nudify apps indicates a lag in the platforms’ ability to monitor and enforce rules effectively, especially given the rapid evolution of AI deepfake technologies. The apps’ monetisation through subscriptions means the platforms also profit indirectly from content that many consider harmful or exploitative.
This situation highlights the challenges app stores face in balancing innovation with user protection. While the platforms have removed a significant number of these apps following the report, the persistence of others suggests a need for more proactive and rigorous oversight mechanisms to prevent the spread of non-consensual and explicit AI-generated content.
What to Watch For Next
As AI technology continues to advance and become more accessible, the responsibility on app stores to safeguard users from exploitative content grows ever more critical. Both Google and Apple have been contacted for comments regarding these findings, and updates are expected as they potentially revise their policies and enforcement strategies. Users and regulators alike will be watching closely to see how these tech giants address the challenges posed by AI nudify and deepfake apps moving forward.
Overall, this report serves as a reminder of the complex ethical and practical issues AI introduces to digital platforms, emphasising the importance of vigilant content moderation and user protection.