Apple and Google Apps Caught Hosting 400 Deepfake Tools
Your app store approval isn't a safety guarantee—here's what you need to know.
A recent investigation by WIRED uncovered a sprawling network of more than 400 apps and websites that offer AI tools to create fake sexual images—often called deepfakes—of real people without their consent. These apps managed to get listed on Apple's App Store and Google Play, as well as advertised on Meta's platforms like Facebook and Instagram. The apps disguised themselves as ordinary AI products, but hidden features allowed users to generate nonconsensual sexual imagery from uploaded photos.
The trick? These apps didn't reveal their true functionality during app store reviews. Instead, they used remote servers to detect who was using them—showing harmless features to reviewers and hiding the abusive tools from the general public. In some cases, simply clicking a Facebook ad and installing the app unlocked the hidden deepfake capabilities. The investigation linked many of these apps to Chinese developers and a Hong Kong-based company called KeLing Technology Limited, which has since cut ties with the apps.
Apple and Google have responded by removing some of the identified apps. Apple says developers changed their apps after approval, while Google claims it had already removed the apps before the report. Both companies emphasize that they prohibit apps that allow 'nudifying' images. However, the investigation suggests that removing individual apps isn't enough—the shared code and infrastructure mean the network can easily bounce back with new listings.
For everyday users, this is a wake-up call: app store approval doesn't guarantee safety. Be wary of apps advertised on social media, especially those promising AI photo editing. If you spot an app that seems to hide its true purpose or promotes nonconsensual image generation, report it to the app store and the social platform. Your vigilance can help protect others from harassment and abuse.
- Over 400 apps and websites were found to offer AI deepfake tools, often disguised as normal AI products.
- These apps bypassed Apple and Google's reviews by showing harmless features to reviewers and hiding abusive tools from users.
- Apple and Google have removed some apps, but the shared network makes it hard to eliminate entirely.
Why It Matters
Your photos could be used to create fake explicit images without consent, and app store approval doesn't guarantee safety.