San Francisco orders Apple and Google to remove 13 AI nudify apps

San Francisco is escalating pressure on Apple and Google over AI 'nudify' apps that generate non-consensual nude images. City Attorney David Chiu sent cease-and-desist letters demanding the removal of 13 specific apps from their app stores, citing a California law that prohibits knowingly facilitating the creation of non-consensual deepfake pornography. According to reports, eight of the apps were on Apple's App Store and five on Google Play. Chiu gave both companies 28 days to comply or face significant civil penalties. The move signals a broader regulatory push to hold platform owners responsible for harmful AI tools distributed through their stores, rather than just the developers who build them.

Apple responded by stating it has already removed three of the eight apps and is terminating the associated developer accounts, while it is in contact with four others about policy violations—leaving one app still unaccounted for. Google told multiple outlets it has removed hundreds of apps violating its policies, blocked search terms linked to nudify software, and uses both automated and human reviews to combat abusive content. Despite these efforts, Chiu argues the platforms' current safeguards are insufficient, as problematic apps continue to surface repeatedly. This case could influence future legal precedents around app store liability for AI-generated abuse, potentially reshaping how tech giants moderate content and enforce safety policies.