San Francisco demands Apple and Google remove 13 'nudify' deepfake apps from stores

San Francisco city attorney David Chiu sent cease-and-desist letters to Apple and Google on Thursday, ordering them to remove 13 face-swapping apps from their app stores. These 'nudify' apps allow users to upload photos and create AI-generated nonconsensual nude images of individuals—overwhelmingly women and girls. The letters accuse the tech giants of 'aiding and abetting' the sale of explicit deepfake imagery by profiting from in-app purchases, with Chiu estimating they made 'millions of dollars in fees.' California law prohibits supporting services that create deepfake pornography, the notices state.

Both Apple and Google have developer policies against pornography and harassment. Google spokesperson Dan Jackson told WIRED the company has already removed 'hundreds' of nudifying apps for policy violations, including the five Android apps flagged by Chiu’s office. Apple spokesperson Adam Dema said the company removed three flagged apps and is terminating their developer accounts, while four others must address violations or risk removal. The action follows years of reports showing these apps—some even rated as suitable for children—persistently reappearing despite platform bans. The letters highlight the broader crisis of deepfake nudification tech, which has become easier to use with improved generative AI, requiring only a reference photo and a few clicks to generate realistic sexualized images.