San Francisco Demands Tech Giants Remove AI 'Nudify' Apps From App Stores
The San Francisco City Attorney's Office has taken action against what it describes as a proliferation of harmful AI applications. This week, the office sent cease-and-desist letters to both Apple and Google, calling on the tech giants to remove 13 specific "face-swap" applications from their respective app stores.
These apps, often referred to colloquially as "nudify" tools, utilize artificial intelligence to digitally undress images of individuals without their consent. According to the city attorney's office, the targeted apps are overwhelmingly used to victimize women and girls, raising significant concerns about privacy violations and the potential for harassment.
The legal action highlights growing regulatory scrutiny over AI tools that can be easily weaponized for non-consensual purposes. Law enforcement officials and advocates have long warned about the dangers of such technology, which can create realistic fake images that lead to emotional distress, reputational damage, and in some cases, extortion.
By targeting the distribution platforms rather than individual app developers, the city is applying pressure directly to Apple and Google to stop profiting from applications that facilitate what authorities describe as harmful and illegal activity. The move represents an attempt to hold the app store operators accountable for the content available on their platforms.
This action adds to an ongoing public debate about the responsibilities of technology companies in moderating AI-generated content and protecting users—particularly women and minors—from exploitation.