San Francisco Orders Apple, Google to Remove AI Apps Creating Non-Consensual Intimate Images
The city of San Francisco has formally requested that Apple and Google remove dozens of artificial intelligence-powered applications from their app stores. These apps, often called 'nudify' tools, are designed to create intimate images of individuals without their consent, a practice known as deepfaking.
According to San Francisco City Attorney David Chiu, the apps violate California law by enabling the creation of non-consensual intimate deepfakes, which disproportionately target women and girls. Chiu stated that both companies continued to host and process payments for these apps despite being aware of their presence and the associated legal risks.
The legal action argues that Apple and Google are profiting from software that facilitates sexual abuse. Chiu emphasized that the companies have a responsibility to prevent the distribution of such harmful content. The city is seeking a court order to compel the removal of these apps and to prevent future listings.
This case highlights the broader challenges posed by deepfake technology, which can be used to create realistic but fake images and videos without a person's permission. Laws in several US states, including California, have been updated to criminalize the non-consensual creation and distribution of intimate deepfakes.
As of now, neither Apple nor Google have publicly commented on the specific allegations, but both have policies prohibiting sexually explicit content and non-consensual imagery in their app stores. The outcome of this legal action may set a precedent for how tech platforms handle such abusive AI tools.
