Edit Anyway My Face Generates Away
If you use FACELOCK, no one can use AI to edit your face maliciously
Paper: Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editing
Researchers from University of Southern California, Michigan State University and Texas A&M University are interested in FACELOCK, a new algorithm designed to protect personal images, especially portraits, from malicious editing using diffusion models.
Hmm..What’s the background?
Advances in diffusion models have made image editing incredibly realistic and easy to use. This raises ethical concerns about the potential for malicious edits, especially to human portraits, impacting privacy and identity security. Existing methods try to cancel the editing effects using adversarial perturbations, but they struggle with diverse editing requests and are susceptible to purification techniques.
So what is proposed in the research paper?
The research paper incorporates several key insights:
FACELOCK moves beyond canceling edits and instead aims to erase or significantly alter the original biometric information (like facial features) after editing. This makes it agnostic to specific editing prompts.
FACELOCK leverages this definition by targeting image integrity, specifically the biometric information, to disrupt facial recognition.
By incorporating a facial recognition model (like CVLFACE) into diffusion loop
Maximizes feature embeddings between the edited and source images using a pre-trained CNN
Experiments showcase FACELOCK outperforms baseline methods in both quantitative (using various metrics like FR, CLIP, SSIM) and qualitative evaluations. It works well across diverse editing types (facial features, accessories, background) and different diffusion-based algorithms.
What’s next?
The authors identify several areas for future research:
Extending to multiple subjects: Currently tailored for single portraits.
Adapting to new generative models: Needs further work to stay robust against emerging models like rectified flows.
If you use FACELOCK, no one can use AI to edit your face maliciously
Learned something new? Consider sharing it!