Did AI See This? Detecting Copyrighted Data in Large-Scale Models’ Training

Priberam Labs

Instituto Superior Técnico, Anfiteatro PA2

Abstract:Large-scale models are trained on massive amounts of data, yet the secrecy surrounding training datasets makes it difficult to determine whether specific content was included. In this talk, I introduce two novel approaches for addressing this challenge in the context of large language and vision-language models.First, I present DE-COP, a method designed to detect whether copyrighted text has been included in a language model’s training data. By leveraging multiple-choice questions that contrast verbatim text with its paraphrases, DE-COP effectively exposes memorization, significantly outperforming prior methods. Unlike most existing training data detectors, it does not rely on access to token probabilities, making it fully applicable to black-box models.Then, I extend this investigation to vision-language models with DIS-CO, a new approach for identifying copyrighted visual content in training data. DIS-CO queries models with frames from movies, evaluating whether they can correctly guess the corresponding titles in free-form text generation. Using our MovieTection benchmark, built from 14,000 frames across various films, we find that many popular VLMs display clear signs of memorization, raising broader concerns about AI training practices and copyright compliance. Bio:André Duarte is a Dual Degree PhD student at Carnegie Mellon University and Instituto Superior Técnico, supervised by Prof. Lei Li and Prof. Arlindo Oliveira. His research primarily focuses on the security and privacy of Generative AI models, with a particular emphasis on Membership Inference Attacks. In addition to his research, André has also been a part of the INESC-ID team that led the development of two AI solutions for the Portuguese government, aiming to accelerate human evaluations of corporate applications for European funding and citizen reimbursement claims for energy-efficient home investments. <a href="https://www.priberam.com/" title="https://www.priberam.com/" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">www.priberam.com</a>

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

Did AI See This? Detecting Copyrighted Data in Large-Scale Models’ Training

More events from Priberam Labs

Discover more events from Priberam Labs, from Science & Tech to other experiences you might love.

Still looking for the right event?

Explore all events in Lisboa and filter by date, category, and more to find the perfect fit.

Did AI See This? Detecting Copyrighted Data in Large-Scale Models’ Training

More events from Priberam Labs

Discover more events from Priberam Labs, from Science & Tech to other experiences you might love.

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.

Still looking for the right event?

Explore all events in Lisboa and filter by date, category, and more to find the perfect fit.