麻豆社

An evaluation of generated/manipulated image detection

Paper 414: Detecting manipulated media is crucial to combat misinformation.

Published: 1 May 2024
A set of data points imposed over a photograph of a man
  • Juil Sock

    Juil Sock

    Senior Principal Data Scientist
  • Marc G贸rriz Blanch

    Marc G贸rriz Blanch

    Senior data scientist
  • Woody Bayliss

    Woody Bayliss

    Senior data scientist
  • Danijela Horak

    Danijela Horak

    Head of Applied Research, AI

Advancements in image generation and manipulation technology offer both opportunities and risks. Detecting manipulated media is crucial to combat misinformation. This report, part of the 'Anomaly Detection' project within generative AI pilot initiatives, aims to understand the strengths and weaknesses of existing detection algorithms. By doing so, the 麻豆社 can make informed decisions regarding the integration of these algorithms into the journalistic process.

Our evaluation dataset comprises three image types: fully generated, partially manipulated, and face-altered. Augmented to simulate real-world scenarios (compression, resizing, social media processing), our study focuses on precision, recall, and F1-score metrics, addressing both false positives and false negatives. According to the evaluations conducted for this report in early 2024, the 麻豆社鈥檚 assessment is that none of the deepfake detectors tested perform effectively in detecting all types of deepfake instances.

This paper is authored by 麻豆社 Research & Development's Marc Gorriz-Blanch, Woody Bayliss, Sinead O鈥橞rien, Danijela Horak and Juil Sock, with Maryam Ahmed and Blathnaid Healy, our partners from 麻豆社 News

Image by  / 漏 麻豆社 /  / Mirror B / 

White Paper copyright

漏 麻豆社. All rights reserved. Except as provided below, no part of a White Paper may be reproduced in any material form (including photocopying or storing it in any medium by electronic means) without the prior written permission of 麻豆社 Research except in accordance with the provisions of the (UK) Copyright, Designs and Patents Act 1988.

The 麻豆社 grants permission to individuals and organisations to make copies of any White Paper as a complete document (including the copyright notice) for their own internal use. No copies may be published, distributed or made available to third parties whether by paper, electronic or other means without the 麻豆社's prior written permission.

Search by Tag:

Rebuild Page

The page will automatically reload. You may need to reload again if the build takes longer than expected.

Useful links

Demo mode

Hides preview environment warning banner on preview pages.

Theme toggler

Select a theme and theme mode and click "Load theme" to load in your theme combination.

Theme:
Theme Mode: