Skip to main content

“We broke them all” — How researchers broke current image watermarking protections and what it means for a new era of truth-altering ‘reality’

The tool many big tech companies are banking heavily on being able to help the public and businesses separate fact from fiction, in the context of AI’s meteoric rise, has already been undermined before it’s even taken off.

The idea of watermarking is something that companies including OpenAI, Amazon and Google have pointed to as being able to combat disinformation online. With generative AI on the rise, particularly in the form of deepfakes, it might be looked at as one way to identify what’s actually real. It’s one of the key proposals among efforts to make the usage of AI, safer and more transparent.

There aren’t, however, many clear-cut approaches to watermarking yet that are completely fool-proof or reliable, and professors with the University of Maryland have already found a way to break all of the existing methods, according to TechXplore.

How scientists have already cracked AI watermarking

The researchers used a technique called diffusion purification to blast Gaussian noise – a kind of electronic noise signaling – at a watermark to completely remove it, without impacting the underlying image too much. 

With AI-generated content on the rise, especially in certain industries, the scope for abuse has also surfaced as a very real possibility. It’s also essential to find tools and strategies to be able to distinguish genuine content from that made by machines.

Watermarking is a promising approach, according to the paper, published on 29 September. It involves hiding a signal in a piece of text or image to determine if it’s AI-generated. The theory goes a tool you run the content through would then be able to determine whether it’s real or fake, and avoid the prospect of falling for something that isn’t real. But the attack method – diffusion purification – has already been able to nullify today’s watermarks.

“Based on our results, designing a robust watermark is a challenging, but not necessarily impossible task,” the paper said, offering a glimmer of hope.

“An effective method should possess specific attributes, including a substantial enough watermark perturbation, resistance to naive classification, and resilience to noise transferred from other watermarked images.”

More from TechRadar Pro



Comments

Popular posts from this blog

Garmin's new radar-equipped tail light will keep you safe on your e-bike

Garmin's Varia bike radars are some of the most popular pieces of cycling tech around – and now the company has delivered its first rearview radar to have been specially designed for some of the best e-Bikes .   Garmin's Varia range mounts to the back of your bike and broadcasts a radar signal behind you, so you can get visual and audible alerts when something's overtaking you. Even better, the new Varia eRTL615 plugs directly into most e-bikes, with no battery required. Because the catchily-named Varia eRTL615 is also a tail light, it'll also make sure you're visible to other vehicles too, promising to emit a flashing or solid light that's visible from up to a mile away in daylight. To connect Garmin's new radar tail light to your e-bike, you'll need to pick the right Garmin adapter cable (which isn't included). You can buy power cables compatible with Bosch, Shimano, or USB-A terminals or connections, with more info on those available on Garmin...

Revolution Software is using their own AI technology to remake Broken Sword

TechRadar Gaming is reporting live from Gamescom 2023 on the latest and greatest developments in gaming and hardware. Revolution Software announced at Gamescom 2023 that Broken Sword would be coming back, with Broken Sword - The Shadow of the Templars getting a full remake while a sixth title in the series is coming in the future too, under the title Broken Sword - Parzival’s Stone .  Speaking to TRG ahead of the announcement, Cecil talked about the studio’s plans for a Broken Sword remake and the sixth title in the series. Cecil is a larger-than-life character, who is able to talk about the studio’s plans with enthusiasm. It even carries a pocketful of stones to illustrate the plans for Parzival’s Stone , but he also talks about how Broken Sword - The Shadow of the Templars would be using AI to upscale.  Cecil wasn’t shy about the studio’s use of AI technology, but he gave a fairly robust explanation of why the game was using it. The AI technology will be used to upda...

Hackers steal passwords, emails from hookup websites

Two gay hookup websites have been breached with sensitive and personal user data stolen and sold online, new reports have claimed. The databases, which are now being sold on dark web forums, were taken from platforms called TruckerSucker, and CityJerks. They contain enough personally identifiable information to engage in identity theft , such as usernames and passwords, email addresses, profile pictures, sexual preferences, birth dates, postal addresses, IP addresses, and bios. The passwords are encrypted, but according to TechCrunch, the algorithm is “weak” and could be broken by a more persistent hacker. The silent treatment HaveIBeenPwned founder Troy Hunt, who was tipped off on the leak, described the incident as a “typical forum breach, albeit with super sensitive content.”  However the content includes more than just identity data, as there are also messages users exchanged, including arranging meetings and describing their sexual preferences.  In total, more than...