Skip to main content

Google is rapidly turning into a formidable opponent to BFF Nvidia — the TPU v5p AI chip powering its hypercomputer is faster and has more memory and bandwidth than ever before, beating even the mighty H100

Google accompanied the recent launch of its Gemini AI models with the latest version of its flagship tensor processing unit (TPU) for AI training and inference, in what appears to be an attempt to take on Nvidia's own market-leading GPUs.

TPU v5p – Google's most powerful custom-designed AI accelerator – has been deployed to power the firm's 'AI Hypercomputer'. This is a supercomputing architecture that's built specifically to run AI applications, rather than supercomputers which normally run scientific workloads, because TPUs are unsuited to this.

The latest version of its TPU has 8,960 chips per pod (which comprise the system), versus 4,096 in v4, and it's four times as scalable in terms of total availability of FLOPs per pod. These new pods provide a throughput of 4,800Gbps. The new pods also have 95GB of high-bandwidth memory (HBM) versus 32GB HBM RAM in TPU v4. 

Nvidia H100 vs Google TPU v5p: Which is faster?

Unlike Nvidia, which offers its GPUs out for other companies to purchase, Google's custom-made TPUs remain in-house for use across its own products and services. Google's TPUs have long been used to power its services including Gmail, YouTube and Android, and the latest version has also been used to train Gemini. 

Google's v5p TPUs are up to 2.8 times faster at training large language models than TPU v4, and offer 2.1-times value-for-money. Although the intermediary version, TPU v5e, released earlier this year, offers the most value for money of all three, it's only up to 1.9-times faster than TPU v4, making TPU v5p the most powerful.

It's even powerful enough to rival Nvidia's widely in-demand H100 GPU, which is one of the best graphics cards out there for AI workloads. This component is four times faster at training workloads than Nvidia's A100 GPU, according to the company's own data. 

Google's TPU v4, meanwhile, is estimated to be between 1.2 and 1.7-times faster than the A100, according to research it published in April. Incredibly rough calculations would suggest the TPU v5p, therefore, is roughly between 3.4 and 4.8-times faster than the A100 – which makes it on par or superior to the H100, although more detailed benchmarking is needed before any conclusions can be drawn.

More from TechRadar Pro



Comments

Post a Comment

Popular posts from this blog

The latest Apple TV 4K test lets you watch four sports streams at once

Apple is trying something new with the latest beta version of tvOS 16.5: the option to watch up to four simultaneous streams at once. Right now it's limited to live sports streamed through the Apple TV app on the Apple TV 4K , specifically MLB Friday Night Baseball and the MLS Season Pass. A multi-view option was spotted in the tvOS software last month, but the code was hidden and not enabled. MacRumors reported that the feature would be enabled this weekend, and beta testers have since been able to use it. As yet multi-view hasn't been officially announced by Apple, but it's expected that tvOS 16.5 is going to be pushed out in its final form within the next month or so. WWDC 2023 is around the corner as well, when we should be hearing about the next major updates for Apple's various operating systems – including tvOS 17. How it works Over at 9to5Mac there's a hands-on demonstrating how the multi-view feature works, and it's pretty much as you would expe...
Post a Comment
Read more

Garmin's new radar-equipped tail light will keep you safe on your e-bike

Garmin's Varia bike radars are some of the most popular pieces of cycling tech around – and now the company has delivered its first rearview radar to have been specially designed for some of the best e-Bikes .   Garmin's Varia range mounts to the back of your bike and broadcasts a radar signal behind you, so you can get visual and audible alerts when something's overtaking you. Even better, the new Varia eRTL615 plugs directly into most e-bikes, with no battery required. Because the catchily-named Varia eRTL615 is also a tail light, it'll also make sure you're visible to other vehicles too, promising to emit a flashing or solid light that's visible from up to a mile away in daylight. To connect Garmin's new radar tail light to your e-bike, you'll need to pick the right Garmin adapter cable (which isn't included). You can buy power cables compatible with Bosch, Shimano, or USB-A terminals or connections, with more info on those available on Garmin...
Post a Comment
Read more

Revolution Software is using their own AI technology to remake Broken Sword

TechRadar Gaming is reporting live from Gamescom 2023 on the latest and greatest developments in gaming and hardware. Revolution Software announced at Gamescom 2023 that Broken Sword would be coming back, with Broken Sword - The Shadow of the Templars getting a full remake while a sixth title in the series is coming in the future too, under the title Broken Sword - Parzival’s Stone .  Speaking to TRG ahead of the announcement, Cecil talked about the studio’s plans for a Broken Sword remake and the sixth title in the series. Cecil is a larger-than-life character, who is able to talk about the studio’s plans with enthusiasm. It even carries a pocketful of stones to illustrate the plans for Parzival’s Stone , but he also talks about how Broken Sword - The Shadow of the Templars would be using AI to upscale.  Cecil wasn’t shy about the studio’s use of AI technology, but he gave a fairly robust explanation of why the game was using it. The AI technology will be used to upda...
Post a Comment
Read more