Skip to main content

Move asides CPU, today is the day the GPU takes over your kingdom

It is often easy to forget that GPU stands for Graphics Processing Unit, but in yesterday’s busy GTC 2023 (GPU Technology Conference) sessions, Nvidia announced no less than four new processors (the company's own word) as it looks to cement its position as the AI hardware champion with barely any competition in sight. 

The extraordinary success of ChatGPT has helped shape the narrative, boosting demand for bigger, better, larger, more powerful inference computing platforms.

“The number of applications for generative AI is infinite, limited only by human imagination. Arming developers with the most powerful and flexible inference computing platform will accelerate the creation of new services that will improve our lives in ways not yet imaginable.” said Jensen Huang, founder and CEO of NVIDIA.

Because Nvidia has a much smaller set of customers to service, it can deliver fine tuned products for specific tasks. The new L4 for AI video is 120x more powerful at video performance than CPUs while the L40 for image generation is 7x better at inference for Stable Diffusion than the previous generation. 

The H100 NVL has been built to tackle massive LLM (Large Language Model) deployments with a whopping 94GB of memory, helping it deliver 12x faster inference performance on the already-obsolete ChatGPT3 (and compared to the previous A100 generation). Last on the list is the Nvidia Grace Hopper superchip for recommendation models that brings Nvidia’s Arm based CPU and GPU closer and is expected later this year.

What about Intel and AMD? 

For 40 years, the CPU (Central Processing Unit) has been at the core of computing but we’re witnessing - live - a leadership coup. Nvidia single handedly tilted the balance of power; Intel has been the biggest loser with its share price halved since last year while AMD continues to play second fiddle in the land of GPU (less so when it comes to CPU).

The CPU was always in the danger of being supplanted due to its generic nature; it is a jack of all trade after all. The GPU (and other more exotic processing units) leveraged their ability to bring hardware and software closer (through Nvidia’s API CUDA for example) to excel in specialized workloads.

Nvidia’s long lasting impact is illustrated by a new service called cuLitho (short for computational lithography) where it collaborated with ASML, TSMC and Synopsys to help design and manufacture the next generation of chips, regardless of whether its CPU, GPU, NAND or any other silicon-based product. Here we have GPUs accelerating the development of the next generation of GPUs with Nvidia predicting a performance improvement of 40x compared to CPU.

With a market capitalization of almost $640 billion, Nvidia is worth more than Qualcomm ($137bn), Intel ($117bn), AMD ($153bn) and Arm (est. $50bn) put together. With Nvidia having seemingly built an insurmountable lead in AI hardware, all odds are off as to who will be second best.



Comments

Post a Comment

Popular posts from this blog

Windows Copilot leak suggests deeper assimilation with Windows 11 features

Key Windows 11 features may soon be customizable as Microsoft further integrates its Windows Copilot AI assistant into the operating system. This tidbit comes from tech news site Windows Latest , which claims to have discovered new .json (JavaScript Object Notation) files within recent preview builds of Windows 11. These files apparently hint at future upgrades for the desktop AI assistant. For example, a “TaskManagerService-ai-plugin.json” was found which is supposedly a “plugin for Task Manager integration”. If this ever comes out, it could give users the ability to “monitor or close running apps using” Copilot. In total, six are currently tested and they affect various aspects of Windows 11. Next, there is an “AccessbilityTools-ai-plugin.json” that gives Copilot a way to “control accessibility [tools]. This would make it "easier for those with [a] disability to navigate through the system.” Third is “ai-plugin-WindowsSettings.json” for controlling important Windows 11 set...
Post a Comment
Read more

Google Chrome releases security fix for this major flaw, so update now

Google says it has fixed a high-severity flaw in its Chrome browser which is currently being exploited by threat actors in the wild.  In a security advisory , the company described the flaw being abused and urged the users to apply the fix immediately.  "Google is aware that an exploit for CVE-2023-2033 exists in the wild," the advisory reads. Automatic updates The zero-day in question is a confusion weakness vulnerability in the Chrome V8 JavaScript engine, the company said. Usually, this type of flaw can be used to crash the browser, but in this case it can also be used to run arbitrary code on compromised endpoints.  The flaw was discovered by Clement Lecigne from the Google Threat Analysis Group (TAG). Usually, TAG works on finding flaws abused by nation-states, or state-sponsored threat actors. There is no word on who the threat actors abusing this flaw are, though. Read more > Patch Google Chrome now to fix this emergency security flaw > Emergency...
Post a Comment
Read more

Samsung's ViewFinity S9 may be the monitor creatives have been searching for

Originally revealed during CES 2023 , Samsung has finally launched its ViewFinity S9 5K monitor after nine long months of waiting.  According to the announcement, the ViewFinity S9 is the company’s first-ever 5K resolution (5,120 x 2880 pixels) IPS display aimed primarily at creatives. IPS stands for in-plane switching , a form of LED tech offering some of the best color output and viewing angles on the market. This quality is highlighted by the fact that the 27-inch screen supports 99 percent of the DCI-P3 color gamut plus delivers 600 nits of brightness.  Altogether, these deliver great picture quality made vibrant by saturated colors and dark shadows. The cherry on top for the ViewFinity S9 is a Matte Display coating to “drastically [reduce] light reflections.”  As a direct rival to the Apple Studio Display , the monitor is an alternative for creative professionals looking for options. It appears Samsung has done its homework as the ViewFinity S9 addresses some of...
Post a Comment
Read more