Skip to main content

Unlimited cloud storage provider used ancient technique to boost upload speeds — Son of Intel's Robson makes a timid return with SSD cache but on a much, much bigger scale

Blackblaze claims to have achieved upload speeds on its B2 Cloud Storage platform that are up to 30% faster than AWS S3 by tapping into a “shard stash” based on solid-state drives (SSDs).

When customers previously uploaded small files to Blackblaze B2, the data was written to several hard drives, and these had to be completed before returning a response to the client. But data is now written to HDDs as well as some SSDs – known as the ‘shard stash’ at the same time. The SSD-held data is stored only until HDDs have received all the data, after which point these copies are deleted. Since uploading to the SSD is much faster than the HDD, the result is faster uploads.

The firm benchmarked its new storage technology by uploading a 256kb file and a 1MB file to the Blackblaze B2 US East servers as well as the AWS S3 equivalents – and found the file was 30% faster than S3 for the former file and 10% faster for the latter.

Seeking inspiration from Intel’s Robson 

When a client application uploads files, Blackblaze normally deploys a coordinator pod to split them into 16 data shards alongside four parity shards. These 20 shares are then written to 20 different HDDs. 

When using HDDs, incidentally, most of the time it takes to write the file is dedicated to waiting for the drive platter to spin to the right location. This data is first written to in-memory cache, and then written to the physical disk in the future. Until this point, users won’t receive a “success” response. 

But even the best HDDs are much slower than SSDs, and the firm’s engineers have managed to find a way to incorporate them into the upload process and boost performance without raising costs too much. The new and improved B2 Cloud Storage lets the coordinator split files under 1MB into 20 shards as normal, which are sent to HDDs, but there are additional shards sent to servers fitted with ten Micron SSDs.

Because writing to the SSDs is much quicker, these “shard stash” servers can serve as a temporary but secure repository for the data, and send a “success” response to the user far quicker than using the previous model. Once the data is safely uploaded to the HDDs, the data is purged from the SSDs and can be reused.

It’s similar to Intel’s TurboMemory system that it developed in the 2000s, codenamed Robson, which was embedded in the best laptops of the era to boot systems much quicker.

More from TechRadar Pro



Comments

Post a Comment

Popular posts from this blog

Windows Copilot leak suggests deeper assimilation with Windows 11 features

Key Windows 11 features may soon be customizable as Microsoft further integrates its Windows Copilot AI assistant into the operating system. This tidbit comes from tech news site Windows Latest , which claims to have discovered new .json (JavaScript Object Notation) files within recent preview builds of Windows 11. These files apparently hint at future upgrades for the desktop AI assistant. For example, a “TaskManagerService-ai-plugin.json” was found which is supposedly a “plugin for Task Manager integration”. If this ever comes out, it could give users the ability to “monitor or close running apps using” Copilot. In total, six are currently tested and they affect various aspects of Windows 11. Next, there is an “AccessbilityTools-ai-plugin.json” that gives Copilot a way to “control accessibility [tools]. This would make it "easier for those with [a] disability to navigate through the system.” Third is “ai-plugin-WindowsSettings.json” for controlling important Windows 11 set...
Post a Comment
Read more

Google Chrome releases security fix for this major flaw, so update now

Google says it has fixed a high-severity flaw in its Chrome browser which is currently being exploited by threat actors in the wild.  In a security advisory , the company described the flaw being abused and urged the users to apply the fix immediately.  "Google is aware that an exploit for CVE-2023-2033 exists in the wild," the advisory reads. Automatic updates The zero-day in question is a confusion weakness vulnerability in the Chrome V8 JavaScript engine, the company said. Usually, this type of flaw can be used to crash the browser, but in this case it can also be used to run arbitrary code on compromised endpoints.  The flaw was discovered by Clement Lecigne from the Google Threat Analysis Group (TAG). Usually, TAG works on finding flaws abused by nation-states, or state-sponsored threat actors. There is no word on who the threat actors abusing this flaw are, though. Read more > Patch Google Chrome now to fix this emergency security flaw > Emergency...
Post a Comment
Read more

Samsung's ViewFinity S9 may be the monitor creatives have been searching for

Originally revealed during CES 2023 , Samsung has finally launched its ViewFinity S9 5K monitor after nine long months of waiting.  According to the announcement, the ViewFinity S9 is the company’s first-ever 5K resolution (5,120 x 2880 pixels) IPS display aimed primarily at creatives. IPS stands for in-plane switching , a form of LED tech offering some of the best color output and viewing angles on the market. This quality is highlighted by the fact that the 27-inch screen supports 99 percent of the DCI-P3 color gamut plus delivers 600 nits of brightness.  Altogether, these deliver great picture quality made vibrant by saturated colors and dark shadows. The cherry on top for the ViewFinity S9 is a Matte Display coating to “drastically [reduce] light reflections.”  As a direct rival to the Apple Studio Display , the monitor is an alternative for creative professionals looking for options. It appears Samsung has done its homework as the ViewFinity S9 addresses some of...
Post a Comment
Read more