Technology content trusted by users in Australia and around the world.
4,960 Articles | 29,945 Posts
Select Your Edition:  
Tweakipedia
A wealth of
tech information!

TRENDING NOW: Xbox One - Just what is Microsoft thinking?!
AU EditionYou are located: Home > All News > Super Computing News > Microsoft Research roughly triples amount of data sorted in 60 seconds while using less hardware

Microsoft Research roughly triples amount of data sorted in 60 seconds while using less hardware

By: (more) | Super Computing News | Posted: May 21, 2012 8:31 pm

Microsoft has announced a victory in the MinuteSort test. They claim to have tripled the amount of data sorted by the previous record holder, a Yahoo team. MinuteSort is a test to see how much data can be sorted in just a mere 60 seconds. As more data moves into the cloud, this ability to sort data quickly becomes a bigger and bigger issue.

 

microsoft_research_roughly_triples_amount_of_data_sorted_in_60_seconds_using_less_hardware

 

According to Microsoft's post on TechNet, "In raw numbers, the team's system sorted 1401 gigabytes in just 60 seconds - using 1033 disks across 250 machines." This hardware compared to what Yahoo ran is roughly "one-sixth of the hardware resources" and managed to sort around 3 times as much data. You can see that the Microsoft solution is much more efficient.

 

Additionally, it's interesting to note that Microsoft Research didn't use Hadoop as one might expect. Instead, the researchers at Microsoft created a new system called "Flat Datacenter Storage." The "flat" portion is the important part of the system. Microsoft explains:

 

[Microsoft Research's Jeremy] Elson compares FDS to an organizational chart. In a hierarchical company, employees report to a superior, then to another superior, and so on. In a "flat" organization, they basically report to everyone, and vice versa.

 

Along with "full bisection bandwidth networks," this FDS has proved to be an effective way to sort data. Hadoop currently has the industry as a commercial standard, so FDS may take some of this thunder. Microsoft has hinted that it will likely be deployed on some of its projects. The numbers have not been confirmed by an external entity yet, so, for now, this is just Microsoft praising itself. I suggest taking it with a grain of salt until someone else confirms the numbers.


SOURCE #1

Related Tags



Further Reading: Read and find more Super Computing news at our Super Computing news index page.

TweakTown News RSS FeedDo you get our news RSS feed? Get It! Got a news tip? Tell Us!

Post a Comment about this news



Check out our
RSS feeds!
  • Upcoming Content: NZXT Grid 10 Port Fan Hub Review
  • Upcoming Content: MSI Z77A-GD65 Gaming Series (Intel Z77) Motherboard Review
  • Upcoming Content: HGST Travelstar 7K1000 1TB 2.5" Hard Drive Review
  • Upcoming Content: Western Digital My Passport Edge for Mac 500GB External HDD Review
  • Upcoming Content: PQI Air Card 4GB Wi-Fi SDHC Review
  • Upcoming Content: LaCie CloudBox 1TB Personal NAS Review
  • Upcoming Content: Star Trek: The Next Generation - Season Three (1989) Blu-ray Review
  • Upcoming Content: The Hobbit: An Unexpected Journey (2012) Blu-ray Movie Review
  • Upcoming Content: Whatever happened to Comodo Time Machine?
  • Upcoming Content: ADATA DashDrive Elite UE700 USB 3.0 Flash Drive Review
  • Upcoming Content: MyDigitalSSD BP4 240GB mSATA Review


Super Computing News Posts

View More Super Computing News Posts


TweakTown Web Poll

Question: What new stuff are you most excited to see at Computex Taipei 2013?

Cases, Coolers & PSU’s

CPU's

Gadgets

GPU's & Video Cards

Keyboards & Mice

Laptops, Tablets & Phones

Motherboards & Chipsets

New Tech

SSD's & Memory

Booth Babes

or View the Results

View More Polls

Forum Activity

View More Forum Posts

Super Computing Press Releases

View More Super Computing Press Releases