Visitors Now:
Total Visits:
Total Stories:
Profile image
By Next Big Future (Reporter)
Contributor profile | More stories
Story Views

Now:
Last Hour:
Last 24 Hours:
Total:

Google’s systems send out alerts when they are down to their last few petabytes

Thursday, March 7, 2013 19:56
% of readers think this story is Fact. Add your two cents.

(Before It's News)

From NextBigFuture.com

One of the best-kept secrets of Google’s rapid evolution into the most dominant force on the web is a software called Borg. Google has been using the system for a good nine or 10 years and John Wilkes and his team are now building a new version of the tool, codenamed Omega.

Borg is a way of efficiently parceling work across Google’s vast fleet of computer servers, and according to Wilkes, the system is so effective, it has probably saved Google the cost of building an extra data center. Yes, an entire data center. That may seem like something from another world — and in a way, it is — but the new-age hardware and software that Google builds to run its enormous online empire usually trickles down to the rest of the web. And Borg is no exception.

Google's systems are big. Google engineers might receive an emergency alert because a system that stores data is down to its last few petabytes of space. In other words, billions of megabytes can flood a fleet of Google machines in a matter of hours.

Google’s system provides a central brain for controlling tasks across the company’s data centers. Rather than building a separate cluster of servers for each software system — one for Google Search, one for Gmail, one for Google Maps, etc. — Google can erect a cluster that does several different types of work at the same time. All this work is divided into tiny tasks, and Borg sends these tasks wherever it can find free computing resources, such as processing power or computer memory or storage space.

Wilkes says it’s like taking a massive pile of wooden blocks — blocks of all different shapes and sizes — and finding a way to pack all those blocks into buckets. The blocks are the computer tasks. And the buckets are the servers. The trick is to make sure you never waste any of the extra space in the buckets.

“If you just throw the blocks in the buckets, you’ll either have a lot of building blocks left over — because they didn’t fit very well — or you’ll have a bunch of buckets that are full and a bunch that are empty, and that’s wasteful,” Wilkes says.

B4INREMOTE-aHR0cDovLzEuYnAuYmxvZ3Nwb3QuY29tLy1odDlNSXl6MnM3RS9VVGcycnpYYWVzSS9BQUFBQUFBQWpJZy8zdHB6RXZMaExIdy9zNjQwL2dvb2dsZW9tZWdhLmdpZg==

Rather than run separate software systems on separate server clusters, Google can run everything on one cluster — thanks to Borg and its successor, Omega. Illustration: Ross Patton

Read more »

See more and subscribe to NextBigFuture at NextBigFuture.com



Source:

Report abuse

Comments

Your Comments
Question   Razz  Sad   Evil  Exclaim  Smile  Redface  Biggrin  Surprised  Eek   Confused   Cool  LOL   Mad   Twisted  Rolleyes   Wink  Idea  Arrow  Neutral  Cry   Mr. Green

Top Stories
Recent Stories

Register

Newsletter

Email this story
Email this story

If you really want to ban this commenter, please write down the reason:

If you really want to disable all recommended stories, click on OK button. After that, you will be redirect to your options page.