Airbnb Open Sources Its Chronos Scheduler, A More Flexible Cron Replacement With A Web-Based GUI

(Before It's News)

In SoMeIT (Social Media Information Technology), we are fully dedicated to satisfying all of your web needs, integrating your business to social networks.

Airbnb just announced that it has open sourced Chronos, the company’s replacement for the standard time-based Cron schedule that is probably familiar to everybody who has ever used a Unix-based system. Chromos runs on top of Apache’s Mesos cluster manager and allows developers to execute shell scripts at set intervals and, unlike Cron, you can also trigger jobs by the completion of other jobs. Chronos, the team writes, was born out of Airbnb’s need to automate more of its data processing pipeline. Until last December, Airbnb was apparently using a single hourly Cron job that would start its complex processing pipeline. The problem with this, the company’s engineers write was that they “use a managed Hadoop product from Amazon, called Elastic Map/Reduce. High variance in network latency, virtualization and not having predictable I/O performance is an ongoing challenge in a cloud environment.” This increased the chance of something going wrong, so the team decided it needed a system that would allow for retries and would give its analysts the ability to see which jobs had failed. To make keeping track of Chronos even easier, the team also developed a web-based user interface that makes it easier to manage and run jobs than the usual text file Cron users have to rely on (Chronos also features an API, so you can always build your own GUI, too). Airbnb’s GitHub repository delves a little bit deeper into the details of how Chronos works and if you’ve got 45 minutes to burn and would love to hear more about Chronos, here is the tech talk the team did at Airbnb’s headquarters earlier this year:

source: http://feedproxy.google.com/~r/Techcrunch/~3/jIxg5dhWrus/

• Facebook Fills Its Vacant CTO Role By Promoting Its VP Of Engineering, Mike Schroepfer
• Street Performer Punches Guy in Face
• Samsung announces production of Exynos 5 Octa chip
• [Deal Alert] Modern Combat 4: Zero Hour on special for a Buck and it was just Updated
• First Evidence Of Life Deep Under Oceanic Crust Realized
• Google Reader On Death Bed: 5 Best Google Reader Alternatives To Consider
• Samsung puts Exynos 5 Octa into production: guess who’s the first customer
• Jeopardy Burns Taylor Swift
• Saint’s Row IV unleashed: open-playground madness on tap!
• 7 YouTube Tutorials for the Perfect St. Patrick’s Day Party