Subscribe / Unsubscribe Enewsletters | Login | Register

Pencil Banner

Know this right now about Hadoop

Andrew C. Oliver | May 26, 2014
Here's what you must know this instant about big data darling Hadoop and its expanding universe of add-ons and subprojects.

Ancillary (this you should know about)
Finally, here are the items about which you should at least be able to talk a good game.

  • Zookeeper: This is for configuration and (cluster) group membership and coordination.
  • Sqoop: This is essentially an ETL (extract, transform, load) for sucking data out of your RDBMS or pushing data back into the RDBMS. It's not a difficult tool to use or learn if you need to. It might be good to spend some time on it, because chances are this is where your data will come from for your early Hadoop installation, integration, and implementation (or proof-of-concept projects).
  • Flume: If you've used an ESB, messed with Spring Integration, or even glanced at the Enterprise Integration Patterns book, then you have some passing familiarity with Flume, an integration tool that lets you publish data to channels, aggregate data, multiplex data, filter data, and more. Unless you've rolled out your "data lake" and have a relatively high level of maturity using Hadoop in your organization, I'd work on a passing strategic knowledge of Flume for now, just enough to talk strategy.

By my informal study -- and plenty more formal by analysts -- Hadoop is the hottest growth area of the industry. While you may have a (misguided) passion for $RANDOMCOMPUTERLANGUAGE or ${api.of.theday}, if you want to be the kind of highly valued developer that every organization is trying to poach and no one wants to lose, this is the stuff you should know right about now. The curve will rise as time goes on.

In the comments I expect "the author is clearly an idiot because he left out $FAVORITEPETPROJECT" or some random detail I omitted or oversimplified. All that means is that this is a fast-growing ecosystem and the secret to winning the gold rush is get there and buy the land first.

Source: Infoworld


Previous Page  1  2  3 

Sign up for Computerworld eNewsletters.