How to avoid overspending on Big Data

By Thor Olavsrud, CIO.com | May 10, 2012

Big Data is a powerful lure, promising to turn the massive and ever-increasing volumes of data inside an organization into a pool of intelligence that promises deep, actionable insight into every aspect of a business. However, that lure can lead you into an expensive trap if you don't plan carefully.

"Big Data has big spending risks," says Jeff Muscarella, IT spend management consultant with NPI Financial. Muscarella warns that Big Data projects can easily ring up seven-figure price tags after you finish paying for the hardware, software and services, and sometimes the glowing business cases presented by vendors lose their luster when you look closely. "A lot of times, when you pull them apart, they're not as rosy as they seem," he says.

That's not to say that harnessing the power of Big Data is a mistake, Muscarella explains. But it does mean that organizations seeking to base their decisions on data need to start by gathering real data on how a Big Data project will benefit the business.

"This is not just new technology," Muscarella says. "It's new technology solving a business problem that we often haven't proved. That's important for CIOs to keep in mind. The business is going to be coming to them with all sorts of half-baked ideas for what they can do with Big Data. They have to ask: Will it really drive revenue? How and for how long? What will it take to build it? They need to make sure they have a crisp focus on the mission; that it is going to have a return on investment."

For Big Data, Fire Bullets not Cannons

When you're exploring a Big Data project, don't dive in head first, Muscarella warns. Start with open source tools like Apache Hadoop and build a test case.

"You want to really pilot these things," Muscarella says. "Pick something that's manageable. Start on a small scale to prove your hypothesis. For instance, if we could mine this sensor data or these Web clicks or these purchasing habits, would what we do with these results improve our business."

"Don't get trapped into building the infrastructure yet," he adds. "Prove it first and then go back and architect your solution. Assume that however you solve the problem, you're probably going to throw it away and start over. That's OK because at least you proved the business need before you spent a lot of money."

 
 

Add comment

The content of this field is kept private and will not be shown publicly.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <a> <p> <span> <div> <h1> <h2> <h3> <h4> <h5> <h6> <img> <img /> <map> <area> <hr> <br> <br /> <ul> <ol> <li> <dl> <dt> <dd> <table> <tr> <td> <em> <b> <u> <i> <strong> <font> <del> <ins> <sub> <sup> <quote> <blockquote> <pre> <address> <code> <cite> <embed> <object> <strike> <caption>
  • Lines and paragraphs break automatically.
  • Use <!--pagebreak--> to create page breaks.

More information about formatting options

Verification Code
This question is for testing whether you are a human visitor and to prevent automated spam submissions.