We talk incessantly about the importance of big data to drive better business decisions and outcomes. Marketers, managers, business owners, thought leaders – just about everyone is spending inordinate amounts of time debating big data. Why? It’s because companies engaging in data projects are doing better than those that are not. The proof is out there for everyone to see. For instance, a study by IDC finds that companies using diverse data sources, analytical tools, and different sets of metrics are “five times more likely to exceed expectations for their projects” than those that don’t use these big data strategies.
Growing over the past few years, big data has been established by an obscene number of research, studies, and surveys as a holy grail for business success. But let me ask you this: Just because the data is there, does that mean we are using it correctly? Are businesses really benefiting from all that data they are painstakingly mining and trying to make sense of? Are they choosing the right data?
Which begs the question, can data steer us wrong?
Big data: the right signal or mere noise?
I believe the biggest challenge in the age of big data is that there is so much information that it’s easy to make mistakes. One of the best examples of how data can lead us to totally out-of-context results comes from Harvard University professor Gary King.
This big data project, using Twitter feeds and other social media data, attempted to predict the unemployment rate in the U.S. With the help of keywords like “unemployment,” “jobs,” and “classifieds,” the researchers drew a correlation between the total monthly mentions of those keywords on social channels, and the monthly employment rate. Then, the researchers noticed an incredible increase in the number of tweets having one particular keyword. There’s a spike! Something must have shifted in society! Except, those tweets weren’t talking about anything work related — they were talking about the death of former Apple co-founder and CEO Steve Jobs.
That, my friends, pretty much sums up how precarious it can be to chase data without knowing if you’re chasing the right data.
When you have a hammer, everything looks like a nail
The easiest and, at the same time, the most dangerous thing about data is it can be skewed and manipulated. With so much information — especially unstructured data and numerous similar studies by known and unknown groups — it’s easy for us to take data and use it to prove what we want it to prove. So when you’re using data sets that you think are important and relevant to build your strategies, but you aren’t checking to see if they are well-aligned with your business objectives, you’re inviting failure.
Also Check Out: When Big Data Causes Big Problems (Podcast)
Yes, data can steer us wrong if we are not careful about how we use it. When we have so much data at our disposal and are able to benefit from it, there’s an irrefutable temptation to use it to try and solve all business problems. What we often forget is that while data can present us with better insights, predictions, and decisions, it can be misleading and, at times, plain useless. We have to develop a better understanding of the power of big data. We have to be careful to make sure we use data to drive better results; we can’t just use data to prove what we already believe.
This post was written as part of the Dell Insight Partners program, which provides news and analysis about the evolving world of tech. Dell sponsored this article, but the opinions are my own and don’t necessarily represent Dell’s positions or strategies.
Image: Creative Commons
Daniel Newman is the Principal Analyst of Futurum Research and the CEO of Broadsuite Media Group. Living his life at the intersection of people and technology, Daniel works with the world’s largest technology brands exploring Digital Transformation and how it is influencing the enterprise. From Big Data to IoT to Cloud Computing, Newman makes the connections between business, people and tech that are required for companies to benefit most from their technology projects, which leads to his ideas regularly being cited in CIO.Com, CIO Review and hundreds of other sites across the world. A 5x Best Selling Author including his most recent “Building Dragons: Digital Transformation in the Experience Economy,” Daniel is also a Forbes, Entrepreneur and Huffington Post Contributor. MBA and Graduate Adjunct Professor, Daniel Newman is a Chicago Native and his speaking takes him around the world each year as he shares his vision of the role technology will play in our future.