We’ve all most likely seen the hoarding programming on television lately showing everyday people with collected items piled wall to wall, from floor to ceiling throughout their home with barely any room to live. Unfortunately this too can happen, virtually, to enterprises with no more room to store data because they’ve collected more then expected too fast and are now scrambling to come up with a solution. The bottom line is don’t be a Big Data hoarderWith all this talk about how to handle and process Big Data, how to derive insight and analytics from Big Data and how to store Big Data, there is little conversation around what to do with Big Data after you finally have it. It’s important before you start handling Big Data that you come with a realistic data retention plan. This plan has to be both realistic for your analysis needs as well as your enterprise needs for data handling and storage.
All too often, companies formulate a plan to take in Big Data and begin analysis for customer insight; however, they soon realize they are not only overwhelmed by the deluge of information, but they’re also overwhelmed by the amount of storage capacity that’s required to keep massive amounts of data. It’s a difficult situation to be in when you finally get what you ask for only to realize you’re up to the rafters in data with no where to walk.
In terms of the marketing world, BigData is typically obtained in the collection of customer data such as Social Media conversations or detailed customer purchasing behavior over time. Before your start collecting this type of data, determine exactly how you’re going to use that specific data and come up with a time frame for storing the data where it will remain fresh and relevant for your specific purpose. Make sure you implement an auto archiving or auto purge of the data once it passes your established time frame for relevancy.
For most organizations the period of data relevancy can differ on usage requirements, program requirements and also even legal requirements which stipulate the amount of time data must be retained. Make it a priority before you start consuming Big Data to work with your companies internal IT department or your marketing service partner to better help you to understand not only how to use and analyze Big Data but also to determine when is the best time to say good by to Big Data.