Pervasive DataRush

This blog is syndicated from the Pervasive DataRush site.

October 2011 - Posts

  • Making The Most Out Of Your Data: Big Data Opportunities

    Last month, Forrester Research released a report, "Expand Your Digital Horizon With Big Data,” for CIOs that focused on how they should approach big data in order to take full advantage of it for their businesses. It addressed how big data is influencing markets across industries and is prevalent in various business sectors, such as healthcare, web marketing and telecommunications. The report also discussed several factors for companies to consider when working with their data, such as redefining approaches to using data beyond traditional BI tools.

    Key points included how major potential challenges of big data include not only the cost of the technology but also the shortage of data scientists. Companies are starting to seek professionals with big data skills, stimulated by new pressures to scale large volumes of unstructured data. According to a recent Forbes article by Quentin Hardy, the “data scientist” phenomenon has recently started to emerge in big data conversations with debates currently over its definition, the skill set required and the data scientist’s role in the big data trend.

    Forrester analyst Brian Hopkins, who co-authored the report with Boris Evelson, Sharyn Leaver, Connie Moore, Alex Cullen, Mike Gilpin and Mackenzie Cahill, posted a brief summary of the report on his blog, emphasizing three key questions for companies to address in order to understand and create a big data plan: 1) What is new about big data? 2) What is it? and 3) How will it influence our market?


    Some interesting data points, findings and recommendations from the report include:

    1.       Forrester surveyed 60 of their clients who are using or experimenting with big data computing. 75% of the surveyed clients responded that data volume was the main reason for looking into big data solutions. 58% of respondents in Forrester's June 2011 Global Big Data Online Survey reported interest in insight driven by an analytics approach.

    2.       70% of respondents expressed interest in big data for managing current enterprise information. Therefore, many early adopters are using big data solutions to understand existing information and not new data sources.

    3.       Cost is the underlying theme for big data challenges. These challenges include:

    ·         Volume, in terms of data amount exceeding how it can be stored cost-effectively

    ·         Velocity, in terms of processing data fast enough for businesses to respond and adapt rapidly

    ·         Variety, in terms of integration costs of adding new data feeds and interpreting variable data structures

    ·         Variability, in terms of complex and highly variable data structures that complicate analysis

    4.       Big data is still in its early stage, and thus serves as a challenge to businesses. To succeed and overcome the challenges, businesses should:

    ·         Encourage collaboration between business and IT

    ·         Create new, agile and compliant processes and approaches to deliver big data solutions

    ·         Adapt quickly to fast-paced, changing technology trends for rapid growth 

    As the big data trend continues to flourish throughout industries, companies that tend to have a handle on managing and using their data are able to develop forward-looking strategies and gain a competitive advantage over their competitors. CIOs are facing increased pressure to figure out ways to make use of the company’s data to achieve meaningful insight for valuable business decisions. As a result, this brings up an important question to address: how is the CIO’s role evolving as new big data technologies emerge and IT spending in big data increases? Is your business feeling the pressure to join the competitive big data crowd?


    Pervasive Big Data encompasses
    Pervasive’s DataRush big data software platform for companies to consume high volume and variable data for complex analysis.  We have been watching this big data trend grow for the past two years and have built our tools to help with the challenges of processing and analyzing big data.

  • Is Your Big Data Problem Solved Yet?

    We’re certainly more informed these days. And even my grandmother is hearing of the challenges of big data. But after listening to DM Radio last week, Avoiding Bottlenecks and Hurdles in Data Delivery, the big data crisis appears to be subsiding according to Philip Russom. Or is it?

    Russom points out that the biggest bottleneck in big data is moving the data from processing into data flow. Old ways of processing data relied on the hardware. The faster the hardware then the faster the processing…right? Pervasive’s Big Data Director David Inbar pointed out that old software IS the bottleneck. Organizations are throwing more hardware to handle slow processes when it’s poorly written software causing the problem.

    So we have organizations that have overhauled their technology to stay ahead of the curve, but they haven’t updated their software to process in parallel with their new technology. Do they still sell single-core work machines? If it’s more than a single core machine then your software needs to process in parallel for the most high performance efficiency. Parallel processing is the ability to carry out multiple operations simultaneously. And parallel processing allows organizations to expand and handle bottlenecks of data traffic. Once you’ve parallelized your working environment, is your big data problem solved? Probably not.

    I’m not sure if the big data crisis is subsiding OR if big data awareness is more prevalent. Organizations are certainly starting to experience the IT side of big data, but what about educating the persons running the analytics? When Jeff Kelly wrote Data Scientists Are Rocking the Big Data World, he mentions that there are few formal training and educational programs that focus on big data and analytics. To get the right answer, you have to ask the right question. And to ask the right question, you have to understand the quality of your data.

    Hopefully parents in the high tech industry are coaxing their children and their educational system to jump on the big data train today because I have a feeling that it’s going to be a long ride.

More Posts