Big Data beyond the hype


Big Data beyond the hype

The Big Data hype cycle is in full swing. But what is Big Data? How do you know if your data is BIG?

Big Data is not a concretely definable category. You can’t always say exactly what it is, but you know it when you see it. In this episode I define the key characteristics of Big Data that enable us to make more intelligent assessments and decisions regarding Big Data solutions.

Listen to the Podcast: http://media.podcastingmanager.com/4/1/7/2/9/203374-192714/Media/RTDW19%20Big%20Data13052013141408-5.mp3

Key characteristics of Big Data:

  • Physical Attributes

    • Bigness: physical size of data sets

    • Multi-source: data from multiple sources, especially both internal and external to the organization

    • Multi-structure: tabular data, markup data, audio and video data, geospatial, activity, transactions, snapshots, statuses

    • Fast arriving: streaming, frequently updated, time volatile

  • How we process it

    • Real time analysis

    • Real time outputs

      • Delivery to decision makers in real time

      • Delivery to external users (consumers, social/mobile users)

      • Interaction with software APIs

    • Aggregate and details

  • What we do with it

    • Predictive value

    • Pattern recognition, especially unlikely relationships

      • fuzzy matching

      • flexible matching

  • Challenges

    • Storage

    • Processing

    • Integration

    • Analysis

 

Ref:

TBDI Definition of Big Data: Big Data is a term applied to voluminous data objects that are variety in nature – structured, unstructured or a semi-structured, including sources internal or external to an organization, and generated at a high degree of velocity with an uncertainty pattern, that does not fit neatly into traditional, structured, relational data stores and requires strong sophisticated information ecosystem with high performance computing platform and analytical capabilities to capture, process, transform, discover and derive business insights and value within a reasonable elapsed time

Advertisements