Happy New Year 2014!!!

Happy New Year 2014!!!


The CIO in the Age of Analytics: From Infrastructure to Insight

Author: Joseph Baird

I have been advising senior executives for much of the past twenty years.  Many of my clients have been Chief Information Officers and it has been remarkable to see this role change during this time.  In the pre-2000 period, IT was seen as a strategic advantage and the move towards the web gave the CIO a very important seat at the table.

But as the decade wore on,  and the globalization of IT occurred, the role became more about managing down costs, the stabilization of ERP and operational systems and the providing of infrastructure for a mobile workforce.  Cost containment and predictability ruled the day and the job was more about Infrastructure vs. Information.

The CIOs that thrived during this time period were skillful administrators, negotiators and technology generalists. Their backgrounds mostly were from within the IT organization or Finance.  This served companies very well in this period of stabilization and commoditization of core IT services.  As the famous Harvard Business Review article  proclaimed IT was perceived to no longer be strategic but rather a cost center that needed to be aggressively managed.

The role of the CIO became more about defending vs. attacking and many who assumed these leadership positions were not natural risk takers but risk managers.

And then the ground shifted…the age of the smart phone and tablet has ushered in a new wave of business models in which the consumer knows more than ever before about what, where and how they want to engage.  We are awash in Big Data Hype and the same HBR has now proclaimed….

Now these same CIOs are being asked to develop new consumer facing technologies and create solutions that can take advantage of Big Data.   But the skills and operating models necessary during a period of modest innovation and cost containment are not the same as required for the Age of Big Data.

The skills for data scientists, app developers and others may not only be hard to find but also are at a much higher price point.  This is creating challenges for CIOs who are far from comfortable taking the risk of these hires or the necessary experimentation and controlled failures.

I believe that multiple operating models are and will continue to emerge.  In the case where the current is not suited to extend his or her skill sets into the required areas, the role may be split. In other words, the traditional CIO may need to focus on infrastructure and senior management will need to hire a leader to drive the analytics initiatives forward.

CIOs should recognize that this model has a risk of driving the relative value down of the traditional role.  This model will likely occur where the CIO does not have a history of an operating role either in sales, product development or supply chain.

For those executives who want to make the leap to Chief Insight Officer, I offer a few words of advice.  First of all, recognize that the core skill gap is not technology but technical.  That is, emerging Big Data technologies are fairly easy to understand. The technical aspects of data mining, visualization and process optimization are not.  Spend more time understanding the appropriate use of techniques than you do on a specific technology or vendor. 

Further, successful analytical transformation is all about adding predictive or prescriptive insight to core business processes. As such, knowledge of these business processes is essential.  The CIO who partners with the business to build deep knowledge about the nature of the business will become essential. The ability to apply new technology and techniques to these processes is the holy grail.   The development of six sigma and other process mapping and optimization skills on your team should be a top priority.

Finally, get comfortable with the development of business cases that justify your investment in people and other resources.  Your success demands the formation of a A team who can deliver extraordinary results.  This will not be the low cost provider.  The Chief Insight Officer must confidently build investment cases to acquire this talent and deliver on the investment required.

Who will drive your Big Data Bus? Executive leadership in a new age

Author: Joseph Baird


First let me start by stating my dislike of the ambiguity and hype of the term “Big Data”.  And by Big Data in the context of this writing is nothing to do with the overused Velocity, Variety, Volume and Veracity.

But it has everything to do with what we can now more easily know about the signals from the physical world and its systems as well as the interactions and behaviors of customers for a wide range of companies around the globe.

I have spent much of the past five years advising senior executives from the world’s largest retailers and media companies.  From an nascent awareness brought about by the work of Tom Davenport a few years ago to the screaming hype from today’s cover of Harvard Business Review, it is clearly on the top of mind for nearly every CEO, CFO and COO.

But there is also a disconcerting pattern of corporate behavior that has largely left many frustrated and entering the land of disenchantment.   Non-IT Executives, uncomfortable with asking “stupid” questions or appearing vulnerable, too often have pushed the Big Data opportunity back to the CIO or others in the IT organization.

Yet, if you view the problem as an opportunity to create new products, customer experiences or market opportunities, the decision may be a bit different.   Let’s say your Walmart and you are making a decision to launch a new group of groceries.  Or maybe you are General Motors bring the new electrical Leaf to market?  Maybe even State Farm Insurance deciding which products to bring into which markets?

Invariably, these companies would bring together engineers, market researchers, and designers under the leadership of a very senior business executive.  And ultimately, the decisions(after thorough analysis, prototype and experimentation) to launch product would make its way to desk of the CEO or maybe the Board of Directors.

So, when I am asked who should lead a company’s Big Data efforts, I invariably ask what is the business trying to achieve in the market?   If there is a real, clear vision of a new market opportunity, leadership must be driven by the executives in charge of the functional area or business unit and not the IT leadership.

While there is a clearly a supporting role to be played by the CIO,  the bus must be driven by the senior executive responsible for the business opportunity. And, those executives must take the time to get smart about the new raw materials that are available to create these Big Data products.

Henry Ford became a student of the automation of the assembly line.  Fred Smith at Fedex immersed himself in the new logistics technology that picked Memphis as the first hub.  They realized that even though it was a technology problem, ultimate ownership was taken by the business leader not the technician.

Be good to remember as you decide who is going to drive your Big Data bus….

Twitter Accounts in 2013 to follow for #BigData #DataScience #Hadoop topics

Here is the consolidated list of Twitter Accounts that has been active in 2013 on #Big Data #Data Science #Hadoop topics. We will be publishing the Top 50 Rank for 2013 in early Jan 2014. Let us see who tops the Top 50 charts in TBDI Rankings!!!

@5h15h @CosimoAccoto @fhalper @Josh_Bersin
@AAjraou @cosmopolitanvan @FindChrisTaylor @joshuagrossman
@ABridgwater @CraigMilroy @Frank_Konkel @jotero81
@acroll @craigmullins @FrankBuytendijk @juliebhunt
@adsuara @custom_publish @FrankFormisano @JulieBrillFTC
@ajayc47 @dainsworld @fredhermelin @JWVance
@ajbowles @Dana_Gardner @fredtrotter @kdnuggets
@al3xandru @DanaFLove @furrier @keesdenhartigh
@AliRebaie @DanielBurrus @GaryMarcus @kevinweil
@andrejverity @dannyjpalmer @GilPress @kidehen
@andrewbrust @Darryl_McDonald @GJ7300 @KirkDBorne
@annamasera @data_nerd @gkm1 @kncukier
@antgoldbloom @datagenius @gleonhard @lauriemccabe
@applebyj @Datagrrl @govloop @lfeuerstein
@aregenberg @David_MSullivan @graemeknows @lilithlela
@atulbutte @DavidAmerland @greenplum @lisaarthur
@bakercom1 @davidedelman @GregoryJGreben @lisagualtieri
@BarryDevlin @davidfcarr @guidoromeo @LoraineLawson
@BernardMarr @DavidLinthicum @Guille_Mas @louleporace
@bevelson @DeepInTheCode @HaleChris @lucadebiase
@BeverlyMacy @deKokPieter @HealthcareMBA @lucatbarone
@bigdata @DHenschen @HealthcareWen @luisdans
@BigData_paulz @dhinchcliffe @hkisker @luiy
@BigDataBorat @digiphile @HKotadia @MandiBPro
@BigDataGal @digitalarun @hlsdk @ManeeshJuneja
@BigDataSpeaker @Doug_Laney @hmason @manovich
@Bilafer @downtotheblock @hsteph @marcusborba
@billfranksga @dpatil @HugoSarrazin @marie_wallace
@BillRuh_GE @dr_morton @hyounpark @marilor
@BITechWatch @DrBonnie360 @Hypatia_LeslieA @MarkBonchek
@bkardon @DrMattRoach @IBMbigdata @MarketBuildr
@bobehayes @dschubmehl @idin77 @marksmithvr
@bobevansIT @DTurnerBlogs @imbigdata @Marsee
@bobgourley @dvellante @infoarbitrage @maslett
@BobViolino @ecereda @infochimps @MDMGeek
@BradfordBrown @edd @ITredux @merv
@BrennerMichael @EdwardTufte @jaimefitzgerald @Metamarkets
@Brian_Eastwood @elchiconaranja @jameskobielus @mgualtieri
@brunoaziza @Ellen_Friedman @jamet123 @mhausenblas
@BuyukVeri @ellisbooker @jasonaverbook @mich8elwu
@captain_dash @Enderle @jburnmurdoch @mjcavaretta
@carbone @eric_kavanagh @JDavidMorris @MOC_Aproged
@carmeartigas @EricDBrown @jenstirrup @moorejh
@Charly_BG @erikbryn @jg21 @mphnyc
@chiefmartec @estebanmoro @jilldyche @NadhanAtHP
@christianve @etamb @Joab_Jackson @Natasha_D_G
@Claudia_Imhoff @evanquinn @John4man @NeilRaden
@cloudera @FangFeng88 @johnchavens @nicfish
@ColinJWhite @FastBigData @JohndeVoogd @nopiedra
@Colinstrong @fcharles @Joseph_Marks_ @nstevenlucas
@ocdqblog @spoonen
@OmoNsasi @StacyLeidwinger
@OReillyMedia @SteveLohr
@oscarwijsman @storagesport
@OttmarAmann @strataconf
@PatrickMeier @SusanFourtane
@PaulDunay @Sve_Sic
@PaulNemitz @tamaradull
@PepeCerezo @tcrawford
@petervan @TechTalkEditor
@philsimon @TheSocialPitt
@practicingEA @timoelliott
@prasannalaldas @tinagroves
@praxsozi @TonyBaer
@preinman @TonyCosentinoVR
@prussom @tunvall
@RadhikaAtEmcien @tweetsinha
@RafaelPadura @ukgav
@rajatrocks @usamaf
@rcalo @ValaAfshar
@revodavid @VanRijmenam
@rgkirkpatrick @Viktor_MS
@richardwinter @vincos
@RichDuszak @vipsgupta
@RICHI @VishalTx
@rjwissin @vmugonline
@RobertsPaige @wareFLO
@robinbloor @webtechman
@ronbodkin @williammcknight
@rwang0 @WillmottPaul
@ryanpraski @witolddc
@Saif_Abed @WyattKash
@SameerPatel @YvesMulkers

Top Big Data Posts for Year 2013 !!!

To close the busy 2013 year, here is the list of Top blogs for the Year 2013 by TBDI.

Total Hits: 16200+

Total Followers: 2100+

Total Basic Member: 10000+

We are growing rapidly! Thanks to all your support!

Home page / Archives 3,660
Big Data Use-Cases – Retail, Manufacturing and Auto Industry 1,515
Big Data Use-Cases in Telecom, Media and Entertainment industry 1,500
Big Data Use-cases – Banking and Financial Services 1,415
Our Favorite 40+ Big Data use-cases. What’s your? 1,129
Big Data Use-cases – Insurance, Energy and Utilities, Travel and Hi-Tech 1,080
Big Data Use-Cases in Healthcare – Provider, Payer and Care Management 896
10 Big Data Implementation Best Practices 887
Introduction to Big Data and Hadoop Ecosystem – For Beginners! 652
Will Hadoop replace or augment your Enterprise Data Warehouse? 486
7 steps to Advanced Predictive Analytics! 377
About TBDI 270
Top 10 Blogs so far this year 212
Addressing the big data security! 189
Wonder how to start your Big Data POC / Lab? 165
Hadoop meets SQL 149
Building your Launch Team! 120
Big Data Scientists, Architects, Lead and Developer Needed for IBM – Immediate Need!!! 119
The Hadoop Data Warehouse! 114
Running Hadoop in the Cloud 108
6 Steps to Start Your Big Data Journey 105
Big Data making the difference in Retail industry! 96
Big Data Analytics – Acquire, Grow and Retain Customers 89
Using Big Data Analytics in Healthcare 83
Join TBDI – The Big Data Institute! 77
Invitation to The Big Data Institute (TBDI) Partnership program 70
Who will drive your Big Data Bus? Executive leadership in a new age – By Joseph Baird 57
Analytics in Banking Services 45
Predicting Customer Behavior with Analytics! 44
Facebook and Twitter Social Media Analytics – From White House to Boardroom! 38
A new type of Blog? What Big Data might mean to the business 29
Welcome to new Partners and Alliances 27
Big Data = more diverse data 24
I wonder if exploiting Big Data will enable big companies to grow even bigger or whether it will enable smaller companies to compete with them to level the playing field? 23
Big Data…Defi… 21
Regulation – a class of Big Data apps 21
Join us this Thursday, May 2nd for our next Big Data Developer Meetup! 17
Making the most of what you have 17
Policy for Establishing New TBDI Chapters 13
TBDI Definition… 10
TBDI Big Data & Data Science Meetup in So California, USA 8
Natural Selection in Business – Does using Big Data provide a sustainable advantage? 5
The TBDI News! 4
Reserve your seat now – TBDI Big Data MeetUp: Big Data Analytics and Data Science – 2014 Trends 4
Being Bold and Big with your Big Data Pilots 4

Reserve your seat now – TBDI Big Data MeetUp: Big Data Analytics and Data Science – 2014 Trends

We have the first meetup scheduled for 1/25/2014. For more details, see the full listing:

When: Saturday, January 25, 2014 10:00 AM

Where: Foothill Ranch Community Facility

27021 Burbank Road, Foothill Ranch, ca (edit map)


If the changes affect your plans to attend, please take a moment to update your RSVP. (You can RSVP “No” or “Yes”.)
Please plan to attend and RSVP before all seats are reserved.

Happy Holidays and stay safe!

Sushil Pramanick

Big Data beyond the hype

Big Data beyond the hype

The Big Data hype cycle is in full swing. But what is Big Data? How do you know if your data is BIG?

Big Data is not a concretely definable category. You can’t always say exactly what it is, but you know it when you see it. In this episode I define the key characteristics of Big Data that enable us to make more intelligent assessments and decisions regarding Big Data solutions.

Listen to the Podcast: http://media.podcastingmanager.com/4/1/7/2/9/203374-192714/Media/RTDW19%20Big%20Data13052013141408-5.mp3

Key characteristics of Big Data:

  • Physical Attributes

    • Bigness: physical size of data sets

    • Multi-source: data from multiple sources, especially both internal and external to the organization

    • Multi-structure: tabular data, markup data, audio and video data, geospatial, activity, transactions, snapshots, statuses

    • Fast arriving: streaming, frequently updated, time volatile

  • How we process it

    • Real time analysis

    • Real time outputs

      • Delivery to decision makers in real time

      • Delivery to external users (consumers, social/mobile users)

      • Interaction with software APIs

    • Aggregate and details

  • What we do with it

    • Predictive value

    • Pattern recognition, especially unlikely relationships

      • fuzzy matching

      • flexible matching

  • Challenges

    • Storage

    • Processing

    • Integration

    • Analysis



TBDI Definition of Big Data: Big Data is a term applied to voluminous data objects that are variety in nature – structured, unstructured or a semi-structured, including sources internal or external to an organization, and generated at a high degree of velocity with an uncertainty pattern, that does not fit neatly into traditional, structured, relational data stores and requires strong sophisticated information ecosystem with high performance computing platform and analytical capabilities to capture, process, transform, discover and derive business insights and value within a reasonable elapsed time