Not surprisingly, in our work with beta customers and in numerous conversations with enterprise IT leaders, the topic of real time data is a constant theme. After all, real time data is what we do. Our initial conversations usually revolve around very specific real time use cases. And then it becomes clear how much more we can help with. Because real time data management isn’t just for “real time” anymore.
That might sound counterintuitive, or even plain silly. But consider this – as high volume, variegated data environments become the rule, more than just data stores and analytic tools have to change. The core data infrastructure for processing, moving and managing data has to change. Data “grunt work” like ETL, batch processing, quality filtering, data enrichment, legacy integration, and data operations overall has to change. Manual or high touch operations projects aren’t just expensive and painful – they can’t keep pace with data. And if every new data initiative needs custom programming before it gets off the ground, then aren’t you just boxing yourself into a new set of data problems and becoming beholden to a new set of specialized, hard-to-hire skills?
That’s why real time data management matters. When real time processing is the requirement, the opportunities to simplify and gain flexibility are rich. Treating all data as data in motion results in flexible information streams, ready to be combined, correlated, filtered and routed in a responsive manner. Focus becomes on “feeds and speeds” rather than schema and stored processes. You make decisions on what to do with data instantaneously, and continually evolve your practices. The painful drudgery of data management goes away. And if you do it right, this can all be achieved through an agile configuration framework, without the need for deploying and maintaining custom code.
Granted, most organizations are going to move toward real time data to suit specific real time use cases. We’re happy about that and look forward to helping them. But we’ll continue to spread the word that real time isn’t just for real time anymore.