When was the last time you felt you were taking a flight and getting an aerial view of the entire data landscape? And I don’t mean just the current fad of most-used glamorous word “Big Data”, but also the evolution of database systems since the 60s (CODASYL et al). For those who could not make it to the VOLTDB event, they apparently missed out a $5000.00 event that had Michael and team taking us on this fli ...

The Big Data Infra for Enterprises – Making Hadoop Secure for Enterprises session was probably my 4th or 5th attendance to BigDataCloud meetup hosted by DJ and Jeeta Das. Time is luxury and if you login to meetup.com, several meetups with names that generate significant interest crop up. I am sure all agree with me. However, attending BigDataCloud meetup is time well invested. Few days ago I had spoken to J ...

This winter is turning into a severe flu season across large sections of the United States. According to the U.S. Centers for Disease Control (CDC), 29 states and New York City are reporting high levels of influenza-like illness (ILI), while another nine states are experiencing moderate flu levels. What's the best way to monitor flu activity across the world? That's debatable, of course, but Google has an i ...

Hive is great for large scale data warehousing applications. In one of my recent projects I was handed over the interesting and challenging task of making Hive behave like an OLTP system i.e., support update and delete. To be more specific, the Hive database needed to be kept in near real time synchronization with multiple OLTP systems. In this post, I will discuss the high level features of the solution ba ...

This is just amazing – the kind of growth we have seen at BigDataCloud, and it wouldn’t have been possible without the help & support from all of you, BigDataCloud readers/members. Thanks to all of you for making it happen! For the meetup on this Thursday, September 8th, for the first time, we are having an industry track. We would be looking at various Big Data solutions as practiced in sprawling indus ...

New technologies are enabling companies to perform increasingly sophisticated data analytics on very large and very diverse data sets, an upcoming report from The Data Warehousing Institute (TDWI) shows. The report is based on responses from 325 IT managers, business users and consultants at small, medium and large companies. Slightly more than a third of the respondents said they are currently running some ...

Users share billions of pieces of content daily on Facebook, and it’s the data infrastructure team's job to analyze that data so we can present it to those users and their friends in the quickest and most relevant manner. This requires a lot of infrastructure and supporting data, so much so that we need to move that data periodically to ever larger data centers. Just last month, the data infrastructure team ...

The potential of “big data,” the massive explosion of sources of information from sensors, smart devices, and all other devices connected to the Internet, is probably under-appreciated in terms of its eventual business impact. However, to take maximum advantage of big data, IT is going to have to press the re-start button on its architecture for acquiring and understanding information. IT will need to const ...

The Evolving Role of the Enterprise Data Warehouse in the Era of Big Data Analytics A white paper by Dr. Ralph Kimball The enterprise data warehouse (EDW) community has entered a new realm of meeting new and growing business requirements in the era of “Big Data.” A few of the common challenges include: extreme integration, semi- and un-structured data sources, petabytes of behavioral and image data accessed ...

We are very excited to share with you that today we announced our company, Aster Data, is being acquired by Teradata, who as you all know commands the #1 position in data warehousing. Together, we will tackle the massive opportunity in the big data and big data analytics market. Upon close, Aster Data will become part of the Teradata organization and our products will become part of the Teradata family of p ...