If you’re into systems that can share data among each other in real time, this has been a good week. On Tuesday, Yahoo open sourced its version of the popular Storm stream-processing software that’s able to run inside Hadoop clusters. Then, on Thursday, Facebook detailed a system called Wormhole that informs the platform’s myriad applications when changes have occurred in another, so that each one is workin ...

There are plenty of server and storage options for the wave of data that is being collected and analyzed. New platforms such as Apache™ Hadoop® provide the opportunity to make all the new data types being collected useful. However, like any other platform, performance varies depending on the underlying servers being used. There is great promise in what Hadoop can deliver in terms of business value, and the ...

Raymie Stata knows a lot about Hadoop. It was Stata who helped bring Hadoop creator Doug Cutting to Yahoo in 2006, and as during a seven-year stint as chief architect and then CTO at Yahoo, Stata was instrumental in helping position Hadoop as the technology famously “behind every click” at the web portal. Now, Stata is trying his hand at the Hadoop startup game, launching a new startup called Altiscale that ...

Hadoop 2.0 will be announced within a matter of days, and a new YARN framework component at its core promises to "take Hadoop beyond MapReduce," according to Arun Murthy, chairman of the Apache committee overseeing the release. Moving beyond slow, iterative MapReduce processing is obviously a good thing, but just what are the new possibilities?Better SQL querying, graph analysis and stream processing are al ...

The Hadoop market is on a tear, growing at a compound annual growth rate of roughly 60%, according to IDC. But why it's growing, or rather, how it's being used, might surprise you. Given all the media hype around Hadoop and its power to predict everything from the optimal number of raisins in your cereal (23) to the exact date of Armageddon (next Tuesday - call in sick), it's perhaps surprising to learn tha ...

The Hadoop explosion continues, with the number of organizations adopting the platform growing at a compound annual growth rate of about 60 percent, according to the International Data Corporation. However, ReadWrite's Matt Asay wrote that many of the companies adopting it are still acclimating to Hadoop and aren't using it at its optimal capacity. Currently, most organizations that use Hadoop take advantag ...

Splunk Inc. (NASDAQ: SPLK), the leading software platform for real-time operational intelligence, and Cloudera, the category leader that sets the standard for Apache Hadoop in the enterprise, today announced a strategic alliance that delivers big data analytics across the enterprise. The relationship ensures best-in-class integration of Splunk® Enterprise to Cloudera Enterprise using Splunk Hadoop Connect, ...

Summary: Today’s Ford is a data-driven behemoth that is sitting on huge opportunities in Big Data -- once the tools catch up. While Big Data is arguably the hottest buzz phrase in tech in 2012, there is a shockingly scarce amount of information about how real companies are using Big Data to do big things. We recently sat down with Ford, one of the world’s most data-driven and data-rich companies, to talk ab ...

Summary: Hortonworks' chief talks about the run on Hadoop distributions, an "open core" strategy and crunching the big data numbers. Hortonworks CEO Rob Bearden has a simple mission: Grow the Hadoop and big data markets with a heavy dash of open source and then the company's financial health will follow. Amid current Hadoop developments---is there any company NOT launching a distribution with some value add ...