Intel today announced that it is joining the Hadoop ecosystem in a permanent way that will accelerate adoption of Hadoop by the broader enterprise market. While the news that Intel is going to offer an distribution that has been extended with features for security and improved performance is interesting enough, Intel’s arrival illustrates some broader trends at play in the world of Hadoop, namely that: Hado ...

Introduction to Hadoop 2 Core Hadoop 2 consists of the distributed filesystem HDFS and the compute framework YARN. HDFS is a distributed filesystem that can be used to store anywhere from a few gigabytes to many petabytes of data. It is distributed in the sense that it utilizes a number of slave servers, ranging from 3 to a few thousand, to store and serve files from. YARN is the compute framework for Hadoo ...

The Big Data Infra for Enterprises – Making Hadoop Secure for Enterprises session was probably my 4th or 5th attendance to BigDataCloud meetup hosted by DJ and Jeeta Das. Time is luxury and if you login to meetup.com, several meetups with names that generate significant interest crop up. I am sure all agree with me. However, attending BigDataCloud meetup is time well invested. Few days ago I had spoken to J ...

We're hitting big data for one big reason, which is that our life is incredibly measurable. That started with the Internet, which could measure what we did in our lives. In your pocket, you have basically a data-acquisition device—your phone—which has the capacity to generate more data about every day than you've had in your entire life. Every one of you right now is generating actionable data about your ow ...

The Yahoo spin-off may have a better handle on Open Source Hadoop than any of its competitors.Consider that 24 engineers from the original Yahoo team that developed the Open Source software framework that supports data-intensive distributed applications work at the company. And that they say they have contributed more code to the Apache Hadoop project than any of their competitors. (Namely MapR and Cloudera ...

Acquisition of Hadoop expertise will accelerate WANdisco’s product development in fast-growing Big Data market WANdisco (LSE: WAND), a leading provider of global collaboration software to the software development industry, announced today it has completed the acquisition of Silicon Valley-based software company AltoStor. This acquisition underscores WANdisco's drive into the Big Data solutions market, forec ...

BI Developers need to access, transform & load data sets. For performing these activities over Big Data sets, in a Hadoop environment, Hive and Pig are extremely handy skills to have. In this one (1) day course , we will learn in-depth about Hive and Pig’s architecture & design and development framework including installation steps and performance tuning of Map Reduce Programs covering SessionLog Da ...

When Morgan tried to do some portfolio analysis 18 months ago it found that traditional databases and grid computing just wouldn’t scale  to the very large volumes of data that its data scientists wanted to use. Gary Bhattacharjee, executive director of enterprise information management at the firm, had worked with Hadoop as early as 2008 and thought that it might provide a solution. So the IT department ho ...

It looks like Oracle has some competition when it comes to selling big iron for big data. On Wednesday, Cray, the Seattle-based company best known for building some of the world’s fastest supercomputers, said it’s getting into the big data game. A new division within Cray, called YarcData, will leverage Cray’s experience working within data-intensive environments for customers such as Boeing in order to woo ...

Organizations as diverse as Northrop Grumman (NOC), Harvard University, Zynga, and the New York Stock Exchange (NYX) have filled job websites with requests for talented puppeteers and master chefs. A quick dig into the job listings reveals that these positions have nothing to do with office entertainment or gourmet meals. Instead, the companies want people who have mastered Puppet or Chef, competing softwar ...