In one of my recent projects, I had to load product data from a CSV file into HBase and also to index it for search purpose.. I decided to separate out the loader part of the project as a stand alone tool and make available as open source. Currently, it’s hosted in github. It supports HBase. I will be adding support for Cassandra soon. I am working on Solr indexing right now. Introduction The tool is very g ...

Organizations as diverse as Northrop Grumman (NOC), Harvard University, Zynga, and the New York Stock Exchange (NYX) have filled job websites with requests for talented puppeteers and master chefs. A quick dig into the job listings reveals that these positions have nothing to do with office entertainment or gourmet meals. Instead, the companies want people who have mastered Puppet or Chef, competing softwar ...

We get asked a lot of questions about how to select Apache Hadoop worker node hardware. During my time at Yahoo!, we bought a lot of nodes with 6*2TB SATA drives, 24GB RAM and 8 cores in a dual socket configuration. This has proven to be a pretty good configuration. This year, I’ve seen systems with 12*2TB SATA drives, 48GB RAM and 8 cores in a dual socket configurations. We will see a move to 3TB drives th ...

BigDataCloud’s theme of “Hadoop Powered Predictions & Recommendations Engines” attracted over 100 people to the meetup last night, sponsored by LexisNexis & ThirdEyeCloud. The attendees thronged the LexisNexis’s booth about its newly debuted HPCC Systems & got an understanding of how its Hadoop alternative can actually solve “Big Data” challenges in enterprises. The attendees also had a chance to “meet & gr ...

Looks like BigDataCloud's meetup tomorrow would be our biggest ever yet! We have more than 150+ signups from various sources. For the first time, the BigDataCloud meetup would be sponsored. Our sponsors are: 1. LexisNexis HPCC Systems from LexisNexis® Risk Solutions offers a proven, data-intensive supercomputing platform designed for the enterprise to solve big data problems. As an alternative to Hadoop, HP ...

Hadoop technologies have started to mature and many of us are now tasked at implementing Hadoop MapReduce based solutions at our respective organizations. From our own practical experiences, we can tell that the going is not going to be as smooth as you might have expected. That’s what peaked our interest in this webinar by Platform Computing: Top Issues IT faces with Hadoop MapReduce This webinar claims th ...

Third Eye is launching "Byte Sized Hadoop" classes – for as low as $125/class! These Hadoop classes will be offered byte-sized, 3 hours each, after work hours & conducted by industry veterans with a practical "from-the-trenches" approach. BigDataCloud meetup attendees have heard & met the instructors individually: Paul Baclace - presented "Optimizing bursty Hadoop analysis demands for big data using A ...

I spend lot of time tracking and monitoring Hadoop jobs running across multiple clusters in my current project. Typically I navigate around multiple Job tracker web admin consoles. Although the job tracker web console gives some basic system level statuses and metrics for Hadoop daemons, it leaves a lot to be desired. What’s missing is a monitoring platform at the application level. In my Hadoop job I may h ...

Jobs around Hadoop technologies have exploded while the number of professionals experienced on Hadoop have not! The current job markets around Hadoop technologies is a very different one, one that is opposite to everything else other job markets all over the US are experiencing today. Jobs around Hadoop technologies have exploded, in all parts of the US, in companies big and small – while the number of prof ...

The cloud computing world has been anxious to hear former NASA CTO Chris Kemp’s plans since he left his post in the spring to pursue a startup venture, and on Wednesday morning, he introduced his new company, Nebula. It’s selling an OpenStack-based appliance for managing scale-out cloud deployments, and is backed by premier talent and investors. Nebula isn’t disclosing how much it has raised, but Co-Founder ...