I always encourage companies to break down their Big Data projects into smaller pieces. I call this process crawl, walk, run. There is an interesting corollary to this process. Some companies get stuck at the crawl phase and don’t progress on to the walk and run...
Last week, I gave two talks about Strata+Hadoop World. These talks covered some of the up and coming technologies in Big Data. I describe Strata as the Super Bowl of Big Data conferences. This is where you’ll find the best minds talking about the present and...
We need to make diversity in Big Data a priority or we’ll suffer the groupthink that makes data engineering teams less innovative. We have a lack of diversity in technology. In my experience, the issue is a question of supply and not demand. When you get into...
In the first post in the series, I talked about Big Data’s first and last mile problems. I showed how the first mile problems could be solved with Kafka. In this post, I’m going to talk about the last mile problems. Big Data Last Mile With Big Data...
See part 2 in the series. In telecommunications, there is the term “last mile”. It refers to getting the connection to customer. It’s the last mile between the company’s infrastructure and the customer’s location. We have similar issues...