Jesse+ by | Feb 24, 2021 | Blog, Business, Data Engineering, Data Engineering is hard |
As a distributed systems person, I’m used to figuring out how to spread a problem out to the most number of computers possible. Spreading out a problem lets me leverage my resources far better and faster. However, we’re failing to apply this optimization to our own...
Jesse+ by | Oct 13, 2020 | Blog, Business, Data Engineering, Data Engineering is hard |
Data teams require all of their parts to be complete and succeed. When one of the teams of a data team is missing, the other teams will suffer. Often, organizations or team members don’t understand what’s happening when a team is missing. They blame themselves or...
Jesse+ by | Sep 23, 2020 | Blog, Business, Data Engineering, Data Engineering is hard, Magnum Opus |
I’m thrilled to announce that Data Teams: A unified management model for successful data-focused teams is available for purchase! My goal is to drive a real increase in the percentage of successful big data projects. Data Teams represents years of work and research,...
Jesse+ by | Sep 11, 2020 | Blog, Data Engineering, Data Engineering is hard |
Kafka 2.0 added a new poll() method that takes a Duration as an argument. The previous poll() took a long as an argument. The differences between the two polls don’t stop there. You should know about the differences before porting your poll from a long to a Duration....
Jesse+ by | Apr 29, 2020 | Blog, Business, Data Engineering, Data Engineering is hard |
In my last post, I gave some general suggestions on how analytics and data engineering teams should be dealing with COVID-19. Now, I want to give specific advice on how data engineering teams can reduce their cloud costs. Note: while this post focuses on cloud,...
Jesse+ by | Mar 15, 2020 | Blog, Business, Data Engineering, Data Engineering is hard, Magnum Opus |
Big Data and analytics are going to change in this COVID-19 era. I want to share with everyone the same messages that I’m giving my own clients. I’m hoping that this post will help those data teams that aren’t living up to their potential to start creating real value....