Big Data and Analytics in the COVID-19 Era

Jesse+ by | Mar 15, 2020 | Blog, Business, Data Engineering, Data Engineering is hard, Magnum Opus | 0 comments

Big Data and analytics are going to change in this COVID-19 era. I want to share with everyone the same messages that I’m giving my own clients. I’m hoping that this post will help those data teams that aren’t living up to their potential to start creating real value....

Why I Recommend My Clients NOT Use KSQL and Kafka Streams

Jesse+ by | Oct 9, 2019 | Blog, Business, Data Engineering, Data Engineering is hard, Magnum Opus | 16 comments

Update: Confluent has renamed KSQL to ksqlDB It’s that Kafka Summit time of year again. There are lots of announcements. Some are good and some you have to sift through in order to figure out what’s the best for you and your organization. I’ll briefly state my...

Getting Your Programming Skills Ready for Data Engineering

Jesse+ by | Jun 19, 2019 | Blog, Data Engineering, Data Engineering is hard | 0 comments

Note: This post was guest written by John Desmond. My preparation for the course began before I knew about the course, and before I realized that I wanted to specialize in data engineering. When I decided I wanted to learn programming, I hadn’t quite decided if I...

I Come Not To Bury Cloudera But To Praise It

Jesse+ by | Jun 10, 2019 | Blog, Business, Data Engineering | 17 comments

It’s been a tumultuous past few weeks for big data vendors. First MapR is having problems (their update). Now, Cloudera is having problems. As of today, Cloudera closed at $5.21 (June 6, 2019). To put that in perspective, at its last valuation, Confluent was valued at...

Reducing Operational Overhead with Pulsar Functions

Jesse+ by | May 16, 2019 | Blog, Business, Data Engineering | 0 comments

It’s been fascinating watching the operational world change over the years. We started out by racking and stacking anything that needed to run. We wisened up a bit and started using virtual machines. More recently we’ve moved into containerization. Surely, that’s the...

Advice for Small Teams and Startups on Data Engineering

Jesse+ by | Dec 19, 2018 | Blog, Business, Data Engineering | 0 comments

Small data engineering teams require different tactics. Much of my writing is geared towards larger companies and teams. How should a startup or small data engineering team in a big company be set up and work? What, if anything, should be done different? Your First...