Why I Recommend My Clients NOT Use KSQL and Kafka Streams

Jesse+ by | Oct 9, 2019 | Blog, Business, Data Engineering, Data Engineering is hard, Magnum Opus | 12 comments

Update: Confluent has renamed KSQL to ksqlDB It’s that Kafka Summit time of year again. There are lots of announcements. Some are good and some you have to sift through in order to figure out what’s the best for you and your organization. I’ll briefly state my...

Getting Your Programming Skills Ready for Data Engineering

Jesse+ by | Jun 19, 2019 | Blog, Data Engineering, Data Engineering is hard | 0 comments

Note: This post was guest written by John Desmond. My preparation for the course began before I knew about the course, and before I realized that I wanted to specialize in data engineering. When I decided I wanted to learn programming, I hadn’t quite decided if I...

I Come Not To Bury Cloudera But To Praise It

Jesse+ by | Jun 10, 2019 | Blog, Business, Data Engineering | 17 comments

It’s been a tumultuous past few weeks for big data vendors. First MapR is having problems (their update). Now, Cloudera is having problems. As of today, Cloudera closed at $5.21 (June 6, 2019). To put that in perspective, at its last valuation, Confluent was valued at...

Reducing Operational Overhead with Pulsar Functions

Jesse+ by | May 16, 2019 | Blog, Business, Data Engineering | 0 comments

It’s been fascinating watching the operational world change over the years. We started out by racking and stacking anything that needed to run. We wisened up a bit and started using virtual machines. More recently we’ve moved into containerization. Surely, that’s the...

Advice for Small Teams and Startups on Data Engineering

Jesse+ by | Dec 19, 2018 | Blog, Business, Data Engineering | 0 comments

Small data engineering teams require different tactics. Much of my writing is geared towards larger companies and teams. How should a startup or small data engineering team in a big company be set up and work? What, if anything, should be done different? Your First...

Creating a Data Engineering Culture

Jesse+ by | Nov 7, 2018 | Blog, Business, Data Engineering, Data Engineering is hard | 0 comments

At DataEngConf Barcelona, I premiered a new talk about the importance of creating a data engineering culture. I share what a data engineering culture is and what management needs to do to be successful with Big Data. You can download the slides from the talk here and...