Getting Your Programming Skills Ready for Data Engineering

Jesse+ by | Jun 19, 2019 | Blog, Data Engineering, Data Engineering is hard | 0 comments

Note: This post was guest written by John Desmond. My preparation for the course began before I knew about the course, and before I realized that I wanted to specialize in data engineering. When I decided I wanted to learn programming, I hadn’t quite decided if I...

I Come Not To Bury Cloudera But To Praise It

Jesse+ by | Jun 10, 2019 | Blog, Business, Data Engineering | 15 comments

It’s been a tumultuous past few weeks for big data vendors. First MapR is having problems (their update). Now, Cloudera is having problems. As of today, Cloudera closed at $5.21 (June 6, 2019). To put that in perspective, at its last valuation, Confluent was valued at...

Reducing Operational Overhead with Pulsar Functions

Jesse+ by | May 16, 2019 | Blog, Business, Data Engineering | 0 comments

It’s been fascinating watching the operational world change over the years. We started out by racking and stacking anything that needed to run. We wisened up a bit and started using virtual machines. More recently we’ve moved into containerization. Surely, that’s the...

Advice for Small Teams and Startups on Data Engineering

Jesse+ by | Dec 19, 2018 | Blog, Business, Data Engineering | 0 comments

Small data engineering teams require different tactics. Much of my writing is geared towards larger companies and teams. How should a startup or small data engineering team in a big company be set up and work? What, if anything, should be done different? Your First...

Creating a Data Engineering Culture

Jesse+ by | Nov 7, 2018 | Blog, Business, Data Engineering, Data Engineering is hard | 0 comments

At DataEngConf Barcelona, I premiered a new talk about the importance of creating a data engineering culture. I share what a data engineering culture is and what management needs to do to be successful with Big Data. You can download the slides from the talk here and...

Why You Can’t Do All of Your Data Engineering with SQL

Jesse+ by | Oct 24, 2018 | Blog, Business, Data Engineering, Data Engineering is hard | 0 comments

There is a common misunderstanding in data engineering that you can do everything you need to create a Big Data data pipeline with SQL. This notion is being promoted by some vendors and companies. They’re wrong and you can’t do all of your data engineering with SQL....