Jesse+ by | Dec 19, 2018 | Blog, Business, Data Engineering |
Small data engineering teams require different tactics. Much of my writing is geared towards larger companies and teams. How should a startup or small data engineering team in a big company be set up and work? What, if anything, should be done different? Your First...
Jesse+ by | Nov 7, 2018 | Blog, Business, Data Engineering, Data Engineering is hard |
At DataEngConf Barcelona, I premiered a new talk about the importance of creating a data engineering culture. I share what a data engineering culture is and what management needs to do to be successful with Big Data. You can download the slides from the talk here and...
Jesse+ by | Oct 24, 2018 | Blog, Business, Data Engineering, Data Engineering is hard |
There is a common misunderstanding in data engineering that you can do everything you need to create a Big Data data pipeline with SQL. This notion is being promoted by some vendors and companies. They’re wrong and you can’t do all of your data engineering with SQL....
Jesse+ by | Aug 29, 2018 | Blog, Business, Data Engineering, Data Engineering is hard |
A common use case for using Kafka and Pulsar is to create work queues. The two technologies offer different implementations for accomplishing this use case. I’ll discuss the ways of implementing work queues in Kafka and Pulsar as well as the relative strengths of...
Jesse+ by | Aug 15, 2018 | Blog, Business, Data Engineering |
Here is my keynote from InfiniteConf 2018. I talk about why real-time is gaining so much momentum, what it does for businesses, how it helps data sciences, and some common use cases.
Jesse+ by | Aug 1, 2018 | Blog, Business, Data Engineering
I’ve been seeing some questions about data pipelines lately. I realized I haven’t written a post that gives the level of detail necessary for a good definition of a data pipeline in the context of data engineering. Instead of just giving my opinion, I’ve brought...
