Most of my posts are about specific platforms such as Microsoft Fabric and Databricks. But platforms change quickly, and the engineers I’ve seen grow fastest are the ones who understand the principles underneath. For that, this is the book I recommend most.
The resource
- Title: Fundamentals of Data Engineering
- Provider: O’Reilly Media (book, also available on the O’Reilly learning platform)
- Authors: Joe Reis and Matt Housley
- Link: Fundamentals of Data Engineering on O’Reilly
What it covers
The book is organised around what the authors call the data engineering lifecycle. It starts with foundations: what data engineering is, how to design good data architecture, and how to choose technologies. It then goes through the lifecycle in depth, from data generation in source systems through storage and ingestion, and on to transformation and serving data to downstream users. Security, data management, orchestration and DataOps run through all of it, rather than being left to a final chapter.
Who it’s for
The publisher’s description names software engineers, data scientists and analysts who want a complete view of data engineering, and I’d add architects and technical leads. It isn’t a coding tutorial, so pair it with hands-on platform learning.
My take
The biggest strength of this book is that it’s honest about trade-offs. It gives you a framework for choosing technology on merit and, in the book’s own words, for cutting through marketing hype. That’s exactly the skill I use most as an architect. When a team argues about tools, I often bring the conversation back to lifecycle questions this book covers well: where does the data come from, how will it be stored and served, and who owns it?
Read it once early in your career and again a few years later. It reads differently once you’ve run production pipelines. I’d also suggest reading it alongside a real project: as you work through each stage of the lifecycle, compare the book’s questions with the decisions your own platform has already made.
This is an independent recommendation. I’m not affiliated with O’Reilly Media or the authors.




Leave a Reply