Summary

Joe Reis argues that fundamentals of data engineering remain essential despite pressure to move fast and claims that AI will handle everything. He pushes back against 'vibe engineering' — building data platforms based on hearsay and tribal knowledge without understanding underlying theory — warning that skipping fundamentals inevitably leads to tech debt and failure.

Key Insight

AI and higher-level abstractions make understanding data engineering fundamentals more important, not less, because leaky abstractions will inevitably expose those who skipped the foundations.

Spicy Quotes (click to share)

• 7

  Building data platforms without understanding the underlying theory is 'vibe engineering.' You operate on vibes rather than a strong theoretical or practical framework.

• 6

  It's the equivalent of building a house on a steep jungle hillside just because the view is nice, without consulting an engineer first. It works fine...right up until monsoon season hits and your house disappears in a mudslide.

• 6

  As we move to higher-level orchestrations and 'agentic' workflows, you actually need to understand the innards of your systems more, not less.

• 7

  If you want to be the yahoo climber learning to climb on the spot, just remember that gravity is indifferent to your opinion on its existence.

• 4

  As I often quote Bill Inmon: 'The fundamentals are gravity.' You can't escape them.

Tone

reflective, blunt, cautionary