Ancient roman data tables to streaming pipelines

Let's look at how data and data engineering has evolved over the ages.

Author

Dinuraj Sugumaran
May 31, 2023

Welcome to this week's Five Data Points.

I'm Dinuraj, and I want to share with you five interesting articles I've read this week that I believe will be valuable to you.

1 - A brief history on data

This article explores the evolution of data management: from ancient data tables to relational databases, Excel spreadsheets, and Spark.

Data & Data Engineering — the past, present, and future

2 - Evolution of data engineering in the last 10 years

While we’ve been trying to manage data since ancient times as seen in the previous article, the role of “Data Engineering” emerged only in the early 2010s. This article takes a deeper dive into how it has evolved since then.

A Decade In Data Engineering - What Has Changed?

3 - Tools are just a means to an end

One key learning I had while chasing the latest tool is: Tools are great, but many data engineering problems cannot be resolved by using the newest tool but by human — Data Engineers.

Data Engineering: Why It's About Much More Than Just the Tools You Use

4 - Handy guide to being a bad data engineer

Being a good engineer requires effort, and who has the time for that?

Become a Terrible Data Engineer.

5 - Search engine startup Neeva acquired by Snowflake

❝

Search is fundamental to how businesses interact with data

Snowflake Bolsters Data Cloud Search Capabilities with Neeva Acquisition

I hope these articles enriched your thinking with fresh perspectives and deeper insight. Let me know if any of the articles especially resonate with you, or you have topics that you want explored further.

If you found any value in this at all, do pass it along to your friends and colleagues who you think might benefit from it.

Thanks for joining me on this journey of expanding our knowledge about data. I'll see you again next week with more to learn.

Dinuraj Sugumaran