@rob_rich

Data Warehouse, Data Lake, Data Mesh, Oh My

The History of Data Storage

by Rob Richardson

  @rob_rich

https://robrich.org/

About Me

Rob Richardson

Rob Richardson is a software craftsman building web properties in ASP.NET and Node, React and Vue. He's a frequent speaker at conferences, user groups, and community events, and a diligent teacher and student of high quality software development. You can find this and other talks on https://robrich.org/presentations and follow him on twitter at @rob_rich.

Is Data Mesh a fad?

Should I skip this one and
wait for the next one?

Database

Databases

Databases

OLAP

Online Analytical Processing

OLAP Databases

Data Warehouse

Normalized

Customers
CustId Name
1 Jon Doe
2 Jane Doe

Orders
OrderId CustId Order Date
1 1 1/1/2000
2 1 2/2/2000
3 2 3/3/2000

Denormalized

Orders
OrderId CustId Name Order Date
1 1 Jon Doe 1/1/2000
2 1 Jon Doe 2/2/2000
3 2 Jane Doe 3/3/2000

SQL

SELECT CustomerName, Address
FROM Customer
WHERE CustomerId = 1
              
CustomerName Address
John Doe 123 Main St
Jane Doe 456 Main St

NoSQL

{
  "id": 1,
  "name": "Jon Doe",
  "favorites": [
    "apples",
    "bananas"
  ]
}
              

Data Warehouse

Data Warehouse

Data Lake

The Data Swamp

When the data lake ages badly and data becomes unhelpful or not useful.

Data Lake

Data Mesh

Data Mesh

The Grocery Store analogy

Data Mesh

Comparisons

Should I skip this one
and wait for the next one?