Data Warehouse, Data Lake, Data Mesh, Oh My
The History of Data Storage
by Rob Richardson
About Me
Rob Richardson is a software craftsman building web properties in ASP.NET and Node, React and Vue. He's a frequent speaker at conferences, user groups, and community events, and a diligent teacher and student of high quality software development. You can find this and other talks on https://robrich.org/presentations and follow him on twitter at @rob_rich.
Is Data Mesh a fad?
Should I skip this one and
wait for the next one?
Database
Databases
Databases
OLAP
Online Analytical Processing
OLAP Databases
Data Warehouse
Normalized
Customers
| CustId | Name |
|---|---|
| 1 | Jon Doe |
| 2 | Jane Doe |
Orders
| OrderId | CustId | Order Date |
|---|---|---|
| 1 | 1 | 1/1/2000 |
| 2 | 1 | 2/2/2000 |
| 3 | 2 | 3/3/2000 |
Denormalized
Orders
| OrderId | CustId | Name | Order Date |
|---|---|---|---|
| 1 | 1 | Jon Doe | 1/1/2000 |
| 2 | 1 | Jon Doe | 2/2/2000 |
| 3 | 2 | Jane Doe | 3/3/2000 |
SQL
SELECT CustomerName, Address
FROM Customer
WHERE CustomerId = 1
| CustomerName | Address |
|---|---|
| John Doe | 123 Main St |
| Jane Doe | 456 Main St |
NoSQL
{
"id": 1,
"name": "Jon Doe",
"favorites": [
"apples",
"bananas"
]
}
Data Warehouse
Data Warehouse
Data Lake
The Data Swamp
When the data lake ages badly and data becomes unhelpful or not useful.
Data Lake
Data Mesh
Data Mesh
The Grocery Store analogy
Data Mesh
Comparisons
Should I skip this one
and wait for the next one?