#30 - The State Of Data Engineering in 2021 (article review)
05/10/21 • 37 min
This week, we talk about this article from LakeFs on the State of Data Engineering in 2021. We give our candid take, and much more. Enjoy!
Matt Turck's 2020 data landscape slide
#dataengineering #datascience #data
------------------------------------
Timestamps
- Intro - 0:00
- Proliferation of tools - 2:00
- Data lakes and data warehouses - 7:30
- Metadata and metastores - 9:30
- Data science and analytics usability - 16:15
- Organizational metadata - 18:05
- Observations and predictions - 19:30
- Tool consolidation in the data industry - 25:50
- The rapidly evolving data space - 35:30
---------------------------------
TERNARY DATA
We are Matt and Joe, and we’re "recovering data scientists". Together, we run a data architecture company called Ternary Data. Ternary Data is not your typical data consultancy. Get no-nonsense, no BS data engineering strategy, coaching, and advice. Trusted by great companies, both huge and small.
Ternary Data Site - https://ternarydata.com
LinkedIn - https://www.linkedin.com/company/ternary-data/
YouTube - https://www.youtube.com/channel/UC3H60XHMp6BrUzR5eUZDyZg
This week, we talk about this article from LakeFs on the State of Data Engineering in 2021. We give our candid take, and much more. Enjoy!
Matt Turck's 2020 data landscape slide
#dataengineering #datascience #data
------------------------------------
Timestamps
- Intro - 0:00
- Proliferation of tools - 2:00
- Data lakes and data warehouses - 7:30
- Metadata and metastores - 9:30
- Data science and analytics usability - 16:15
- Organizational metadata - 18:05
- Observations and predictions - 19:30
- Tool consolidation in the data industry - 25:50
- The rapidly evolving data space - 35:30
---------------------------------
TERNARY DATA
We are Matt and Joe, and we’re "recovering data scientists". Together, we run a data architecture company called Ternary Data. Ternary Data is not your typical data consultancy. Get no-nonsense, no BS data engineering strategy, coaching, and advice. Trusted by great companies, both huge and small.
Ternary Data Site - https://ternarydata.com
LinkedIn - https://www.linkedin.com/company/ternary-data/
YouTube - https://www.youtube.com/channel/UC3H60XHMp6BrUzR5eUZDyZg
Previous Episode
#29 - Cloud Data Warehouse Anti-Patterns
Cloud data warehouses such as Snowflake, BigQuery, and Redshift are hugely popular. And rightfully so - they work great for modern data needs. However, people often make costly mistakes when trying to use them.
This week, we discuss some very common anti-patterns - and solutions for better usage - with cloud data warehouses. We cover general CDW concerns, and best practices for loading and querying data. Enjoy!
---------------------------------
TERNARY DATA
We are Matt and Joe, and we’re "recovering data scientists". Together, we run a data architecture company called Ternary Data. Ternary Data is not your typical data consultancy. Get no-nonsense, no BS data engineering strategy, coaching, and advice. Trusted by great companies, both huge and small.
Ternary Data Site - https://ternarydata.com
LinkedIn - https://www.linkedin.com/company/ternary-data/
YouTube - https://www.youtube.com/channel/UC3H60XHMp6BrUzR5eUZDyZg
Next Episode
#31 - Let's Talk Data Engineering - Live Q&A on LinkedIn Live & YouTube
Let's talk data engineering! We did a live Monday Morning Data Chat, and answered listener questions in a live Q&A on LinkedIn Live and YouTube.
#dataengineering #datascience #data
---------------------------------
TERNARY DATA
We are Matt and Joe, and we’re "recovering data scientists". Together, we run a data architecture company called Ternary Data. Ternary Data is not your typical data consultancy. Get no-nonsense, no BS data engineering strategy, coaching, and advice. Trusted by great companies, both huge and small.
Ternary Data Site - https://ternarydata.com
LinkedIn - https://www.linkedin.com/company/ternary-data/
YouTube - https://www.youtube.com/channel/UC3H60XHMp6BrUzR5eUZDyZg
If you like this episode you’ll love
Episode Comments
Featured in these lists
Generate a badge
Get a badge for your website that links back to this episode
<a href="https://goodpods.com/podcasts/monday-morning-data-chat-217061/30-the-state-of-data-engineering-in-2021-article-review-24450045"> <img src="https://storage.googleapis.com/goodpods-images-bucket/badges/generic-badge-1.svg" alt="listen to #30 - the state of data engineering in 2021 (article review) on goodpods" style="width: 225px" /> </a>
Copy