Increase the Quality and Reliability of Your Data

07/27/21 • 31 min

Building the Backend: Data Solutions that Power Leading Organizations

In this episode, we speak with Lior Gavish, the co-founder of Monte Carlo to explore all things data quality. Monte Carlo is a data lineage and observability tool that lowers your data downtime.
Top 3 Value Bombs:

Data products should be thought of in it’s entirely from the source to the consumer.
No one data stakeholder can solve data quality issues, it’s a collaboration of the data engineers, business, data consumer and even software to help automate certain aspects of cataloging and capturing meaningful metadata.
Good data quality processes should alert you to anomalies in your metrics before your data consumers do.

Data products should be thought of in it’s entirely from the source to the consumer.
No one data stakeholder can solve data quality issues, it’s a collaboration of the data engineers, business, data consumer and even software to help automate certain aspects of cataloging and capturing meaningful metadata.
Good data quality processes should alert you to anomalies in your metrics before your data consumers do.

Previous Episode

Build Real-Time Data Pipelines in Minutes Not Months with Meroxa

In this episode, we speak with DeVaris Brown, he is the CEO and co-founder of Meroxa, which is a data platform that enables organizations to build real time data pipelines in minutes not months. Prior to founding Meroxa, DeVaris was a product leader at Twitter, Heroku, and Zendesk. In this episode we will be talking about all things data ingestion.

Top 3 Value Bombs:

Data ingestion should be in real time to provide the most flexibility across your use cases. Real time ingestion is not as complex as it used to be - many tools i.e. Meroxa simplify this process
Stand on the shoulders of giants - take advantage of open source technologies and build on top of them.
Make your data extendable to be able to be consumed from various destination types.

Next Episode

A Powerful Open Source Database That Supports Many Storage Needs (MariaDB)

In this episode, we speak with Rob Hedgpeth, a director of developer developer relations at Maria DB. We explore all things Maria DB, the capabilities it has and when you should consider it for your next project.
Top 3 value bombs:

MariaDB follows a shared nothing architecture and supports distributed SQL for unlimited scaling on demand.
MariaDB can handle many types of storage (i.e. document store, graph and spatial)
When deciding on your next relational database do not just look at options available within your cloud service provider, include Databases as a Service within your analysis (i.e. Sky SQL - Maris DB’s commercial product).