Big Data Talks #27 | Pankaj Zanke: Effective Data Architecture and Pipeline Strategies

07/31/24 • 45 min

Welcome to Big Data Talks: Episode with Pankaj Zanke Welcome to another episode of Big Data Talks, the podcast where we explore the transformative power of data, machine learning, and artificial intelligence with leading experts from around the globe. I'm Jan-Willem Middelburg, your host for today. As the author of the Enterprise Big Data Framework, I'm excited to guide you through these enlightening conversations. Tune In Anytime You can watch the recording of this discussion on YouTube, visit the Big Data Framework website, or listen to the podcast on Apple Podcasts. Make sure to subscribe and stay updated with our latest episodes, featuring the brightest minds in the industry. Meet Pankaj Zanke: Expert in Data Architecture and Pipelines Today, I’m excited to welcome Pankaj Zanke, a seasoned expert in data pipelines and big data solutions. With extensive experience in using cutting-edge tools like Hadoop and Spark, as well as cloud platforms such as Azure and GCP, Pankaj excels in data warehousing, governance, and machine learning. His work spans diverse industries including finance, healthcare, and retail. Currently pursuing a Master of Science in Data Science and Analytics at Georgia Institute of Technology, Pankaj has also made significant academic contributions, with research featured in esteemed journals. As an active tech writer for platforms like Dzone and Dataversity, his career reflects a strong commitment to advancing data science and analytics. What to Expect in This Episode Join us for an insightful discussion with Pankaj Zanke as he shares his journey from early influences to becoming an expert in data architecture and pipeline construction. We will dive into the key components and stages of data architecture, explore the challenges and solutions in data migration, and discuss best practices for maintaining data pipelines. Additionally, Pankaj will share his vision for the future of data management and offer advice for aspiring data professionals. Stay Connected Whether you're a data enthusiast, a professional in the field, or someone intrigued by the intersection of data and communication, this episode is packed with valuable insights you won't want to miss. Remember to subscribe on YouTube, the Big Data Framework website, or Apple Podcasts to keep up with our latest episodes.

Previous Episode

Big Data Talks #26 | Susan Walsh: Strategic Data Quality Management and Leveraging Excel Effectively

Welcome to Big Data Talks: Episode with Susan Walsh Welcome to another episode of Big Data Talks, the podcast where we explore the transformative power of data, machine learning, and artificial intelligence with leading experts from around the globe. I'm Jan-Willem Middelburg, your host for today. As the author of the Enterprise Big Data Framework, I'm excited to guide you through these enlightening conversations. Tune In Anytime You can watch the recording of this discussion on YouTube, visit the Big Data Framework website, or listen to the podcast on Apple Podcasts. Make sure to subscribe and stay updated with our latest episodes, featuring the brightest minds in the industry. Meet Susan Walsh: The Mistress of Data and Champion of Data Quality In this episode, I have the great pleasure to welcome Susan Walsh, famously known as the Mistress of Data. Susan is an industry expert in spend data classification, supplier normalization, and taxonomy customization, with a rich background that includes experience with industry giants like Philips and Colgate Palmolive. With her degree in Commerce from Abertay University and a dynamic career in sales and customer account management, Susan took a bold leap into the world of data, founding The Classification Guru in 2017. Her journey has been marked by significant achievements, including being recognized in the DataIQ100 and winning the DataIQ Data Champion award in 2022 and 2023. Susan is also a TEDx speaker and has authored the book "Between the Spreadsheets: Classifying and Fixing Dirty Data." She is dedicated to sharing her knowledge through various platforms, including a new course for O'Reilly, making her a prominent thought leader in the data industry. What to Expect in This Episode Join us for an enlightening discussion with Susan Walsh, the Mistress of Data, as she shares her unique journey from corporate sales to founding The Classification Guru. Susan will provide invaluable insights into data quality, including her COAT methodology and the Dirty Data Maturity Model, foundational tips for data cleansing, and the interconnectedness of data classification. We will also explore common mistakes in Excel data management and effective use of its features, along with Susan's vision for future advancements in data tools. Additionally, she will offer advice for aspiring women in the data field, drawing from her own experiences and successes. Stay Connected Whether you're a data enthusiast, a professional in the field, or someone intrigued by the intersection of data and communication, this episode is packed with valuable insights you won't want to miss. Remember to subscribe on YouTube, the Big Data Framework website, or Apple Podcasts to keep up with our latest episodes.

Next Episode

Big Data Talks #28 | Andrew Jones: Building a Data-Driven Organization with Data Contracts

In this episode of Big Data Talks, we sit down with Andrew Jones, an Independent Data Consultant with over 15 years of experience in the industry. Hosted by Jan-Willem Middelburg, author of the Enterprise Big Data Framework, we explore how data, machine learning, and artificial intelligence are transforming the world we live in. Andrew’s journey from software engineer to data infrastructure expert has led him to define groundbreaking concepts like data contracts, which he detailed in his book Driving Data Quality with Data Contracts. Join us as Andrew shares his insights on building scalable data architectures and his passion for helping organizations unlock the true potential of their data. Beyond his professional achievements, Andrew is also a dedicated family man, runner, and amateur brewer. This episode is packed with valuable takeaways on the future of data engineering, making it a must-listen for anyone in the field. Tune in for a deep dive into Andrew’s innovations, challenges, and vision for the future of data. Watch the full discussion on YouTube, the Big Data Framework website, or listen on Apple Podcasts and Spotify.