From Small Data to Big Data | Ep. 11

04/30/24 • 39 min

How did we go from the very first databases of the 1950s to modern data analytics on massive amounts of data in the cloud? In this episode of Keyboard and Quill, Tim Berglund and Rachel Pedreschi continue exploring the world of analytics, tracing its evolution from the mid-20th century to today's dynamic data-driven landscape. They unravel how early mainframes using punch cards and magnetic tapes laid the groundwork for the sophisticated databases of the present. From the costly storage of the mid 20th century to the affordable, expansive capabilities of today, they shed light on the pivotal shifts that have led to big data, profoundly shaping industries and individual habits alike.

Keyboard and Quill is created and made possible by StarTree, hosts of the Real-Time Analytics Summit for data professionals. Get 30% off registration.
SPECIAL THANKS TO:

Rachel Pedreschi and Claritype
Link: https://www.claritype.com
Dr. Doron Swade
Book: https://global.oup.com/academic/product/the-history-of-computing-a-very-short-introduction-9780198831754
Gwen Shapira
Link: https://www.thenile.dev
Chris Wiggins and Matthew Jones
Book: https://wwnorton.com/books/how-data-happened
Coastal Kites for the music you heard in our interlude.

--
Story by Tim Berglund and Rachel Pedreschi
Produced by Peter Furia, Noelle Gallagher, and Tim Berglund
Edited by Noelle Gallagher and Peter Furia
Original music and sound by Jeff Kite, keyboardist for The Voidz

🎧 Subscribe to K&Q wherever you listen to podcasts.
▶️ Subscribe on YouTube, and hit the 🔔 to never miss new K&Q uploads
👍 If you enjoyed this video, please leave us a rating.
🧠 Real-Time Analytics Summit (for data professionals). Get 30% off registration.
🎧 Subscribe to our other podcast, Real-Time Analytics with Tim Berglund (for data professionals)

Keyboard and Quill is created and made possible by StarTree, hosts of the Real-Time Analytics Summit for data professionals. Get 30% off registration.
SPECIAL THANKS TO:

🎧 Subscribe to K&Q wherever you listen to podcasts.
▶️ Subscribe on YouTube, and hit the 🔔 to never miss new K&Q uploads
👍 If you enjoyed this video, please leave us a rating.
🧠 Real-Time Analytics Summit (for data professionals). Get 30% off registration.
🎧 Subscribe to our other podcast, Real-Time Analytics with Tim Berglund (for data professionals)

Previous Episode

From Early Statistics to Early Analytics | Ep. 10

Why do nearly all stores have a loyalty program? Are they really just seeking loyalty, or is it a key aspect of how they’re using analytics to improve their business? In this episode of Keyboard and Quill, hosts Tim Berglund and Rachel Pedreschi explore the evolution of early data analytics. They trace its development from early statistics concepts to Florence Nightingale's pioneering work in healthcare to Ronald Fisher’s foundational null hypothesis and randomized controlled trials (despite his deplorable role in history as a eugenicist) to John Tukey’s advocacy for exploratory data analysis. Through it all, we see how various threads contributed to the methods and practices underlying today's data-driven decision making.

Keyboard and Quill is created and made possible by StarTree, hosts of the Real-Time Analytics Summit for data professionals. Get 30% off registration.
SPECIAL THANKS TO:

Rachel Pedreschi and Claritype
Link: https://www.claritype.com
Bill Inmon
Link: https://datavox.ai
Dr. Doron Swade
Book: https://global.oup.com/academic/product/the-history-of-computing-a-very-short-introduction-9780198831754
Gwen Shapira
Link: https://www.thenile.dev
Chris Wiggins and Matthew Jones
Book: https://wwnorton.com/books/how-data-happened
Coastal Kites for the music you heard in our interlude.

🎧 Subscribe to K&Q wherever you listen to podcasts.
▶️ Subscribe on YouTube, and hit the 🔔 to never miss new K&Q uploads
👍 If you enjoyed this video, please leave us a rating.
🧠 Real-Time Analytics Summit (for data professionals). Get 30% off registration.
🎧 Subscribe to our other podcast, Real-Time Analytics with Tim Berglund (for data professionals)

Next Episode

Data Goes Real-Time with Apache Kafka | Ep. 12

In this penultimate episode of Season 1 of "Keyboard and Quill," hosts Tim Berglund and Rachel Pedreschi delve into the world of Apache Kafka, the invisible data powerhouse behind many of the apps we use daily like LinkedIn, Uber, and DoorDash. They take us back to 2010, a pivotal year when the internet became more than just a convenience—it became a staple of daily life, with more and more homes connected to broadband and smartphones becoming increasingly prevalent. This technological surge set the stage for innovations like ride-sharing and meal delivery services, which rely on constant data streams to function smoothly. Our hosts discuss how Kafka, initially developed within the walls of LinkedIn, has grown to be central to the operations of numerous companies large and small, managing the flow of data with unprecedented efficiency. This episode not only highlights the technical breakthroughs but also contextualizes them within the broader narrative of digital acceleration, making us ponder how such innovations continue to reshape our interactions and expectations in a world that moves faster by the day.

Keyboard and Quill is created and made possible by StarTree, hosts of the Real-Time Analytics Summit for data professionals. Get 30% off registration.
SPECIAL THANKS TO:
Rachel Pedreschi and Claritype
Link: https://www.claritype.com
Jay Kreps
Link: https://confluent.io
Gwen Shapira
Link: https://www.thenile.dev
Coastal Kites for the music you heard in our interlude.

🎧 Subscribe to K&Q wherever you listen to podcasts.
▶️ Subscribe on YouTube, and hit the 🔔 to never miss new K&Q uploads
👍 If you enjoyed this video, please leave us a rating.
🧠 Real-Time Analytics Summit (for data professionals). Get 30% off registration.
🎧 Subscribe to our other podcast, Real-Time Analytics with Tim Berglund (for data professionals)