Moving from Redis to SQLite with Mike Buckbee

11/26/24 • 69 min

1 Listener

Want to learn more SQLite? Check out my SQLite course: https://highperformancesqlite.com In this episode, I sit down with Mike Buckbee to dive into the nitty-gritty of web application firewalls and his journey from using Redis to SQLite in Wafris. We talk about database architecture, operational challenges, and the fascinating ways SQLite improves performance and usability in cybersecurity tools. Get production ready SQLite with Turso: https://tur.so/af. Follow Mike: Twitter: https://twitter.com/mbuckbee LinkedIn: https://www.linkedin.com/in/michaelbuckbee Wafris website: https://wafris.org Rearchitecting Redis to SQLite article: https://wafris.org/blog/rearchitecting-for-sqlite Follow Aaron: Twitter: https://twitter.com/aarondfrancis LinkedIn: https://www.linkedin.com/in/aarondfrancis Website: https://aaronfrancis.com - find articles, podcasts, courses, and more. Chapters: 00:00 - Introduction and Guest Overview 01:06 - What is Wafris? 02:43 - Naming and Origins of Wafris 04:00 - Mike's Cybersecurity Background 07:17 - Challenges with Web Application Firewalls 10:01 - Wafris Architecture Overview 16:15 - Why Switch to SQLite? 18:01 - Handling IP Address Ranges 24:00 - Wild Redis Data Structures Explained 28:51 - Transitioning to SQLite 32:02 - Operational Advantages of SQLite 37:04 - How Wafris Leverages Threat Lists 40:13 - Performance Gains with SQLite 46:51 - Splitting Reads and Writes in the New Architecture 52:29 - Closing Thoughts and Where to Learn More

Previous Episode

Bootstrapping an email service provider (with Jesse Hanley)

Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com.

In this interview, I talk with Jesse Hanley, founder of Bento, about running a lean email service from Japan. We chat about the challenges of scaling infrastructure, managing databases, and maintaining a calm business while serving a global customer base.

Links Mentioned:
Bento: https://bentonow.com
Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15
Database school audio only: https://databaseschool.transistor.fm

Follow Jesse:
Twitter: https://twitter.com/jessethanley
Bento on Twitter: https://twitter.com/Bento

Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.

Chapters:
00:00 - Introduction to Jesse Hanley
01:02 - Running Bento from Japan
01:48 - The Lean Team Structure at Bento
03:00 - Managing Support via Discord
05:01 - Benefits of Using Discord for Customer Support
06:45 - The Role of Community in Customer Feedback
09:01 - How Bento Gained Traction
13:00 - Bootstrapping Bento and Profitable Growth
16:00 - Running Your Own Mail Servers
19:03 - The Economics and Redundancy of Email Delivery
21:00 - Bento's Heroku Setup and Scaling Challenges
26:00 - Handling and Querying Massive Data in Bento
29:52 - Leveraging Elasticsearch for Data Queries
35:40 - Moving Toward Multi-Database Solutions
37:45 - Exploring Crunchy Data and Citus for Database Scaling
42:00 - Optimizing Bento for Performance and Scalability
54:02 - Jesse’s Advice on Building a Calm and Profitable Business
57:00 - How Bento Uses WebSockets and Background Jobs
1:00:00 - Optimizing Bento with Action Cable
1:02:25 - Avoiding N+1 Queries with WebSockets
1:04:50 - Scaling Redis and Postgres at Bento
1:09:00 - Jesse’s Approach to Managing Growth and Multiple Services
1:11:00 - Final Thoughts on Scaling and Optimizing Databases
1:13:10 - Advice for Aspiring Builders: Stay Patient and True to Your Vision
1:16:00 - Bento’s Unique Approach to Email Marketing and Transactional Emails
1:19:50 - Closing Thoughts and Where to Find Jesse Hanley Online

Next Episode

Postgres on bare metal with the CEO of Prisma

Prisma started as a GraphQL backend and pivoted into one of the most widely used ORMs in the world. Now, they’ve launched Prisma Postgres, and CEO Søren Bramer Schmidt is here to break down the journey, the challenges, and the massive technical innovations behind it—including bare-metal servers, Firecracker microVMs, and unikernels. If you care about databases, performance, or scaling, this one’s for you.

Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com.

Follow Søren:
Twitter: https://twitter.com/sorenbs
GitHub: https://github.com/prisma/prisma
Prisma Postgres: https://www.prisma.io/postgres

Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.

Chapters:
00:00 - Introduction
01:15 - The Origins of Prisma: From GraphQL to ORM
02:55 - Why Firebase & Parse Inspired Prisma
04:04 - The Pivot: From GraphQL to Prisma ORM
06:00 - Why They Abandoned Backend-as-a-Service
08:07 - The Open Source Business Model Debate
10:15 - The Challenges of Monetizing an ORM
12:42 - Building Prisma Accelerate & Pulse
14:55 - How Prisma Accelerate Optimizes Database Access
17:00 - Real-Time Database Updates with Prisma Pulse
20:03 - How Prisma Pulse Handles Change Data Capture (CDC)
23:15 - Users Wanted a Hosted Database (Even When Prisma Didn’t)
25:40 - Why Prisma Finally Launched Prisma Postgres
27:32 - Unikernels, Firecracker MicroVMs & Running Millions of Databases
31:10 - Bare Metal Servers vs. AWS: The Controversial Choice
34:40 - How Prisma Routes Queries for Low Latency
38:02 - Scaling, Cost Efficiency & Performance Benefits
42:10 - The Prisma Postgres Roadmap & Future Features
45:30 - Why Prisma is Competing with AWS & The Big Cloud Players
48:05 - Final Thoughts & Where to Learn More