Ep063: Building Generative AI for Speed and Cost Efficiency with Druva

David Gildea of Druva shares their approach to building cost-effective, fast generative AI applications, focusing on cybersecurity, data protection, and the innovative use of LLMs for simplified, natural language threat detection.

Topics Include:

• Introduction by Dave Gildea, VP of Product at Druva.
• Focus on building generative AI applications.
• Emphasis on cost and speed optimization.
• Mention of Amazon's Matt Wood keynote.
• AI experience with kids using "Party Rock."
• Prediction: GenAI as future workplace standard.
• Overview of Druva's data security platform.
• Three key Druva components: protection, response, and compliance.
• Druva's autonomous, rapid, and guaranteed recovery.
• Benefits of Druva’s 100% SaaS platform.
• Handling 7 billion backups annually.
• Managing 450 petabytes across 20 global regions.
• Druva’s high NPS score of 89.
• Introduction to Dru Investigate AI platform.
• Generative AI for cybersecurity and threat analysis.
• Support for backup and security admins.
• Simplified cybersecurity threat detection.
• AI-based natural language query interpretation.
• Historical analogy with Charles Babbage’s steam engine.
• "Fail upwards" model for LLM optimization.
• Using small models first, escalating to larger ones.
• API security and customer data protection.
• Amazon Bedrock and security guardrails.
• Testing LLMs with Amazon’s new prompt evaluation tool.
• Speculation on $100 billion future model costs.
• Session wrap up

Participants:

· David Gildea - VP Product Generative AI, GM of CloudRanger, Druva

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon/isv/