How to Perform Cloud Selection for AI Workloads

02/19/25 • 39 min

Sam Zamanian, a principal advisory director at Infotech Research Group with over 20 years of IT and architecture expertise, joins us to dissect the critical decisions surrounding AI infrastructure selection. This episode promises to equip you with the insights needed to navigate the complexities of AI workloads, from data preparation to model training and deployment. With Sam's guidance, you'll uncover the intricacies of optimizing each stage, leveraging high-performance computing and AI accelerators to tailor cloud solutions for any AI challenge.
Choosing between cloud and on-premises infrastructure is a nuanced decision influenced by various factors. We explore the flexibility and potential trade-offs involved, weighing the cloud's convenience against the control offered by on-premises solutions. Whether it's the ease of rapid deployment or the need for customization and predictability, our discussion provides a roadmap for selecting the best infrastructure setup based on specific use cases, performance, cost, and security considerations.
The evolving AI hardware landscape brings both challenges and opportunities, as discussed in our final segment. With supply bottlenecks and market dynamics shifting, new collaborations like AMD and Microsoft's partnership are making waves. We delve into optimization strategies to enhance efficiency, highlighting tools like the DeepSeek model for cost reduction in training large AI models. As the AI industry rapidly evolves, we capture the excitement of future developments and the potential for broader hardware adoption, setting the stage for the next era of technological advancement.

How to connect with Sam:

https://www.linkedin.com/in/sam-z-77028a59/

Purchase Chris and Tim's new book on AWS Cloud Networking: https://www.amazon.com/Certified-Advanced-Networking-Certification-certification/dp/1835080839/

Check out the Fortnightly Cloud Networking News
https://docs.google.com/document/d/1fkBWCGwXDUX9OfZ9_MvSVup8tJJzJeqrauaE6VPT2b0/

Visit our website and subscribe: https://www.cables2clouds.com/
Follow us on BlueSky: https://bsky.app/profile/cables2clouds.com
Follow us on YouTube: https://www.youtube.com/@cables2clouds/
Follow us on TikTok: https://www.tiktok.com/@cables2clouds
Merch Store: https://store.cables2clouds.com/
Join the Discord Study group: https://artofneteng.com/iaatj

Send us a text

How to connect with Sam:

https://www.linkedin.com/in/sam-z-77028a59/

Purchase Chris and Tim's new book on AWS Cloud Networking: https://www.amazon.com/Certified-Advanced-Networking-Certification-certification/dp/1835080839/

Previous Episode

Maybe If We Throw Money At It, It Will Make Money - NC2C029

Send us a text

This episode dives deep into the ramifications of the DOJ's move to halt the HPE-Juniper merger, questioning whether this action genuinely promotes competition or stifles innovation. We also explore staggering investments in AI from top tech companies and what these might mean for future growth and competition.
• Discussion on the DOJ's lawsuit against the HPE-Juniper merger
• Examination of potential market impacts of the merger
• Insights into AWS's and Google's significant AI investments
• Analysis of market expectations regarding AWS's recent revenue growth
• Concerns surrounding SolarWinds and private equity acquisitions
• Calls to action for listeners to engage with their thoughts on these topics

Purchase Chris and Tim's new book on AWS Cloud Networking: https://www.amazon.com/Certified-Advanced-Networking-Certification-certification/dp/1835080839/

Next Episode

New Microsoft Quantum Chip... For Windows Updates! - NC2C030

Send us a text

In a world that continues to evolve at breakneck speed, staying ahead in cloud networking and technology is imperative. This episode jumps into a whirlwind of recent developments that could reshape the landscape of IT. We begin with CompTIA's unveiling of the new CloudNetX certification, designed specifically for IT professionals focusing on cloud architecture and security, positioning itself as pivotal in validating advanced networking skills.
We also explore the launch of Aviatrix’s Certified Engineer Program, which emphasizes the importance of hybrid cloud connectivity. This program provides valuable insights into connecting on-premise systems with cloud solutions, highlighting the increasing demand for seamless integration across platforms. Staying relevant in this era involves continuously updating our knowledge and capabilities; these certifications are significant steps toward that goal.
As we examine the multi-cloud networking market, Cloudflare’s Magic Cloud Networking is aimed at providing orchestration services—an essential need as companies increasingly rely on different cloud service providers. However, with changing dynamics comes the question of visibility and control over networks, a key concern that professionals must address.
In a fascinating twist, Microsoft has introduced a new quantum chip, Majorana, that promises to revolutionize how we think about computing. This opens a discussion on encryption security and the implications for current technologies as quantum computing advances.
Finally, we confront a concerning report detailing an 82% increase in DDoS attacks, a stark reminder of the evolving security landscape aided by emerging technologies like AI. As we delve into these important topics, the call to action for IT professionals remains clear: be proactive, stay informed, and prepare for a future where technology will continually challenge our assumptions. Subscribe, share, and join us in these discussions as we navigate the exciting, yet complex, world of cloud networking.

Purchase Chris and Tim's new book on AWS Cloud Networking: https://www.amazon.com/Certified-Advanced-Networking-Certification-certification/dp/1835080839/

Cables2Clouds - How to Perform Cloud Selection for AI Workloads

Transcript

Speaker 100:00:14.153

Hello everyone and welcome back to another episode of the Cables to Clouds podcast . My name is Chris Miles at BGP Main on Blue Sky .

Speaker 100:00:30.179

At BGP Main on Blue Sky , joining me , as always , is my ever happy and gleeful co-host , tim McConaughey at Carpe Diem VPN on Blue Sky as well . Today . We have a very special episode for you today .