
Scott Nichols: Azure AI Foundry - Episode 338
02/24/25 • 40 min
Scott Nichols is a Principal Cloud Solutions Architect at Microsoft. He works for the commercial enterprise division serving the high-tech division out of Silicon Valley. He is also the leader of the .NET and the Azure user groups in Boise, Idaho. He started his career in the IT profession in 1993 as a mainframe and web developer. Since then, he has served as a Lead Software Engineer/Solution Architect, a Software Development Engineering Manager, a Sr. Cloud Software Solution Architect, and a Sr. Enterprise Solution Architect. When not at the keyboard, he loves the outdoors hunting, camping, fishing, archery, and working in the yard.
Topics of Discussion:
[4:03] Generative AI’s turning point.
[5:52] Bridging the AI coding gap.
[6:39] Scott explains the shift in project workloads to generative AI-based projects, both customer-facing and internal.
[7:25] Networking companies using AI to analyze telemetry data and create new products.
[8:49] Azure AI Foundry is a web portal that allows developers to spin up Azure Compute and access over 1800 models.
[13:00] Although a “Cloud Guy,” Scott values his on-prem hardware as a playground for learning and experimenting with AI tools.
[15:04] The benefits of using open source or on-prem tools to start working with AI without incurring cloud costs right away.
[15:40] The rapid pace of innovation.
[20:41] An example of Khan Academy using AI to create an online tutor, requiring significant prompt engineering to ensure accurate responses.
[27:12] AI agents monitoring AI agents.
[27:59] AI’s limitations and opportunities.
[31:56] Testing strategies for AI-Integrated systems.
[35:37] The future of AI and how it’s a great time to be in AI.
[39:35] Great advice for the next generation of developers and software engineers.
Mentioned in this Episode:
Programming with Palermo — New Video Podcast! Email us at [email protected].
Clear Measure, Inc. (Sponsor)
.NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo
The Five Pillars: Leadership For Effective Custom Software, by Jeffrey Palermo
Jeffrey Palermo’s Twitter — Follow to stay informed about future events!
Want to Learn More?
Visit AzureDevOps.Show for show notes and additional episodes.
Scott Nichols is a Principal Cloud Solutions Architect at Microsoft. He works for the commercial enterprise division serving the high-tech division out of Silicon Valley. He is also the leader of the .NET and the Azure user groups in Boise, Idaho. He started his career in the IT profession in 1993 as a mainframe and web developer. Since then, he has served as a Lead Software Engineer/Solution Architect, a Software Development Engineering Manager, a Sr. Cloud Software Solution Architect, and a Sr. Enterprise Solution Architect. When not at the keyboard, he loves the outdoors hunting, camping, fishing, archery, and working in the yard.
Topics of Discussion:
[4:03] Generative AI’s turning point.
[5:52] Bridging the AI coding gap.
[6:39] Scott explains the shift in project workloads to generative AI-based projects, both customer-facing and internal.
[7:25] Networking companies using AI to analyze telemetry data and create new products.
[8:49] Azure AI Foundry is a web portal that allows developers to spin up Azure Compute and access over 1800 models.
[13:00] Although a “Cloud Guy,” Scott values his on-prem hardware as a playground for learning and experimenting with AI tools.
[15:04] The benefits of using open source or on-prem tools to start working with AI without incurring cloud costs right away.
[15:40] The rapid pace of innovation.
[20:41] An example of Khan Academy using AI to create an online tutor, requiring significant prompt engineering to ensure accurate responses.
[27:12] AI agents monitoring AI agents.
[27:59] AI’s limitations and opportunities.
[31:56] Testing strategies for AI-Integrated systems.
[35:37] The future of AI and how it’s a great time to be in AI.
[39:35] Great advice for the next generation of developers and software engineers.
Mentioned in this Episode:
Programming with Palermo — New Video Podcast! Email us at [email protected].
Clear Measure, Inc. (Sponsor)
.NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo
The Five Pillars: Leadership For Effective Custom Software, by Jeffrey Palermo
Jeffrey Palermo’s Twitter — Follow to stay informed about future events!
Want to Learn More?
Visit AzureDevOps.Show for show notes and additional episodes.
Previous Episode

Shaun Walker: Seven Years of Blazor - Episode 337
Shaun Walker is the founder and CEO of Devessence, a global technology consultancy with a boutique approach. He’s also the founder of the Oqtane and DotNetNuke web application frameworks, which have earned the recognition of being amongst the most pioneering and widely adopted open-source projects native to the Microsoft platform. He has over 30 years of professional experience in architecting and implementing enterprise software solutions for private and public organizations.
Topics of Discussion:
[4:38] While AI can be a useful tool, it won’t replace the need for traditional programming.
[8:32] The gap between mainstream AI messaging and the reality of digital transformation.
[9:22] While AI is a significant advancement, it should be seen as just another tool in a developer’s toolkit.
[9:39] The history and evolution of Blazor.
[13:31] The versatility of Blazor and its ability to adapt to various hosting models make it a powerful tool for different types of applications.
[14:06] Challenges and best practices in Blazor development.
[16:26] The decision to make Blazor official and its impact on the .NET ecosystem.
[18:12] The evolution of Blazor Server vs. Blazor WebAssembly and why both are still relevant.
[21:06] When to use Blazor Static, Blazor Server, or Blazor WebAssembly, based on project needs.
[24:17] The tendency for technologists to be critics without actually using the technologies.
[34:36] The advantages of Octane and why it streamlines Blazor development.
[39:56] The TrailBlazor Conference.
Mentioned in this Episode:
Programming with Palermo — New Video Podcast! Email us at [email protected].
Clear Measure, Inc. (Sponsor)
.NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon!
Jeffrey Palermo’s Twitter — Follow to stay informed about future events!
ErrorBoundary and Logging in Blazor
Want to Learn More?
Visit AzureDevOps.Show for show notes and additional episodes.
Next Episode

Dustin Campbell: C# 13 - Episode 339
Dustin is a Principal Software Engineer at Microsoft. He works on enhancing .NET tooling and contributing to the design of the next version of C# as part of the language design team. Prior to his current role, he spent several years working as a program manager on Project Roslyn. He also contributed in a strong way to the Razor UI framework. He recently presented a session at .NET Conf 2024 on What's new in C# 13.
Topics of Discussion:
[4:04] Fun fact: Dustin has a jazz guitar performance degree!
[3:39] The unique appeal of C#.
[5:06] Evolution of C# and its features.
[10:48] Impact of Async and Await on C#.
[13:17] The compatibility of C# 13 with older .NET versions, specifically .NET 8.
[15:04] How developers can leverage the latest C# features while still targeting older .NET frameworks, and the challenges associated with runtime support for new language capabilities.
[17:04] Hacking the C# compiler.
[17:28] The evolution of records from their initial introduction to the added features.
[18:46] Records vs. Classes in C#.
[22:51] AI’s influence on developer productivity.
[25:46] The future of AI developer tools.
[33:26] The need for better support for testing with large language models and other AI-driven dependencies.
Mentioned in this Episode:
Programming with Palermo — New Video Podcast! Email us at [email protected].
Clear Measure, Inc. (Sponsor)
.NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo
The Five Pillars: Leadership For Effective Custom Software, by Jeffrey Palermo
Jeffrey Palermo’s Twitter — Follow to stay informed about future events!
.NET Conf 2024: What’s New in C#13
Want to Learn More?
Visit AzureDevOps.Show for show notes and additional episodes.
If you like this episode you’ll love
Episode Comments
Generate a badge
Get a badge for your website that links back to this episode
<a href="https://goodpods.com/podcasts/azure-and-devops-podcast-389797/scott-nichols-azure-ai-foundry-episode-338-86123072"> <img src="https://storage.googleapis.com/goodpods-images-bucket/badges/generic-badge-1.svg" alt="listen to scott nichols: azure ai foundry - episode 338 on goodpods" style="width: 225px" /> </a>
Copy