Hugging Face and Intel – Driving Towards Practical, Faster, Democratized and Ethical AI solutions

03/31/23 • 40 min

Transformer models are the powerful neural networks that have become the standard for delivering advanced performance behind these innovations. But there is a challenge: Training these deep learning models at scale and doing inference on them requires a large amount of computing power. This can make the process time-consuming, complex, and costly.

Today we will talk about all kinds of issues around accessible, production level AI solutions. We also talk about ethical questions around AI usage and why open, democratized AI solutions are important.

Learn more:
Hugging Face
https://huggingface.co

Hugging Face Hub
https://huggingface.co/models

Fast Inference on Large Language Models: BLOOMZ on Habana Gaudi2 Accelerator
https://huggingface.co/blog/habana-gaudi-2-bloom

Accelerating Stable Diffusion Inference on Intel CPUs
https://huggingface.co/blog/stable-diffusion-inference-intel

Transformer Performance with Intel & Hugging Face Webinar
https://www.intel.com/content/www/us/en/developer/videos/optimize-end-to-end-transformer-model-performance.html#gs.pomt5k

Intel Explainable AI Tools
https://github.com/IntelAI/intel-xai-tools

Intel Distribution of OpenVINO Toolkit
https://www.intel.com/content/www/us/en/developer/tools/openvino-toolkit/overview.html

Intel AI Analytics Toolkit (AI Kit)
https://www.intel.com/content/www/us/en/developer/tools/oneapi/ai-analytics-toolkit.html

Guests:
Julien Simon – Chief Evangelist @ Hugging Face
Ke Ding – Principal Engineer @ Intel

Learn more:
Hugging Face
https://huggingface.co

Hugging Face Hub
https://huggingface.co/models

Fast Inference on Large Language Models: BLOOMZ on Habana Gaudi2 Accelerator
https://huggingface.co/blog/habana-gaudi-2-bloom

Accelerating Stable Diffusion Inference on Intel CPUs
https://huggingface.co/blog/stable-diffusion-inference-intel

Transformer Performance with Intel & Hugging Face Webinar
https://www.intel.com/content/www/us/en/developer/videos/optimize-end-to-end-transformer-model-performance.html#gs.pomt5k

Intel Explainable AI Tools
https://github.com/IntelAI/intel-xai-tools

Intel Distribution of OpenVINO Toolkit
https://www.intel.com/content/www/us/en/developer/tools/openvino-toolkit/overview.html

Intel AI Analytics Toolkit (AI Kit)
https://www.intel.com/content/www/us/en/developer/tools/oneapi/ai-analytics-toolkit.html

Guests:
Julien Simon – Chief Evangelist @ Hugging Face
Ke Ding – Principal Engineer @ Intel

Previous Episode

Safehouse Initiative Podcast – Conversations in the Cloud – Episode 294 – Part 3

The SafeHouse Initiative was organized to provide education and awareness to businesses who are inundated with technical concepts, jargon and terms around the concepts of Business Continuity and Cyber Security. We understand that customers want to focus on their business rather than becoming Cyber Security or Disaster Recovery/Business Continuity technology experts.

Follow Jake on Twitter at: twitter.com/jakesmithintel

Next Episode

Audio White Paper: Wallarm and GDPR

In 2016, the European Commission approved the most significant change in the EU Data Protection Directive since its inception in 1995. The new General Data Protection Regulation law, also known as GDPR, became enforceable in May of 2018. It is designed to strengthen security, give control of personal data to data owners in Europe, and to make sure that data regulations are consistent across all European countries.

As a security company, Wallarm recognizes the importance of data protection laws. In this audio version of the white paper, Wallarm demonstrates that its solution follows the guidelines and requirements of GDPR and that many of Wallarm’s features can help customers achieve GDPR compliance in their web applications.

The PDF version of this paper can be found here:
wallarm.com/resources/#whitepapers