AI Everyday #23 - Hands on & discussion on vLLM - high speed inference engine
01/30/24 • 6 min
Hands on and discussion around vLLM, high performance inference engine supporting continuous batching and paged attention.
Hands on and discussion around vLLM, high performance inference engine supporting continuous batching and paged attention.
Previous Episode
AI Everyday #22 - BootPIG: DreamBooth-worthy image modification without fine-tuning
Matt reviews bootpig, a paper/model that provides DreamBooth-style modification of images without fine tuning.
Next Episode
AI Everyday #24 - Faster and Faster!
7 wild updates from this week in about 8 minutes. #AI moving at crazy speed!
If you like this episode you’ll love
Episode Comments
Generate a badge
Get a badge for your website that links back to this episode
<a href="https://goodpods.com/podcasts/ai-everyday-305199/ai-everyday-23-hands-on-and-discussion-on-vllm-high-speed-inference-en-43449137"> <img src="https://storage.googleapis.com/goodpods-images-bucket/badges/generic-badge-1.svg" alt="listen to ai everyday #23 - hands on & discussion on vllm - high speed inference engine on goodpods" style="width: 225px" /> </a>
Copy