Accelerating Stable Diffusion Inference on Intel CPUs

What changed

In this post, we're going to show you different techniques to accelerate Stable Diffusion models on Sapphire Rapids CPUs. A follow-up post will do the same for distributed fine-tuning. At the time of writing, the simplest way to get your hands on a Sapphire Rapids server is to use the Amazon EC2 R7iz instance family.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

• Fine-tuning Stable Diffusion models on Intel CPUs
• 🧨 Accelerating Stable Diffusion XL Inference with JAX on Cloud TPU v5e
• 🚀 Accelerating LLM Inference with TGI on Intel Gaudi

• Fine-tuning Stable Diffusion models on Intel CPUs similarity 0.77
• 🧨 Accelerating Stable Diffusion XL Inference with JAX on Cloud TPU v5e similarity 0.42
• 🚀 Accelerating LLM Inference with TGI on Intel Gaudi similarity 0.41