OpenAI standardizes on PyTorch

What changed

We are standardizing OpenAI’s deep learning framework on PyTorch.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

• Quanto: a PyTorch quantization backend for Optimum
• Accelerating PyTorch distributed fine-tuning with Intel technologies
• Fine-tuning Llama 2 70B using PyTorch FSDP

• Quanto: a PyTorch quantization backend for Optimum similarity 0.29
• Accelerating PyTorch distributed fine-tuning with Intel technologies similarity 0.28
• Fine-tuning Llama 2 70B using PyTorch FSDP similarity 0.28