CLIP: Connecting text and images
What changed
We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the “zero-shot” capabilities of GPT-2 and GPT-3.
Why it matters
A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.
How it compares
Related prior coverage to compare against:
- Multimodal neurons in artificial neural networks
- Introducing ChatGPT Images 2.0
- Introducing GPT-5
Sources
- CLIP: Connecting text and images (openai-blog)primary