Ollama is now available as an official Docker image

Practical AI: Tools, Models & Frameworks

What changed

Ollama is now available as an official Docker image October 5, 2023 Ollama is now available as an official Docker image We are excited to share that Ollama is now available as an official Docker sponsored open-source image, making it simpler to get up and running with large language models using Docker containers. With Ollama, all your interactions with large language models happen locally without sending private data to third-party services. On the Mac Ollama handles running the model with GPU acceleration.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

  • OpenJarvis: a local-first personal AI is now available to run with Ollama
  • Windows preview
  • Llama 3

Sources