Introducing the Hugging Face Embedding Container for Amazon SageMaker

What changed

In this Blog we will show you how to deploy open Embedding Models, like Snowflake/snowflake-arctic-embed-l, BAAI/bge-large-en-v1.5 or sentence-transformers/all-MiniLM-L6-v2 to Amazon SageMaker for inference using the new Hugging Face Embedding Container. We will deploy the Snowflake/snowflake-arctic-embed-m-v1.5 one of the best open Embedding Models for retrieval - you can check its rankings on the MTEB Leaderboard. Retrieve the new Hugging Face Embedding Container - 3.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

• Introducing the Hugging Face LLM Inference Container for Amazon SageMaker
• Deploy GPT-J 6B for inference using Hugging Face Transformers and Amazon SageMaker
• Llama 2 on Amazon SageMaker a Benchmark

• Introducing the Hugging Face LLM Inference Container for Amazon SageMaker similarity 0.85
• Deploy GPT-J 6B for inference using Hugging Face Transformers and Amazon SageMaker similarity 0.48
• Llama 2 on Amazon SageMaker a Benchmark similarity 0.48