Habana Labs and Hugging Face Partner to Accelerate Transformer Model Training

Practical AI: Tools, Models & Frameworkstransformer

What changed

Santa Clara and San Francisco, CA, April 12th, 2022 Powered by deep learning, transformer models deliver state-of-the-art performance on a wide range of machine learning tasks, such as natural language processing, computer vision, speech, and more. However, training them at scale often requires a large amount of computing power, making the whole process unnecessarily long, complex, and costly. Today, Habana® Labs, a pioneer in high-efficiency, purpose-built deep learning processors, and Hugging Face, the home of Transformer models, are happy to announce that they’re joining forces to make it easier and quicker to train high-quality transformer models.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

  • Patch Time Series Transformer in Hugging Face
  • Introducing 🤗 Accelerate
  • Co-Scientist: A multi-agent AI partner to accelerate research

Sources