Base Labs launches an open-weight AI safety partnership with Hugging Face and Goodfire

Practical AI: Tools, Models & Frameworksopen-weight

What changed

Baseten launched a new safety infrastructure standard alongside its Base Labs research arm on Wednesday, partnering with Hugging Face and Goodfire AI to build safety evaluation and monitoring infrastructure for open-weight models. The announcement lands amid debate for the safety of open-weight models — which can be made dangerous by removing their safeguards through a rising technique known as abliteration. The scale of the problem is massive: Hugging Face, which hosts open source AI models, currently lists over 6,000 abliterated models.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

  • Y Combinator’s Garry Tan wants US open-weight AI labs to ‘distill’ frontier models, too
  • Habana Labs and Hugging Face Partner to Accelerate Transformer Model Training
  • Baseten on Hugging Face Inference Providers 🔥

Sources