Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Practical AI: Tools, Models & Frameworkstransformer

What changed

We're excited to share Jack of All Trades (JAT), a project that aims to move in the direction of a generalist agent. We then trained multi-modal Transformer models on it, introducing several improvements over Gato for handling sequential data and continuous values. The resulting agents are called expert agents, and have been released on the ๐Ÿค— Hub.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

  • DABStep: Data Agent Benchmark for Multi-step Reasoning
  • Train your first Decision Transformer
  • Introducing ChatGPT agent

Sources