PrismML brings its tiny LLMs to Qualcomm-powered smart glasses

What changed

The AI Lab PrismML — founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica — has created a version of its tiny language models for smart glasses running on Qualcomm’s Snapdragon chips. On Wednesday, at Qualcomm’s Snapdragon Summit, the chipmaker showcased PrismML’s 1-bit Bonsai LLM, which can be run locally on AI smart glasses built on the Snapdragon AR1 Gen 1 Platform. As TechCrunch previously reported, PrismML’s claim to fame is that it shrinks larger models substantially (in this case, by 4x), while retaining almost all of their performance on standard benchmarks.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

• PrismML hopes its tiny LLM will change how we all use AI
• Introducing Prism
• Qualcomm launches two new smartphone chips with emphasis on AI

• PrismML hopes its tiny LLM will change how we all use AI similarity 0.27
• Introducing Prism similarity 0.15
• Qualcomm launches two new smartphone chips with emphasis on AI similarity 0.15