PrismML brings its tiny LLMs to Qualcomm-powered smart glasses
News Source
β’Thu, 24 Sep 2026 19:00:42 +0000
π° What Happened
An AI lab called PrismML has made a version of its small language models for smart glasses that use Qualcomm's Snapdragon chips. Qualcomm showed it off on Wednesday at its Snapdragon Summit.
The model is called Bonsai and uses a 1-bit design. It has 2 billion settings, known as parameters, and is trained for both vision and language. That is small enough to run on the glasses themselves.
The idea is that a wearer can ask what they are looking at and get an answer straight away. PrismML says it can shrink big models by about four times while keeping almost all of their performance.
π The Backstory
PrismML was founded by researchers from Caltech and is advised by Ion Stoica of UC Berkeley. Its goal is open AI models that run on your device instead of distant servers.
The company argues this is better for privacy. It says users should not have to trust the promises of big AI firms that always want more computing power.
No smart glasses running PrismML have been announced yet, so the technology is still a demonstration. Qualcomm showed the model on its own reference hardware.
π― Why It Matters
AI that runs on the device can work without the internet and keeps your data local. It could also make smart glasses cheaper and more useful. It may use less energy than sending everything to a data centre.
An AI lab called PrismML has made a version of its small language models for smart glasses that use Qualcomm's Snapdragon chips. Qualcomm showed it off on Wednesday at its Snapdragon Summit.
The model is called Bonsai and uses a 1-bit design. It has 2 billion settings, known as parameters, and is trained for both vision and language. That is small enough to run on the glasses themselves.
The idea is that a wearer can ask what they are looking at and get an answer straight away. PrismML says it can shrink big models by about four times while keeping almost all of their performance.
PrismML was founded by researchers from Caltech and is advised by Ion Stoica of UC Berkeley. Its goal is open AI models that run on your device instead of distant servers.
The company argues this is better for privacy. It says users should not have to trust the promises of big AI firms that always want more computing power.
No smart glasses running PrismML have been announced yet, so the technology is still a demonstration. Qualcomm showed the model on its own reference hardware.
AI that runs on the device can work without the internet and keeps your data local. It could also make smart glasses cheaper and more useful. It may use less energy than sending everything to a data centre.