Generative AI like ChatGPT and Google’s Bard have disrupted the industry. However, they are still limited to browser windows and smartphone apps, where the processing is done through cloud computing. That is about to change soon as Qualcomm Snapdragon-powered devices will soon be able to run on-device generative AI.

At MWC 2023, Qualcomm showcased Stable Diffusion on a Snapdragon 8 Gen 2-powered Android smartphone. The demo showed how a smartphone can generate a new image with text commands or even change the background, without connecting to the internet. Running generative AI apps directly on a device offers several advantages, including lower operational costs, better privacy, security, and reliability of working without internet connectivity.

ALSO LISTEN: Podcast #69: ChatGPT and Generative AI: Differences, Ecosystem, Challenges, Opportunities

In the latest episode of ‘The Counterpoint Podcast’, host Peter Richardson is joined by Qualcomm's Senior Vice President of Product Management Ziad Asghar to talk about on-device generative AI. The discussion covers a range of topics from day-to-day use cases to scaling issues for computing resources and working with partners and the community to unlock new generative AI experiences across the Snapdragon product line.

Click the play button to listen to the podcast

You can read the transcript here.

Podcast Chapter Markers

01:35: Ziad starts by defining generative AI and comparing it with machine learning and other types of AI.

03:56: Ziad talks about AI experiences that are already present in Snapdragon-powered devices.

06:24: Ziad addresses the scaling issue for computing resources used to train large language models.

09:46: Ziad deep dives into the types of day-to-day applications for generative AI on devices like a smartphone.

13:34: Ziad talks about the hybrid AI model, involving both cloud interaction and edge.

15:43: Ziad on how Qualcomm is leveraging its silicon chip capabilities to unlock generative AI experiences.

19:20: Ziad on how Qualcomm is working with its ecosystem and the developer community.

21:57: Ziad touches on the privacy and security aspect with respect to on-device generative AI.

Also available for listening/download on: