Chris Cole - Running LLMs on Microcontrollers

Posted on Friday, Jul 19, 2024
A discussion about AI at the edge.

Show Notes

Available on your favorite podcast platform.

In this episode, we discuss aspects running AI on edge systems (both microcontrollers and embedded Linux). Chris has a lot of experience doing this and has used AI at the edge in multiple projects to solve real problems. This episode provides an overview of the technology and will help you understand the steps to implementing an AI model in your system.

Chris has published an open source project for implementing neural networks on embedded systems.

Discuss this episode at our community site.

Hosts

Cliff Brake

Cliff Brake

Cliff has been developing products for a long time. See BEC and Github for more information.

Khem Raj

Khem Raj

Khem is an OpenEmbedded maintainer.