I Ran AI on a Raspberry Pi… The Results Were Unexpected

I tested running a local LLM on a Raspberry Pi 5 to see how practical it really is. I tested it on its own, with the Hailo AI HAT+ 2 accelerator, and against an N100 mini PC, all running the same Qwen2.5 model. I also benchmarked it against a cheap cloud-based model through OpenRouter to see how it stacks up in terms of performance, quality, power usage and cost.

ADDITIONAL INFORMATION
---------------------------------------------------
Visit my blog for the testing write-up - https://the-diy-life.com/i-ran-ai-on-a-raspberry-pi-the-results-were-unexpected/

PURCHASE LINKS
---------------------------------------------------
Raspberry Pi 5 - https://amzn.to/4bxwexq
Pi 5 Active Cooler - https://amzn.to/47selO7
Pi AI HAT+ 2 Accelerator - https://amzn.to/4rJUYrr
Beelink S12 N100 Mini PC - https://amzn.to/4lLdUo1

Tools & Equipment Used:
Main Power Meter - https://amzn.to/4lO6Nvg
USB C Pencil Screwdriver - https://amzn.to/4lWg5Ec

Some of the above parts are affiliate links. By purchasing products through the above links, you'll be supporting this channel, at no additional cost to you.

If you've got any ideas for Raspberry Pi, Arduino, or other Electronics projects or tutorials you'd like to see, let me know in the comments section

Видео I Ran AI on a Raspberry Pi… The Results Were Unexpected канала Michael Klements