Raspberry Pi 5

I tested running a local LLM on a Raspberry Pi 5 to see how practical it really is. I tested it on its own, with the Hailo AI HAT+ 2 accelerator, and against an N100 mini PC, all running the same Qwen2.5 model. I also benchmarked it against a cheap cloud-based model through OpenRouter to see how it stacks up in terms of performance, quality, power usage and cost. ADDITIONAL INFORMATION --------------------------------------------------- Visit my blog for the testing write-up - https://the-diy-life.com/i-ran-ai-on-a-raspberry-pi-the-results-were-unexpected/ PURCHASE LINKS --------------------------------------------------- Raspberry Pi 5 - https://amzn.to/4bxwexq Pi 5 Active Cooler - https://amzn.to/47selO7 Pi AI HAT+ 2 Accelerator - https://amzn.to/4rJUYrr Beelink S12 N100 Mini PC - https://amzn.to/4lLdUo1 Tools & Equipment Used: Main Power Meter - https://amzn.to/4lO6Nvg USB C Pencil Screwdriver - https://amzn.to/4lWg5Ec Some of the above parts are affiliate links. By purchasing products through the above links, you'll be supporting this channel, at no additional cost to you. If you've got any ideas for Raspberry Pi, Arduino, or other Electronics projects or tutorials you'd like to see, let me know in the comments section