Deepseek-V4-Flash on a MacBook M5 Max — Does It Actually Work? (Mac Apple silicon)

🚀 The M5 Max chip is finally here — I benchmarked DeepSeek-V4-Flash (~85GB) running fully locally on an Apple M5 Max MacBook using a custom llama.cpp — no cloud, no API, just raw silicon. See below for setup details. #opensource #llm #m5 #llamacpp #deepseek #applesilicon
👉ⓢⓤⓑⓢⓒⓡⓘⓑⓔ
👉 !! try Wan Video online at https://agireact.com/wan-t2v !!

Please join the discord server at https://discord.gg/SgmBydQ2Mn where you developed free chatgpt bot and stable diffusion bot!
If you would like to support me, here is my Kofi link: https://ko-fi.com/techpractice and Patreon page: https://www.patreon.com/user?u=89548519
Thank you for watching!

If you found this useful:
👍 Like if the results surprised you
🔔 Subscribe for more local AI benchmarks and hardware deep-dives
💬 Drop your setup in the comments — curious what you're running models on

For Gemma4 model comparison, see https://youtu.be/VYc47oqBnqI

🔧 TOOLS & MODELS USED
- Model: Deepseek V4 Flash (Q2) https://huggingface.co/antirez/deepseek-v4-gguf
- Sofware: llama.cpp fork: https://github.com/antirez/llama.cpp-deepseek-v4-flash
- Hardware: MacBook Pro M5 Max, 128GB unified memory
- macOS Tahoe

📄 Deepseek V4 Flash model: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash

Tutorial links:
For python virtualenv install, see https://youtu.be/uOCL6h9fuVc
ComfyUI for more advanced workflows
ComfyUI on Macbook tutorial: https://youtu.be/ZCswfm0dBYY
FLUX on Macbook: https://youtu.be/asngm4s_9Ho
The ComfyUI workflow can be downloaded from https://github.com/ttio2tech/ComfyUI_workflows_collection (Pulid_flux_workflow.json)

Affiliate links: buy hardware on Amazon
Mac-Mini M4: https://amzn.to/4emPxrB (also has coupon)
AMD GPU: https://amzn.to/3vCp6h1
4600G https://amzn.to/45LhGFa
5600G: https://amzn.to/3LgnFtC (same iGPU, better CPU)
5700G: https://amzn.to/3Z9gUiM (better iGPU, and better CPU)
ssd drive: https://amzn.to/3MVJdg2
DDR4 drive: https://amzn.to/3sKNufi
AM4 motherboard: https://amzn.to/3GfrPit
PSU (power supply unit): https://amzn.to/3Gd87UA
PC Case: https://amzn.to/3QPDNnF
if you are interested in discrete GPU: https://amzn.to/3QT1wDp

Видео Deepseek-V4-Flash on a MacBook M5 Max — Does It Actually Work? (Mac Apple silicon) канала Tech-Practice