We can't find the internet
Attempting to reconnect
Something went wrong!
Attempting to reconnect
Analysis Summary
Ask yourself: “Did I notice what this video wanted from me, and did I decide freely to say yes?”
Worth Noting
Positive elements
- This video provides a real-world benchmark for MLX distributed performance on Apple Silicon, which is valuable for developers tracking local LLM capabilities.
Influence Dimensions
How are these scored?About this analysis
Knowing about these techniques makes them visible, not powerless. The ones that work best on you are the ones that match beliefs you already hold.
This analysis is a tool for your own thinking — what you do with it is up to you.
Related content covering similar topics.
DeepSeek 671B params on Mac Studio
Alex Ziskind
$5,000 Mac Studio vs. $4,000 Gaming PC
Joe Urbinati
Mac Studio vs. Nvidia: Running Large Models Locally!
Heavy Metal Cloud
MAC Studio M5 Ultra - OFFICIAL RELEASE!
Technology Trends
Transcript
All right, the new GLM 5. This is the 4-bit version which could easily fit on one Mac Studio. It's running across four. This is using Tensor Parallelism using MLX distributed. So, it's actually a little bit faster running on a cluster of four than it would be on just one. And we're getting about 23 tokens per second right now running across the cluster of four.
Video description
I wired four Mac Studios together and loaded a 1 Trillion parameter LLM. 🛒 Gear Links 🛒 ⌨️🏢 The rack in this video: tall version- https://amzn.to/4cvsfk3 short version - https://amzn.to/4j6Nuv4 🪛🪛Highly rated precision driver kit: https://amzn.to/4fkMVfg 💻☕ Favorite 15" display with magnet: https://amzn.to/3zD1DhQ 🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW 🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo 📦🎮 My gear: https://www.amazon.com/shop/alexziskind 🎥 Related Videos 🎥 🧳🧰 Mini PC portable setup - https://youtu.be/4RYmsrarOSw 🍎💻 Dev setup on Mac - https://youtu.be/KiKUN4i1SeU 💸🧠 Cheap mini runs a 70B LLM 🤯 - https://youtu.be/xyKEQjUzfAk 🧪🔥 RAM torture test on Mac - https://youtu.be/l3zIwPgan7M 🍏⚡ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo 🧠📉 REALITY vs Apple’s Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A 🧬🐍 Set up Conda - https://youtu.be/2Acht_5_HTo ⚡💥 Thunderbolt 5 BREAKS Apple’s Upcharge - https://youtu.be/nHqrvxcRc7o 🧠🚀 INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k 🧱🖥️ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho * 🛠️ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX 🔗 AI for Coding Playlist: 📚 - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw My MLX cluster setup: https://github.com/alexziskind1/mlx-jaccl-cluster.git — — — — — — — — — ❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺 Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 — — — — — — — — — Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join — — — — — — — — — 📱 ALEX on X: https://x.com/digitalix 📱 AWNI (MLX) on X: https://x.com/awnihannun #macstudio #m4max #m3ultra