My 4x Mac Studio M3 Ultra 256gb cluster
by nrmjeremy
deepseek/deepseek-v4-flash4x Mac Studio M3 Ultra 256gbQ5_K_M
4 Mac Studio M3 Ultras connected with Thunderbolt 5, 10gbe fallback and 2gb internet. Currently using mlx-vllm with distributed inference. Have a GX10 that can be added.
During the rental period, you'll be invited to a Slack channel with my agent for immediate troubleshooting, model or framework changes, etc. Please contact with questions.