Apple's minions project leverages idle mac gpus for AI task acceleration

Apple has unveiled a research project called Minions, which aims to harness idle Mac GPUs to form a dynamic virtual GPU cloud for AI inference tasks. The system, described in a paper by Apple's research team, allows multiple Mac devices to collaborate without requiring additional GPU hardware. By aggregating underused GPU resources across macOS devices, Minions enables the execution of large-scale machine learning tasks in minutes rather than hours. The system uses a 'pull-based' task model, where devices actively request subtasks from a server and execute them locally on Apple Silicon GPUs. It also includes a watchdog component to monitor device availability and reassign tasks when devices go offline. Testing showed that tasks previously requiring over 10 hours of GPU time could now be initiated in minutes. While the technology is currently an internal research initiative, Apple acknowledges challenges such as data security and governance when using shared devices across departments.