New compute grid aims to address AI chip shortage

A coalition of AI startups, cloud providers, researchers, and investors is launching a National Compute Grid to address the AI chip supply crunch. The initiative seeks to pool AI computing resources to reduce the high costs of accessing scarce computing power. Anjney Midha, a leader of the effort, told Axios that the project aims to share computing resources for both commercial and public-sector use, emphasizing the need for coordination around an open standard to maintain competitiveness with China. The grid plans to aggregate AI computing capacity from labs, cloud providers, and different chip systems, then allocate it through a shared scheduler. The project is opening access to public-sector employees and teams, including government, education, and national laboratory users. The goal is to make computing more broadly available and increase the supply of one of the world's most scarce resources. The initiative highlights the inefficiencies in the current AI infrastructure, where many data centers operate below capacity, leaving valuable chips idle while some startups and researchers struggle to access resources. AI companies require vast computing resources for training new systems, often nearing full capacity during these periods. The grid's launch marks a significant step toward addressing these challenges by creating a more efficient and accessible computing environment.