Google's Gemini Shows Significant Math Learning Gains in Sierra Leone Trial

Google has released results from an eight-week randomized controlled trial in Sierra Leone's Port Loko District, involving 1,763 secondary students across 12 schools. The study examined how Gemini's Guided Learning feature affected mathematics progress and educational outcomes. The quantitative findings were substantial: students using Guided Learning achieved a gain of 0.258 standard deviations compared to the control group, equivalent to 1.2 to 1.7 years of typical learning progress in just eight weeks. When teachers integrated the tool into roughly half their lessons, the gains increased to 1.8 to 2.5 years of progress. Analysis of over 113,000 interactions during the trial showed that 91.4% of student conversations focused on building conceptual understanding rather than seeking direct answers. Gemini posed scaffolding questions in 76% of its responses while providing solutions in only 2% of cases. Student engagement was notably high, with 69% meeting or exceeding usage targets, far exceeding typical voluntary technology adoption rates. Teachers reported professional development benefits from using the platform, transitioning from lecturers to facilitators. Students demonstrated increased motivation for mathematics and shifted toward learning-oriented questions, with skill-building inquiries rising from 68% in the first week to 90% by the final week. The study did reveal one important limitation: students who began with stronger mathematics skills benefited most, highlighting an achievement gap that needs addressing. Google plans to conduct additional trials in other countries and explore deeper aspects like metacognition and relational intelligence to develop more equitable tools.