Google DeepMind 公布塞拉利昂 AI 学习试验结果,学生数学进步约合 1.2 至 1.7 年
Measuring the impact of learning with AI in Sierra Leone and beyond
- 1塞拉利昂预注册试验显示,使用 Guided Learning 的试验组数学成绩较对照组提升 0.258 个标准差,约合 1.2 至 1.7 年学习进度。
- 2教师在约一半课时引入 Gemini、达到 12 小时目标的班级增益更高,约合 1.8 至 2.5 年学习进度。
- 3超 11.3 万条交互分析显示,91.4% 的对话用于构建概念理解,Gemini 仅在 2% 的情况直接给出答案。
- 4试验同时暴露成效差距,入组时数学基础较强的学生获益最大。
Google 用预注册随机对照试验为 AI 辅导学习效果拿出量化证据,教育类 AI 正从功能宣传走向效果可测量的阶段。
- 影响:教育与培训类 AI 的采购评估开始有试验级数据可参照;基础较弱学员获益更小的发现提示,企业内训若引入类似工具宜按学员基础分层设计。
- 参考:可考虑把预注册试验数据和效果量级列为培训类 AI 工具的评估标准;值得参考 DeepMind 与 Fab AI 公开的试验方法手册,按学员基础分层先做小规模对比试点。
- 依据:数据出自 Google DeepMind 官方博客口径的预注册试验,合作方含 EducAid、Laterite、Oxford MeasurEd,获 Google.org 与盖茨基金会支持,尚无第三方独立复核。
The results from this pre-registered trial suggest that AI can be a powerful pedagogical partner — not by replacing teachers, but by augmenting their reach. This study is part of our ongoing effort to build a global evidence base for the impact of AI on teaching and learning.
Beyond the answer engine: protecting critical thinking
A common concern is that generative AI could become a shortcut for students, potentially bypassing the challenging yet essential cognitive effort required for deeper learning. Guided Learning is designed to address this concern: it’s built from years of research and work in our LearnLM efforts to be pedagogically-grounded and specifically tuned to prioritize building understanding over providing direct answers.
The data from Sierra Leone suggests this approach is working. An analysis of over 113,000 interactions exchanged during our trial revealed that students used the tool to build conceptual understanding in 91.4% of conversations, rather than simply seeking solutions. Gemini responded by posing scaffolding questions in 76% of its messages, providing direct solutions in only 2% of cases. This "Socratic" interaction ensures that the cognitive heavy lifting remains with the student.
A teacher-led intervention
The success of this trial was built on a partnership between AI and educators, where teachers remained firmly at the center of the experience. Educators designed the lessons, set the objectives, and facilitated classroom discussions that drove learning.
In focus groups, teachers reported that Gemini also supported their own professional growth. By using the tool for lesson preparation, they discovered new ways to explain familiar topics like fractions. Many described a shift from "lecturers" to "facilitators," moving through the classroom to support pairs of students as they navigated their own learning journeys.
To help others implement similar programs, we are releasing a teacher training guide with materials created in collaboration with Fab AI, including the specific protocols used for this study.
Measuring the impact
The quantitative results were significant. Students using Guided Learning saw a gain of +0.258 standard deviations in their math scores compared to the control group. In practical terms, this represents roughly 1.2 to 1.7 years of typical learning progress achieved within the eight-week trial.
Students in classrooms where their teachers incorporated Gemini into roughly half their lessons to meet a target of 12 hours during the trial saw even higher gains—roughly 1.8 to 2.5 years of progress. Engagement was also remarkably high: 69% of students met or exceeded usage targets, far surpassing the five percent typical for voluntary educational technology (famously known as “The Five Percent Problem”). That means students were not only engaged but they enjoyed coming to class more.
Beyond the numbers, we also saw a profound shift in behavior. Students reported enjoying math more and actively engaged with learning beyond regular instruction. Crucially, over time, their conversations and questions became more learning-oriented, shifting toward skill building instead of seeking direct solutions. Specifically, skill-building queries rose to 90% by the final week — up from 68% in the first week — while solution-seeking questions dropped from 25% to 10%, proving students didn’t just want answers, they wanted to understand how they got there.
To further understand the impact of Guided Learning on student learning, we are conducting a series of additional pre-registered RCTs globally. In the interest of advancing open science and disseminating timely insights, we are also releasing a playbook on our approach to RCTs with Fab AI to help others run faster, scalable studies aligned to their needs and contexts — to uncover robust localised evidence that keeps pace with technological advances. We will continue to publish our results and learnings as we conclude subsequent RCTs to construct a more comprehensive, cross-country evidence base, which we hope will inform responsible development of AI across the learning ecosystem. Additionally, our support of the Global AI for Learning Alliance (GAILA) will accelerate these commitments and others through collective action.
The path forward
Though these results are promising, they also highlighted the challenge of the "achievement gap." While the majority of students benefited, those who entered the trial with stronger math skills benefited most. This underscores an important need: to offer tools that deliver the strongest gains for the students who need it most.
Looking ahead, we plan to expand these trials to other countries and probe more deeply into areas like metacognition and relational intelligence to capture a more holistic view that explores the nuanced complexity of learning. By combining the relational foundation of a teacher-led classroom of students with the personalized, scaffolding capabilities of AI, we can help ensure that technology serves as a bridge to meaningful learning opportunities for all.
1 We also received support from Google.org and the Gates Foundation to conduct the trial. EducAid, Laterite and Oxford MeasurEd also collaborated with us.
来源:Google DeepMind:Blog · deepmind.google