Theory Ventures (Tomasz Tunguz) · 2025-05-10
· 390d
AI as a Personal Tutor: Measuring Impact on Student Learning and Workplace Performance
A meta-analysis published in Nature demonstrates that AI, particularly ChatGPT, produces medium to large effects on higher-order thinking in education, with strongest impacts in STEM courses and personalized learning models. The author argues AI functions as a personal Socrates in education and should serve as a workplace coach to elevate employee productivity and competitive advantage, though effectiveness diminishes with prolonged use.
Metrics in this report
Effect Size - 4-8 Week Duration
0.654effect size (Hedges' G)
large effect
Studies lasting 4-8 weeks
Effect Size - AI as Intelligent Tutor
0.945effect size (Hedges' G)
large effect
Tutoring role in education
Effect Size - Extended Use
0.332effect size (Hedges' G)
medium effect (50% reduction)
Longer-term AI tool usage
Effect Size - Personalized Learning
0.718effect size (Hedges' G)
large effect
Personalized learning models
Effect Size - STEM Courses
0.737effect size (Hedges' G)
large effect
STEM and related coursework
Overall Effect Size - ChatGPT on Higher-Order Thinking
0.457effect size (Hedges' G)
medium effect
All student learning scenarios
Publication Reach
150000subscribers
median
Theory Ventures newsletter readership