How the AI Tutor Drives Student Success

When students use AI to support their learning, what kind of impact does it actually have? This research examines the effectiveness of Macmillan Learning’s AI Tutor, a generative AI tool designed to provide personalized, scaffolded feedback to college students within their digital homework experience. Drawing from more than 1,200 students across 36 institutions, the findings reveal that how students use AI significantly shapes their outcomes.

Key Takeaways from the AI Tutor Study:

• Optimal usage matters. Student learning outcomes improved most when the AI Tutor was used on 25%–75% of homework questions.
• Passive use is less effective: Students who relied only on pre-set prompts showed little improvement.
• Interaction style drives results. Students who interacted with the AI Tutor in their own words saw significantly higher gains, including exam score increases of up to 10%.
• AI Tutor use strengthens foundational learning: When students are able to seek help for themselves through the Tutor, it can reduce the volume of foundational questions instructors receive and they (instructors) can then focus their attention on more complex questions.

What This Means

These findings suggest that AI is most effective when used as a learning partner, not just an answer tool. Intentional, engaged use can improve performance while also helping students build problem-solving skills and confidence, while also reducing the volume of foundational questions for instructors, freeing them up to focus on addressing more complex questions.

For full methodology, detailed findings, and implementation insights, explore the full research report here.

Read the Full Research Report

FAQ’s

What is the AI Tutor?

The AI Student Tutor uses a Socratic approach to help students work through homework problems—asking guiding questions rather than providing answers—so they build understanding step by step.

Does using AI in homework lead to cheating?

The AI Tutor is designed to prevent "answer-seeking" behaviour. It uses research-backed prompting to guide students toward the correct logic. Data indicates that students who interact in their own words see the highest learning gains, distinguishing this from passive AI use.

How does this reduce the workload for instructors?

When the AI Tutor addresses foundational questions and clarifies basic concepts during homework, students arrive at class with a better baseline understanding. This allows instructors to focus on high-level instruction and complex student needs.

What is Achieve?

Achieve delivers research-backed personalised learning, real-time feedback, and accessibility features—all integrated into your LMS to keep students engaged without increasing your workload.

---

This post was authored by a member of the Learning Science Research team at Macmillan Learning. The team’s learning scientists and researchers work closely with educators and students to study how learning happens and how to best support today’s learners. They translate those findings into evidence-based guidance for classroom practice and insights that strengthen teaching and student success.