Product Vision

Leveraging AI early intervention systems for students at risk of failure

UNSW

Identifying the best application of AI, without losing a human touch where it matters most is a common challenge across services. UNSW wanted to develop an early intervention Academic Success Monitor to support students at risk of failing. By defining who the AI should engage, how it should communicate, and which support services to offer, we helped UNSW develop an internationally awarded initiative that’s delivered measurable improvements in student engagement and intervention outcomes.

Objective

Defining when and how to use AI

AI should be used to enhance, not replace critical human based interventions and services. UNSW had promising early results based on data tests, but wanted to understand when and how to deploy AI across a vast range of students at varying degrees of risk. The solution needed to effectively dovetail with academic staff and an array of student support services.

Sandbox was tasked with simplifying UNSW's approach, providing focus on key areas of impact and the defining the design required to drive results.

Approach

Identifying key sources of value for students and staff

Through qualitative research and testing with UNSW students and staff, compiled with existing insight from surveys, Sandbox was able to identify key source of value for all stakeholders. This helped UNSW to focus on the most impactful use cases and profiles. Prototyping and testing the hypotheses provided guidance around the language and design of AI nudges to target this sensitive issue.

"Today, it's impossible to know how you are doing compared to others. It's so weird to ask someone.”

UNSW Student

"Sandbox's contribution was instrumental in transforming this initiative, which has since received international recognition. It was an exceptional experience"

UNSW Director, Educational Innovation
Outcome

A measurable uplift in academic and wellbeing outcomes

Sandbox helped UNSW to reframe their project, focusing on the right areas with the right design to ensure success. UNSW's Academic Success Monitor has led to significant measurable improvements for students & staff including;

  • AI nudges led to a 20% increase in student engagement.
  • 75% of academics confirmed the system helped identify students at risk earlier than previously possible.
  • Academics cited between 1 to 5 hrs a week saved on tracking student engagement and identifying risk
  • Testing on historic data showed 81% of failures were accurately flagged

Learn more about UNSW's award winning initiative at UNSW's eLearning channel

View All Work