EdTech Research, Implementation and Policy I UX Research I Early Warning Systems I Published Author I Editor, Frontiers in Education I Host, Dancing with the Machine podcast
For the past 18 months, I’ve been collaborating with Beyond Virtual ai and Temasek Polytechnic on a joint research project which examines the effects of an AI-powered Virtual-Human training on STEM major students’ SRL strategy practice and use. We just finished conducting a series of focus groups with STEM major students who were given access to an AI-powered Virtual-Human SRL training. The focus groups generated a large amount of qualitative data, including detailed notes, transcripts, audio and video recordings. All of this data was synthesized into a set of implications for future design of digital SRL training interventions and their provision to STEM students in need of support. These can be summarized as follows: 📈 Virtual-human trainings that provide opportunities to practice applying SRL strategies can promote desired SRL behavior. Therefore, such training should be incorporated into the LMS course site of STEM courses. 🎯Student behavior should be tracked and analyzed in real time (how the bot is used, where it fails, how users interact with it, words from the users that the bot cannot understand, or words from the bot that the users cannot understand). 💡Real-time data on student satisfaction should be gathered using quick reply buttons (thumbs up/thumbs down emojis) and feedback messages. 📣Students’ frustration should be detected by analyzing their tone and the type of language they use. 🔦Finally, providers of digital SRL training interventions should plan for misunderstandings and create fallback scenarios. On to the next stage of the analysis process – analysis of the pre- and post- student surveys! Edge | Innovative Education Center #research #ai #design #selfregulation #edtech #srl #digitaltraining #instructionaldesign #userexperience #focusgroups #qualitativeresearch
