Wolfbauer Irmtraud, Pammer-Schindler Viktoria, Maitz Katharina, Rosé Carolyn P.
2022
A Script for Conversational Reflection Guidance: A Field Study on Developing Reflection Competence with Apprentices
IEEE Transactions on Learning Technologies - Special Issues on Workplace Learning Minjuan Wang IEEE -
We present a script for conversational reflection guidance embedded in reflective practice. Rebo Junior, a non-adaptive conversational agent, was evaluated in a 12-week field study with apprentices. We analysed apprentices’ interactions with Rebo Junior in terms of reflectivity, and measured the development of their reflection competence via reflective essays at three points in time during the field study. Reflection competence, a key competency for lifelong professional learning, becomes significantly higher by the third essay, after repeated interactions with Rebo Junior (paired-samples t-test t13=3.00, p=.010 from Essay 1 to Essay 3). However, we also observed a significant decrease in reflectivity in the Rebo Junior interactions over time (paired-samples t-test between the first and eighth interaction: t7=2.50, p=.041). We attribute this decline to i) the novelty of Rebo Junior wearing off (novelty effect) and ii) the apprentices learning the script and experiencing subsequent frustration due to the script not fading over time. Overall, this work i) informs future design through the observation of consistent decreases in engagement over 8 interactions with static scaffolding, and ii) contributes a reflection script applicable for reflection on tasks that resemble future expected work tasks, a typical setting in lifelong professional learning, and iii) indicates increased reflection competence after repeated reflection guided by a conversational agent.