Education Data Science

Thinking Like a Scientist: Can Interactive Simulations Foster Critical AI Literacy?

Project Year
2025
Abstract

As AI systems shape individual and societal decisions, fostering critical AI literacy is essential. Traditional AI literacy approaches---such as blog articles, static lessons, and social media discussions---often fail to support deep conceptual understanding and critical engagement. This study examines whether interactive simulations can help learners "think like a scientist" by engaging them in hypothesis testing, experimentation, and direct observation of AI behavior. In a controlled study with 605 participants, we assess how interactive AI tutorials impact learning on key concepts like fairness, dataset representativeness, and bias in language models. Results show that interactive simulations improve AI literacy more substantially and consistently across topics compared to static materials, though engagement alone does not predict learning. This work contributes to the growing field of AI literacy education, highlighting how interactive, inquiry-driven methodologies can better equip individuals to critically engage with AI in their daily lives.

EDS Students

Yiling Zhao
Yiling Zhao
Class: 2025
Areas of interest: Machine Learning in Education, Learning Science, AI-assisted learning, EdTech, Data Visualization