Presentation Schedule
Validating Course Evaluations: A Formative and Outcome-Based Validation of the CARE² Model (112758)
Session Chair: Karen K. Fujii
This presentation will be live-streamed via Zoom (Online Access)
Monday, 9 November 2026 13:00
Session: Session 2
Room: Live-Stream Room 3
Presentation Type:Live-Stream Presentation
– click here to convert to your timezone
Course evaluation instruments are used in higher education, yet rely on measurement assumptions that may not align with the multidimensional nature of pedagogical learning experiences. This study developed and validated the CARE² model, a formative course evaluation instrument composed of nine single-item dimensions: Culture, Peer Collaboration, Instructor Collaboration, Autonomy, Agility, Relevance, Repetition, Engagement, and Evaluation. Unlike traditional reflective approaches, the CARE² model conceptualizes pedagogical quality as a composite of design features. Using a multistep validation design with 156 university learners across two course sections, the study examined the instrument's formative measurement properties using statistics, inter-item correlations, multicollinearity diagnostics, bootstrapped outer weights, and bias assessment. Results indicated measurement characteristics, with low multicollinearity (VIFs = 1.35-2.80), significant outer weights for all indicators (p < .001), and no evidence of indicator redundancy. In addition, relationships between the CARE² model ratings and pre-post technology learning outcomes were examined for nomological validity, while accounting for baseline skill differences. Students in the intervention group demonstrated significantly greater technology learning gains despite equivalent baseline proficiency. The technology composite gain was substantially larger in the intervention group (d = 1.23) than in the comparison group (d = 0.60), with stronger gains observed across multiple technology skill domains. Although additional research is needed across diverse instructional contexts and populations, the results support the CARE² model as a promising framework for evaluating and improving teaching and learning experiences in higher education.
Authors:
Karen K. Fujii, Niels Brock Copenhagen Business College, Denmark
Natalie Perez, University of Hawaii, United States
Sonia Caroline Baptista, Niels Brock Copenhagen Business College, Denmark
About the Presenter(s)
Dr. Karen K. Fujii is an associate professor at Niels Brock Copenhagen Business College in Copenhagen, Denmark.
Connect on Linkedin
https://www.linkedin.com/in/karen-fujii/
Connect on ResearchGate
https://www.researchgate.net/profile/Karen-Fujii-2
Additional website of interest
https://scholar.google.com/citations?user=qAJjn4sAAAAJ
See this presentation on the full schedule – Monday Schedule




