Associations between Goal Orientation and Self-Regulated Learning Strategies are Stable across Course Types, Underrepresented Minority Status, and Gender: A Replication of Muis and Franco (2009)

Brendan Schuetze; Veronica Yan

doi:10.15626/MP.2021.2918

Authors

Brendan Schuetze The University of Texas at Austin https://orcid.org/0000-0002-5210-6785
Veronica Yan The University of Texas at Austin https://orcid.org/0000-0002-3988-3184

DOI:

https://doi.org/10.15626/MP.2021.2918

Keywords:

SEM Replication, Achievement Goals, Learning Strategies, Heterogeneity

Abstract

In this pre-registered replication of findings from Muis and Franco [2009; Contemporary Educational Psychology, 34(4), 306-318], college students (N = 978) from across the United States and Canada were surveyed regarding their goal orientations and learning strategies. A structural equation modelling approach was used to assess the associations between goal orientations and learning strategies. Six of the eight significant associations (75%) found by Muis and Franco replicated successfully in the current study. Mastery approach goals positively predicted endorsement of all learning strategies (Rehearsal, Critical Thinking, Metacognitive Self-Regulation and Elaboration). Performance avoidance goals negatively predicted critical thinking, while positively predicting metacognitive self-regulation and rehearsal. Evidence for moderation by assignment type was found. No evidence of the moderation of these associations by gender, underrepresented minority status, or course type (STEM, Humanities, or Social Sciences) was found. The reliability of common scales used in educational research and issues concerning the replication of studies using structural equation modeling are discussed.

Metrics

Metrics Loading ...

References

Alipourfard, N., Arendt, B., Benjamin, D. M., Benkler, N., Bishop, M. M., Burstein, M., Bush, M., Caverlee, J., Chen, Y., Clark, C., Dreber, A., Errington, T. M., Fidler, F., Fox, N. W., Frank, A., Fraser, H., Friedman, S., Gelman, B., Gentile, J., & Wu, J. (2021). Systematizing confidence in open research and evidence (SCORE) [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/46mnb DOI: https://doi.org/10.31235/osf.io/46mnb

Anderson, N. (2020). Examining ways COVID-19 adaptation derailed our assumptions about online learning. In 2020 IEEE Conference on e-Learning, e-Management and e-Services (IC3e) (pp. 67–70). https://doi.org/10.1109/IC3e50159.2020.9288463 DOI: https://doi.org/10.1109/IC3e50159.2020.9288463

Bjork, R. A., & Bjork, E. L. (1992). A new theory of disuse and an old theory of stimulus fluctuation. In From learning processes to cognitive processes: Essays in honor of William K. Estes (pp. 35–67).

Broekkamp, H., & Van Hout-Wolters, B. H. A. M. (2006). Students’ adaptation of study strategies when preparing for classroom tests. Educational Psychology Review, 19(4), 401. https://doi.org/10.1007/s10648-006-9025-0 DOI: https://doi.org/10.1007/s10648-006-9025-0

Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64(8), 1–9. DOI: https://doi.org/10.1177/016146816306400801

Carroll, J. B. (1989). The Carroll model: A 25-year retrospective and prospective view. Educational Researcher, 18(1), 26–31. https://doi.org/10.2307/1176007 DOI: https://doi.org/10.3102/0013189X018001026

Carvalho, P. F., Sana, F., & Yan, V. X. (2020). Self-regulated spacing in a massive open online course is related to better learning. NPJ Science of Learning, 5(1), 1–7. https://doi.org/10.1038/s41539-020-0061-1 DOI: https://doi.org/10.1038/s41539-020-0061-1

Chen, K.-C., & Jang, S.-J. (2010). Motivation in online learning: Testing a model of self-determination theory. Computers in Human Behavior, 26(4), 741–752. https://doi.org/10.1016/j.chb.2010.01.011 DOI: https://doi.org/10.1016/j.chb.2010.01.011

Cortina, J. M., Markell-Goldstein, H. M., Green, J. P., & Chang, Y. (2021). How are we testing interactions in latent variable models? Surging forward or fighting shy? Organizational Research Methods, 24(1), 26–54. https://doi.org/10.1177/1094428119872531 DOI: https://doi.org/10.1177/1094428119872531

Crede, M., & Harms, P. (2019). Questionable research practices when using confirmatory factor analysis. Journal of Managerial Psychology, 34(1), 18–30. https://doi.org/10.1108/JMP-06-2018-0272 DOI: https://doi.org/10.1108/JMP-06-2018-0272

DeBacker, T. K., Crowson, H. M., Beesley, A. D., Thoma, S. J., & Hestevold, N. L. (2008). The challenge of measuring epistemic beliefs: An analysis of three self-report instruments. The Journal of Experimental Education, 76(3), 281–312. https://doi.org/10.3200/JEXE.76.3.281-314 DOI: https://doi.org/10.3200/JEXE.76.3.281-314

Deemer, S. (2004). Classroom goal orientation in high school classrooms: Revealing links between teacher beliefs and classroom environments. Educational Research, 46(1), 73–90. https://doi.org/10.1080/0013188042000178836 DOI: https://doi.org/10.1080/0013188042000178836

D’Lima, G. M., Winsler, A., & Kitsantas, A. (2014). Ethnic and gender differences in first-year college students’ goal orientation, self-efficacy, and extrinsic and intrinsic motivation. The Journal of Educational Research, 107(5), 341–356. https://doi.org/10.1080/00220671.2013.823366 DOI: https://doi.org/10.1080/00220671.2013.823366

Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58. https://doi.org/10.1177/1529100612453266 DOI: https://doi.org/10.1177/1529100612453266

Elliot, A. J., & McGregor, H. A. (2001). A 2 x 2 achievement goal framework. Journal of Personality and Social Psychology, 80(3), 501–519. https://doi.org/10.1037/0022-3514.80.3.501 DOI: https://doi.org/10.1037//0022-3514.80.3.501

Engelschalk, T., Steuer, G., & Dresel, M. (2017). Quantity and quality of motivational regulation among university students. Educational Psychology, 37(9), 1154–1170. https://doi.org/10.1080/01443410.2017.1322177 DOI: https://doi.org/10.1080/01443410.2017.1322177

Flake, J. K., & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3(4), 456–465. https://doi.org/10.1177/2515245920952393 DOI: https://doi.org/10.1177/2515245920952393

Fong, C. J., Alejandro, A. J., Krou, M. R., Segovia, J., & Johnston-Ashton, K. (2019). Ya’at’eeh: Racereimaged belongingness factors, academic outcomes, and goal pursuits among indigenous community college students. Contemporary Educational Psychology, 59, 101805. https://doi.org/10.1016/j.cedpsych.2019.101805 DOI: https://doi.org/10.1016/j.cedpsych.2019.101805

Fuchs, L. S., Fuchs, D., Karns, K., Hamlett, C. L., Katzaroff, M., & Dutka, S. (1997). Effects of task-focused goals on low-achieving students with and without learning disabilities. American Educational Research Journal, 34(3), 513–543. https://doi.org/10.3102/00028312034003513 DOI: https://doi.org/10.3102/00028312034003513

Harackiewicz, J. M., Barron, K. E., Carter, S. M., Lehto, A. T., & Elliot, A. J. (1997). Predictors and consequences of achievement goals in the college classroom: Maintaining interest and making the grade. Journal of Personality and Social Psychology, 73(6), 1284–1295. https://doi.org/10.1037/0022-3514.73.6.1284 DOI: https://doi.org/10.1037//0022-3514.73.6.1284

Harackiewicz, J. M., Barron, K. E., Pintrich, P. R., Elliot, A. J., & Thrash, T. M. (2002). Revision of achievement goal theory: Necessary and illuminating. Journal of Educational Psychology, 94(3), 638–645. https://doi.org/10.1037/0022-0663.94.3.638 DOI: https://doi.org/10.1037//0022-0663.94.3.638

Hecker, B. L. (2017). Four decades of open science. Nature Physics, 13(6), 523–525. https://doi.org/10.1038/nphys4160 DOI: https://doi.org/10.1038/nphys4160

Henry, F., Dua, E., Kobayashi, A., James, C., Li, P., Ramos, H., & Smith, M. S. (2017). Race, racialization and Indigeneity in Canadian universities. Race Ethnicity and Education, 20(3), 300–314. https://doi.org/10.1080/13613324.2016.1260226 DOI: https://doi.org/10.1080/13613324.2016.1260226

Hofer, B. K. (2000). Dimensionality and disciplinary differences in personal epistemology. Contemporary Educational Psychology, 25(4), 378–405. https://doi.org/10.1006/ceps.1999.1026 DOI: https://doi.org/10.1006/ceps.1999.1026

Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447 DOI: https://doi.org/10.1007/BF02289447

Hurtado, S., & Ruiz Alvarado, A. (2012). The climate for underrepresented groups and diversity on campus (tech. rep.). HERI Research Brief.

Kaplan, A., & Maehr, M. L. (2007). The contributions and prospects of goal orientation theory. Educational Psychology Review, 19(2), 141–184. https://doi.org/10.1007/s10648-006-9012-5 DOI: https://doi.org/10.1007/s10648-006-9012-5

Kuncel, N. R., Credé, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages, class ranks, and test scores: A meta-analysis and review of the literature. Review of Educational Research, 75(1), 63–82. https://doi.org/10.3102/00346543075001063 DOI: https://doi.org/10.3102/00346543075001063

Li, K. (2019). MOOC learners’ demographics, self-regulated learning strategy, perceived learning and satisfaction: A structural equation modeling approach. Computers & Education, 132, 16–30. https://doi.org/10.1016/j.compedu.2019.01.003 DOI: https://doi.org/10.1016/j.compedu.2019.01.003

Liem, A. D., Lau, S., & Nie, Y. (2008). The role of self-efficacy, task value, and achievement goals in predicting learning strategies, task disengagement, peer relationship, and achievement outcome. Contemporary Educational Psychology, 33(4), 486–512. https://doi.org/10.1016/j.cedpsych.2007.08.001 DOI: https://doi.org/10.1016/j.cedpsych.2007.08.001

Macnamara, B. N., Hambrick, D. Z., & Oswald, F. L. (2014). Deliberate practice and performance in music, games, sports, education, and professions: A meta-analysis. Psychological Science, 25(8), 1608–1618. https://doi.org/10.1177/0956797614535810 DOI: https://doi.org/10.1177/0956797614535810

McGee, E. O. (2020). Interrogating structural racism in STEM higher education. Educational Researcher, 49(9), 633–644. https://doi.org/10.3102/0013189X20972718 DOI: https://doi.org/10.3102/0013189X20972718

Meece, J. L., Anderman, E. M., & Anderman, L. H. (2006). Classroom goal structure, student motivation, and academic achievement. Annual Review of Psychology, 57(1), 487–503. https://doi.org/10.1146/annurev.psych.56.091103.070258 DOI: https://doi.org/10.1146/annurev.psych.56.091103.070258

Merkle, E. C., & Rosseel, Y. (2015). Blavaan: Bayesian structural equation models via parameter expansion. ArXiv Preprint ArXiv:1511.05604.

Mouratidis, A., Michou, A., Demircio ̆glu, A. N., & Sayil, M. (2018). Different goals, different pathways to success: Performance-approach goals as direct and mastery-approach goals as indirect predictors of grades in mathematics. Learning and Individual Differences, 61, 127–135. https://doi.org/10.1016/j.lindif.2017.11.017 DOI: https://doi.org/10.1016/j.lindif.2017.11.017

Muis, K. R., & Franco, G. M. (2009). Epistemic beliefs: Setting the standards for self-regulated learning. Contemporary Educational Psychology, 34(4), 306–318. https://doi.org/10.1016/j.cedpsych.2009.06.005 DOI: https://doi.org/10.1016/j.cedpsych.2009.06.005

Museus, S. D., & Liverman, D. (2010). High-performing institutions and their implications for studying underrepresented minority students in STEM. New Directions for Institutional Research, 2010(148), 17–27. https://doi.org/10.1002/ir.358 DOI: https://doi.org/10.1002/ir.358

Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1991). A manual for the use of the motivated strategies for learning questionnaire (MSLQ) (tech. rep.). ERIC. https://eric.ed.gov/?id=ED338122

Plucker, J. A., & Makel, M. C. (2021). Replication is important for educational psychology: Recent developments and key issues. Educational Psychologist, 56(2), 90–100. https://doi.org/10.1080/00461520.2021.1895796 DOI: https://doi.org/10.1080/00461520.2021.1895796

Psaltou-Joycey, A. P. A. (2008). Cross-cultural differences in the use of learning strategies by students of Greek as a second language. Journal of Multilingual and Multicultural Development, 29(4), 310–324. https://doi.org/10.1080/01434630802147817 DOI: https://doi.org/10.1080/01434630802147817

Purdie, N., Hattie, J., & Douglas, G. (1996). Student conceptions of learning and their use of self-regulated learning strategies: A cross-cultural comparison. Journal of Educational Psychology, 88(1), 87–100. https://doi.org/10.1037/0022-0663.88.1.87 DOI: https://doi.org/10.1037//0022-0663.88.1.87

Ranellucci, J., Muis, K. R., Duffy, M., Wang, X., Sampasivam, L., & Franco, G. M. (2013). To master or perform? Exploring relations between achievement goals and conceptual change learning. British Journal of Educational Psychology, 83(3), 431–451. DOI: https://doi.org/10.1111/j.2044-8279.2012.02072.x

Revelle, W. (2018). Psych: Procedures for psychological, psychometric, and personality research. R Package Version, 1(10).

Rivers, M. L., & Dunlosky, J. (2020). Are test-expectancy effects better explained by changes in encoding strategies or differential test experience? Journal of Experimental Psychology: Learning, Memory, and Cognition, 10. DOI: https://doi.org/10.1037/xlm0000949

Seaman, C. S., & Weber, R. (2015). Undisclosed flexibility in computing and reporting structural equation models in communication science. Communication Methods and Measures, 9(4), 208–232. https://doi.org/10.1080/19312458.2015.1096329 DOI: https://doi.org/10.1080/19312458.2015.1096329

Senko, C., Hama, H., & Belmonte, K. (2013). Achievement goals, study strategies, and achievement: A test of the “learning agenda” framework. Learning and Individual Differences, 24, 1–10. https://doi.org/10.1016/j.lindif.2012.11.003 DOI: https://doi.org/10.1016/j.lindif.2012.11.003

Senko, C., Hulleman, C. S., & Harackiewicz, J. M. (2011). Achievement goal theory at the crossroads: Old controversies, current challenges, and new directions. Educational Psychologist, 46(1), 26–47. https://doi.org/10.1080/00461520.2011.538646 DOI: https://doi.org/10.1080/00461520.2011.538646

Senko, C., & Miles, K. M. (2008). Pursuing their own learning agenda: How mastery-oriented students jeopardize their class performance. Contemporary Educational Psychology, 33(4), 561–583. https://doi.org/10.1016/j.cedpsych.2007.12.001 DOI: https://doi.org/10.1016/j.cedpsych.2007.12.001

Shi, D., Lee, T., & Maydeu-Olivares, A. (2019). Understanding the model size effect on SEM fit indices. Educational and Psychological Measurement, 79(2), 310–334. https://doi.org/10.1177/0013164418783530 DOI: https://doi.org/10.1177/0013164418783530

Tabak, F., Nguyen, N., Basuray, T., & Darrow, W. (2009). Exploring the impact of personality on performance: How time-on-task moderates the mediation by self-efficacy. Personality and Individual Differences, 47(8), 823–828. https://doi.org/10.1016/j.paid.2009.06.027 DOI: https://doi.org/10.1016/j.paid.2009.06.027

Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd DOI: https://doi.org/10.5116/ijme.4dfb.8dfd

van der Zee, T., & Reich, J. (2018). Open education science. AERA Open, 4(3), 2332858418787466. https://doi.org/10.1177/2332858418787466 DOI: https://doi.org/10.1177/2332858418787466

Vrugt, A., & Oort, F. J. (2008). Metacognition, achievement goals, study strategies and academic achievement: Pathways to achievement. Metacognition and Learning, 3(2), 123–146. https://doi.org/10.1007/s11409-008-9022-4 DOI: https://doi.org/10.1007/s11409-008-9022-4

Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51(1), 409–428. https://doi.org/10.3758/s13428-018-1055-2 DOI: https://doi.org/10.3758/s13428-018-1055-2

Yan, V. X., & Schuetze, B. A. (2023). What is meant by “growth mindset”? Current theory, measurement practices, and empirical results leave much open to interpretation: Commentary on Macnamara and Burgoyne (2023) and Burnette et al. (2023). Psychological Bulletin, (3-4), 206–219. https://doi.org/10.1037/bul000037 DOI: https://doi.org/10.1037/bul0000370