Measuring Teachers’ Beliefs: A Comparison of Three Different Approaches
More details
Hide details
University of Cologne, GERMANY
Mulawarman University, INDONESIA
Safrudiannur Safrudiannur   

University of Cologne, Germany
Online publication date: 2019-09-08
Publication date: 2019-09-08
EURASIA J. Math., Sci Tech. Ed 2020;16(1):em1796
The use of Likert scale items for measuring teachers’ beliefs quantitatively is criticized. In this study, two quantitative methods to measure teachers’ beliefs, a Likert scale instrument as well as a new instrument employing rank-then-rate items, are each compared with a qualitative approach at obtaining beliefs, i.e. interviews along with observations. In the first comparison, teachers’ responses to the Likert scale instrument seem to not fit the beliefs interpreted from the qualitative approach, particularly regarding beliefs about teaching and learning. Further analyses show that a tendency to respond according to social desirability as well as unspecific teaching contexts seem to be responsible for these inconsistencies. In the second comparison, since the rank-then-rate instrument also takes students’ abilities as a teaching context into account, we observed a better fit between teachers’ responses to the instrument and the qualitative approach. The results of both comparisons indicate the importance of considering teaching contexts as well as alternatives to Likert scale items because of social desirability in order to have a better prediction about teachers’ beliefs.
Alwin, D. F., & Krosnick, J. A. (1985). The Measurement of values in surveys: A comparison of ratings and rankings. The Public Opinion Quarterly, 49(4), 535-552.
Ambrose, R., Clement, L., Philipp, R., & Chauvot, J. (2004). Assessing prospective elementary school teachers’ beliefs about mathematics and mathematics learning: Rationale and development of a constructed-response-format beliefs survey. School Science and Mathematics, 104(2), 56–69.
Anderson, J., White, P., & Sullivan, P. (2005). Using a schematic model to represent influences on, and relationships between, teachers’ problem solving beliefs and practices. Mathematics Education Research Journal, 17(2), 9-38.
Bai, B., Liu, X., & Kou, Y. (2016). Belief in a just world lowers bribery intention. Asian Journal of Social Psychology, 19, 66-75.
Beswick, K. (2004). The impact of teachers’ perceptions of student characteristics on the enactment of their beliefs. In M. J. Hoines & A. B. Fuglestad (Eds.), Proceedings of the 28th annual conference of the International Group for the Psychology of Mathematics Education (Vol. 2, pp. 111–118). Bergen: Bergen University College.
Beswick, K. (2005). The beliefs/practice connection in broadly defined contexts. Mathematics Education Research Journal, 17(2), 39-68.
Beswick, K. (2018). Systems perspectives on mathematics teachers’ beliefs: Illustrations from beliefs about students. In E. Bergvist, M. Österhom, C. Granberg & L. Sumpter (Eds.). Proceedings of the 42nd Conference of the International Group for the Psychology of Mathematics Education (Vol. 1, pp. 3-18). Umeå, Sweden: PME.
Brown, A., & Maydeu-Olivares, A. (2012). How IRT can solve problems of ipsative data in forced-choice questionnaires. Psychological Methods, 18(1), 36-52.
Buehl, M. M., & Beck, J. S. (2015). Beliefs and teachers’ practices. In H. Fives and M. G. Gill (Eds.), International Handbook of Research on Teachers’ Beliefs, (pp. 66-84). New York: Routledge.
Cooney, T. J. (1985). A beginning teacher’s view of problem solving. Journal for Research in Mathematics Education, 16(5), 324-336.
Cross Francis, D. I. (2015). Dispelling the notion of inconsistencies in teachers’ mathematics beliefs and practices: A 3-year case study. Journal of Mathematics Teacher Education, 18(2), 173-201.
Di Martino, P., & Sabena, C. (2010). Teachers’ beliefs: The problem of inconsistency with practice. In M. Pinto, & T. Kawasaki (Eds.). Proceedings of the 34th Conference of the International Group for the Psychology of Mathematics Education (Vol. 2, pp. 313-320). Belo Horizonte, Brazil: PME.
Ernest, P. (1989a). The impact of beliefs on the teaching of mathematics, in P. Ernest (Ed.), Mathematics teaching: The state of the art (pp. 249-254). London: Falmer Press.
Ernest, P. (1989b). The knowledge, beliefs and attitudes of the mathematics teacher: a model. Journal of Education for Teaching: International research and pedagogy, 15(1), 13-33.
Furinghetti, F., & Pehkonen, E. (2002). Rethinking characterisations of beliefs. In G. Leder, E. Pehkonen, & G. Törner (Eds.), Beliefs: A hidden variable in mathematics education? (pp. 39–57). Dordrecht: Kluwer Academic Publishers.
Hannula, M., & Oksanen, S. (2016). The effect of teacher beliefs on student affect and achievement. Paper presented at the conference of the 13th International Congress on Mathematical Education, Hamburg, Germany.
Hill, C. E., Thompson, B., & Williams, E. N. (1997). A guide to conducting consensual qualitative research. The Counseling Psychologist, 25(4), 517-572.
Hoyles, C. (1992). Mathematics teaching and mathematics teachers: A meta-case study. For the Learning of Mathematics, 12(3), 32–44.
Kementerian Pendidikan dan Kebudayan Indonesia. (2013). Lampiran Peraturan Menteri Pendidikan dan Kebudayaan Indonesia no. 65 tahun 2013: Standar proses untuk satuan pendidikan dasar dan menengah [The attachment of the decree of the Minister of Education and Culture of Indonesia no. 65 year 2013: The process standard for elementary and secondary school]. Retrieved on 16 November 2015 from
Leatham, K. R. (2006). Viewing mathematics teachers’ beliefs as sensible systems. Journal of Mathematics Teacher Education, 9(1), 91-102.
Li, M., & Yu, P. (2010). Study on the inconsistency between a pre-service teacher’s mathematics education beliefs and mathematics teaching practice. Journal of Mathematics Education, 3(2), 40-57.
McCarty, J. A., & Shrum, L. J. (1997). Measuring the importance of positive constructs: A test of alternative rating procedures. Marketing Letters, 8(2), 239-250.
Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17–59). San Diego: Academic Press.
Paulhus, D. L. (2017). Socially desirable responding on self-reports. In V. Zeigler-Hill, T.K. Shackelford (eds.), Encyclopedia of Personality and Individual Differences (pp. 1-5). Springer,
Peterson, R. A. (2000). Constructing effective questionnaires. Thousand Oaks: Sage Publication Inc.
Philipp, R. A. (2007). Mathematics teachers’ beliefs and affect. In F. K. Lester (Ed.), Second handbook of research on mathematics teaching and learning: A project of the national council of teachers of mathematics (pp. 257-315). Charlotte, NC: Information Age Publishing.
Raymond, A. M. (1997). Inconsistency between a Beginning Elementary School Teacher’s Mathematics Beliefs and Teaching Practice. Journal for Research in Mathematics Education, 28(5), 550-576.
Rott, B. (2019, in press). Teachers’ behaviors, epistemological beliefs, and their interplay in lessons on the topic of problem solving. International Journal of Science and Mathematics Education.
Safrudiannur, & Rott, B. (2017). Teachers’ beliefs and how they correlate with teachers’ practices of problem solving. In B. Kaur, W. K. Ho, T. L: Toh, B. H. & Choy (Eds), Proceedings of the 41st Conference of the International Group for the Psychology of Mathematics Education, Vol. 4 (pp. 121-128). Singapore: PME.
Safrudiannur, & Rott, B. (2018a). The different mathematics performances in PISA 2012 and a curricula comparison: enriching the comparison by an analysis of the role of problem solving in intended learning processes. Mathematics Education Research Journal, online first,
Safrudiannur, & Rott, B. (2018b). Evaluation of a questionnaire for studying teachers’ beliefs on their practice (TBTP). In B. Rott, G. Törner, J. Peters-Dasdemir, A. Möller, & Safrudiannur (Eds.), Views and Beliefs in Mathematics Education: The Role of Beliefs in the Classroom (pp. 227–238). Berlin: Springer.
Schoenfeld, A. H. (2015). What counts, when? Reflection on beliefs, affect, attitude, orientations, habits of mind, grain size, time scale, context, theory, and method. In B. Pepin and B. Roesken-Winter (Eds.), From beliefs to dynamic affect systems in mathematics education (pp. 395–404). Switzerland: Springer International.
Schuessler, K., Hittle, D., & Cardascia, J. (1978). Measuring responding desirably with attitude-opinion items. Social Psychology, 41(3), 224-235.
Skott, J. (2001). Why belief research raises the right question but provides the wrong type of answer. Paper presented at the 3rd Nordic Conference on Mathematics Education, Kristianstad, Sweden.
Skott, J. (2015). Towards a participatory approach to ‘beliefs’ in mathematics education. In B. Pepin and B. Roesken-Winter (Eds.), From beliefs to dynamic affect systems in mathematics education (pp. 3–23). Switzerland: Springer International.
Speer, N. M. (2005). Issues of methods and theory in the study of mathematics teachers’ professed and attributed beliefs. Educational Studies in Mathematics, 58(3), 361-391.
Steenkamp, J., de Jong, M., & Baumgartner, H. (2010). Socially desirable response tendencies in survey research. Journal of Marketing Research, 47(2), 199-214.
Thompson, A. G. (1984). The relationship of teachers’ conceptions of mathematics and mathematics teaching to instructional practice. Educational Studies in Mathematics, 15(2), 105–127.
Thompson, A. G. (1992). Teachers’ beliefs and conceptions: A synthesis of the research. In D. A. Grouws (Ed.), Handbook of research on mathematics teaching and learning: A project of the National Council of Teachers of Mathematics (pp. 127-146). New York, NY, England: Macmillan Publishing Co, Inc.
Van Zoest, L. R., Jones, G. A., & Thornton, C. A. (1994). Beliefs about mathematics teaching held by pre-service teachers. Mathematics Education Research Journal, 6(1), 37–55.
Zohar, A., Degani, A., & Vaaknin, E. (2001). Teachers’ beliefs about low-achieving students and higher order thinking. Teaching and Teacher Education, 17(4), 469-485.