The Kloser lab explores issues related to cognition and instruction in STEM education, especially K-12 science education. Recently, the lab has focused on three research strands:
- conceptions of STEM education and their implications for instruction;
- the correlation between core science instructional practices and student outcomes; and
- biology education
Projects
Click the title of the project to view the description.
Core Practices: UPTAKE
Core Practices: UPTAKE
Research on teaching practice has recently gained attention as an effective lever for improving student engagement and achievement. Recent studies have shown that even more than years of teaching experience or degree held, the instructional practice that occurs in K-12 classrooms is the best predictor of student learning. Given the limited amount of time and resources available for preparing new teachers, identifying and helping novices take up a small set of effective, content-specific practices, has great potential for improving the education of students in our nation's schools.
This program of researching draws on the emerging work of core instructional practices. Fueled by work with the Core Practice Consortium (https://www.corepracticeconsortium.com/), this series of studies focuses specifically on how science teachers learn and engage core practices like facilitating sensemaking discussions and how students participate in these experiences.
Quality Assessment in Science (QAS)
Quality Assessment in Science (QAS)
The Quality Assessment in Science Professional Development (QAS PD) project is a joint research endeavor between researchers and teacher educators at the University of Notre Dame and Stanford University investigating teachers' conceptions and practices across a year-long intervention using portfolios of assessment and data-use artifacts. This work builds on previous iterations of QAS Notebook studies in collaboration with Felipe Martinez (PI) at UCLA and Brian Stecher (Co-PI) at RAND Corporation, funded in part by the Spencer Foundation and the W.T. Grant Foundation.
In this current studies, we use the Notebook as a means for professional development. Teams of middle school science teachers from four schools in two states were trained to reflect on artifacts in these portfolios - assessment tasks, student samples, and annotations of the artifacts - in light of nine dimensions of effective practice. Drawn from the literature, the nine Dimensions used during the PD and the professional learning communities (PLCs) include:
Dimension 1: Setting Clear Learning Goals
Dimension 2: Aligning Assessments to Goals
Dimension 3: Assessing Frequently
Dimension 4: Varying Assessment
Dimension 5: Assessing with Appropriate Cognitive Complexity
Dimension 6: Reflecting Math/Science Practices
Dimension 7: Involving Students in Own Assessment
Dimension 8: Providing Specific Feedback
Dimension 9: Using Evidence of Student Thinking to Adapt Instruction
Participating teachers collected an initial 10-day Notebook prior to an intensive professional development where they were introduced to and used the Dimensions to reflect on their own practice (Figure 1). During the school year, teachers met in PLCs on a monthly basis, collecting shorter 5-day Notebooks and reflecting on specific Dimensions. A final Notebook was collected one year after the initial baseline collection.
Quality Instruction in Science (e-QIS)
Quality Instruction in Science (e-QIS)
This project is focused on developing, deploying, and evaluating a new generation of teacher portfolio instruments based on modern tablet technology. The project is a collaboration between a multidisciplinary team of experts in assessment, science education, and technology aimed at helping researchers and practitioners monitor, assess, and improve instruction in middle school science classrooms aligned to the Next Generation Science Standards (NGSS).
Building on prior successful portfolio systems, a new electronic portfolio platform has been developed and tested using a mixed methods validation study. A sample of 40 volunteer middle school science teachers collected two 10-day Notebooks. Teachers collected evidence of their instruction using the electronic portfolios, and this evidence was scored by a group of experienced raters and experts using a set of guidelines of instructional practice aligned to the Next Generation Science Standards. Advanced quantitative methods, including multifaceted generalizability theory, factor analysis, and hierarchical linear models, was used to assess the properties of portfolio data against other teacher measures. An additional set of ratings investigated the reliability of rating Notebooks based on a smaller sample of days rated.
Qualitatively, the e-QIS Notebook was used in the context of a professional learning community (PLC). This study investigated the following research questions:
- What do teachers learn from engaging in PLCs using the e-QIS Notebook and Dimensions?
- In what ways, if at all, are new understandings translated into practice?
- What is the nature of PLC discussions when using the e-QIS app and Dimensions?
- What decisions do teachers make in collecting and selecting artifacts using the e-QIS app?
- How do teachers envision the use of the e-QIS app for the following purposes:
- Self-identified professional growth;
- Alignment with school PD goals;
- Professional evaluation?
Reading Nature
Reading Nature
Texts play a critical role in science research and science classrooms, yet most K-12 textbooks have failed to represent the epistemic elements of the science disciplines, including the justification of claims or references to empirical data. This line of research investigates students' reading experiences when engaging alternative text types that are more epistemologically considerate, that is, texts that better convey both what we know and how we know it to be true.
Using narratives of historical experiments, these brief narrative texts have been shown in initial randomized trials to result in more interest from students, equivalent comprehension of core biology ideas, and higher performance on transfer tasks when compared to traditional textbook accounts. Current research is focusing on how students engage these alternate text types in group discussions and the impact of their use over the course of an entire year.
As a result of these studies, we look to create a set of historical narratives that are more epistemologically considerate than traditional science texts that can be used, in alignment with the Next Generation Science Standards and the Common Core Literacy Standards for Science, in middle and high school science classrooms.
STEM School Transformation
STEM School Transformation
The formation of STEM-focused schools has been a priority for local school systems and state and national policymakers. Yet despite calls for 1,000 new STEM-focused schools within the next decade, little consensus exists on what defines a STEM-focused school and the process by which they come to be. As greater emphasis is placed on the formation of STEM-focused schools we, as a research field, must better understand the process by which STEM-focused schools develop and how such transformations impact student outcomes and teacher practices in order to improve their outcomes across different contexts.
Our research explores the emergence of a more contemporary phenomenon - the formation of STEM-focused Catholic schools. Our research addresses the following research questions:
- What factors define a Catholic STEM-focused school?
- What are the critical components of a Catholic STEM-focused school?
- How does a STEM transformation impact the nature of schooling?
Publications
-
In review_Influences of professional development on middle school science teachers’ mental models of assessment practice.
Wilsey, M., Kloser, M., Borko, B., Rafanelli, S. Middle School Science Teachers' Conceptions of Assessment Practice Throughout a Year-long Professional Development Experience.
-
2019_Teaching and Teacher Education
Kloser, M., Wilsey, M., Madkins, T., Windschitil, M., (in press). Connecting the dots: Linking frameworks for facilitating discussion to novice teacher practice. Teaching and Teacher Education.
-
2018_School Science and Mathematics
Kloser, M., Wilsey, M., Immonen, A., Navotas, A., Twohy, K. (in review). “We do STEM”: Unsettled conceptions of STEM education in middle school STEM classrooms.
-
2018_Routledge
Rafanelli, S., Borko, H., Kloser, M., Wilsey, M. (2018). From focusing on grades to exploring student thinking: A case study of change in assessment practice. In Fives, H. and Barnes, N. (Eds) Data use. London: Routledge.
-
2018_NSTA Press
Kloser, M. and Troy, S. (2018). Reading nature: Engaging biology students with evidence from the living world. Arlington, VA: NSTA Press.
-
2018_National Academies of Sciences, Engineering, and Medicine
Kloser, M. (2018). The nature of the teacher’s role in supporting student investigations in middle and high school science classrooms: Creating and participating in a community of practice. A report commissioned by the National Academies of Sciences, Engineering, and Medicine. Washington D.C.
-
2018_In P. Grossman and M. Franke (Eds), Teaching core practices in teacher education.
Kelly-Peterson, M., Davis, Ghousseni, H., Kloser, M., and Monte-Sano, C. (2018). Rehearsals as approximations of practice. In P. Grossman and M. Franke (Eds), Teaching core practices in teacher education. Cambridge, MA: Harvard Education Press.
-
2017_Science Education
Kloser, M., Borko, H., Martinez, F., Stecher, B., Luskin, R. (2017). Evidence of middle school science assessment practice from classroom-based portfolios, Science Education, 101(2), 209-231.
-
2017_Journal of Science Teacher Education
Davis, E., Kloser, M., Windschitl, M., Wells, A., Carlson, J., Marino, J-C. (2017). Teaching the practice of leading sense-making discussions in science: Using rehearsals, Journal of Science Teacher Education, 28(3), 275-293.
-
2017_Cultural Studies in Science Education
Kloser, M., Wilsey, M., Hopkins, D., Dallavis, J. W., Lavin, E., and Comuniello, M. (2017). Dual identities: Organizational negotiation in STEM-focused Catholic schools. Cultural Studies in Science Education, 1-31.
-
2016_Journal of Science Education
Kloser, M. (2016). Alternate text types and student outcomes: An experiment comparing traditional textbooks and more epistemologically considerate texts, International Journal of Science Education, 38(16), 2477-2499.
-
2015_The Science Teacher
Kloser, M. and Wilsey, M. (2015). No blue ribbon: Reforming science fairs in middle and high school science education, The Science Teacher, 82(8).
-
2015_Studies in Higher Education
Kloser, M. J. and Brownell, S. E. (2015). Toward a conceptual framework for measuring the effectiveness of course-based undergraduate research experiences in undergraduate biology. Studies in Higher Education, 1 – 20.
-
2014_Journal of Research in Science Teaching
Kloser, M. (2014). Identifying a core set of science teaching practices: A Delphi expert panel approach. Journal of Research in Science Teaching, 51(9), 1185 – 1217.
-
2014_Environmental Education Research
Kloser, M. & Bofferding, L. (2014). Middle and high school students’ conceptions of climate change mitigation and adaptation strategies. Environmental Education Research.
-
2013_Journal of College Science Teaching
Kloser, M., Brownell, S., Fukami, T., Shavelson, R. (2013). Effects of a research-based ecology lab course: A study of non-volunteer achievement, self-confidence and perception of lab course purpose. Journal of College Science Teaching, 42(3), 72 – 81.
-
2013 _Journal of Research in Science Teaching
Kloser, M. (2013). Exploring high school biology students’ engagement with more and less epistemologically considerate texts. Journal of Research in Science Teaching, 50(10), 1232 – 1257.
-
2013 _Journal of Microbiology & Biology Education
Brownell, S., Kloser, M., Fukami, T., & Shavelson, R. (2013). Context Matters: Volunteer Bias, Small Sample Size, and the Value of Comparison Groups in the Assessment of Research-Based Undergraduate Introductory Biology Lab Courses. Journal of Microbiology & Biology Education : JMBE, 14(2), 176–182.
Conferences
-
2018_NARST_Atlanta, GA
Rafanelli, S., Borko, H., Kloser, M., Wilsey, M. (2018). Science teachers’ changing assessment practices: Case studies of individual change through PD and professional collaboration. A Paper for the Annual Meeting of the National Association of Research on Science Teaching. Atlanta, GA.
-
2018_AERA_New York, NY
Kloser, M., Borko, H., Wilsey, M., Rafanelli, S. (2018). Leveraging portfolios in professional development for middle school science teachers’ assessment and data-use practice. A Paper for the Annual Meeting of the American Educational Research Association. New York, NY.
-
2018_AERA_New York, NY
Kloser, M., Wilsey, M., Madkins, T., Windschitl, M., Wells, A., Carlson, J., Davis, B. (2018). Connecting the dots: Secondary science teacher candidates’ uptake of facilitating discussions from teacher education experiences. A Paper for the Annual Meeting of the American Educational Research Association. New York, NY.
-
2018_AERA_New York, NY
Martinez, J. F., Stecher, B., Kloser, M….(2018). Measuring instruction using classroom artifacts and portfolios: Evidence from four recent studies. A Symposium for Annual Meeting of the National Council on Measurement in Education. New York, NY.
-
2018 _AERA_Washington, DC
Davis, B., Kloser, M., Windschitl, M., Wells, A., Carlson, J. (2016). Teaching the practice of leading sensemaking discussions in science: Using rehearsals. A Paper for the Annual Meeting of the American Education Research Association. Washington DC.
-
2017_NARST_San Antonio, TX
Kloser, M., Gottlieb, J., Wilsey, M., Svarovsky, G. N., Kirkland, P., Puricelli, J. (2017). Exploring the relationship among middle grade teacher’s conceptions of STEM and equity. A Paper for the Annual Meeting of the National Association of Research on Science Teaching. San Antonio, TX.
-
2017_AERA_San Antonio, TX
Rafanelli, S., Borko, H., Kloser, M., Wilsey, M. (2017). From focusing on grades to exploring student thinking: A case study of change in assessment practice. A Paper for the Annual Meeting of the American Educational Research Association. San Antonio, TX.
-
2016_NARST_Baltimore, MD
Kloser, M., Borko, H., Wilsey, M., Rafanelli, S. (2016). Science teachers’ use of data for instructional decisions: Mental models of middle school science assessment practice. A Paper for the Annual Meeting of the National Association of Research for Science Teaching. Baltimore, MD.
-
2016_NARST_Baltimore, MD
Kloser, M., Wilsey, M., Hopkins, D., Dallavis, J., Lavin, E., Comuniello, M. (2016). Dual identities: Toward a framework for STEM-focused Catholic schools. A Paper for the Annual Meeting of the National Association of Research for Science Teaching. Baltimore, MD.
-
2016_EARLI_Oslo, Norway
Martinez, F., Riedell, K., Rocchio, R., Srinivasan, J., Kloser, M., Wilsey, M., Stecher, B. (2016). Next generation tablet e-portfolio tool for documenting and reflecting on instructional practice: Possibilities for teacher evaluation and development. A Paper for the Annual Meeting of the European Association for Research on Learning and Instruction. Oslo, Norway.
-
2016_AERA_Washington, DC
Martinez, J. F., Kloser, M., Srinivasan, J., Riedell, K., Stecher, B., Rocchio, R., Wilsey, M., Tangmunarunkit, H. (2016). A tablet-based teacher e-portfolio tool for documenting and reflecting on next generation science instruction. A Paper for the Annual Meeting of the American Education Research Association. Washington DC.
-
2014_NARST_Pittsburgh, PA
Kloser, M., Borko, H., Martinez J. F., Stecher, B., Luskin, R. (2014). Portraits of assessments: The intended and enacted assessments in middle school science classrooms. A Paper for the Annual Meeting of the National Association of Research for Science Teaching. Pittsburgh, PA.