Teacher Education Summary Data 2021-2022

2021-2022 Annual Reporting Measures based on data collected during 2020-2021

Measure 1: Completer Effectiveness (Component R4.1)

Data below is from the NExT Common Metrics Supervisor Survey conducted in Spring 2021. The response rate for this survey was 54% based on reachable supervisors of first-year teachers during the 2020-2021 academic year who were graduates of MSUM.

According to the NExT Teacher Effectiveness Work Group (2018), “Common Metrics surveys have been psychometrically analyzed for factors related to teaching such as planning for instruction, instructional practices, assessment, and professionalism.” An additional factor, student engagement, has also been found. Teachers who utilize effective student engagement strategies also tend to positively impact student learning. The items below represent the six survey items aligned to the student engagement factor (NExT Teacher Effectiveness Work Group, 2018). Based on the Supervisor Survey data presented below, MSUM graduates display strong student engagement skills during their first year of teaching.

NExT Teacher Effectiveness Work Group. (2018). Preparing effective teachers: Multiple approaches to ensuring teaching quality and impact. M. Sato & R.M. Lloyd (Eds.). Minneapolis, MN: Network for Excellence in Teaching. Retrieved from: nextdigitalhandbook.org

  # Mean SD
Develops and maintains a classroom environment that promotes student engagement.
#
41
Mean
3.86
SD
0.52
Creates a learning environment in which differences such as race, culture, gender, sexual orientation, and language are respected.
#
41
Mean
3.59
SD
0.49
Clearly communicates expectations for appropriate student behavior.
#
41
Mean
3.61
SD
0.54
Responds appropriately to student behavior.
#
41
Mean
3.59
SD
0.58
Helps students work together to achieve learning goals.
#
41
Mean
3.54
SD
0.50
Helps students regulate their own behavior.
#
41
Mean
3.49
SD
0.55

Note. Scale: 1 = Disagree; 2 = Tend to Disagree; 3 = Tend to Agree; 4 = Agree.
a“Unable to Respond” responses were excluded from the mean calculation.

Measure 1: Completer Impact (Component R4.1)

Data for Measure 1: Completer Impact is currently under development/not yet available due to completion of Phase 1 of the NExT Teacher Effectiveness Project (see 2020-2021 annual reporting measures for a summary of the project). A phase-in plan to complete a new project that includes more direct measures of completer impact in the classroom is currently in the beginning stages. The EPP plans to annually collect evidence from a sample of completers beginning in Spring 2023. Data for this measure are expected to become available to the public by Spring 2024.

Measure 2: Satisfaction of Employers and Stakeholder Involvement (Components R4.2 | A.4.1 | 5.3)

Initial Programs: Satisfaction of employers is evidenced from quantitative responses and qualitative comments provided on the NExT Common Metrics Supervisor Survey (SS). This data represents the 2020-2021 academic year. Survey data represents responses from all undergraduate programs at MSUM.

MSUM 2020-2021 Response Rate:

Supervisor Survey (SS) = 54% of reachable supervisors

Each NExT Common Metrics survey is designed to collect information related to four constructs: Professionalism, Learning Environment, Diverse Learners, and Instructional Practice. The below summaries provide information related to each construct. Data indicates consistency across annual reporting years.

Means are based on a four-point scale.

Professionalism (SS):

  # Mean SD
Acts as an advocate for all students.
#
41
Mean
3.73
SD
0.50
Collaborates with parents and guardians to support student learning.
#
41
Mean
3.61
SD
0.49

Note. Scale: 1 = Disagree; 2 = Tend to Disagree; 3 = Tend to Agree; 4 = Agree.
a“Unable to Respond” responses were excluded from the mean calculation.

Consistently, supervisors of MSUM graduates indicate candidates demonstrate positive skills within this area. The means on a four-point scale indicate strong employer satisfaction in this area.

Learning Environment (SS):

  # Mean SD
Clearly communicates expectations for appropriate student behavior.
#
41
Mean
3.61
SD
0.54
Helps students regulate their own behavior.
#
41
Mean
3.49
SD
0.55

Note. Scale: 1 = Disagree; 2 = Tend to Disagree; 3 = Tend to Agree; 4 = Agree.
a“Unable to Respond” responses were excluded from the mean calculation.

Skills within the Learning Environment scale continue to be an area of strength for MSUM completers. The two items within MSUM’s 2020 data having the lowest means in this scale (Clearly communicating expectations for appropriate student behavior (M = 3.55) and helping students regulate their own behavior (M = 3.38)) show an upward trend in 2021, indicating that supervisors perceive MSUM graduates have strong skills related to learning environments.

Diverse Learners (SS):

  # Mean SD
Effectively teaches students from culturally and ethnically diverse backgrounds and communities.
#
41
Mean
3.56
SD
0.50
Differentiates instruction for students with IEPs and 504 plans.
#
41
Mean
3.59
SD
0.54

Note. Scale: 1 = Disagree; 2 = Tend to Disagree; 3 = Tend to Agree; 4 = Agree.
a“Unable to Respond” responses were excluded from the mean calculation.

Generally speaking, data indicates that item means within this scale are trending upward across the three most recent data cycles. Additionally, the two items which showed a decrease in means over time: 1) Effectively teaches students from culturally and ethnically diverse backgrounds and communities (2018 M = 3.64, 2019 M = 3.63, and 2020 M = 3.52) and 2) differentiates instructions for students with IEPs and 504s (2018 M = 3.57, 2019 M = 3.66, and 2020 M = 3.55) show improvement in the 2021 data above.

Instructional Practice (SS):

  # Mean SD
Effectively teaches the subject matter in his/her licensure area.
#
41
Mean
3.83
SD
0.38
Selects instructional strategies to align with curriculum standards.
#
40
Mean
3.73
SD
0.45

Two items within Instructional Practice supervisors consistently indicate as areas of strength are highlighted above. The 2021 data also shows an increase in these two areas from 2020 data on the same items (2020 data: M = 3.66 and M = 3.69, respectively).

Sample of Qualitative Comments from Supervisor Survey:

[New teacher] is a great addition to … Elementary. She is a caring and nuturing teacher. She collaborates with colleagues in her grade level as well as support staff in the building. We are happy to have [New teacher] on our Team!

[New teacher] has been an amazing addition to our staff. She is mature beyond her years and is a natural teacher!

[New teacher] has been a great addition to our teaching staff. Thanks for doing a great job getting her ready to teach during a COVID challenging first year.

[New teacher] gets it! she She was one of my best hires ever. She will be a master teacher in a short time.

[New teacher] is an excellent instructor and educational leader. We had a great year together and I know great things are ahead for him.

Advanced Programs: Satisfaction of employers and stakeholder involvement data is gathered through a structured focus group process. Below is a summary of employer responses during focus groups completed during the 2020-2021 academic year.

Focus Group Question Summary of Responses
Focus Group Question
Describe the strengths of MSUM’s completers in relation to job expectations.
Summary of Responses
  • Have a history with the school (hire within)
  • Strong elementary/middle/high school background
  • Bright and hit the ground running.
  • Flexible
  • Willing to work hard
  • Knowledgeable – they have the necessary skills
  • Able to work with teams
  • Solid foundation
  • Good work ethic
  • Independent thinkers but also they accept correction and feedback
  • Confident. They know it is ok to have a different opinion than others and also know it is ok to ask for help
  • Good at summarizing information, reformulating it and clarifying
  • Focused on licensing
  • Collaborative,
  • Flexible course offerings (online)
Focus Group Question
Overall, are you satisfied with the completers from this program? Why or why not?
Summary of Responses
  • Very satisfied
  • I am impressed with how much MSUM reaches out to various stakeholders
  • Yes, graduates are well trained in a broad range of skills. They are leaders and are willing to work in both large/urban and small/rural districts
  • Yes, they are knowledgeable in assessment, behavior, mental health, MTSS, culture…
  • We are beyond satisfied. Your graduates are leaders and in leadership positions.
  • Yes, we have never had a problem with one of your graduates
  • We hire a lot [of MSUM completers] – we’ve been very, very satisfied
  • Do a good job about educating them about licensure –
  • MSUM is dedicated to master’s level coursework

Measure 3: Competency at Completion (Component 3.3)

Pass rate data is reported based on Title II data. Title II definitions are as follows:

  • Pass rate = The percentage of students who passed assessment taken for an initial teaching credential in the field of preparation.
  • Single assessment pass rate: The percentage of students who passed the assessment among all who took the assessment.
  • Summary pass rate: The percentage of students who passed all tests they took for their area of specialization among those who took one or more tests in their specialization areas.

MTLE Summary Pass Rates (Pedagogy) -

  • Early Childhood (n = 26)
    • Subtest 1 = 100%
    • Subtest 2 = 100%
  • Elementary (n = 103)
    • Subtest 1 = 100%
    • Subtest 2 = 96%
  • Secondary (n = 61)
    • Subtest 1 = 93%
    • Subtest 2 = 95%

Content area first attempt passing rates range from 80% to 100%. Specific passing rates are not publicly reported due to low n’s in several content areas.

Median GPA - Undergraduates

Median GPA of individuals accepted into the program Median (Average) – 3.56 (3.51)
Median GPA of individuals completing the program Median (Average) – 3.54(3.49)

Measure 4: Ability of Completers to Be Hired in Education Positions for Which They Have Prepared (initial & advanced levels)

Graduate employment rates are presented by major within each academic college.