One of the distinguishing features of the Network for Educator Effectiveness that separates it from other teacher evaluation systems is the training and support principals experience through NEE. NEE training is designed to help principals increase reliability of classroom observations and improve the quality of feedback they provide to teachers, making the evaluation process growth-focused and meaningful.

In NEE training, principals practice scoring classroom observations by watching videos of teachers in the classroom and comparing their scores to master scores. Master scores are generated through an important process called NEE consensus scoring. In this blog, we walk through what consensus scoring is, how it works, and why it’s worth administrators’ time to participate.

What Is Consensus Scoring? 

Returning evaluators – those who have used NEE for at least a year in their schools – have the opportunity to participate in NEE consensus scoring sessions, which are held online during each school year. 

Consensus scoring is a collaborative professional learning activity that brings together evaluators from different districts to score videos of classroom instruction using the rubrics from NEE indicators. 

For example, a classroom video might feature a middle school science lesson where the teacher is facilitating an activity. During the consensus scoring session, evaluators would independently observe and score NEE indicators of effective teaching practice such as checking for understanding, cognitive engagement, and/or use of academic language. Then, participants come together to discuss the evidence they saw and how it aligns with the NEE rubric language. This exchange of perspectives helps calibrate scoring across varied school settings. 

Calibration is one of the main goals of consensus scoring. Each session is designed to help evaluators align their scoring practices through thoughtful discussion and exposure to varied perspectives. Along the way, it also supports learning, builds evaluator confidence, and contributes to a growing database of NEE video scores. 

What Happens in a NEE Consensus Scoring Session? 

1. Group Video Scoring and Discussion (~2 hours) 

  • Evaluators watch two classroom videos together. 
  • For each video, each evaluator independently scores four preselected NEE indicators. 
  • After scoring, the group discusses the evidence they saw and how it connects to the rubric. 
  • The discussion often leads to a narrow range of scores for each indicator — typically one or two scores that reflect the shared reasoning of the group. During the discussion, evaluators share evidence they observed and compare it with their own knowledge from NEE classroom observations. This discussion helps others consider the evidence from different perspectives, which can lead to a change in their scores. Evaluators are encouraged to adjust their scores if they feel persuaded by the evidence or interpretations of others, but only if they are convinced. It’s common and acceptable for some evaluators to maintain their original scores even if they differ from others, as long as they believe those scores still best align with the rubric and observed evidence. 
  • Each evaluator also identifies a focus for feedback, selecting the instructional area they believe would most impact student learning if they were conferencing with the teacher. Participants are encouraged to focus on the area they believe will drive the greatest instructional improvement based on the context of the lesson. 

2. Independent Scoring (~1 hour, flexible) 

  • After the session, evaluators watch two more videos independently. 
  • They score the same four indicators and select a feedback focus for each of the videos. 
  • Scores and focus areas are submitted through an online survey for all four videos – the two discussed during the group session and the two watched independently. 

Who Participates in NEE Consensus Scoring? 

Consensus scoring sessions typically include around 8 evaluators who are building and district administrators from a variety of school districts. 

Participants come from schools of all sizes and regions, with evaluators representing small and large schools and diverse student populations. Additionally, administrators often have specializations in subject areas, non-core classes, or special education, bringing a wide range of experiences and perspectives that enrich the session discussions. 

The varied perspectives shared during the session help everyone grow. 

One of the NEE regional trainers guides the session, sometimes offering questions or reflections to help explore the evidence from the observation. 

What Are the Benefits of Participating in NEE Consensus Scoring? 

  • Administrators sharpen their evaluator skills by comparing their thinking with others. 
  • Administrators gain exposure to different classroom contexts and scoring perspectives. 
  • Administrators contribute to the collective understanding of NEE scoring practices across NEE districts. 
  • There is no travel required, as all sessions are conducted online. 
  • Evaluators stay sharp and connected to best practices. 
  • Completing both the group and independent portions of consensus scoring fulfills the NEE recertification requirement for the following year, meaning evaluators who participate will not need to complete summer training. 

How Can Administrators Register Their Interest in Consensus Scoring? 

When principals complete NEE recertification training each year, they will be asked whether they would like to be included in the pool of potential consensus scorers. 

Consensus scoring offers meaningful professional learning, calibration with peers, and helps strengthen the NEE system as a whole. We hope administrators will continue to say yes to this opportunity!

Questions? 

If you have questions about NEE consensus scoring, reach out to the NEE Help Desk or any of our training & field support staff.  We’re happy to talk more about what participation involves. 

Contributors to this post include the NEE regional trainers who facilitate consensus scoring sessions: Chuck Mayes, Benjy Fenske, Jill Wiseman, and Aaron Jones

The Network for Educator Effectiveness (NEE) is a simple yet powerful comprehensive system for educator evaluation that helps educators grow, students learn, and schools improve. Developed by preK-12 practitioners and experts at the University of Missouri, NEE brings together classroom observation, student feedback, teacher curriculum planning, and professional development as measures of effectiveness in a secure online portal designed to promote educator growth and development.