5D+™ Rater Reliability Training

Developing reliable evaluators of teachers is a key component to the success of any school district’s teacher evaluation system. Teachers and students benefit from principals and evaluators who are trained and certified to observe, analyze and rate instruction, before they ever step into a classroom to observe a teacher for the purpose of evaluation. Research has indicated that in-depth rater reliability training should happen annually and calibration tune-ups should happen monthly.

What is rater reliability? Rater reliability occurs when an observer of instruction uses an evaluation rubric to observe a lesson and consistently scores each rubric indicator in alignment with expert raters.

The Center for Educational Leadership offers 5D+ rater reliability training institutes to provide opportunities for principals and district staff to become certified using the 5D+ Teacher Evaluation Rubric. Participants who successfully complete the institute are certified in their ability to use a video observation to align instructional practices to the 5D+ Rubric. These sessions engage leaders in discussions of best practices in evaluation and calibration, and significant opportunities to practice scripting, coding and rating classroom videos. Through discussion with their colleagues, principals become increasingly aligned in their calibration to the rubric.   

Institute Overview:

  • Day 1: 5 Dimensions of Teaching and Learning; 5D+ Teacher Evaluation Rubric examples.
  • Day 2: Rater reliability protocol; Scripting and coding practices; Identifying evidence connected to 5D dimensions and 5D+ indicators using video observations. Match scripted evidence to 5D+ indicators with 35% accuracy.
  • Day 3: Continue to develop effective scripting and coding practices; Continue identifying evidence connected to 5D dimensions and 5D+ indicators using video observations. Match scripted evidence to 5D+ indicators with 55% accuracy.
  • Day 4: Refine effective scripting and coding practices; Refine ability to identify evidence connected to 5D dimensions and 5D+ indicators using video observations; Match scripted evidence to 5D+ indicators with 70% accuracy.

Calibration Tune-Ups

CEL also offers shorter “Calibration Tune-ups” designed to be completed more regularly in shorter chunks of time across the year. The research suggests that calibration is a process that requires monthly check ins. Calibration Tune-ups are designed to prevent districts from “drifting” from their alignment to the standards.  

Technology Requirements:

Participants will need to bring to the training institute a laptop, tablet or smartphone that can be used to check work email and browse the Web via Wi-Fi or cellular data networks.

Upcoming Training Institutes


Contact us to schedule a training institute for your district.