Peer Course Review

Roles and Responsibilities

Rubric Scoring Summary

The Quality REACHE Rubric consists of 40 standards assigned different points (3, 2, or 1) depending on their relative importance. Courses are reviewed by a team of three (3) reviewers.

Standards and Points: 14 of the standards are considered essential in a quality online course and have the highest point value of three (3). (A course must meet all of these standards to meet expectations and attain recognition.) The remaining 26 standards are assigned 1 or 2 points.

Standards assigned three (3) points: Essential in a quality online course

Standards assigned two (2) points: Very important but not essential

Standards assigned one (1) point: Important but not essential

Rating procedure: Each reviewer rates each standard by deciding whether or not the course meets the standard (i.e., either “yes” the course meets the standard, or “no” it doesn’t.) The overall team score for each standard is based on its points and majority rule. One score per standard based on the majority. If a majority of the review team rates “yes,” the course receives full score for that standard depending on its points. If a majority of the review team rates “no,” the course receives no points for that standard. See example below.

Standard	Points	Team of 3 Reviewers		Points awarded
		# of Yes’s	# of No’s
Standard 1 (essential)	3 points	2	1	3
Standard 2	2 points	3	0	2
Standard 3	2 points	1	2	0
Standard 4	1 point	0	3	0
Standard 5	1 point	3	0	1

In this example, the course received 3 points for Standard 1 since 2 out of 3 reviewers gave it a YES, and received no points for Standard 4 since 2 out of 3 gave it a NO.

For each of the standards, at least 2 out of 3 reviewers must rate it as a “YES.”

Point system: The maximum number of possible points is 80. To meet expectations and attain recognition, the course must receive:

1) A scoring of "3" on all of the essential standards (42 pts total.), and

2) A total overall score of 68 points.

Why an 85% to meet expectations?

The Project Management Team believes that an 85% meets expectation score achieves the best balance between assessing quality and minimizing risk. Because of the number of standards and points involved, an 85% to meet expectations means that a course can fail to meet between 6-12 standards (depending on the points of the unmet standards) and still meet expectations and attain recognition. This is because of the relative distribution of points for the 40 standards:

Point Distributions: 14 standards required x 3’s = 42 points

12 standards x 2’s = 24 points;

14 standards x 1’s = 14 points

Total Points: 80 points

Meets Expectations: 85% (68 pts.) means 28-34 (70-85%) standards met,

6-12 (15-30%) standards not met.

QR Rubric Scoring Summary 10/5/2006