Design Question 5

A music teacher is in charge of evaluating student performances at a musical competition. Numerous judges are available to judge the students, but each judge only evaluated two or three performances. The response variable is based on a performance-rating scale.

Fifty students were evaluated by 50 judges. Judges were randomly assigned to teams of two or three, and each member of the team evaluated the two or three student performances randomly assigned to that team. Results were compared across judges to determine a winner. The instructor was dissatisfied with this approach and would like to analyze additional competition data using a better model.

Identify the original design. Identify any weaknesses in the design. Faced with the same sort of constraints, how might you design this experiment?