Aggregating Partial Rankings with Applications to Peer Grading in Massive Online Open Courses

I. Caragiannis, G. Krimpas, A. Voudouris

Election type Ordinal
Culture Mallows
Candidates {5, 8, 12}
Voters {1000}
Each agent ranks a subset of 5, 8, or 12 other agents.
Instances 50
not clearly stated, but assumed based on other experiments
Parameters Different value of phi parameter for different voters.
Notes Each vote is a partial ranking that is based on a ground-truth ranking with some Mallows noise added.
Motivation peer grading