P2 Grades

by Mike Gleicher on November 10, 2012

Yes, P2 grades are still delayed. But I thought I should explain what you will get, which might also give you an idea why it takes so long.

Both Mark and I evaluated your games based on your demo, and playing them a little more afterwards. We tried to evaluate the game itself, without considering the “backstory” of how it was made. As much as possible we tried looking at post-mortems until after we were done with this. This grade is meant to be about how good is this game (in terms of the assignment goals), not necessarily how much we liked it (although, the two are highly correlated). After independently doing this, we traded answers (you should get both). In the event our assessments were different, we re-evaluated. The grade with my assessment is what counts, but it considers Marks comments.

Note that this grade does not correct for “other factors” that we may be aware of – its just based on playing the game. Also, in some cases, we give you a range of grades, or a notation that its closer one way than the other for when we have to determine final grades.

Then I read all of the post-mortems. First, I “graded” the post-mortems independent of what they said. If you put energy into a thoughtful, reflective assessment of what happened, it doesn’t matter if what happened was good or not. That said, it’s actually easier to draw lessons from failures rather than successes, so if things were successful, the expectations are a little lower. Here, things are graded “poor, cursory, ok, good, reflective” – where the categories are all +/- 1.

I wrote a sentence or two of feedback. However, this is really terse and in many cases cursory. The problem is that in the interesting cases, it is difficult for me to make meaningful comments without giving away some of the things your partners said. One of the things that is fascinating (and challenging) about this process is that we often get 3 very different stories – trying to reconcile them is an interesting puzzle. In some cases, I can figure out what I think happened.

One of the things that helps in figuring out what happened is to look across the 3 projects. This is part of the reason why I reserve judging some of the “extra factors” that come out in the post-mortems until the end. From a single project, it might not be obvious how different people contribute from the different accounts, but with a semester’s worth of data, we can actually figure out a lot.

Print Friendly, PDF & Email

Previous post:

Next post: