Against letter grades

Next semester, no quantitative grades until the end of the semester. No As, no Fs, no 83%. At least one study has shown that grades not only do not help students, they actually impede their performance (Butler, 1987). Students tend to take a horse-race approach to grading, and pay less attention to how they are doing and more to whether their grade on one assignment has gone up or down in comparison with the previous assignment, or various satisficing strategies for achieving whatever they have set as their minimum acceptable grade.

I am already using self-assessment in all of my classes. Rather than giving letter grades, I will list the strengths and weaknesses of each student’s work, and leave the assessment–in terms of grade–until the very end of the semester. Of course, I would prefer to go all Evergreen, and have narrative grades make up the final grade in the class, but I don’t think this can happen at my university.

I have toyed with another possibility, which is not assigning a grade, but rather force-ranking students and revealing to them where they land on that ranking. As a matter of practice, in large undergraduate classes, I have often force-ranked assignments, in order to make sure that all my Bs were grouped together, all Ds together, etc., and that I hadn’t somehow mis-evaluated a project. Moreover, students can estimate their ranking when they see the histogram (when I provide one, which is rare). And at some essential level, this is what we are doing when we grade: my grades at QU are essentially a comparison of work I’ve seen at QU. It would be unfair to compare them to, for example, students in a top doctoral program, or students in 9th grade.

Nonetheless, I can’t decide whether the dire knowledge that your assignment was the worst in the class (or the third worst, or whatever) would be so depressing that you would just give up, or if it would spur you to get off the bottom of the list. According to an article that appeared in the Chronicle, a couple of universities have toyed with class rank and similar measures as alternatives to the all-mighty GPA, but these have generally fallen through.

I suspect, however, that class rank on assignments frankly would not change much from assignment to assignment, even if grades varied somewhat more. I wonder whether the stability of this rank over time would lead to extreme competition among students. My experience has been that under conditions of such competition (think law school) students actually tend to band together, and that may not be a bad thing.

In any case, I’m trying a structured non-grading approach to my courses next semester. If you’ve had success or failure in doing this, I’d be interested in your feedback.

Butler, R. (1987). Task-involving and ego-involving properties of evaluation: Effects of different feedback conditions on motivational perceptions, interest and performance. Journal of Educational Psychology, 79(4), 474-482.

Posted in Teaching | Tagged , | 6 Comments

Against assessment

When you assess something, you are forced to assume that a linear scale of values can be applied to it. Otherwise, no assessment is possible. Every person who says of something that it is good or bad or a bit better than yesterday is declaring that a points system exists; that you can, in a reasonably clear and obvious fashion, set some sort of a number against an achievement.

But never at any time has a code of practice been laid down for the awarding of points. No offense intended to anyone. Never at any time in the history of the world has anyone–for anything ever so slightly more complicated than the straightforward play of a ball or a 400-meter race–been able to come up with a code of practice that could be learned and followed by several different people, in such a way that they would all arrive at the same mark. Never at any time have they been able to aggree on a method for determining when one drawing, one meal, one sentence, one insult, the picking of one lock, one blow, one patriotic song, one Danish essay, on playground, one frog, or one interview is good or bad or better or worse than another.

Never at any time. Nothing that comes anywhere near a code of practice.

But a code of practice is essential. To ensure that things can be spoken of, fully and frankly. A code of practice is something that could be passed on, maybe not to a character like Jes Jessen, or me, but at any rate to someone like Katarina or a teacher.

But, in all the history of the world, no code of practice has ever existed for the assessment of complex phenomena.

And certainly not for what crops up in the laboratory.

– Peter Høeg, Borderliners: A Novel, pp. 89-90

Posted in Uncategorized | Tagged | 1 Comment

I love it when a course comes together

I’ve turned in the last of my grades, and the semester is over. I was pretty happy with all my courses this semester, and particularly with one of the two versions of the “Introduction to Interactive Communication” seminars I led. It made me think a bit about what makes a course go well or poorly. This is especially acute because I taught two versions of what was essentially the same course–one entirely online, and one mostly in person. And I was surprised at just how different the experience of an online course was in comparison with the off-line course.

ICM 501 Fall 08Ask any professor and they will tell you that some classes just “click.” When I was a TA, a decade ago (yikes), I would teach discussion sections–the same lesson plan four or five times a day. Sure, there was variation according to the content and the process, but there were also glum, depressing sections and sections that were lively and engaged, and it seemed to have very little to do with me. Sure I wasn’t the same person from section to section, but I was (I think) close.

So, what are some of the ingredients? Well, there are some things I might be able to control. For example, the room really makes a difference, I think. I hate the fact that we don’t have enough real seminar rooms to do seminars in. But this year’s course was in a room that I don’t like–tables bolted down and facing front–and that has hosted two of my favorite courses since I’ve been at Quinnipiac.

As much as I hate to say it, size matters. Despite my preference that seminar courses be around 12-14 people, the best grad seminars have always been those with around 20 people. I think that 19-21 range might actually be a sweet spot, though I have no idea why. At that size, I am unable to really give a lot of personalized feedback on the students’ work, but that doesn’t seem to hurt the learning environment as much as I would like to think.

It helps to have some really brilliant people in the class. That seems obvious, but it isn’t. I mean, logically, it would be good to have people all at the same “level,” but in my experience so far, the best classes are those in which there is a small number–3 or 4 people–who raise the level of discourse in discussions and set the bar for other students.

It is good to have “characters,” those who are interesting and throw a curve ball into the room. They don’t have to be the brightest students, necessarily (though often they are), but they need to be willing to inject themselves into the conversation and give everyone a bit of a kick in the side of the head now and then. I don’t mean a class clown–not exactly–but I do mean people who are showmen or women, who can carry an audience and know it, and who are also engaged in the material of the class.

It’s good not to have people who are either really stupid, but more importantly, best to avoid those who really don’t want to be there. I choose not-too-bright but engaged over bright-but-disengaged any day. It only takes one or two people who just obviously don’t want to be there to ruin a class, and I have rarely been successful in motivating these folks to jump in with us, at least beyond short periods of time. I don’t know what to do about this, but I need to review my strategies.

Ideally, the class feels like a group from an early stage. There are ways we could encourage this (expose them to an extremely stressful event, require a jumping in, or something like that) but it’s hard to know how to do this ethically. I’ve always been a proponent of something like a paint-ball day or skydiving early in the semester–some sort of physical, bonding experience. Short of this, it’s difficult to know how to get students to come together. Actually, a poor classroom experience does a great deal to create an esprit de corps, but that’s cutting off your nose to spite your face. Maybe we could have a sacrificial course at the beginning of a program: a really bad and demanding course taught be an adjunct that would require students to band together out of sympathy and survival. Maybe not.

I’ve always thought food helped to bind students together into a group, but this semester was pretty foodless, suggesting this is not the case.

I’ve also assumed that group projects had an impact, and they can, but students often seem to do better work and learn more when working alone than they do in a group. Let me reiterate: in my experience group work is not as good as individual work. I think in future courses I will encourage single-person projects, but will also group folks into peer support groups, who are charged with reading each other’s stuff, and the like. Not quite sure how to make the mechanics of that work, but it might be a good alternative to group projects.

So, how do you get a class that meets these requirements. One way is to cancel classes smaller than a dozen, even at the grad level. Actually, this is something the dean is pushing us to across the school, and it is particularly difficult in our program because we need to provide enough required classes to allow people to graduate in a timely way. It also plays against my own gut feeling that the smaller the class the better–a feeling that has not born out empirically.

Perhaps it’s a matter of just being thankful for a strong cohort, and for getting to work with a great group of students in all three of my seminars this semester. Hopefully, this does not portend an outlier on the other end any time soon.

Posted in General | Tagged , | 6 Comments

The 1-1-1 map

I live in a part of New York that is sometimes called Manhattan Valley. You wouldn’t know why until seeing this snapshot from Google Earth. Though almost all of lower Manhattan now has skinned buildings, my area does not. It’s ironic, since the building across the street (at 100th and Broadway), which shows as a construction site on Google Earth, is now one of the tallest in more than 30 blocks. I’m not complaining, really, just surprised to see this depression–it looks like a giant footprint, right in my neighborhood.

More broadly, I’ve found myself in the strange position of visiting old houses and neighborhoods in Google Earth, and on the web. I stroll down Motomachi and note a new Gap–they show up everywhere these days. As do, it seems, the Street View vans. It made sense that they would start with the large cities, but I somehow didn’t expect them to start covering my old neighborhood in Buffalo (ah, so there’s the neighbor’s new playhouse–they told us about that) or my Mom’s place in California that I’ve never visited, but sits out in a spot that is pretty remote. What happens when the Google car covers the globe? Well, they turn around and do it again, of course. That way we can also roll the clock back.

Google Earth already integrates some photos, those marked on Panoramio, but wouldn’t it be nice to integrate video from YouTube, or images from Picasa (or heck, be more open and include Flickr and Revver). As more of our multimedia becomes time stamped and geotagged, I think we can look forward to records that come close to approximating what was happening at a given time or place. Now, of course, if you are out in the middle of nowhere, the nearest tagged photo may be beyond the horizon and five years old. But in Times Square, you can see photos from last week. Is it that hard to believe that, as more and more phones and cameras include instant uploading, that images from an hour ago, or from five minutes ago, are that far off?

This isn’t some huge leap in technology, this is just charting the current trajectory. What happens when you want to know where your friend is standing and can pull up five views of 82nd and Broadway from your mobile?

Posted in Uncategorized | Tagged , , , , , , , | Leave a comment