More on ratings

Slithy Tove” has a reply to my brief comment on “Rate Your Students.” I’ve talked a bit about evaluations before, but I thought I’d address some of his comments. In particular, he is frustrated by the lack of quality in some of his teachers. It does seem that, especially among tenured professors, there are bad teachers at every school. It’s very difficult to get rid of faculty, even those without tenure, so it takes extreme incompetence before anyone has to leave. Even then, the Byzantine bureaucracy of the university means that the process of getting rid of and replacing them takes years.

It is important to choose a school that has a reputation for actually caring what their professors do in the classroom. Law school is a bit different, since even at the research universities, they tend to stress teaching over research. That said, many clearly are more interested in bringing in folks who can add weight through their reputation than can do so through good teaching. So, it’s not always the case that the best ranked schools also have the best teachers.

In some places, and I’m sad to say my current institution is one of them, teaching doesn’t matter that much to tenure or promotion. There are some really excellent teachers, but they are excellent teachers in many ways in spite of the university. I’ve been told that the only way to have your teaching impact a tenure decision is if you bite the students. Another tenured faculty member said that students would have to picket the tenure proceedings in order for bad teaching to stop someone from getting tenure. In other words, excellent student evaluations don’t matter in my school. There is a move afoot to make evaluation reports more easily accessible to students, which I think will help them to choose classes more effectively. But if you are no good at teaching, you don’t mind if people decide not to take your classes.

I have mixed feelings about student evals. I think they do roughly approximate the ability of the teacher. Unfortunately, I know exactly how to improve my evals. First, I raise the average grade in the class: there is a strong correlation between mean grade in a class and teacher evaluation. In fact, some schools (not UB) are now weighting these ratings by the average grade. That again raises problems, because in a small senior seminar or optional graduate class, I may have a dozen students, many of whom deserve the A. The efficacy of the class leads its evaluations to be discounted.

The other way I can improve ratings is to do something a faculty member at my graduate institution did, and build the evaluations into the syllabus, reminding students along the way the ways he was “effectively using information technology,” or “providing timely feedback.” Certainly, this “teaching to the test” in reverse probably led the course to do better in those categories, but he was also aiming (successfully) to manipulate his evaluations.

The best suggestion I’ve heard–this from Tom Feeley, who has studied student evaluations, as well as from others–is that you give the student evaluations five years after the course is over. Yes, we tend to forget traumatic events as time passes ;), but we also find that some of the teaching that we like at the time may not be the work that was really relevant to our lives and careers down the road. Deciding the worth of a class just before a looming final exam may not be the best timing.

This entry was posted in Teaching and tagged . Bookmark the permalink. Post a comment or leave a trackback: Trackback URL.


  1. Posted 2/26/2006 at 4:18 pm | Permalink

    The cat ate your html on this one. I think that the end tag borked.

  2. Posted 2/26/2006 at 4:30 pm | Permalink

    Wow! yes, giving the evals after the fact is a great idea. I know I’m a good teacher. Why? because I get people coming back to me a saying “You, know what? Your course changed the way I think about the world…” or whatever. Having a course eval that says the readings were too hard, or the assignments required too much work, or that my lectures were not ‘well organized’ doesn’t help me much; rather it highlights issues in students’ prior expectations and experiences.

    Thinking back to my undergrad: I would say that of my 23 full year undergrad credits, there were no more than 5-6 profs who really did anything for me. MA: 2 out of 5. PhD 3 out of 8, of the ones I took courses with. Who really expected more than that? I was there to learn, not to be entertained. I was there to get a degree, not delight.

    Not that I think students shouldn’t expect more, and demand more from faculty, but the question is criteria. It would be nice if course evals included questions like “Did the instructor force you to look at issues from a different perspective?”

  3. Posted 2/26/2006 at 4:57 pm | Permalink

    Thanks, I guess I ought to be less open-ended on my tags…

  4. Sarah W
    Posted 2/28/2006 at 12:19 pm | Permalink

    I don’t want to bite my students, (but I’m not in a tenure position) but I do want to throw things at them sometimes :)

    As a student, I hate the short time period that evals are open, right when I’m writing final papers, grading, and everything else. It should be open longer so we have TIME to do the evals.

One Trackback

  1. By The Salt-Box on 4/8/2006 at 8:13 pm

    Teaching Carnival #7…

    If you’re reading this, it means that the server is up and running again . . . Sorry for……

Post a Comment

Your email is never published nor shared. Required fields are marked *


You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>