Students don’t like professors who teach them the really difficult things.

As I wrote the other day, one of my most difficult tasks as a teacher is to get students to focus on learning rather than on grades, to try to master the skills I am teaching rather than insist on being told what they need to “know” in order to get an A. In doing so, I may be insisting on what I ought to be insisting on if in fact I am trying to advance my students on the exceedingly difficult road to becoming excellent lawyers, but I may also be undermining my own professional advancement. How can that be? Well, it’s been clear to me for a long time that I pay a price with students when I am unable to simply tell them that they need to know and do “A, B, and C” to get a good grade. Those students give me terrible evaluations. And, indeed, I’ve found students tend to either love me or hate me. Those students who get that I’m pushing them to learn and do things they’ve never been taught to do and learn before love me. They realize learning is the result of the work they put into learning, not the result of what I give them in nice, neat packages to regurgitate to me as information they’ve memorized. But the bad evaluations not only hurt; they have an impact in the evaluation of my performance that would perhaps astonish those outside academia. (Why in the world would an organization give credence to the evaluations of terrible students — (whose evaluations, done anonymously, cannot be distinguished from the evaluations of excellent students?)

And now I have evidence that my deep doubts about the reliability and use of student evaluations are well founded. In a study entitled “Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors,” (pdf) Scott E. Carrell of the University of California, Davis and National Bureau of Economic Research and James E. West of the U.S. Air Force Academy conclude that students give good evaluations to professors who teach students what they need for a good grade in their course but punish professors who teach subject matter that provides knowledge and skills that have long-term value:

[S]tudents appear to reward higher grades in the introductory course but punish professors who increase deep learning (introductory course professor value-added in follow-on courses). Since many U.S. colleges and universities use student evaluations as a measurement of teaching quality for academic promotion and tenure decisions, this latter finding draws into question the value and accuracy of this practice. (emphasis added)

Addendum: Stanley Fish expresses feelings similar to mine about students’ abilities to judge the quality of teaching in connection with proposals in Texas “for college and university teachers to contract with their customers — that is, students — and to be rewarded by as much as $10,000 depending on whether they meet the contract’s terms. The idea is to hold “tenured professors more accountable” (“A&M regents push reforms,” The Eagle, June 13, 2010), and what they will be accountable to are not professional standards but the preferences of their students, who, in advance of being instructed, are presumed to be authorities on how best they should be taught”:

[S]ometimes (although not always) effective teaching involves the deliberate inducing of confusion, the withholding of clarity, the refusal to provide answers; sometimes a class or an entire semester is spent being taken down various garden paths leading to dead ends that require inquiry to begin all over again, with the same discombobulating result; sometimes your expectations have been systematically disappointed. And sometimes that disappointment, while extremely annoying at the moment, is the sign that you’ve just been the beneficiary of a great course, although you may not realize it for decades.

Needless to say, that kind of teaching is unlikely to receive high marks on a questionnaire that rewards the linear delivery of information and penalizes a pedagogy that probes, discomforts and fails to provide closure. Student evaluations, by their very nature, can only recognize, and by recognizing encourage, assembly-line teaching that delivers a nicely packaged product that can be assessed as easily and immediately as one assesses the quality of a hamburger.

And I don’t mean to suggest student evaluations are pointless. Like at least one commenter, I have gleaned very valuable things from my student evaluations. But I know too that they are also rife with the kind of hostility and irrationality that can only come from anonymity and the kind of profound discomfort that can come from genuinely educational experience. Finally, I know too that everyone gets negative student evaluations. The biggest problem is that the process of evaluating teachers has become so dependent on evaluations that the availability of negative evaluations means that the evaluators always have available “evidence” to support their desire to refuse promotion to a faculty member they don’t like for reasons that have nothing to do with the quality of their teaching.