student evaluations of teaching (set) are widely used in academic personnel decisions as a measure of teaching effectiveness. the way set are used is statistically unsound--but worse, set are biased and unreliable. observational evidence shows that student ratings vary with instructor gender, ethnicity, and attractiveness; with course rigor, mathematical content, and format; and with 2022年亚洲世界杯预选赛 ' grade expectations. experiments show that the majority of student responses to some objective questions can be demonstrably false. a recent randomized experiment shows that giving 2022年亚洲世界杯预选赛 cookies increases set scores. randomized experiments show that set are negatively associated with objective measures of teaching effectiveness and biased against female instructors by an amount that can cause more effective female instructors to get lower set than less effective male instructors. gender bias also affects how 2022年亚洲世界杯预选赛 rate objective aspects of teaching. it is not possible to adjust for the bias, because it depends on many factors, including course topic and student gender. 2022年亚洲世界杯预选赛 are uniquely situated to observe some aspects of teaching and 2022年亚洲世界杯预选赛 ' opinions matter. but for the purposes of evaluating and improving teaching quality, set are biased, unreliable, and subject to strategic manipulation. reliance on set for employment decisions disadvantages protected groups and may violate federal law. for some administrators, risk mitigation might be a more persuasive argument than equity for ending the use of set in employment decisions: union arbitration and civil litigation over institutional reliance on set are on the rise. several major universities in the u.s. and canada have already de-emphasized, substantially re-worked, or abandoned set for personnel decisions.