Highly credentialed and experienced professors are better at preparing students for long-term academic success than their less-experienced counterparts, but that ability isn't necessarily reflected in their students' teaching evaluations. That's according to research by a pair of economists published in this month's Journal of Political Economy.
The study's authors, Scott Carrell of U.C. Davis and James West of the U.S. Air Force Academy, say their results raise questions about the value of student evaluations as measures of instructor quality.
Student evaluations are widely used by colleges in tenure and promotion decisions, but Carrell and West considered a different measure of instructor quality. They looked at how well instructors in introductory courses prepare students for more advanced courses in related subjects.
Their data come from Calculus I and follow-on classes at the U.S. Air Force Academy. All Air Force Academy students are required to take Calculus I, Calculus II, and nine math-based technical courses regardless of their majors, and professors in all sections of classes use an identical syllabus and give identical exams. That gives the researchers a chance to compare instructors on a relatively even playing field.
The study found that students' achievement in follow-on coursework was strongly influenced by their Calculus I instructor. Students who had a seasoned Calculus I professor with a Ph.D. tended to do better in follow-on coursework than students who had less-experienced and less-credentialed Calculus I instructors. This happened despite the fact that students of seasoned professors tended to have lower grades in Calculus I. The results, the researchers say, suggest that less experienced instructors have a tendency to "teach to the test," while more experienced teachers produce "deep learning" of the subject matter that helps students down the road.
The findings weren't a result of newer professors being "easy-graders," because the Calculus I course was designed to remove as much instructor discretion as possible from their student's grades. Midterm and final exams are group graded, where one instructor grades a single question for the entire course to ensure uniformity of partial credit.
The deep learning produced by more-experienced instructors was not reflected in their students' teaching evaluations, the study found. Less-experienced instructors—whose students tended to do better in the short-term but worse in later classes—received higher ratings on student evaluations. For example, the instructor who ranked dead last in "deep learning" in the sample of 91 Calculus I instructors ranked sixth best in student evaluations.
Taken together, the findings imply that student evaluations give instructors—especially those who do not have tenure—incentive to teach in ways that "have great value for raising current scores, but may have little value for lasting knowledge," the authors conclude.
Scott E. Carrell and James E. West, "Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors." Journal of Political Economy 118:3 (June 2010).
One of the oldest and most prestigious journals in economics, the Journal of Political Economy has since 1892 presented significant research and scholarship in economic theory and practice. The journal aims to publish highly selective, widely cited articles of current relevance that will have a long-term impact on economics research.
Kevin Stacey | EurekAlert!
Study relating to materials testing Detecting damages in non-magnetic steel through magnetism
23.07.2018 | Technische Universität Kaiserslautern
Innovative genetic tests for children with developmental disorders and epilepsy
11.07.2018 | Christian-Albrechts-Universität zu Kiel
There are currently great hopes for solid-state batteries. They contain no liquid parts that could leak or catch fire. For this reason, they do not require cooling and are considered to be much safer, more reliable, and longer lasting than traditional lithium-ion batteries. Jülich scientists have now introduced a new concept that allows currents up to ten times greater during charging and discharging than previously described in the literature. The improvement was achieved by a “clever” choice of materials with a focus on consistently good compatibility. All components were made from phosphate compounds, which are well matched both chemically and mechanically.
The low current is considered one of the biggest hurdles in the development of solid-state batteries. It is the reason why the batteries take a relatively long...
New design tool automatically creates nanostructure 3D-print templates for user-given colors
Scientists present work at prestigious SIGGRAPH conference
Most of the objects we see are colored by pigments, but using pigments has disadvantages: such colors can fade, industrial pigments are often toxic, and...
Scientists at the University of California, Los Angeles present new research on a curious cosmic phenomenon known as "whistlers" -- very low frequency packets...
Scientists develop first tool to use machine learning methods to compute flow around interactively designable 3D objects. Tool will be presented at this year’s prestigious SIGGRAPH conference.
When engineers or designers want to test the aerodynamic properties of the newly designed shape of a car, airplane, or other object, they would normally model...
Researchers from TU Graz and their industry partners have unveiled a world first: the prototype of a robot-controlled, high-speed combined charging system (CCS) for electric vehicles that enables series charging of cars in various parking positions.
Global demand for electric vehicles is forecast to rise sharply: by 2025, the number of new vehicle registrations is expected to reach 25 million per year....
17.08.2018 | Event News
08.08.2018 | Event News
27.07.2018 | Event News
21.08.2018 | Ecology, The Environment and Conservation
21.08.2018 | Life Sciences
21.08.2018 | Power and Electrical Engineering