Learn About: 21st Century | Charter Schools | Homework
Home / Edifier


The EDifier

January 7, 2011

What does baseball have to do with evaluating teachers?

Filed under: Growth Models,Pay for Performance,teachers — Tags: , , — Jim Hull @ 12:50 pm

“Look on the back of their baseball card.”

That’s the common reply from baseball managers and general managers around the major leagues when asked about what kind of production they expect from a player in an upcoming season.

It is a reference to the career stats of baseball players, which appear on the back of their baseball cards. Most often, at the end of the season a player’s stats will be more or less as their career stats.

This basic assumption is so accepted in Major League Baseball that teams offer tens of millions of dollars to those players with the strongest career stats, while players with the weakest stats tend to disappear after a few years.  The stakes don’t get much higher than that.

But in education, it’s still rare for similar high stakes decisions about school personnel (teachers, principals, and other administrators) to be made using data such as student test scores. Critics argue that evaluating educators primarily based on student test scores would be unfair. That even the most complex statistical models designed to isolate educators’ impact, such as value-added growth models, are not reliable enough to base high-stakes decisions such as salaries or tenure.

Now, these critics argue correctly that there is only a moderate correlation between a teacher’s past performance, as measured by value-added models, and their future effectiveness. For example, a Brookings report on value-added models stated that the correlation between test-based measures of teacher effectiveness between one school year and the next is between .30 and .40 (1.0 would mean a perfect correlation and 0.0 would be no correlation). This is a low to moderate correlation in statistical terms. Sounds like the critics have a strong point.

However, Brookings also points out when comparing that correlation to statistics used in other professions, such as Major League Baseball, the correlation doesn’t sound very weak.

Take batting average—one of the most widely used statistics to evaluate a player. The between-season correlation for batting averages for Major League Baseball players is just .36. Yet, a team will pay a player millions for hitting .300 and cut a player for hitting .250.  

Of course batting average is just one statistic teams use to evaluate a player and value-added scores are just one statistic that could be used to evaluate educators, but both can be key measures to determine how effective they will be in the future if used correctly.  

Do teams sometimes make the wrong decision by paying millions for the player who hit .300 last season while cutting the player who hit .250? Yes, it does happen. But overall, the teams are better off signing the players who had the strongest stats on back of his baseball card. Our schools could be more effective if they kept the educators with the strongest stats as well.– Jim Hull






July 30, 2009

Some extra pay to play

Filed under: Growth Models,Pay for Performance — Tags: , — Jim Hull @ 7:07 am

At long last, the guidelines for the Race to the Top funds were announced by President and Secretary Duncan this past Friday. The funds, billed as the “largest-ever federal investment in education reform” by Secretary Duncan, are meant to urge states to :

  • ease restrictions on charter schools,
  • link teacher pay to student achievement, and
  • adopt common national standards.

The EDifier wrote earlier this week about the common standards CCSSO and NGA have been putting together. Today we take on linking teacher pay to student achievement, a.k.a. performance pay—also formerly known as merit pay.

Teachers should get paid for their performance. Who can argue with that? Ah, but of course this is education. What sounds like common sense in theory is much more complicated in practice. It’s not that it is impossible; some districts, like Denver, have been successful at implementing a pay for performance program. But in many other district and states, pay for performance plans have fallen flat. Paying teachers for performance is easier said than done.

But it can be done. Keep in mind, however, that one size certainly does not fit all. Much will depend on the achievement level of your students, the makeup of your teaching staff, the goal of the pay for performance plan, the culture of your school district and the data available about teacher performance.

One piece of data that some districts are collecting now to make pay for performance fairer is teacher value-added data. This is data that uses gains in student test scores to isolate the impact an individual teacher has on student achievement over the school year. This is much fairer than previous plans, which based their evaluation of teacher performance on student test scores at a single point in time. This led to teachers who had the highest-performing students entering their class being recognized as high performing, eliminating teachers who may have had lower-achieving students entering their class and making dramatic gains.

Is value-added data the answer? It’s not a silver bullet, but it is a significant piece of the puzzle when trying to identify the best teachers for performance rewards. But it is just that, one piece of the puzzle. No one piece of data, no matter how sophisticated, can accurately measure teacher effectiveness. So other measures, like principal evaluations and peer reviews, should be included in a pay-for-performance plan. Including multiple measures of teacher effectiveness will more accurately identify those teachers for performance rewards.

For more information on pay for performance plans, check out the Center’s report Promise or peril? And to learn more about the strength and weaknesses of value-added and other growth models (in non-technical terms!) check out the Center’s Guide to growth models.






« Newer Posts
RSS Feed