• Teacher Retention: Estimating The Effects Of Financial Incentives In Denver

    Our guest author today is Eleanor Fulbeck, who earned her Ph.D. in education policy from the University of Colorado at Boulder in 2011, and is currently a post-doctoral fellow at the University of Pennsylvania.

    There is currently much interest in improving access to high-quality teachers (Clotfelter, Ladd, & Vigdor, 2010; Hanushek, 2007) through improved recruitment and retention. Prior research has shown that it is difficult to retain teachers, particularly in high-poverty schools (Boyd et al., 2011; Ingersoll, 2004). Although there is no one reason for this difficulty, there is some evidence to suggest teachers may leave certain schools or the profession in part because of dissatisfaction with low salaries (Ingersoll, 2001).

    Thus, it is possible that by offering teachers financial incentives, whether in the form of alternative compensation systems or standalone bonuses, they would become more satisfied with their jobs and retention would increase. As of yet, however, support for this approach has not been grounded in empirical research.

    Denver’s Professional Compensation System for Teachers ("ProComp") is one of the most prominent alternative teacher compensation reforms in the nation.* Via a combination of ten financial incentives, ProComp seeks to increase student achievement by motivating teachers to improve their instructional practices and by attracting and retaining high-quality teachers to work in the district.

    My research examines ProComp in terms of: 1) whether it has increased retention rates; 2) the relationship between retention and school quality (defined in terms of student test score growth); and 3) the reasons underlying these effects. I pay special attention to the effects of ProComp on schools that serve high concentrations of poor students – “Hard to Serve” (HTS) schools where teachers are eligible to receive a financial incentive to stay. The quantitative findings are discussed briefly below (I will discuss my other results in a future post).

  • Do Half Of New Teachers Leave The Profession Within Five Years?

    You’ll often hear the argument that half or almost half of all beginning U.S. public school teachers leave the profession within five years.

    The implications of this statistic are, of course, that we are losing a huge proportion of our new teachers, creating a “revolving door” of sorts, with teachers constantly leaving the profession and having to be replaced. This is costly, both financially (it is expensive to recruit and train new teachers) and in terms of productivity (we are losing teachers before they reach their peak effectiveness). And this doesn’t even include teachers who stay in the profession but switch schools and/or districts (i.e., teacher mobility).*

    Needless to say, some attrition is inevitable, and not all of it is necessarily harmful, Many new teachers, like all workers, leave (or are dismissed) because they are just aren’t good at it – and, indeed, there is test-based evidence that novice leavers are, on average, less effective. But there are many other excellent teachers who exit due to working conditions or other negative factors that might be improved (for reviews of the literature on attrition/retention, see here and here).

    So, the “almost half of new teachers leave within five years” statistic might serve as a useful diagnosis of the extent of the problem. As is so often the case, however, it's rarely accompanied by a citation. Let’s quickly see where it comes from, how it might be interpreted, and, finally, take a look at some other relevant evidence.

  • New Policy Brief: The Evidence On Charter Schools And Test Scores

    In case you missed it, today we released a new policy brief, which provides an accessible review of the research on charter schools’ testing effects, how their varying impacts might be explained, and what this evidence suggests about the ongoing proliferation of these schools.

    The brief is an adaptation of a three-part series of posts on this blog (here is part one, part two and part three).

    Download the policy brief (PDF)

    The abstract is pasted directly below.

  • Today's Forecast: Cloud Computing In Education

    It’s hard to tell whether cloud computing is "the next big thing" or just another buzz word, but, according to a recent survey of 5,300 organizations in 38 countries, change is already taking place: "the promises of reduced cost, improved performance and greater scalability" are driving interest in "moving to cloud."

    But what does cloud computing mean to those of us who care about education, teaching and learning?

    When an organization "goes cloud" it means that the organization no longer deals directly with many of its computing/IT needs – e.g., software, updates, storage etc. The key to understanding this model and its broader implications is to appreciate the transition it represents: from viewing computing as a product to viewing it as a service. Much like public utilities, IT resources are delivered to users through the internet, just like electricity is distributed to our homes through the power grid. Users pay according to their consumption level, and the service provider takes care of the rest – see here.

    Evidently, by moving to the cloud, organizations (including schools and universities) can save on IT infrastructure and maintenance. Some have noted that the model could also bring about changes in the IT sector, perhaps require a different type of (and/or fewer) IT professionals. Second, cloud computing should also help increase accessibility to educational content and convenience. For example, if lessons and assignments are be posted and stored in the cloud (i.e., on the shared server), students can work from anywhere, collaborate/interact with their peers etc.

    But what else is cloud computing?

  • The Deafening Silence Of Unstated Assumptions

    Here’s a thought experiment. Let’s say we were magically granted the ability to perfectly design our public education system. In other words, we were somehow given the knowledge of the most effective policies and how to implement them, and we put everything in place. How quickly would schools improve? Where would we be after 20 years of having the best possible policies in place? What about after 50 years?

    I suspect there is much disagreement here, and that answers would vary widely. But, since there is a tendency in education policy to shy away from even talking realistically about expectations, we may never really know. We sometimes operate as though we expect immediate gratification - quick gains, every single year. When schools or districts don't achieve gains, even over a short period of time, they are subject to being labeled as failures.

    Without question, we need to set and maintain high expectations, and no school or district should ever cease trying to improve. Yet, in the context of serious policy discussions, the failure to even discuss expectations in a realistic manner hinders our ability to interpret and talk about evidence, as it often means that we have no productive standard by which to judge our progress or the effects of the policies we try.

  • A Republic At Risk

    Hardly a week goes by when some newspaper or television network doesn’t feature where the U.S. ranks among the nations participating in the Programme for International Student Assessment (PISA). This test, administered to 15-year olds every three years, serves as a benchmark for “how we’re doing” in terms of education outcomes relative to our international competitors.

    Because the results get so much attention, millions of Americans are aware that our students' average scores rank relatively low on all three tests (though, when you account for error margins, U.S. scores are actually roughly average). Such awareness has stirred up remarkable urgency to improve our education system – we are told this is a “Sputnik moment," and that the very future of our nation’s economy is at risk.

    Yet, for all the attention we pay to our rankings on standardized tests, how many Americans are aware that, in terms of voter turnout (voters as a proportion of voting-age population) between 1945 and 2001, the U.S. ranked 138th out of the world’s 169 democracies? To whatever degree electoral participation is an indicator of the health of a republic, ours is a sick one indeed. And it’s about to get even sicker.

  • The Year In Research On Market-Based Education Reform: 2011 Edition

    ** Also posted here on 'Valerie Strauss' Answer Sheet' in the Washington Post

    If 2010 was the year of the bombshell in research in the three “major areas” of market-based education reform – charter schools, performance pay, and value-added in evaluations – then 2011 was the year of the slow, sustained march.

    Last year, the landmark Race to the Top program was accompanied by a set of extremely consequential research reports, ranging from the policy-related importance of the first experimental study of teacher-level performance pay (the POINT program in Nashville) and the preliminary report of the $45 million Measures of Effective Teaching project, to the political controversy of the Los Angeles Times’ release of teachers’ scores from their commissioned analysis of Los Angeles testing data.

    In 2011, on the other hand, as new schools opened and states and districts went about the hard work of designing and implementing new evaluations compensation systems, the research almost seemed to adapt to the situation. There were few (if any) "milestones," but rather a steady flow of papers and reports focused on the finer-grained details of actual policy.*

    Nevertheless, a review of this year's research shows that one thing remained constant: Despite all the lofty rhetoric, what we don’t know about these interventions outweighs what we do know by an order of magnitude.

  • Education Advocacy Organizations: An Overview

    Our guest author today is Ken Libby, a graduate student studying educational foundations, policy and practice at the University of Colorado at Boulder.

    Education advocacy organizations (EAOs) come in a variety of shapes and sizes. Some focus on specific issues (e.g. human capital decisions, forms of school choice, class size) while others approach policy more broadly (e.g. changing policy environments, membership decisions). Proponents of these organizations claim they exist, at least in part, to provide a counterbalance to various other powerful interest groups.

    In just the past few years, Stand for Children, Democrats for Education Reform (DFER), 50CAN, and StudentsFirst have emerged as well-organized, well-funded groups capable of influencing education policy. While these four groups support some of the same legislation - most notably teacher evaluations based in part on test scores and the expansion of school choice - each group has some distinct characteristics that are worth noting.

    One thing’s for sure: The proliferation of EAOs, especially during the past five or six years, is playing a critical role in certain education policy decisions and discussions. They are not, contrary to some of the rhetoric, dominating powerhouses, but they aren’t paper tigers either.

  • Do Teachers Really Come From The "Bottom Third" Of College Graduates?

    ** Also posted here on 'Valerie Strauss' Answer Sheet' in the Washington Post

    The conventional wisdom among many education commentators is that U.S. public school teachers “come from the bottom third” of their classes. Most recently, New York City Mayor Michael Bloomberg took this talking point a step further, and asserted at a press conference last week that teachers are drawn from the bottom 20 percent of graduates.

    All of this is supposed to imply that the U.S. has a serious problem with the “quality” of applicants to the profession.

    Despite the ubiquity of the “bottom third” and similar arguments (which are sometimes phrased as massive generalizations, with no reference to actual proportions), it’s unclear how many of those who offer them know what specifically they refer to (e.g., GPA, SAT/ACT, college rank, etc.). This is especially important since so many of these measurable characteristics are not associated with future test-based effectiveness in the classroom, while those that are are only modestly so.

    Still, given how often it is used, as well as the fact that it is always useful to understand and examine the characteristics of the teacher labor supply, it’s worth taking a quick look at where the “bottom third” claim comes from and what it might or might not mean.

  • What Value-Added Research Does And Does Not Show

    Value-added and other types of growth models are probably the most controversial issue in education today. These methods, which use sophisticated statistical techniques to attempt to isolate a teacher’s effect on student test score growth, are rapidly assuming a central role in policy, particularly in the new teacher evaluation systems currently being designed and implemented. Proponents view them as a primary tool for differentiating teachers based on performance/effectiveness.

    Opponents, on the other hand, including a great many teachers, argue that the models’ estimates are unstable over time, subject to bias and imprecision, and that they rely entirely on standardized test scores, which are, at best, an extremely partial measure of student performance. Many have come to view growth models as exemplifying all that’s wrong with the market-based approach to education policy.

    It’s very easy to understand this frustration. But it's also important to separate the research on value-added from the manner in which the estimates are being used. Virtually all of the contention pertains to the latter, not the former. Actually, you would be hard-pressed to find many solid findings in the value-added literature that wouldn't ring true to most educators.