Education

On Teacher Evaluations, Between Myth And Fact Lies Truth

Controversial proposals for new teacher evaluation systems have generated a tremendous amount of misinformation. It has come from both “sides," ranging from minor misunderstandings to gross inaccuracies. Ostensibly to address some of these misconceptions, the advocacy group Students First (SF) recently released a "myth/fact sheet” on evaluations.

Despite the need for oversimplification inherent in “myth/fact” sheets, the genre can be useful, especially about topics such as evaluation, about which there is much confusion. When advocacy groups produce them, however, the myths and facts sometimes take the form of “arguments we don’t like versus arguments we do like."

This SF document falls into that trap. In fact, several of its claims are a little shocking. I would still like to discuss the sheet, not because I enjoy picking apart the work of others (I don’t), but rather because I think elements of both the “myths” and “facts” in this sheet could be recast as "dual myths” in a new sheet. That is, this document helps to illustrate how, in many of our most heated education debates, the polar opposite viewpoints that receive the most attention are often both incorrect, or at least severely overstated, and usually serve to preclude more productive, nuanced discussions.

Let’s take all four of SF’s “myth/fact” combinations in turn.

Education Under Attack In Bahrain

Our guest author today is Jalila Al-Salman, a Bahraini teacher and vice president of the Bahrain Teachers' Association (BTA). A leader in the Bahraini uprisings of Arab Spring, she was arrested, held in prison under abusive conditions, tortured and sentenced to three years in prison. Released late in 2012, Ms. Al-Salman continues to advocate for a peaceful, democratic transition in Bahrain.

Since the outbreak of protests in Bahrain in February 2011, people there have faced varied and numerous forms of oppression by the Government of Bahrain. Peaceful protesters have been arrested and beaten, detainees have been tortured, public and private sector employees have been wrongfully terminated from their positions for participating in protests, and over 100 people have been killed.

Shortly after the uprising began, the Bahrain Teachers’ Association (BTA), of which I am the vice president, participated in a three-day strike from February 20 to 23. Up until then, we had been escalating our calls for improvements to the education system, so it seemed like an appropriate time to make our voices heard. In addition to calls for political reform, educators expressed frustration with the Bahrain government’s policy of hiring foreign educators from Egypt, Tunisia, Jordan and Saudi Arabia - a practice that limits opportunities for domestic educators to teach in Bahrain’s schools. Following the strike, an estimated 9,000 teachers marched to the Pearl Roundabout, a traffic circle in the heart of Manama that served as the epicenter of the 2011 protests. It was the largest protest by educators in Bahrain’s history.

A Miracle In The Mid-Atlantic

The National Assessment of Educational Progress, or NAEP, is often called “the nation’s report card." Advocates sometimes use the results of the main NAEP tests to argue for their policy agendas. One example (among many) is when supporters of the so-called “Florida Formula," a battery of market-based reforms that went into effect throughout the late 1990s and early 2000s and are currently spreading throughout the nation, make their case primarily on Florida’s NAEP performance. The basic logic is that average test scores increased during this time period, and thus whatever Florida did must have worked, and should be exported en masse to other states.

However, since 2003, the state that has brought home the most proverbial A’s on the nation’s report card is not Florida. It is Maryland. In fact, the increase in math and reading performance among fourth and eighth graders in the state’s public schools can only be called the “Maryland Miracle."

There's too much at stake for policy makers to waste time worrying about trivial details, such as policy analysis. Whatever laws and practices were in place in Maryland during this time period are clearly responsible for the Miracle. They should serve as a model for the nation.

How Many Schools Don't Have Nurses?

In 2006, the National Association of School Nurses (NASN) commissioned the largest and, to my knowledge, most recent national survey on the availability of nursing services in U.S. public schools. It was administered to a sample of over 1,000 schools in all 50 states and D.C.

The primary purpose was to gather basic information on the health staff in these schools, as well as a few core characteristics, such as school size and student demographics.

I must confess that I was a little surprised by the results. Here is the distribution of schools by nursing availability, summarized very briefly (these proportions vary by school size, type and other characteristics):

Poor Implementation Undermines Promise Of The Common Core

** Reprinted here in the Washington Post

Our guest author today is Stephen Lazar, a founding teacher at Harvest Collegiate High School in New York City, where he teaches Social Studies. A National Board certified teacher, he blogs at Outside the Cave. Stephen is also one of the organizers of Insightful Social Studies, a grass roots campaign of teachers to reform the newly proposed New York State Social Studies standards.

The Common Core Learning Standards (CCLS) seek to define “college and career readiness expectations." Forty-five states have adopted them, and are moving briskly towards full implementation in the coming year. Last January, I wrote that the standards “represent the greatest opportunity for history teaching and learning to be widely re-imagined since the Committee of Ten set the basic outlines for American education over a hundred years ago."

While I stand by that statement, with each step towards implementation I see the opportunity being squandered. We cannot possibly continue to move solely in the direction of “college and career readiness” in History & Social Studies education without ensuring that “civic” readiness is valued equally.  Additionally, we need to ensure that as states write new curricula, that they contain the proper balance of content, skills, and understandings.  New curricula will need to ensure students use an inquiry-based approach to go in depth with a smaller amount of content to gain the wider breadth of skills and dispositions required for civic, college, and career readiness.

A Controversial Consensus On KIPP Charter Schools

A recent Mathematica report on the performance of KIPP charter schools expands and elaborates on their prior analyses of these schools' (estimated) effects on average test scores and other outcomes (also here). These findings are important and interesting, and were covered extensively elsewhere.

As is usually the case with KIPP, the results stirred the full spectrum of reactions. To over-generalize a bit, critics sometimes seem unwilling to acknowledge that KIPP's results are real no matter how well-documented they might be, whereas some proponents are quick to use KIPP to proclaim a triumph for the charter movement, one that can justify the expansion of charter sectors nationwide.

Despite all this controversy, there may be more opportunity for agreement here than meets the eye. So, let’s try to lay out a few reasonable conclusions and see if we might find some of that common ground.

Causality Rules Everything Around Me

In a Slate article published last October, Daniel Engber bemoans the frequently shallow use of the classic warning that “correlation does not imply causation." Mr. Engber argues that the correlation/causation distinction has become so overused in online comments sections and other public fora as to hinder real debate. He also posits that correlation does not mean causation, but “it sure as hell provides a hint," and can “set us down the path toward thinking through the workings of reality."

Correlations are extremely useful, in fact essential, for guiding all kinds of inquiry. And Engber is no doubt correct that the argument is overused in public debates, often in lieu of more substantive comments. But let’s also be clear about something – careless causal inferences likely do more damage to the quality and substance of policy debates on any given day than the misuse of the correlation/causation argument does over the course of months or even years.

We see this in education constantly. For example, mayors and superintendents often claim credit for marginal increases in testing results that coincide with their holding office. The causal leaps here are pretty stunning.

Teacher Surveys And Standardized Tests: Different Data, Similar Warning Labels

As a strong believer in paying attention to what teachers think about policy, I always review the results of MetLife’s annual teacher survey. The big theme of this year’s survey, as pushed by the press release and reiterated in most of the media coverage, was that job satisfaction among teachers is at “its lowest level in 25 years."

It turns out that changes in question wording over the years complicates straight comparisons of responses to the teacher job satisfaction over time. Even slight changes in wording can affect results, though it seems implausible that this one had a dramatic effect. In any case, it is instructive to take a look at the reactions to this finding. If I may generalize a bit here, one “camp” argued that the decline in teacher satisfaction is due to recent policy changes, such as eroding job protections, new evaluations, and the upcoming implementation of the Common Core. Another “camp” urged caution – they pointed out that not only is job satisfaction still rather high, but also that the decline among teachers can be found among many other groups of workers too, likely a result of the ongoing recession.

Although it is more than plausible that recent reforms are taking a toll on teacher morale, and this possibility merits attention, those urging caution, in my view, are correct. It’s simply not appropriate to draw strong conclusions as to what is causing this (or any other) trend in aggregate teacher attitudes, and it’s even more questionable to chalk it up to a reaction against specific policies, particularly during a time of economic hardship.

School Choice And Segregation In Charter And Regular Public Schools

A recent article in Reuters, one that received a great deal of attention, sheds light on practices that some charter schools are using essentially to screen students who apply for admission. These policies include requiring long and difficult applications, family interviews, parental contracts, and even demonstrations of past academic performance.

It remains unclear how common these practices might be in the grand scheme of things, but regardless of how frequently they occur, most of these tactics are terrible, perhaps even illegal, and should be stopped. At the same time, there are two side points to keep in mind when you hear about charges such as these, as well as the accusations (and denials) of charter exclusion and segregation that tend to follow.

The first is that some degree of (self-)sorting and segregation of students by abilities, interests and other characteristics is part of the deal in a choice-based system. The second point is that screening and segregation are most certainly not unique to charter/private schools, and one primary reason is that there is, in a sense, already a lot of choice among regular public schools.

Teacher Leadership As A School Improvement Strategy

Our guest author today is David B. Cohen, a National Board Certified high school English teacher in Palo Alto, CA, and the associate director of Accomplished California Teachers (ACT). His blog is at InterACT.

As we settle into 2013, I find myself increasingly optimistic about the future of the teaching profession. There are battles ahead, debates to be had and elections to be contested, but, as Sam Cooke sang, “A change is gonna come."

The change that I’m most excited about is the potential for a shift towards teacher leadership in schools and school systems. I’m not naive enough to believe it will be a linear or rapid shift, but I’m confident in the long-term growth of teacher leadership because it provides a common ground for stakeholders to achieve their goals, because it’s replicable and scalable, and because it’s working already.

Much of my understanding of school improvement comes from my teaching career - now approaching two decades in the classroom, mostly in public high schools. However, until six years ago, I hadn’t seen teachers putting forth a compelling argument about how we might begin to transform our profession. A key transition for me was reading a Teacher Solutions report from the Center for Teaching Quality (CTQ). That 2007 report, Performance-Pay for Teachers: Designing a System that Students Deserve, showed how the concept of performance pay could be modified and improved upon with better definitions of a variety of performance, and differentiated pay based on differentiated professional practice, rather than arbitrary test score targets. I ended up joining the CTQ Teacher Leaders Network the same year, and have had the opportunity ever since to learn from exceptional teachers from around the country.