Education

The Implications Of An Extreme "No Excuses" Perspective

In an article in this week’s New York Times Magazine, author Paul Tough notifies supporters of market-based reform that they cannot simply dismiss the "no excuses" maxim when it is convenient. He cites two recent examples of charter schools (the Bruce Randolph School in Denver, CO, and the Urban Prep Academy in Chicago) that were criticized for their low overall performance. Both schools have been defended publicly by "pro-reform" types (the former by Jonathan Alter; the latter by the school’s founder, Tim King), arguing that comparisons of school performance must be valid – that is, the schools’ test scores must be compared with those of similar neighborhood schools.

For example, Tim King notes that, while his school does have a very low proficiency rate – 17 percent – his students are mostly poor African-Americans, whose scores should be compared with those of peers in nearby schools. Paul Tough’s rejoinder is to proclaim that statements like these represent the "very same excuses for failure that the education reform movement was founded to oppose." His basic argument is that a 17 percent pass rate is not good enough, regardless of where a school is located or how disadvantaged are its students, and that pointing to the low performance of comparable schools is really just shedding the "no excuses" mantra when it serves one’s purposes.

Without a doubt, the sentiment behind this argument is noble, not only because it calls out hypocrisy, but because it epitomizes the mantra that "all children can achieve." In this extreme form, however, it also carries a problematic implication: Virtually every piece of high-quality education research, so often cited by market-based reformers to advance the cause, is also built around such "excuses."

A 'Summary Opinion' Of The Hoxby NYC Charter School Study

Almost two years ago, a report on New York City charter schools rocked the education policy world. It was written by Hoover Institution scholar Caroline Hoxby with co-authors Sonali Murarka and Jenny Kang. Their primary finding was that:

On average, a student who attended a charter school for all of grades kindergarten through eight would close about 86 percent of the “Scarsdale-Harlem achievement gap” [the difference in scores between students in Harlem and those in the affluent NYC suburb] in math, and 66 percent of the achievement gap in English.

The headline-grabbing conclusion was uncritically repeated by most major news outlets, including the New York Post, which called the charter effects “off the charts," and the NY Daily News, which announced that, from that day forward, anyone who opposed charter schools was “fighting to block thousands of children from getting superior educations." A week or two later, Mayor Michael Bloomberg specifically cited the study in announcing that he was moving to expand the number of NYC charter schools. Even today, the report is often mentioned as primary evidence favoring the efficacy of charter schools.

I would like to revisit this study, but not as a means to relitigate the “do charters work?" debate. Indeed, I have argued previously that we spend too much time debating whether charter schools “work," and too little time asking why some few are successful. Instead, my purpose is to illustrate an important research maxim: Even well-designed, sophisticated analyses with important conclusions can be compromised by a misleading presentation of results.

What Do We Do When Second Graders Think Math Is Not For Girls?

Although the past several generations have seen declining gender inequalities in educational attainment, gender-based differences in the fields of study we choose seem to persist (see here). For example, the percentage of women obtaining degrees in the science, technology, engineering, and mathematics (STEM) fields has remained exceedingly static in the last few decades (see here).

In trying to explain this persistent trend, some conclude that (1) women are not as interested in these fields, and/or that (2) women just aren’t as good as men in these domains. But how would one tell whether these explanations are right or wrong?

One problem is that people share specific, culturally based ideas about what men and women are and should be. Numerous studies demonstrate that the dearth of women in STEM fields can be directly linked to negative associations regarding girls and the sciences, and especially girls and math ability (see here and here).

What Do State And Local Governments Do?

Those who wish to dismantle public services in the U.S. seem to share a general belief – accepted, to some extent, even by people who generally support public sector spending – that government is a massive, incompetent blob. At the federal level, I have always found this somewhat strange, since around two-thirds of federal spending goes towards Social Security, Medicare/Medicaid and national defense, programs that are generally popular and widely regarded as successful.

Survey data indicate that people do trust state and local government more than they do federal government, but the level of confidence is still not particularly high. Americans also appear generally unwilling to pay higher taxes to preserve public services (except for education), and most accept that state and local government is too large and much of it is superfluous. But when people are asked about specific programs, they tend to respond favorably. This suggests, among other things, that people may have general perceptions of "government" without full knowledge of all the roles government plays.

So, I thought it might be useful to take a quick look at how public dollars actually are spent. After all, it’s our money, and it’s always good to keep track of how our elected officials are spending it.

College Isn't Quite The (Self-Perceived) Middle Class Ticket It Used To Be

In a previous post, I presented some simple data on “subjective class identification," which is the practice of asking people to place themselves within a class structure. The data show that, despite constant political rhetoric appealing the U.S. “middle class," more people actually consider themselves to be working class than middle class, and that this hasn’t changed much over the past thirty years.

I also noted that there is even a fairly significant “working class presence” – about 25 percent – among the highly educated (those with a bachelor's or higher). This struck me as interesting, given the fact that having a college degree is sometimes called “the ticket to the middle class," and also given that the income advantage for college graduates – the “college wage premium” – is substantial (and it's actually increased over the long term). I found myself wondering whether the relationship between having a college degree and “gaining entrance” to the middle class (at least by one’s own judgment of his or her class position) had changed over time. In other words, when it comes to subjective class identification, is college less of a middle class “ticket” than it used to be?

I couldn’t resist taking a quick look.

Student Surveys of Teachers: Be Careful What You Ask For

Many believe that current teacher evaluation systems are a formality, a bureaucratic process that tells us little about how to improve classroom instruction. In New York, for example, 40 percent of all teacher evaluations must consist of student achievement data by 2013. Additionally, some are proposing the inclusion of alternative measures, such as “independent outside observations” or “student surveys” among others. Here, I focus on the latter.

Educators for Excellence (E4E), an “organization of education professionals who seek to provide an independent voice for educators in the debate surrounding education reform”, recently released a teacher evaluation white paper proposing that student surveys account for 10 percent of teacher evaluations.

The paper quotes a teacher saying: “for a system that aims to serve students, young people’s interests are far too often pushed aside. Students’ voices should be at the forefront of the education debate today, especially when it comes to determining the effectiveness of their teacher." The authors argue that “the presence of effective teachers […] can be determined, in part, by the perceptions of the students that interact with them." Also, “student surveys offer teachers immediate and qualitative feedback, recognize the importance of student voice […]". In rare cases, the paper concedes, “students could skew their responses to retaliate against teachers or give high marks to teachers who they like, regardless of whether those teachers are helping them learn."

But student evaluations are not new.

Q: Do We Need Teachers' Unions? A: It's Not Up To Us.

I sometimes hear people – often very smart and reasonable people – talk about whether “we need teachers’ unions." These statements frequently take the form of, “We wouldn’t need teachers’ unions if…," followed by some counterfactual situation such as “teachers were better-paid." In most cases, these kinds of musings reflect “pro-teacher” sentiments – they point out the things that are wrong with public education, and that without these things unions would be unnecessary.

I’d just like to make a very quick comment about this line of reasoning, one that is intended to be entirely non-hostile. The question of whether or not “we need teachers’ unions," though often well-intentioned, is inappropriate.

It’s not up to “us." The choice belongs to teachers.

Teacher Quality Only Matters If Students Come To School

The “no excuses” mantra in education started with an irrefutable premise: Nobody should use poverty as an excuse to tolerate dysfunctional pubic schools. For some (but not all) people, it eventually became an accusation as well, hurled at those who brought up the fact – often in a perfectly reasonable manner – that there is a strong, demonstrated relationship between income and achievement. But in its most virulent form, “no excuses” fosters the colonization of additional problems for which schools and teachers can be “held accountable."

Former DCPS Chancellor Michelle Rhee and her fiancée, Sacramento Mayor Kevin Johnson, were hosted by the University of Arkansas’ Clinton School of Public Service for a discussion on education that aired on C-Span a few weeks ago. The moderator asked the panelists for their views on the dismal conditions in many cities, and how that relates to efforts to improve neighborhood schools.

Rhee recounted a story from the final year of her chancellorship, in which she visited a school unannounced, arriving early in the morning. Many of the classrooms were mostly empty. When she inquired, she was told that attendance was low because it was Friday and raining. Rhee said that she was horrified, but continued to tour the school. She finally found a classroom that was full, and asked one of the students about the class. The student told Rhee that this was her favorite teacher.

Investment Counselors

NOTE: With this post, we are starting a new “feature” here at Shanker Blog – periodically summarizing research papers that carry interesting and/or important implications for the education policy debates. We intend to focus on papers that are either published in peer-reviewed journals or are still in working paper form, and are unlikely to get significant notice. Here is the first:

Are School Counselors a Cost-Effective Education Input?

Scott E. Carrell and Mark Hoekstra, Working paper (link to PDF), September 2010

Most teachers and principals will tell you that non-instructional school staff can make a big difference in school performance. Although we may all know this, it’s always useful to have empirical research to confirm it, and to examine the size and nature of the effects. In this paper, economists Scott Carrell and Mark Hoekstra put forth one of the first rigorous tests of how one particular group of employees – school counselors – affect both discipline and achievement outcomes. The authors use a unique administrative dataset of third, fourth, and fifth graders in Alachua County, Florida, a diverse district that serves over 30,000 students.  Their approach exploits year-to-year variation in the number of counselors in each school – i.e., whether the outcomes of a given school change from the previous year when a counselor is added to the staff.

Their results are pretty striking: The addition of a single full-time counselor is associated with a 0.04 standard deviation increase in boys’ achievement (about 1.2 percentile points). These effects are robust across different specifications (including sibling and student fixed effects). The disciplinary effects are, as expected, even more impressive. A single additional counselor helps to decrease boys’ disciplinary infractions between 15 to 26 percent.

Great Expectations

A couple of years ago, Eat Pray Love author Elizabeth Gilbert explored the negative side of our unrealistically high expectations for artists and, more generally, for those who rely on their creativity to make a living. In ancient Rome, Gilbert recounts, creativity was associated with a sort of divine spirit that came to human beings from some distant and unknowable source, for distant and unfathomable reasons. The Romans referred to this intangible spirit as a genius. An individual was not a genius, but rather had a genius - a magical entity who was believed to live in the walls of an artist's studio and who would come out and invisibly assist the artist with his/her work. The lesson Gilbert draws is one of humility (i.e., successes are not entirely ours – don’t be such a narcissist) and emancipatory relief (i.e., failures are not completely our fault either – can’t hurt to try).

What does all this have to do with education and teachers? It seems to me that our expectations for both teachers and artists are sometimes unrealistic and unproductive, if not detrimental. Great teachers are often portrayed as superheroes, unencumbered by anything that might distract them from their teaching crusade – "refusing to surrender to the combined menaces of poverty, bureaucracy, and budgetary shortfalls." As a recent article in The Atlantic explained, Teach for America now asks applicants to talk about how they have overcome the challenges in their lives and uses these answers to rate their perseverance.

Yet the meaning of "Great Teacher" rarely gets analyzed. Instead, our definition of greatness – or even competence – remains a convenient black box, leading some to suggest that the question of what makes a teacher great is less important than separating the wheat from the chaff. In turn, this reveals a simplistic and, in my view, negative assumption that greatness, unlike Gilbert’s genius, is a stable, static, innate, and independent attribute. You either have it or you don’t.