Beyond Teacher Quality

Beyond PD: Teacher Professional Learning in High-Performing Systems is a recent report from the Learning First Alliance and the International Center for Benchmarking in Education at the National Center for Education and the Economy. The paper describes practices and policies from four high-performing school systems – British Columbia, Hong Kong, Shanghai, and Singapore – where professional learning is believed to be the primary vehicle for school improvement.

My first reaction was: This sounds great, but where is the ubiquitous discussion of “teacher quality?” Frankly, I was somewhat baffled that a report on school improvement never even mentioned the phrase.* Upon close reading, I found the report to be full of radical (and very good) ideas. It’s not that the report proposed anything that would require an overhaul of the U.S. education system; rather, they were groundbreaking because these ideas did not rely on the typical assumptions about how the youth or the adults in these systems learn and achieve mastery. Because, while things are changing a bit in the U.S. with regard to our understanding of student learning – e.g., we now talk about “deep learning” – we have still not made this transition when it comes to teachers.

In the U.S., a number of unstated but common assumptions about “teacher quality” suffuse the entire school improvement conversation. As researchers have noted (see here and here), instructional effectiveness is implicitly viewed as an attribute of individuals, a quality that exists in a sort of vacuum (or independent of the context of teachers’ work), and which, as a result, teachers can carry with them, across and between schools. Effectiveness also is often perceived as fairly stable: teachers learn their craft within the first few years in the classroom and then plateau,** but, at the end of the day, some teachers have what it takes and others just don’t. So, the general assumption is that a “good teacher” will be effective under any conditions, and the quality of a given school is determined by how many individual “good teachers” it has acquired.

What Makes Teacher Collaboration Work?

Today’s guest authors are David Sherer and Johanna Barmore. Sherer is a doctoral candidate at the Harvard Graduate School of Education. He specializes in research on policy implementation and the social dynamics of K-12 school reform. Barmore is a former teacher and also a current doctoral student at the Harvard Graduate School of Education. She studies how policy impacts teachers' instructional practice as well as how teachers learn to improve instruction, with a focus on teacher education.

You’ve probably attended meetings that were a waste of your time. Perhaps there was no agenda. Perhaps the facilitator of the meeting dominated the conversation. Perhaps people arrived late or the wrong people were in the room in the first place. Maybe the team ran in place and no one had any good ideas. Whatever the reason, it’s common for teamwork to feel ineffective. Good teamwork does not just “happen.” Organizational researchers study teams with a goal of understanding the conditions that foster effective meetings and, more broadly, effective collaboration (see here for a review).

Meetings can feel like a waste of time in schools, just like they can in other workplaces. However, educational scholars have paid less attention, compared to researchers in other fields, to the conditions that foster productive collaborative work, such as management (see, e.g. Cohen & Bailey, 1997). Educational researchers and practitioners have long advocated that collaboration between teachers should be a cornerstone of efforts to improve instruction – indeed, teachers themselves often cite collaboration with colleagues as one of the key ways they learn. And yet, we know many teams flounder instead of flourish. So why are some teams more productive than others?

The Story Behind The Story: Social Capital And The Vista Unified School District

Our guest author today is Devin Vodicka, superintendent of Vista Unified, a California school district serving over 22,000 students that was recently accepted into the League of Innovative Schools. Dr. Vodicka participates in numerous state and national leadership groups, including the Superintendents Technical Working Group of the U.S. Education Department .

Transforming a school district is challenging and complex work, often requiring shifts in paradigms, historical perspective, and maintaining or improving performance. Here, I’d like to share how we approached change at Vista Unified School District (VUSD) and to describe the significant transformation we’ve been undergoing, driven by data, focused on relationships, and based in deep partnerships. Although Vista has been hard at work over many years, this particular chapter starts in July of 2012 when I was hired.  

When I became superintendent, the district was facing numerous challenges: Declining enrollment, financial difficulties, strained labor relations, significant turnover in the management ranks, and unresolved lawsuits were all areas in need of attention. The school board charged me and my team with transforming the district, which serves large numbers of linguistically, culturally, and economically diverse students. While there is still significant room for improvement, much has changed in the past three years, generally trending in a positive direction. Below is the story of how we did it.

Will Value-Added Reinforce The Walls Of The Egg-Crate School?

Our guest author today is Susan Moore Johnson, Jerome T. Murphy Research Professor in Education at Harvard Graduate School of Education. Johnson directs the Project on the Next Generation of Teachers, which examines how best to recruit, develop, and retain a strong teaching force.

Academic scholars are often dismayed when policymakers pass laws that disregard or misinterpret their research findings. The use of value-added methods (VAMS) in education policy is a case in point.

About a decade ago, researchers reported that teachers are the most important school-level factor in students’ learning, and that that their effectiveness varies widely within schools (McCaffrey, Koretz, Lockwood, & Hamilton 2004; Rivkin, Hanushek, & Kain 2005; Rockoff 2004). Many policymakers interpreted these findings to mean that teacher quality rests with the individual rather than the school and that, because some teachers are more effective than others, schools should concentrate on increasing their number of effective teachers.

Based on these assumptions, proponents of VAMS began to argue that schools could be improved substantially if they would only dismiss teachers with low VAMS ratings and replace them with teachers who have average or higher ratings (Hanushek 2009). Although panels of scholars warned against using VAMS to make high-stakes decisions because of their statistical limitations (American Statistical Association, 2014; National Research Council & National Academy of Education, 2010), policymakers in many states and districts moved quickly to do just that, requiring that VAMS scores be used as a substantial component in teacher evaluation.

Starting Closest To Home: The Importance Of Developing Teachers’ Understanding Of The Social Contexts Of Their Classrooms

Our guest author today is John Lane, a former teacher and instructional coach who is now working as a post-doctoral researcher at Michigan State University on a project that investigates the impact of social networks and mentorship on the mathematics instructional practices of beginning teachers. 

It may seem foolish now, but there was a time in this country when policymakers believed that reforms were self-executing. Legislatures and educational bureaucrats would articulate the terms of the policies and their vision for improving schools, and teachers and others close to schools would translate these visions into practice. In the meantime, over the past fifty years or so, researchers have been able to better understand the vast gulf between reformers’ ideals and teachers’ practice. In short, we have come to understand that improving teacher’s practice is more difficult than anyone imagined.

Policymakers, however, seem not to have gotten this message, or to have gotten it only partially. For the most part, they still follow a familiar script that reads that teachers either lack the skill or the will to enact reforms, or both. Consequently, reforms typically ratchet up accountability while also including some provision for teacher learning.

In what follows, I focus on the content of this learning and what it might take to achieve it. First, I discuss why teacher learning is complex and often challenging. Next, I discuss how teacher learning is typically organized, and the substance of what teachers currently learn. Specifically, I contend that in teachers’ typical learning opportunities, reforms are reduced to a set of strategies that “work” across settings, and in which the contexts of teaching become an unwanted entanglement. In this post, I argue that teachers would benefit from opportunities to learn about the social dynamics of classrooms -- it is those dynamics, after all, that affect their own reform efforts and teacher practice more broadly. I then offer some ideas about how teachers might be able to accomplish this.

Trust: The Foundation Of Student Achievement

When sharing with me the results of some tests, my doctor once said, "You are a scientist, you know a single piece of data can't provide all the answers or suffice to make a diagnosis. We can't look at a single number in isolation, we need to look at all results in combination." Was my doctor suggesting that I ignore that piece of information we had? No. Was my doctor deemphasizing the result? No. He simply said that we needed additional evidence to make informed decisions. This is, of course, correct.

In education, however, it is frequently implied or even stated directly that the bottom line when it comes to school performance is student test scores, whereas any other outcomes, such as cooperation between staff or a supportive learning environment, are ultimately "soft" and, at best, of secondary importance. This test-based, individual-focused position is viewed as serious, rigorous, and data driven. Deviation from it -- e.g., equal emphasis on additional, systemic aspects of schools and the people in them -- is sometimes derided as an evidence-free mindset. Now, granted, few people are “purely” in one camp or the other. Most probably see themselves as pragmatists, and, as such, somewhere in between: Test scores are probably not all that matters, but since the rest seems so difficult to measure, we might as well focus on "hard data" and hope for the best.

Why this narrow focus on individual measures such as student test scores or teacher quality? I am sure there are many reasons but one is probably lack of familiarity with the growing research showing that we must go beyond the individual teacher and student and examine the social-organizational aspects of schools, which are associated (most likely causally) with student achievement. In other words, all the factors skeptics and pragmatists might think are a distraction and/or a luxury, are actually relevant for the one thing we all care about: Student achievement. Moreover, increasing focus on these factors might actually help us understand what’s really important: Not simply whether testing results went up or down, but why or why not.

Teaching = Thinking + Relationship

Our guest author today is Bryan Mascio, who taught for over ten years in New Hampshire, primarily working with students who had been unsuccessful in traditional school settings. Bryan is now a doctoral student at the Harvard Graduate School of Education, where he conducts research on the cognitive aspects of teaching, and works with schools to support teachers in improving relationships with their students.

Before I became a teacher I worked as a caretaker for a wide variety of animals. Transitioning from one profession to the other was quite instructive. When I trained dogs, for example, it was straightforward: When the dog sat on command I would give him praise and a treat. After enough training, anyone else could give the command and the dog would perform just as well and as predictably. When I worked with students, on the other hand, it was far more complex – we worked together in a relationship, with give and take as they learned and grew.  Regrettably, when I look at how we train teachers today, it reminds me more of my first profession than my second.

Teaching is far more than a mechanized set of actions. Our most masterful teachers aren’t just following scripts or using pre-packaged curricula. They are tailoring lessons, making professional judgments, and forging deep bonds with students – all of which is far more difficult to see or understand.  Teaching is a cognitive skill that has human relationships at its center. Unfortunately, we typically don't view teaching this way in the United States. As a result, we usually don't prepare teachers like (or for) this, we don’t evaluate them like this, and we don’t even study them like this. In our public discussion of education, we typically frame teaching as a collection of behaviors, and teachers as though they are simply technicians.  This doesn’t just create a demoralized workforce; it also leaves students in the care of well-meaning and hard-working teachers who are, nonetheless, largely unable to meet their students' individual needs – due either to lack of preparation for, or mandates that prevent, meeting them.

Is The Social Side Of Education Touchy Feely?

That's right, measuring social and organizational aspects of schools is just... well, "touchy feely." We all intuitively grasp that social relations are important in our work environments, that having mentors on the job can make a world of difference, that knowing how to work with colleagues matters to the quality of the end product, that innovation and improvement relies on the sharing of ideas, that having a good relationship with supervisors influences both engagement and performance, and so on.

I could go on, but I don't have to; we all just know these things. But is there hard evidence, other than common sense and our personal experiences? Behaviors such as collaboration and interaction or qualities like trust are difficult to quantify. In the end, is it possible that they are just 'soft' and that, even if they’re important (and they are), they just don't belong in policy conversations?

Wrong.

In this post, I review three distinct methodological approaches that researchers have used to understand social-organizational aspects of schools. Specifically, I selected studies that examine the relationship between aspects of teachers' social-organizational environments and their students' achievement growth. I focus both on the methods and on the substantive findings. This is because I think some basic sense of how researchers look at complex constructs like trust or collegiality can deepen our understanding of this work and lead us to embrace its implications for policy and practice more fully.

Broadening The Educational Capability Conversation: Leveraging The Social Dimension

Our guest author today is James P. Spillane, Spencer T. and Ann W. Olin Professor in Learning and Organizational Change at the School of Education and Social Policy at Northwestern University. Spillane has published extensively on issues of education policy, policy implementation, school reform, and school leadership. His most recent books are Distributed Leadership in Practice and Diagnosis and Design for School Improvement. Learn more about Spillane's work at www.distributedleadership.org.

We are well into a new century – 15 years and counting! Yet, we continue to fixate on last century notions about human capability. Specifically, we still dwell mostly on the individual teacher or school leader, on investing in and developing their individual human capital so as to improve their productivity and in turn generating higher returns to the individual, school organization, school system, and society. The empirical evidence has established educational professionals' human capital is undoubtedly important for school and school-system productivity.* At the same time, however, by fixating primarily on human capital, we miss or undermine the significance and potential of social capital.

Social capital captures the idea that capability (and by extension productivity) is not simply an individual matter but also a social matter. In other words, in addition to individual capability, there are (often untapped) resources that reside in the relations among people within organizations, systems, or society – a social capability. These social relations can be a source of and a channel for crucial resources such as trust, information, expertise, materials, security, obligation, incentives, and so on - see Bryk & Schneider 2002; Coburn 2001; Daly, Moolenaar, Bolivar, & Burke 2010; Frank, Zhao, & Borman 2004; Frank, Zhao, Penuel, Ellefson, & Porter 2011; Louis, Marks, & Kruse 1996; Moolenaar, Karsten, Sleegers, & Daly 2014. In a given system or organization, social capital is much more than the aggregate of members' human capital.

Teacher Quality - Still Plenty Of Room For Debate

On March 3, the New York Times published one of their “Room for Debate” features, in which panelists were asked "How To Ensure and Improve Teacher Quality?" When I read through the various perspectives, my first reaction was: "Is that it?"

It's not that I don't think there is value in many of the ideas presented -- I actually do. The problem is that there are important aspects of teacher quality that continue to be ignored in policy discussions, despite compelling evidence suggesting that they matter in the quality equation. In other words, I wasn’t disappointed with what was said but, rather, what wasn’t. Let’s take a look at the panelists’ responses after making a couple of observations on the actual question and issue at hand.

The first thing that jumped out at me is that teacher quality is presented in a somewhat decontextualized manner. Teachers don't work in a vacuum; quality is produced in specific settings. Placing the quality question in context can help to broaden the conversation to include: 1) the role of the organization in shaping educator learning and effectiveness; and 2) the shining of light on the intersection between teachers and schools and the vital issue of employee-organization "fit."

Second, the manner in which teacher quality is typically framed -- including in the Times question -- suggests that effectiveness is a (fixed) individual attribute (i.e., human capital) that teachers carry with them across contexts (i.e., it's portable). In reality, however, it is context-dependent and can be (and is indeed) developed among individuals -- as a result of their networks, their professional interactions, and their shared norms and trust (i.e., social capital). In sum, it's not just what teachers know but who they know and where they work -- as well as the interaction of these three.