Eduleadership
Research, Reflections, and Tips for School Leaders
Research, Reflections, and Tips for School Leaders
Nov 23rd
How do you keep track of your tasks? Do you have a to-do list, a random collection of sticky notes, a journal, or a more complex system?
If you keep a to-do list, a common problem is that the list gets too long, and it becomes harder to sort through it. When you reach this point, do you break it into multiple lists, and if so, on the basis of what criteria?
David Allen, in his bestselling book Getting Things Done, recommends collecting tasks on a “next actions” list, and only splitting it into separate project when you actually have multi-step projects.
I find it tempting to subdivide my lists by topic, even when a set of tasks isn’t actually a project – for example, when I have a number of tasks that are all about staff evaluations, but are in fact discrete tasks rather than a coordinated project in the sense that, say, planning a trip is a project. This isn’t a good idea.
The problem with creating too many lists is that they create too many places in which your tasks can hide.
How do you keep your tasks organized and visible, so you can keep track of them and make sure you complete them?
Nov 15th
When giving feedback to improve the performance of those you supervise, where do you start?
If something is painfully wrong, it’s obvious where to focus your attention. If you observe practices that are harmful to students, unethical, unprofessional, or unsafe, it’s easy to know what to address first.
Most of the time, though, we need to provide feedback that isn’t so obvious. When someone is generally doing a good job, how do we decide what to mention, knowing that we have a limited bandwidth for giving constructive feedback?
In this situation, the critical question is “What changes will lead to the largest gains in performance?” More to the point in classroom settings, “What changes in practice will have the greatest benefits for student learning?”
These questions stand in contrast to the typical starting point for feedback, which is the “I noticed…have you thought about…?” line of coaching. Too often, what we notice from a lesson observation is based on a personal interest or pet issue, not the opportunity for improved results.
For example, if I know from informal observations that a teacher’s greatest challenge is adequately preparing for math instruction, I should not allow myself to be distracted by minor areas for improvement that I identify during a formal observation. While it’s important to cite specific evidence when providing feedback, leaders must be purposeful in collecting evidence that will support feedback in the areas of greatest need.
What is the low-hanging fruit for each person you supervise? What feedback would improve their performance the most? Think about it as you prepare for your next observation or discussion.
Nov 1st
If we want to get better results, we can change the working conditions, the inputs, or the actions we take to do the work. As individuals, we often don’t have much control over the inputs or conditions of our work, so the primary point of leverage for improvement is the set of actions we take on the job.
In order to do our work better, we need to get a perspective from someone else on how we’re doing, and how we might do better in the future. This, at the most basic level, is what feedback is.
For an expert supervising a novice, the process of giving feedback is straightforward – observe, describe (with reference to a standard for excellence), celebrate successes, and make suggestions for improvement.
But for principals supervising more experienced staff, the challenges vary. Providing constructive (and not just complimentary) feedback to master teachers is no easy task. Another challenge comes when attempting to provoke thinking to challenge long-established habits or practices.
What challenges do you encounter in giving (or receiving) feedback? What have you found to be effective in improving performance in your organization?
Oct 24th
Seattle meteorologist Cliff Mass, who is a prolific blogger, as well as a UW professor, is also an active member of Where’s the Math?, a parent advocacy group working to improve mathematics instruction in Washington.
Cliff recently had a post on his blog suggesting that OSPI (the Office of the Superintendent of Public Instruction, our state board of education) under Randy Dorn is failing to correct the mistakes of his predecessor when it comes to math education and assessment.
First, I should point out that Cliff does a good job of describing our need to back off a bit from the overly-fuzzy approaches to teaching math that were in vogue until recently. However, it’s easy to make the pendulum swing too far in the other direction, or to be distracted by irrelevant issues such as whether kids today are being taught to do math in the same way older generations were taught.
We’re big fans of Cliff’s weather blog in my house, so I’m writing from a position of respectful disagreement. As much as I respect his expertise as a meteorologist, I must say that Dr. Mass appears to fundamentally misunderstand how academic content standards are assessed in Washington:
Recently, Dorn’s staff released the Test Development Guidelines that will guide the writing of new WA standardized tests. These are on the OSPI website in the What’s New box at this link. In these guidelines, bold text is used to indicate what parts of each state math standard should be tested.
That’s correct. In fact, many parts of the standards are not assessed on the state test, because there are too many standards to assess in a single test.
It’s always been this way, and not just for math – every subject area tested by the WASL contains many content standards that simply don’t make it into the test. Dorn is making the MSP much shorter than the WASL, so even greater selectivity will be needed.
Some standards are difficult or impossible to assess on a standardized test, and must be assessed by the teacher through classroom-based assessments. The science standards contain many obvious examples, but so do the math standards. I find it odd that Cliff writes:
Even a cursory examination of these guidelines reveals that state standards are being compromised to further a Discovery math agenda. Fluency, competency, and standard algorithms are not deemed important enough for evaluation. To illustrate this problem, consider the following key grade 3 standard, with the bold text representing content to be assessed:
“3.1.C Fluently and accurately add and subtract whole numbers using the standard regrouping algorithms.” (page12)
As you can see, neither fluency nor standard algorithms will be tested.
Where Cliff sees a sinister agenda, I see OSPI being very realistic about what the WASL/MSP can actually measure. By “fluently,” he means “quickly.” Measuring fluency would require the state to create a timed test like the ones teachers routinely give in class to ensure that students are learning their basic math facts. It would also require a statewide definition of math fact fluency.
While I want students to be able to quickly recall and use the basic math facts, I don’t think it’s helpful to insist that all students – with their range of fine motor skills, memory recall speeds, and responses to the pressure of a timed test – be held to whatever arbitrary standard could be created. The WASL/MSP is an untimed test – students have as much time as they need to complete it. Changing this would surely prevent some students from demonstrating what they really do know, and would invite lawsuits from parents whose children have disabilities or otherwise complete tests more slowly than other students.
Fluency with basic facts is best tested by teachers in the classroom, who have the best sense of what level of fluency is acceptable for each student, based on the many factors that affect the speed at which they can complete a test. While knowing the basic facts should be a nonnegotiable expectation for all students, being able to write them out quickly does not strike me as a nearly as important a concern as, say, strong conceptual understanding.
You’ll also note that “using the standard regrouping algorithm” is not bolded. Is Mass suggesting that the WASL/MSP penalize students for using the “wrong” technique to solve a problem, even if they solve it correctly? If so, this is ironic considering Where’s the Math?’s complaints about homework that requires students to use non-standard procedures for solving problems. “Who cares if we use a certain technique, as long as the answer’s correct?” is a common complaint. When it comes to high-stakes assessments, I agree. If students understand the concepts and can solve problems using one or more of the algorithms or techniques at their disposal, I don’t see a reason to penalize them for using a technique other than the standard algorithms.
Cliff continues:
The same undermining was applied to multiplication and division, with none of this standard bolded:
“4.1.A Quickly recall multiplication facts through 10 X 10 and the related division facts. “ (page26)So none of our state students have to worry about knowing multiplication and division facts very well! So students won’t have to know that 4×5=20, or 36/6=6!
According to discovery math supporters, that’s for calculators to know, not kids.
Again, the bolded text Cliff is referring to indicates standards that are actually tested on the WASL/MSP. Bolding this standard would require a timed test, which OSPI can’t create. Even if a standard isn’t tested by the state assessment, it’s still a standard which teachers are to help students meet, and this one is clearly best assessed by the teacher.
He concludes:
You can look through the rest yourself, but the bottom line is that the State math standards are being gutted by these folks. Fluency in basic operations will not be tested and they are trying to push the reform approach of heavy reliance on calculators and inefficient discovery-math algorithms.
…
Editing standards is clearly subverting the expressed written intent of the Washington State legislature and the needs of our state.
Again, the standards are not being “edited,” but marked as to what can actually be tested. The WASL has never tested every standard, and cannot.
If Dr. Mass would like to measure every single math standard on our annual state test, I would invite him to draft an assessment that is capable of doing so, and to submit it to Mr. Dorn for consideration. I would also be happy to review it, along with his plan for enduring peace in the Middle East and his list of suggestions for how to solve a problem like Maria.
Until then, I would suggest that advocacy groups such as Where’s the Math? attempt to understand what good math teaching actually looks like, and do the more challenging work of supporting good instruction K-12, rather than focus on the impossible goal of testing every standard.
Oct 13th
As I was entering our standardized test data into a strategic plan template this morning, I saw that one of the options for the various subgroups (Native American, African American, Latino, Free/Reduced Lunch, etc.) was:
n < required
In other words, No Child Left Behind does not hold us accountable as a school for this group’s performance, because the group does not contain enough students.
I can appreciate this from the perspective of statistical validity – it’s not fair to say a school is doing a poor job on the basis of the test scores of a small handful of students.
But neither can we ignore the students in these small groups. Indeed, a commitment to equity demands that we never think of a group as insignificant, that we never think of a child as ignorable.
We owe our attention and dedication and best efforts to the education of all children, even – and especially – if they are but a small fraction of our school’s population.
Sep 19th
How does my work as a principal make a difference? More to the point, how can I distinguish between actions and practices that make a meaningful difference, and those that don’t?
Greater equity in society
comes from
A better educated public
which comes from
A more effective educational system
which comes from
More effective schools
which come from
Consistently high-quality instruction
which comes from
High expectations and mutual accountability
which comes from
Professional development and principal expectations
which are my core responsibility.
Each step in this chain is of course much more complex, and there are always multiple sources of influence, but this is a helpful way for me to refocus my efforts on actions that will make a difference.
Aug 30th
I enjoyed a brief discussion with Alfie Kohn on Twitter today about the appropriateness of merit pay for teachers. Kohn suggested that teachers who are motivated by merit pay are likely to be less intrinsically motivated, and are less likely to do the job well. Furthermore, he asserted that seeking more pay for doing a good job is a problematic mindset for educators, one that schools should not abide.
I should preface my argument by clarifying that I am not an advocate for any specific merit pay plan. The logistics and pragmatics of implementing such schemes tend to be enormously challenging, and the plans themselves are political minefields. However, I’m not ready to write off merit pay completely, especially at the macroeconomic level.
At the the heart of the controversy is the fallacy that teachers will work harder or somehow become more effective if offered merit pay. The vast majority of educators are working as hard as they can, doing the best job that they can, and they don’t need more money to motivate them to continue doing so. A salary increase is always welcome, but if you ask an educator if a $2,000 bonus would motivate them to teach better, they’ll likely laugh (or slap you) in your face. Kohn writes:
The premise of merit pay, and indeed of all rewards, is that people could be doing a better job but for some reason have decided to wait until it’s bribed out of them. This is as insulting as it is inaccurate. Dangling a reward in front of teachers or principals—”Here’s what you’ll get if things somehow improve”— does nothing to address the complex, systemic factors that are actually responsible for educational deficiencies. Pay-for-performance is an outgrowth of behaviorism, which is focused on individual organisms, not systems—and, true to its name, looks only at behaviors, not at reasons and motives and the people who have them.
Despite this fundamental flaw in the logic of merit pay at the individual level, there are a few things I like about the idea of merit pay, from an economic perspective. As Kohn says, we need to look at systems, and I think it’s at the systemic level where merit pay becomes most interesting (though also the most unworkable). While merit pay is ineffective in motivating educators to do a better job, I would argue that it has a major influence on who chooses to enter or remain in the education profession.
The disconnect between performance and compensation can be demoralizing even for the most committed and talented educators. Why? Isn’t the knowledge that you’re making the difference in the life of a child reward enough in itself? I’d like to think so, but personal experience suggests otherwise.
In my second or third year of teaching, as I was making my way up the learning curve, I had the frightening realization that I could, if I wanted to, be a mediocre teacher for the rest of my life, and no one – not my principal, not my co-workers, not my students’ low-income parents – would ever do anything about it. As long as I wasn’t terrible, I’d be left alone. Forever.
Of course, I didn’t want to be mediocre, but I also felt that accountability to myself for the well-being of my students was not enough. Why? Because if I can be mediocre and get away with it, my colleagues can, too. The more I looked around, the more I noticed that many of them had settled into a lifelong pattern of mediocrity. I didn’t consider this an option for myself, and found myself embarrassed to be part of a staff where mediocrity was tolerated.
Even if I’m doing a good job, knowing that my colleagues aren’t – and don’t have to – is insulting and demoralizing to me. I want to work with people who challenge me to be my best.
While the opportunity to earn merit pay would not solve this problem, it would at least acknowledge that the problem exists.
For educators who won’t settle for mediocrity among their co-workers, changing careers is always an option. Thousands of talented people leave education every year because they’re disgusted with the lack of effective means for addressing mediocrity. Sitting on a collaborative team with lazy and/or uninterested co-workers – even just one – is disheartening and frustrating. I doubt that my friends in the private sector, who regularly see colleagues promoted or fired based on their performance, suffer from this frustration.
When competent people become frustrated and demoralized and decide to leave, guess who’s left?
1. Great educators who are intrinsically motivated by the knowledge that they are making a difference and who can grit their teeth and tolerate mediocre colleagues, and
2. The mediocre educators who are extrinsically motivated by job security and minimal scrutiny of their performance.
If you are an excellent educator in a sea of mediocrity, what do you do? Close your door and teach. Model excellence for others. Set a high standard by your example. But what if that’s not enough? There is no room for those who insist on high performance for themselves and their peers. If you find yourself in this situation and you have a choice, you’ll leave.
How many people in private-sector employment would love to teach, but are disgusted by the lack of individual accountability? Perhaps merit pay would appeal to some, but the symbolism of merit pay would be more meaningful to many. The idea that there’s no link between individual contribution and individual consequences is offensive at a visceral level to many people.
Kohn says in his 2003 EdWeek article:
…I tell Fortune 500 executives (or at least those foolish enough to ask me) that the best formula for compensation is this: Pay people well, pay them fairly, and then do everything possible to help them forget about money. All pay-for-performance plans, of course, violate that last precept.
Again, I like this idea, but I must ask why Fortune 500 companies almost invariably pay for performance. They’ve found something that works, and we must find something that works, too (though it will likely be very different in public education).
I don’t think Kohn is wrong in his assertion that merit pay is, at the individual level, an insulting behaviorist fallacy. Merit pay doesn’t work, and I don’t support it. But I do think we need to do something, as a profession, to forge a credible link between performance and rewards of various types.
One interesting proposal I’ve heard from economists is to simply fire the bottom 5% of teachers every year. While that would be just as thorny to implement as merit pay (how do you determine who’s in the bottom 5%? Do we really want teachers competing for “not the worst”?), it would perhaps bypass many of the psychological problems with both our current system and merit pay proposals.
As a young teacher, if I had known that the bottom 5% of teachers in my school would be terminated come June, my problem would have been solved. Mediocrity would quickly be rooted out (except, perhaps, in schools with exceptionally high turnover and difficulty recruiting good teachers). I would know that my work mattered enough to be evaluated, and know that someone considered the well-being of our students important enough not to leave it up to individual discretion.
What was my solution? I became an administrator. It’s now my job to root out low and mediocre performance, to ensure that all of our students receive the education they deserve. But I certainly don’t think all good teachers should become administrators (and, in fact, I’m not sure the same problem of tolerated mediocrity doesn’t exist among principals). I respect teaching as a career and calling, and my respect for the profession leads me to wonder what we can do to attract and retain the best people. Developing some type of individual accountability for performance is, to me, an important part of this puzzle.
What do you think?
Aug 21st
Medicine and education are both professions funded largely by the government for the public good, but with very different structures for billing and professional compensation. What would schools be like if they operated like medical clinics?
Teachers would be paid not for their time or their performance, but for the number of tests and activities they conducted. Publishers would spend billions of dollars advertising their assessments and instructional materials directly to families, urging them to ask for specific materials to be used in their child’s school.
These two factors – compensation and advertising – would lead to an explosion in the number of exotic and experimental practices and interventions used in schools. Students would often be given redundant assessments in an effort to do everything possible to inform their education (and drive up their bill).
Families could sue teachers if their children failed to meet standards, and teachers would have to take out malpractice insurance. These liabilities would rapidly drive up the cost of education.
Lawyers would appear in TV commercials offering to sue schools for failing to successfully educate students, and huge verdicts against teachers would drive up the cost of malpractice insurance and drive some teachers to leave the profession.
Students would not be guaranteed an education; they’d have to have school insurance. However, students could get emergency tutoring if they’re in a desperate situation, but no day-to-day schooling. If students were unable to pay for the services they receive, the school could sue them to recover its tutoring costs, leading many families to bankruptcy.
Wealthy families would have better insurance which would pay for elite private schools, and would grumble about free handouts to uninsured students.
Teachers would be able to create specialty education clinics, and refer students to expensive educational services provided by branches of their own clinics. For example, if a student failed to learn to read, they could be referred for an expensive evaluation and intervention services, all of which would be paid by the school insurance. Some teachers would become extraordinarily wealthy in private practice, while others would continue to work for paltry salaries in public schools. Demographers would note the shortage of the latter, especially in urban and rural low-income communities.
Instead of two or three secretaries per school, we’d need a dozen or more to handle all the insurance claims – after all, the school-insurance companies would have to pay for all the lessons, tests, tutoring, field trips, lunches, supplies, and other costs associated with schooling.
Teachers would use computerized inventory and service-tracking systems to bill students and their insurance for every pencil, every trip to the bathroom, every sip of water from the water fountain, every handful of Goldfish crackers, every tissue, and every Band-Aid.
Schools would continue to buy supplies in bulk at low prices, but would impose a substantial markup in order to cover the cost of supplies for uninsured students. It wouldn’t be uncommon to bill $3.50 for a Band-Aid or $7 for a pencil. Using a chair and desk would be $150 a day, not including the use of space in the room (another $300).
While students would continue to be taught in groups, they’d be billed individually for the educational services they received. Teachers would continue to assess students’ prior knowledge, build on this knowledge to introduce new concepts, reinforce students’ understanding through guided and independent practice, and assess students’ mastery.
Each stage of this teaching and learning process would be a separate billable professional service, and students who ask questions or ask the teacher to check their work will have this noted in their bills. Each paper graded would incur a flat fee; a skilled teacher could generate thousands of dollars per hour in billable work.
The cries for education reform are frequent and loud, but the current national debate on healthcare reform offers us the rare opportunity to reflect on the strengths of our education system compared to other complex social and professional service systems.
Comments on education, healthcare, and the similarities and differences between them are welcome.
Aug 10th
Leaders cannot expect from others what they do not themselves model. People in positions of authority risk a special type of “crying wolf” when using disingenuous arguments to persuade others to behave in ways that they themselves are not willing to behave.
On a recent cross-country flight, the “fasten seatbelt” sign was lit for over an hour, after a long takeoff delay that kept our plane on the runway for more than an hour. Although it had been more than two hours since we boarded, the flight attendants repeatedly told passengers not to use the restroom, citing safety concerns due to turbulence.
However, there was hardly any turbulence, and more importantly, the flight attendants didn’t sit down. They continued to attend to the first-class customers, sold beer to coach passengers, and even carried an ice cream sundae for a first-class passenger from the front galley to the back to put sprinkles on it (I wish I was making this up, but I’m not).
Clearly, the safety issue was not a legitimate concern; the turbulence was minimal and brief, and if the flight attendants believed the safety concerns to be valid, they would not have continued to walk about the cabin for discretionary reasons. Surely a child or elderly person’s need to use the restroom outweighs the need of the person in front of me to buy a beer. If the former is a safety issue, surely the latter is as well.
School leaders are often tempted to make “safety issue” arguments as well, or to otherwise use inauthentic arguments to get people to agree with a decision. While there certainly are situations in which such arguments are legitimate, when we use them in other situations, we’re like the boy who cried “Wolf!” – we condition our audience to stop taking us seriously.
Disingenuous arguments undermine leaders’ moral authority and credibility. When we want people to do things for which they cannot see an immediate and compelling reason – which is certainly necessary at times – a key element of persuasion is modeling. People in positions of authority may be tempted to rely on their role-based power to influence others, but sacrificing moral authority to obtain compliance is never a good trade.
The consequence of the flight attendants’ hypocritical behavior – insisting that children refrain from using the restroom, while walking about the plane to sell beer and prepare ice cream sundaes – was a loss of credibility. Soon, people stopped listening to the flight attendants altogether, using the restroom whenever they needed to.
Fortunately, the plane did not encounter any danger, but if we had encountered a serious situation – especially one that would be less than obvious to passengers, such as an approaching storm – the flight attendants would have no moral authority to rely on to obtain passengers’ cooperation.
Leaders must recognize the tremendous importance of personal credibility and moral authority, and must never sacrifice them by the thoughtless exercise of positional authority.
Jul 19th
When you’re trying to bring about a change, how and when do you decide if your efforts are working? If your efforts are either misdirected or inadequate, it’s important to know this quickly so you can make an adjustment.
If you’re trying to lose ten pounds, and your strategy is to eat less red meat and take a walk three nights a week, at what point do you decide it’s not working? How do you know when you need to step up your efforts?
Whenever we’re pursuing a goal, we need progress indicators to tell us if we’re moving quickly enough toward our goal.
There are two things to measure:
1. Whether you’re actually implementing the strategies you intended
2. Whether the strategies are having the intended effect
Comprehensive improvement planning often fails to address these issues adequately. If the achievement of the goal itself is our only source of data, we may find out too late that our efforts were misdirected or inadequate. We need to ask two questions – early and regularly – to make this determination:
1. Are we doing what we planned to do?
2. Is it working the way we wanted it to?
The first question is about fidelity of implementation – are we really doing what we set out to do? Are we doing it correctly? This is often a multifaceted question, especially when implementing a complex intervention.
The second question is about effectiveness – is this strategy producing results?
If we’ve implemented our strategies faithfully, but without the expected results, we could have a problem with fidelity of implementation, or with the level of intensity.
If research has shown that the strategy consistently works, and we can tell we’ve implemented it with fidelity, the problem is probably one of intensity – we need to step up our efforts. There is no question that exercise leads to weight loss, but only if the exercise is done with enough intensity. Similarly, many programs we use in our schools are effective in achieving their stated goals, but only if implemented with fidelity and intensity.
If we’ve decided in advance what types of evidence to collect to answer each of these questions, supervising and evaluating programs in our schools becomes much easier.