Eduleadership
in search of performance, productivity, and vision
A/B Testing: Finding the Best Option
Oct 19th
Today I read a quantitative study of class-size effects, conducted in Tennessee around 1990. This study (Finn & Achilles, 1990) randomly assigned teachers and students to one of three conditions – small class size, regular class size, or regular class size with aide.
The findings are interesting, but I’d like to point out something unusual about this piece of research: it actually compared different policy options in real school settings to see which was better.
It’s remarkable how rare this type of experimentation is in education. Perhaps it’s the ethical difficulties, which are numerous.
First, we must do no harm to students in conducting research. Second, if it turns out that one option is superior to the other, how do we make it up to the students who received the inferior treatment? Or, at the very least, how do we justify to parents and other stakeholders that the research did no harm?
The Huffington Post uses A/B testing to see which of two headlines gets more clicks. After a few minutes of testing, the superior headline is declared the winner, and is the only one used from that point forward.
How much improvement could we see in education if we were able to regularly employ this type of “which is better?” experimentation?
Quote of the Day: PLCs & Research
Jan 1st
There is no lack of research for those who seek to promote discussion of effective teaching. The issue is whether or not educators are prepared to accept their responsibilities to work together to become proficient consumers of that research. A professional learning community will fulfill that responsibility by ensuring that frequent and focused discussions on teaching and learning are the standard practice in its school.
DuFour & Eaker, Professional Learning Communities at Work, p. 226
The Neuroscience of Leadership
Jun 23rd
A colleague pointed me to this article on organizational change and brain science, entitled “The Neuroscience of Leadership,” by a business coach and a psychologist, so I thought I’d share some of its implications for educational leaders.
The authors summarize new brain research, conducted using technologies such as fMRI, and conclude that behaviorism, humanism, and other traditional means of bringing about change in others or in organizations simply don’t work. Instead, they point to focus, expectations, and attention as keys to forming new neural pathways and, ultimately, to creating lasting change.
In order to learn a new behavior or a new way of thinking, we must through repetition and attention repeat the behavior or use the new way of thinking until it is ingrained in our neural pathways, the connections between our brain cells that constitute memory.
Of course, it’s easy to envision this process for learning a sport or a language; it’s harder to see the practical application in areas as complex as organizational improvement and changing the way a group works together. As groups work together, people will from time to time come to great insights, and leaders must capitalize on these insights by returning people’s attention to them again and again, focusing attention on the question of how these insights can improve the work at hand.
In short, educational leaders should
focus people on solutions instead of problems, let them come to their own answers, and keep them focused on their insights.
You can read, print, or save the article here.
Disciplinary Alternative Programs Used for Nonviolent Offenses, Study Finds
Apr 11th
A study by Texas Appleseed, a “non-profit, public interest law organization,” reports that many students are being sent to alternative schools for minor, nonviolent infractions. The report, entitled Keeping Schools Safe While Reducing Dropouts: Breaking the School-to-Prison Pipeline, asserts that zero-tolerance policies are inappropriately funneling students into alternative programs, which have a dropout rate five times that of a traditional school.
As the report’s title indicates, there is a strong correlation between being sent to an alternative school for disciplinary reasons and being sent to prison. However, school administrators have significant discretion in sending students with nonviolent behaviors to these programs. As the following chart shows, the majority of Disciplinary Educational Alternative Program (DAEP) referrals are for nonviolent offenses:
According to the Houston Chronicle, referrals to DAEPs disproportionately affect students of color and students in special education programs. In some districts such as Pasadena (a suburb of Houston), students in kindergarten or first grade are sent to alternative placements:
Suburban districts tend to be the most the most punitive, said Deborah Fowler, Texas Appleseed legal director.
Of these, the Pasadena Independent School District was one of the harshest.
It is the only district in Texas to appear on the report’s Top 10 districts with the highest alternative school referral rates each of the last five years. Houston-area school districts that made multiple Top 10 appearances in the past five years also include Galveston (twice), Spring Branch (twice) and Katy (three times).
“These numbers indicate that it is not the behavior that determines whether a student is referred to a (district alternative education program),” the report’s authors wrote. But rather, “it is, in large part, the district where the child goes to school.”
Other districts were spotlighted for sending black or special education students to alternative schools for nonviolent, noncriminal offenses at at least twice the rate of other students for the past five years. They include Humble, Klein, Katy, Pearland, Tomball, Goose Creek, College Station, Bryan and Huntsville. link
While clearly this is an embarrassment for the districts named in the Chronicle article, there are several implications for school leaders:
- We must do whatever we can to reduce racial and socioeconomic disproportionality in discipline referrals
- We need to create schools where students are set up for success and safety, not assume that kids will need to be sent to alternative schools
- We need to create systems and structures to promote positive behavior, not just systems for punishing negative behavior efficiently
- For the small number of children who cannot be successful or safe in a regular school environment, we need to create alternative schools where students can become successful, not take the next step down the path to prison
What do you think? Leave a comment.
Self-Discipline vs. Intelligence as a Predictor of School Success
Jun 27th
ASCD reports on a study that may indicate that self-discipline is a stronger indicator of school success than IQ. The ResearchBrief summarizes a study focusing on 8th graders in a magnet school in the Northeast. The ResearchBrief lists both implications of the study and caveats that should be taken into consideration.
Today’s SmartBrief introduces the article by saying “Some research suggests that students who are highly self-disciplined may be able to better focus on long-term goals and make better choices related to academic engagement.” But the study measured self-discipline by giving a questionnaire to students, teachers, and parents. When using a questionnaire and measuring something as nebulous as self-discipline, it is likely that measuring self-discipline is simply another way of measuring school success. Inasmuch as the factors leading to school success are well-known among students, teachers, and parents, it is meaningless to say that better students have these characteristics. Of course they do, and everyone knows it.
The study is also based on a single school, a magnet school with selective admission practices. The representativeness of this population is not established in the review, though this is pointed out in the caveats section.
This leads to crucial questions regarding summaries of research intended for educators:
- When is it misleading to summarize a study?
- Do people hear the caveats appended to research as clearly as they here the apparently dramatic findings?
- Do people really understand the principle that correlation does not equal causation?
Educators are pressed for time, and research of this type is not intended for a broad audience of classroom teachers and school administrators. However, it is critical that all educators understand how research is done, so they are able to determine the implications and significance of a study like this one. Otherwise, statements like “Self-discipline outdoes IQ in predicting academic performance of adolescents,” the title of the original study, will be accepted as un-nuanced gospel.
Risk Factors and Resiliency
Jun 27th
Dr. Rico Catalano of the Social Development Research Group was a guest speaker today in a master’s class at UW. He gave a presentation on resiliency, risk factors, and support programs to reduce the risk of drug use, delinquency, and school dropout.
The presentation he gave can be viewed in its entirety here. One of the most important insights he shared was that not all support programs are effective, despite their popularity. For example, some anti-drug programs actually increase students’ likelihood of trying drugs, because the program raises students’ awareness and piques their interest in drugs, without effectively reducing risk factors. Dr. Catalano described how his research group uses longitudinal studies and meta-analyses to determine if a program is effective.