Cloaking Inequity

Dude, Really?: Education policy kudos and criticism (in the same week)

7–11 minutes

·

·

,

At my core, the reason why I chose educational policy as a profession is because I care about children.

Today I’d like to take up some of the critics of the policy brief that I included in the post Flood of Lies: Education reform crescendo at #Katrina10 Then I would like to humbly share some very cool kudos that happened this week. Be warned, this post has a certain randomness to it, kind of like my favorite blog MGoBlog.

First let me start with some background. I have never lived in New Orleans, however, I did live in Houston— which is about a five hour drive from NOLA at the speed that I drive. So I have been to New Orleans about ten times in my life. Half of the trips to New Orleans were related to schools and communities.

https://twitter.com/ProfessorJVH/status/628317386379251712

Recently I spent almost a week in New Orleans meeting with stakeholders and others. I also attended a community-based education reform conference. I was interested in understanding the perspectives parents, students and activists about education reform in the city. They relayed that the focus on “improvement” didn’t match up with the reality of Black students and families. One parent put it this way, “Improvement for Whites, not Blacks.” Recent surveys have supported the predominance of that perspective.

The Wall Street Journal reported,

Looking across the results of surveys conducted in 2006, 2008, 2010, and 2015, a trend is striking: the widening gulf between blacks and whites when it comes to residents’ sense of opportunities for younger people in the city, something our surveys began tracking in 2008.

Honestly I was incensed after the bus tour that Karen Harper Royal took me on that i described in the post “Slave” market education reform in NOLA? #NOLAEdWarning. When you hear and see the perspectives of Black residents of the city, you are surprised by the lack of the representation of their counternarrative about education reform in the media and from other sources (nationally and locally).

Screen Shot 2015-09-01 at 4.11.33 PM
NOLA Brief authored for the Network For Public Education

I didn’t want to be a colonial researcher, by that I mean someone who goes in and takes then leaves. I also didn’t want to be an outsider projecting my perspectives on a community where I have never lived. In fact, these are two common critiques of “education reform” in NOLA that were discussed at the community-based reform conference. (See also Colonizing the Black Natives: Reflections from a former NOLA Charter School Dean of Students)

So, first I decided to take a look at readily available public data from Louisiana and the Recovery School District (NAEP, ACT, Dropout, etc). I was troubled. So, I organized a conference call with four parents and a teacher from New Orleans to discuss the data I was seeing. They were not surprised. It was at that point that thought it would be important to collate a brief based primarily on the perspectives of Louisiana residents. A brief that my mother and sister could read. Not the typical unintelligible academic piece.

They liked the idea. So I then asked them to send me resources that they felt should be included in a policy brief.

As can be expected, there are critiques of the brief. So I’d like to address a few of those here. Briefly, and with a little humor.

Click here for the NPE NOLA policy brief.

1. What about Doug Harris’ single study? (mentioned in footnote 6) No matter how you slice it, the study uses state tests and compares the lowest performing district to schools in one of the lowest performing states. So that is comparing bad to worse. Bad did slightly better than worse. I think the more telling last and nearly last ranking of Louisiana and the RSD in the data are located in the NPE brief (NAEP, Dropout, Pushout, Graduation, ACT etc.)

2. You mentioned CREDO before on Cloaking Inequity. How about CREDO’s study on New Orleans? First, I should say I was converted by NEPC on CREDO’s charter studies.

https://twitter.com/ProfessorJVH/status/638150163404472320

I think it’s actually okay to change your mind based on new evidence.

Second, I am concerned about the internal validity of the studies based on the fact that apparently CREDO excluded 15% of the data in Louisiana.

3. So “New Orleans is NOT one of the districts that participates in NAEP’s Trial Urban District Assessment” Even if New Orleans participated in the NAEP TUDA, it would be not be valuable because data from charter schools is conveniently (or inconveniently) excluded by the federal government.

unnamed

Why am I talking about the NAEP TUDA anyways? Because one critic briefly liked the idea. That data wasn’t used in the charter vs. traditional school comparisons or pre- and post- Katrina tables because the analysis was of Louisiana as a state. The point being made is that 46 states perform better than Louisiana. That’s fact. It was fact before Katrina, it’s fact now. That’s the data. So about the NAEP sample for the traditional schools versus charter schools in Louisiana. NCES says they sample of be representative:

…charter schools are selected along with other public schools, as part of the sample for each state. Charter schools are therefore sampled to be representative within each state. However, since they are only proportionately sampled, in some states there may not be enough schools and students in sample for them to be reportable, and this could vary over time. 2003 is the only assessment for which a special effort was made to add additional charter schools in some states so that the results would be reportable. However, there are now many more charter schools in most states than there were in 2003, so that the sample sizes of charter schools have grown naturally over time.

So, in the Louisiana sample, charters were sampled by NCES to be representative. A critic of the brief has argued for a series of cross-sectional analyses…but the samples have changed over the years and would invite just as much criticism (Thank you Dr. Francesca Lopez for this point).

4. Does this brief prove causality? I did a search for the following words in the NPE NOLA education reform brief (click on photo of it above to see it): cause (0). causality (0). relationship (0). sidetrack (0). etc. This brief is a collation of data from Louisiana and RSD. Folks can draw their own conclusion on causality, but the conclusion that Louisiana and the RSD are last and nearly last in all of the data discussed is FACT (regardless of year). It is also fact that a decade of test-score-driven, state-takeover, charter-conversion model has occurred over the past ten years in NOLA. No, we did not conduct a randomized experiment or a regression discontinuity etc. However, to the average non-snarky person, the Louisiana and RSD last and nearly last position in the (NAEP, ACT, Graduation, Dropout, Pushout) data speaks for itself.

5. I would loved to have conducted a project like Doug Harris’ study. But, something to be understood is that Doug Harris is politically connected and was given special access by the state of Louisiana to the data for the past several years. He was hand picked to receive the data. In 2013, here is what I wrote in the post LA and the Recovery School District approach (SB1718): A P.T. Barnum Circus

Here is what is interesting about Louisiana that many people don’t know. They are desperately trying to control who accesses public information (data) to examine their “educational miracle.” I have been holding on to this story since 2012 because we have made friendly attempts to gain access to Louisiana data for 10 months. In fact, we have made requests to Louisiana on seven separate occassions since August 2012. When this did not yield data, we made a public information request for an existing dataset already given to CREDO. Louisiana is required by law to respond to public records requests within 3 days, its been more than 90 days and Louisiana has not responded.

ONLY CREDO and Doug Harris received the student-level data from the state of Louisiana. Until this happened in March of 2015: Appeals Court Reverses District Court: Department of Education Must Release CREDO Data to Research on Reforms So now research conducted with student-level by those NOT HANDPICKED by Louisiana politicians and “reformers” is going to start trickling out. Including some that I am participating in currently. More on the peer-reviewed NOLA research soon.

So up until now, the Dude Really? was a surly reference to the critiques of the NPE NOLA brief. But, now I want to segue into a surprised Dude Really? I just want to stay that I was honored by the recognition on two fronts recently. First being named one of the top ten education policy voices (tied for 9th) on social media in the US by Harvard’s Education Next— and the #2 ranked professor behind Dr. Diane Ravitch. I have to be honest, I am not a fan of the publication. They acknowledge as much by calling me an education reform “critic”— a badge of honor in my mind.

Secondly, I was asked to appear on the cover of Diversity in Education magazine October 2015 issue. I think my grandmother will be pleased. I am hoping for a call from GQ or Travel and Leisure (because I need a vacation).

https://twitter.com/ProfessorJVH/status/638814021764841472

I work the hours that I do for children. Thank you for reading Cloaking Inequity. See you soon.

Please Facebook Like, Tweet, etc below and/or reblog to share this discussion with others.

Want to know about Cloaking Inequity’s freshly pressed conversations about educational policy? Click the “Follow blog by email” button in the upper left hand corner of this page.

Twitter: @ProfessorJVH

Click here for Vitae.

See also the following Cloaking Inequity posts on education reform in New Orleans:

At my core, the reason why I chose educational policy as a profession is because I care about children. Today I’d like to take up some of the critics of the policy brief that I included in the post Flood of Lies: Education reform crescendo at #Katrina10 Then I would like to humbly share some very cool kudos…

5 responses to “Dude, Really?: Education policy kudos and criticism (in the same week)”

  1. Laura H. Chapman Avatar
    Laura H. Chapman

    First, I should say I was converted by NEPC on CREDO’s charter studies. Me too. Thanks for your work and congrats on the recognition. I watched the C-SPAN education panel on NOLA’s “recover.” All was wonderful. Charter schools are the answer and so on. If you missed it, I hope you can retrieve it and document at the missing narratives.

    Like

    Reply
  2. Julian Vasquez Heilig: Why I Speak Out | Diane Ravitch's blog Avatar
    Julian Vasquez Heilig: Why I Speak Out | Diane Ravitch's blog

    […] is latest post. He responds to critics of his policy brief on Néw Orleans, and he glories in some unexpected […]

    Like

    Reply
  3. edutalknola Avatar
    edutalknola

    Reblogged this on Education Talk New Orleans and commented:
    Thank you for your work. We need more researchers looking at ALL of the data on the “reform,” which is the Recovery School District (RSD). New Orleans has long been known as one of the worst if not the worst district in our state. 10 years ago the state took all of those “bad” schools and promised to do a better job. They never re-opened many of the schools, so automatically by virtue of doing nothing but keeping some schools closed, the RSD can take credit for having fewer failing schools. The state then closed 26 RSD New Orlens schools displacing nearly 5000 students in a 6 years time period. That will certainly get you fewer failing schools. THAT’S PROGRESS! The LDOE even closed 7 of the new charters schools it opened post-Katrina, displacing 1700 of those 5000 students. That is certainly a way to make your charter school performance look better than it actually is. The one thing the state couldn’t do with closing schools, is hide the actual student achievement from NAEP test scores. Clearly with all of the moving children around, the impact on students has not been transformative enough in the worst school district in the state to push Louisiana out of the cellar of NAEP scores.

    As a native New Orleanian, a public school graduate and the mother of public school graduates over the last 23 years, I am sick of the data wars. I got involved with public education because I wanted to keep my own son from becoming a high school drop out and criminal like one of my brothers. My other 3 brothers spent their entire school careers in special educaiton. I soon realized that my son and my brother were like many young Black males in New Orleans. They were falling through the cracks. I really wanted the RSD reforms to be successful because it would mean fewer people like my brother who became a criminal in my city. That’s all I have every wanted, better outcomes for children like mine and like my brothers. It saddens me that after 10 years, the RSD has not done a good enough job of improving the outcomes for our sons. In fact, a recent report tells us that we have 26,000 youth between the ages of 16-24 who are not in school or employed. Worse yet, in my work as an advocate for parents of students with disabilities, I continue to come across families with children who fall through the cracks of this broken “Recovery School District.” Over the past week I’ve been criticized for not acknowledging the “progress” of the RSD. Forgive me, but I can’t see the progress because I keep hearing from parents like the one I met today whose child has been educated only in the reform and is 14 years old entering 7th grade. It doesn’t look good for this child moving out of 7th grade by the end of this school year. This is the only school this child has attended since 1st grade. Over that time period the school “improved” from an F school to a C school. Yet, this school failed to provide this child with the support he needed. Is this mother supposed to be happy with the the chorus of accolades heaped upon the RSD for the “progress.” they’ve made in 10 years?

    I want to see more focus on how the reforms in New Orleans are impacting our most challenged children. I want every child counted in the data wars and getting better outcomes in my city. I want parents of students with disabilities benefiting from whatever “innovative” strategies that are being used to improve the lives of our children. I want people to stop playing games with the data and give it freely to researchers so we can find out whats happening based on the tests our children are forced to take. Most of all, I want to see more young men like my brothers educated well enough to be employed and not incarcerated in my city. When we look at outcomes for African American males in New Orleans, the picture is not pretty. Let’s end the data wars and be honest about how to help the children who have fallen through the cracks in the last 10 years.

    Like

    Reply
  4. edutalknola Avatar
    edutalknola

    Thank you for your work. We need more researchers looking at ALL of the data on the “reform,” which is the Recovery School District (RSD). New Orleans has long been known as one of the worst if not the worst district in our state. 10 years ago the state took all of those “bad” schools and promised to do a better job. They never re-opened many of the schools, so automatically by virtue of doing nothing but keeping some schools closed, the RSD can take credit for having fewer failing schools. The state then closed 26 RSD New Orlens schools displacing nearly 5000 students in a 6 years time period. That will certainly get you fewer failing schools. THAT’S PROGRESS! The LDOE even closed 7 of the new charters schools it opened post-Katrina, displacing 1700 of those 5000 students. That is certainly a way to make your charter school performance look better than it actually is. The one thing the state couldn’t do with closing schools, is hide the actual student achievement from NAEP test scores. Clearly with all of the moving children around, the impact on students has not been transformative enough in the worst school district in the state to push Louisiana out of the cellar of NAEP scores.

    As a native New Orleanian, a public school graduate and the mother of public school graduates over the last 23 years, I am sick of the data wars. I got involved with public education because I wanted to keep my own son from becoming a high school drop out and criminal like one of my brothers. My other 3 brothers spent their entire school careers in special educaiton. I soon realized that my son and my brother were like many young Black males in New Orleans. They were falling through the cracks. I really wanted the RSD reforms to be successful because it would mean fewer people like my brother who became a criminal in my city. That’s all I have every wanted, better outcomes for children like mine and like my brothers. It saddens me that after 10 years, the RSD has not done a good enough job of improving the outcomes for our sons. In fact, a recent report tells us that we have 26,000 youth between the ages of 16-24 who are not in school or employed. Worse yet, in my work as an advocate for parents of students with disabilities, I continue to come across families with children who fall through the cracks of this broken “Recovery School District.” Over the past week I’ve been criticized for not acknowledging the “progress” of the RSD. Forgive me, but I can’t see the progress because I keep hearing from parents like the one I met today whose child has been educated only in the reform and is 14 years old entering 7th grade. It doesn’t look good for this child moving out of 7th grade by the end of this school year. This is the only school this child has attended since 1st grade. Over that time period the school “improved” from an F school to a C school. Yet, this school failed to provide this child with the support he needed. Is this mother supposed to be happy with the the chorus of accolades heaped upon the RSD for the “progress.” they’ve made in 10 years?

    I want to see more focus on how the reforms in New Orleans are impacting our most challenged children. I want every child counted in the data wars and getting better outcomes in my city. I want parents of students with disabilities benefiting from whatever “innovative” strategies that are being used to improve the lives of our children. I want people to stop playing games with the data and give it freely to researchers so we can find out whats happening based on the tests our children are forced to take. Most of all, I want to see more young men like my brothers educated well enough to be employed and not incarcerated in my city. When we look at outcomes for African American males in New Orleans, the picture is not pretty. Let’s end the data wars and be honest about how to help the children who have fallen through the cracks in the last 10 years.

    Like

    Reply
    1. Dr. Julian Vasquez Heilig Avatar
      Dr. Julian Vasquez Heilig

      Yes! I’ll follow your lead.

      Like

      Reply

Leave a comment

Cloaking Inequity is an online platform for justice and liberty-minded readers. I publish reflections, analysis, and commentary on education, democracy, culture, and politics.

Subscribe to stay informed whenever I publish new content. I never send spam, and you can unsubscribe anytime—no strings attached.

Go back

Your message has been sent

Cloaking Inequity

Email me at jvh@alumni.stanford.edu