Cloaking Inequity

With increased attention and focus given by President Donald Trump and Secretary of Education Betty Devos to charter schools as an alternative to neighborhood public schools, it is crucial to analyze whether or not students who attend charter schools actually display better education performance results than public school students. While standardized test measures are not the most complete or ideal to analyze student outcomes, they can play an important factor in analyzing whether or not charter schools do truly deliver better performance for students.

This post utilizes data from the National Assessment of Educational Progress (NAEP). The National Assessment of Educational Progress (NAEP), first administered in 1969, is the largest continuing and nationally representative assessment of what our nation’s students know and can do in subjects such as mathematics, reading, science, and writing. Standard administration practices are implemented to provide a common measure of student achievement and is consider “the nation’s report card.” The NAEP is a national assessment of American students conducted by the National Center for Education Statistics and the U.S. Department of Education.

For this post, The NAEP Data Explorer tool was used to compare student performance results at the national and large city level. Composite scale scores were compared for charter schools vs. non-charter school students at the “large cities” level due to the fact that the majority of charters are located in urban areas. This study considered the publicly available composite reading, mathematic, and science scores for 4th, 8th, and 12th graders over the course of six years (2009-2015). This post provides a school-level type analysis and not a student-level growth analyses due to the fact that the student-level data is not publicly available online (For student level NAEP data comparisons see for example School Sector and Academic Achievement: A Multilevel Analysis of NAEP Mathematics Data). Note: We are aware from recent personal conversations in DC that NAEP will soon release a student-level charter school study.

Results

While one would most likely suspect from the current positive public discourse about charter schools that they would display higher national and large city performance compared non-charter neighborhood schools, this is not actually the case when considering the NAEP data on a school level. Out of the 28 total comparison tests run, charter schools only displayed higher composite score averages than non-charter neighborhood public schools in 4 cases. Only in the cases of 8th grade reading and math in the years 2013 and 2015 did charter schools display higher large city composite score averages than non-charter neighborhood public schools. In the large city comparison for 4th grade reading in the year 2013, charter schools and non-charter neighborhood public schools displayed the same average composite scale scores. In the other 23 cases charter schools displayed lower average composite scores than non-charter neighborhood public schools.

What were the average differences? Overall, the 18 comparisons utilizing national samples non-charter neighborhood public schools displayed composite scores 9.3 points higher on average than charter schools. For the ten comparisons using samples from large cities non-charter neighborhood public schools displayed composite scores 0.3 points higher on average than charter schools. While this is a much smaller average difference than the comparisons using national samples, these results are still important for the public discourse as charter schools are presently being presented as a superior alternative to the public school system. If in fact the relationship between charter school and improved student performance is not being realized, then many of the present conversations concerning the topic of charter schools clearly need to be reframed…

4^th Grade Composite Score Comparisons (National and Large City)

Mathematics

Reading

Science

8^th Grade Composite Score Comparisons (National and Large City)

Mathematics

Reading

Science

12^th Grade Composite Score Comparisons (National) 

Mathematics

Reading

Science