How and why to avoid Florida’s flaws

It’s not too late to improve state ESSA plans. Approved state ESSA plans can be amended at any time. That’s both good news and bad news.

I fear the premature approval by the U.S. Department of Education (USED) of Florida’s plan to implement the Every Student Succeeds Act (ESSA) could have a negative impact on plans from other states whose policy makers may be aware of and seek the same dispensations accorded Florida. The good news is candidates for state office are on the campaign trail in 46 states, listening to voters. Education stakeholders can forestall backsliding and pave the way for improvements by making public their support for, or their disappointment with, their state ESSA plan.

My fundamental objection to Florida’s ESSA plan is that its failure to comply with the letter of the law, respect its civil rights legacy, and honor its goals can harm children. Two examples from Florida’s plan illustrate the problem and suggest its causes.

No effort to provide native language assessments

Using the Official English amendment to the state constitution as a shield, Florida has made no effort at all to comply with this requirement.

However, the amendment never mentions education and includes no prohibitions. While the state indicates “government services in languages other than English ” are ruled out, the truth is a multiplicity of such services are provided or required by the Florida Department of Education (FLDOE) and described on its web site.

Why would the FLDOE advance an argument so lacking in credibility? Why squander the opportunity for federal funding to get an accurate and valid measure of the content knowledge of 10% of the state’s students? Why would the FDOE abdicate its leadership role in cultivating the treasures multicultural, international, and emerging bilingual students bring to the state?

In 1988, 84% of Florida voters supported the Official English amendment. Language is still a hot button issue. In September, Florida newspapers published two articles on language issues. Readers on both sides of the language divide had reasons to take offense and noted their reactions (and in several instances, their anti-immigrant animus) in the comments sections of the articles.

One out of every four Florida residents is Hispanic, including over a million Puerto Ricans who moved to Florida by 2015. The Pew Research Center reports vast majorities of Hispanics nationally support Spanish language competence for future generations. Candidates for election court the Hispanic vote but don’t want to jeopardize support from other voters. The term-limited Florida Governor is a candidate for the U.S. Senate. A misplaced zeal to sidestep conflict may explain why the state published but never submitted its draft waiver requests. Instead, the initial submission jeopardized the state’s federal funding with a plan written as though waiver requests had been approved.

Florida’s January 15, 2009 implementation plan for the No Child Left Behind Act includes reference to the A+ Plan, signed into law in1999 and crafted by former Governor Jeb Bush and former Commissioner of Education Frank Brogan, now assistant secretary for elementary and secondary education in USED. The 2009 report card grade provisions based on the A+ plan are very similar to those in Florida’s approved ESSA plan.

Appendix E of the 2009 document includes the FLDOE’s view that it would be just too much trouble to change what Florida has been doing.

Florida already has a tremendous investment in its A+ Plan for Education, and educators and citizens are familiar with it. To make changes would require amendments to existing statutes, administrative rules, computer programs, administrative infrastructure, and information dissemination to all public schools (p. 102).

Failure to include subgroup performance and progress in gaining English language proficiency (ELP) in calculations for school report card grades

Although down pedaled in the state plan, the FDOE has clarified elsewhere that there will be “No changes to Florida’s state accountability systems” and trivialized ESSA’s civil rights guardrails by stating that the state plan “Adds a Federal calculation to satisfy ESSA requirements”. The matter is ridiculed in an article comparing the review process to ”jumping through hoops”. The Editor-in-Chief of the blog that published the “hoops” article is Brian Burgess, former communications director for the Scott campaign for governor.

The A-F report card grade compels attention. The Florida plan’s detour around ESSA requirements diverts attention from the needs of schools with challenged students. Tier 1 targeted assistance triggered by federal calculations offers little more than access to universal on-line resources already available to all schools. It is likely historically underserved students will continue to be undeserved. As stated by the Rev. Dr. Russell Meyer, Executive Director, Florida Council of Churches, “No attention, no correction“.

According to USED, since the law does not require a report card grade the Department has nothing to say about it. That interpretation amounts to license for states to ignore congressional intent.

The Alliance for Excellent Education sets forth the argument for an alternative interpretation. The Alliance concludes that whether or not ESSA requires states to rate each school, if the state does so to comply with the law’s requirements, it must use subgroup performance.

Takeaways

To clarify requirements and promote compliance, the law must be more specific and must direct federal and peer reviewers to fact check state plans.

Determination of whose interests are advanced in the state ESSA plan goes to the heart of the matter. What has priority: the needs of children, the political aspirations of elected policy makers, the districts’ interest in protecting bragging rights, preservation of the legacy of former education leaders, or workload considerations of the public servants who write the state plans? The answer to this question will suggest additional solutions.

ESSA provides resources to schools whose students need help. The distribution of resources is one of the functions of the political system. We can have an impact on that system in a few weeks, and again in 2020, by voting for lawmakers who commit to addressing the needs of all children.

Vote!

Dr. Rosa Castro Feinberg, a former teacher and retired faculty member for Florida International  University,  served on the Miami-Dade School Board from 1986 to 1996. She is co-chair of the Government and Media Relations Committee for the Florida Chapter of the League of United Latin American Citizens (LULAC).

Examining the myth of accountability, high-stakes testing and the achievement gap

We are proud to announce a new peer-reviewed paper entitled Examining the myth of accountability, high-stakes testing and the achievement gap In this article, we outline how notions of accountability and the achievement gap have relied upon the massive expansion of high-stakes exams in our nation’s schools. Texas-style test and punish accountability manifested in various ways within schools and school culture across the nation via NCLB, which undermined notions of trust within the teaching profession. More than decade of national education policy focused on high-stakes testing and accountability—despite that the fact that the rise of high-stakes testing also involved considerable legal, ethical, and social considerations. We argue the practice of spending large amounts of time on test preparation and test taking must be reversed lest we continue on the path of maintaining schools solely as machinery for stratification. We conclude that market- and business-oriented ideology, has reinforced the racist under- and overtones of testocracy in the United States and has neither closed the achievement gap nor fomented meaningful accountability or success.

Citation: Vasquez Heilig. J., Brewer, J. & Pedraza, J. (2018). Examining the myth of accountability, high-stakes testing and the achievement gap, Journal of Family Strengths, 18(1), 1-14.

Examining the Myth of Accountability, High-Stakes Testing, and the Achievement Gap

Julian Vasquez Heilig, California State University Sacramento

Jameson Brewer, University of North Georgia

Jimmy Ojeda Pedraza, California State University Sacramento

Popularity and Common Belief: Birth of Texas-Style Accountability

In the late 1990s, students of color in the large, urban high schools in Houston were reporting that they had 0% dropouts, and it was claimed that the achievement gap on the Texas Assessment of Academic Skills (TAAS) was closing rapidly. Education reformers attributed all of this purported success directly to Texas’s implementation of high-stakes testing and accountability (Vasquez Heilig & Darling-Hammond, 2008). The Houston Independent School District and many other traditionally underperforming districts across the state were suddenly a success—it was a Texas miracle (Haney, 2000). But had Houston, and Texas, really experienced a miracle that would justify codifying high-stakes testing and accountability for every student in the entire nation?

Although the standards, testing, and accountability education reform movement is firmly situated as an offspring of the 1983 release of A Nation at Risk (ANAR), surely the passage of the No Child Left Behind (NCLB) Act of 2001 was rooted in policy making in Texas (Vasquez Heilig, Brewer, & White, 2018). In the 1980s and 1990s, there was a concerted push by Texas policymakers and business leaders to reform the state’s schools (Vasquez Heilig & Darling-Hammond 2008). Texas was one of the earlier states to develop statewide testing systems during the 1980s, adopting minimum competency tests for school graduation in 1987 (Carnoy, Loeb, & Smith, 2003). In the early 1990s, the Texas Legislature passed Senate Bill 7 (1993), which mandated the creation of Texas-style public school accountability to rate school districts and evaluate campuses. Signed into law by Democratic Governor Ann Richards in 1993, S.B. 7 represented a bipartisan attempt to remedy the state’s educational woes as it was passed by a wide margin in both the Texas House and Senate.

The first Texas accountability system, an information forum that used test scores and other measures of student progress to determine whether school districts should remain accredited by the state, was implemented in 1994. The Texas accountability system was undergirded by data in the Public Education Information Management System (PEIMS), a state-mandated curriculum, and statewide standardized testing to measure student proficiency in core subjects.

From 1995 to 1999, test-based accountability commenced in Texas under Governor George W. Bush. During this period, educational policy in the state evolved beyond implementing district-level consequences to applying a variety of sanctions on teachers, principals, and schools. The state also saw the promulgation of higher stakes for students, such as the abolition of social promotion, which is automatic grade progression. For example, in Houston, Superintendent Rod Paige utilized TAAS and Stanford 9 test scores to determine whether students should advance to the next grade (Vasquez Heilig & Darling-Hammond, 2008).

The prevailing theory of action underlying Texas-style high-stakes testing and accountability ratings was that schools and students held accountable to these measures would automatically increase their educational output as educators tried harder, schools adopted more effective methods, and students learned more. Pressure to improve test scores would produce genuine gains in student achievement (Scheurich, Skrla, & Johnson, 2000. As test-based accountability commenced in Texas, achievement gains across grade levels conjoined with increases in high school graduation rates and decreases in dropout rates brought nationwide acclaim to the Texas accountability “miracle” (Haney, 2000).

The Texas miracle narrative was supported by high-stakes testing trends purportedly showing that African American and Latina/o students were closing the achievement gap on state-mandated tests over time. The first generation of Texas-style accountability relied on the TAAS from 1994 to 2002. For example, African Americans increased their achievement on the TAAS Exit Math; whereas only 32% met minimum standards in 1994, 85% did so by 2002. Concurrently, the percentage of Latinas/os meeting minimum standards increased from 40% to 88%. Although an achievement gap between minorities and whites remained, the gaps for Latinas/os and African Americans narrowed to 8% and 11%, respectively, between 1994 and 2002. Despite apparent success on the state-controlled TAAS test, large gains were not reflected in other national comparative exams, such as the National Assessment of Educational Progress (NAEP), American College Test (ACT), and Scholastic Achievement Test (SAT) (Vasquez Heilig, Jez, & Reddick, 2012).

Foundations and Literature: Accountability and High-Stakes Testing

Early on, the research literature echoed the administrative progressive ideals that the long-term implications of accountability pointed to increased efficiency and achievement (Cohen, 1996; Smith & O’Day, 1991); however, others, positing Deweyan ideals, argued that testing would ultimately narrow the curriculum and negatively affect classroom pedagogy (McNeil & Valenzuela, 2001; Valencia & Bernal, 2000). Nevertheless, at the point of the national implementation of NCLB, the Texas miracle was the primary source of evidence, fueling the notion that accountability created more equitable schools and districts by positively affecting the long-term success of low-performing students (Nichols, Glass, & Berliner, 2006). In theory, accountability spurs high schools to increase education output for all students, especially for African American and Latina/o students, who have been historically underserved by U.S. schools. Yet the question remains: Do policies that reward and sanction schools and students based on high-stakes test scores improve African American and Latina/o student outcomes over the long term?

We’ve already discussed testing before NCLB, so we now examine dropout data after the passage of NCLB to consider an additional measure of success. In 2005, when Texas began to use the National Center for Education Statistics (NCES) dropout definition for leaver reporting, the yearly count tripled for Latinas/os and quadrupled for African Americans (Vasquez Heilig et al., 2012). Clearly, Latinas/os and African Americans were overrepresented in the underreporting of yearly dropouts. In the 1998-1999 school year, the Texas Education Agency (TEA) introduced the tracking of individual students in cohorts between grades 9 and 12. African American and Latina/o cohort dropout rates halved between 1999 and 2005. However, after 2005, with use of the NCES dropout standard for leaver reporting, a 100% increase in the number of publicly reported dropouts occurred in Texas (Vasquez Heilig et al., 2012).

Notably, the cohort dropout rates more than doubled for African Americans and Latinas/os after adoption of the NCES standard. These numbers align with empirical research critical of the TEA’s publicly reported dropout numbers (Losen, Orfield, & Balfanz, 2006; Vasquez Heilig & Darling-Hammond, 2008) and suggests that the number of students who left was underreported for quite some time by the state, especially when it came to African American and Latina/o populations. In summary, after NCLB, Texas did not experience an educational miracle, and the TEA vastly misrepresented the Lone Star State’s success during the pre- and post-NCLB accountability eras.

Legal Implications: Accountability, High-Stakes Testing, and the Courts

For about a hundred years, high-stakes standardized tests have been used to sort and track students in the United States. The use of tests was spurred early on by the racist eugenics movement to affirm its belief that one race was intellectually superior to another (Sacks, 1999). The first and most influential federal legal challenge in terms of high-stakes testing was Debra P v. Turlington (1981). The case was brought the National Association for the Advancement of Colored People (NAACP) on behalf of African American students who had failed the Florida high school exit exam. The NAACP argued in the lawsuit that students were not given enough notice and that the test was racially unfair. Furthermore, “at the time of the 1979 hearing, after three test administrations, the failure rate of Black students was approximately 10 times greater than that of White students” (Debra P. v. Turlington, 1984, p. 1405). The court ruled in favor of the state but imposed two requirements on the schools: (1) Schools had to give students sufficient notice of the exam and (2) had to demonstrate that the subject matter that needed to be learned to pass the exam was in fact taught at the school. The court concluded that the “state may condition the receipt of a public-school diploma on the passing of a test so long as it is a fair test of that which was taught” (Debra P. v. Turlington, 1981, p. 406).

We now discuss two other notable challenges to high-stake testing in state courts. Student No. 9 v. Board of Education and Valenzuela v. O’Connell were two state court challenges that resulted in testing policy changes. In Student No. 9 v. Board of Education, the seniors graduating in the state of Massachusetts in 2003 challenged the state’s high school exit exam, known as the Massachusetts Comprehensive Assessment System (MCAS). The students argued that the MCAS “violated both due process and equal protection under the state constitution” (Holme & Vasquez Heilig, 2012). They believed that the test was unlawful and did not appropriately test their knowledge. The Massachusetts Supreme Judicial Court ruled against the students. However, the school was required to provide written notice to students if they failed the test, provide retesting opportunities, improve access and instruction for English language learners (ELLs) and disabled students, take specific action to reduce the number of dropouts, and reduce restrictions on appeals for students who fail (Massachusetts Department of Elementary and Secondary Education, 2006).

In Valenzuela v. O’Connell, California students challenged the California High School Exit Exam (CAHSEE). The students stated that the CAHSEE was unconstitutional because low-income and minority students were not given the same access to educational resources as their more affluent counterparts. The Alameda County Superior Court judge sided with the students. Ultimately, California Assembly Bill 347 passed, which required instruction services at no cost to students for those who had not passed the CAHSEE for two consecutive years after grade 12 (Holme & Vasquez Heilig, 2012). Furthermore, the bill required the local county office of education to verify whether or not the districts were complying with the provisions of the settlement (California Education Code Section 52380.7a). In 2017, California passed Assembly Bill 830, following the recent trend among states to abandon high-stakes exit exams.

Ethical Implications: Accountability, High-Stakes Testing, and Gaming

For two decades, on the basis of the Texas miracle, policymakers and pundits argued that high-stakes testing was the answer to improving the educational system in the United States. It is now very rare to hear these arguments. Therefore, it is important to ask who is harmed the most by high-stakes testing? When test scores are tied to a school’s access to funds, schools have acted rationally, but perhaps unethically, to game the test and the accountability system (Vasquez Heilig & Darling-Hammond, 2008). The process of gaming the system has caused many students, many of them of low socioeconomic status, to be pushed out of school—essentially making schools averse to at-risk students (Vasquez Heilig, Young, & Williams, 2012). Gaming responses have not only wrongfully placed students in courses that are not beneficial but also have led to the assignment of low-scoring students to special education so that their scores are not factored into school accountability ratings (Allington & McGill-Franzen, 1992; Figlio & Getzer, 2002). Moreover, research has found that schools encourage low-scoring students to leave school, transfer to general equivalency diploma (GED) programs, or drop out so that their scores will not affect a school’s funding (Haney, 2000; Smith, 1986). Thus, it is clear that when high-stakes testing is connected to school funding, schools have found a way to game the system, at the expense of our most vulnerable students.

Social Implications: Accountability, High-Stakes Testing, and Stratification

There are also important large-scale social implications of accountability and high-stakes testing that purposefully affect social stratification. A noble lie is a myth or untruth, told by the elites in society to maintain social harmony and advance an agenda of social engineering. Plato described the noble lie in The Republic via a fictional tale about society being divided into sections of silver, iron, brass, and gold. High-stakes exams and accountability have essentially functioned as a noble lie because these “reforms” have not fomented equity or social justice but instead have codified a sorting mechanism of stratification—gold, silver, brass, and iron—or, in the parlance of NCLB, “Far Below Basic,” “Below Basic,” “Basic,” “Proficient,” and “Advanced.”

NCLB politically framed tests and accountability as civil rights; however, it entailed a variety of deleterious social implications. First, testing proponents went too far and caused a widespread backlash by requiring too many exams. For example, Texas required students to pass 15 exams to graduate from high school. This overemphasis on testing in Texas and elsewhere led to a national movement to “opt out” of testing. Second, exit exam failure means that students cannot receive a high school diploma, which has had a disparately large effect on low-income students and students of color, who are less likely to pass standardized exams. The fact that a student has not received a high school diploma because of failure to pass exit exams ultimately affects his or her lifetime earnings. Third, test-driven “accountability” linked to education reform has led to mass firings of teachers—primarily persons of color—in cities such as Chicago and New Orleans. Fourth, under NCLB, if a school does not raise the scores of students fast enough, the school can be closed or turned over to private operators. Fifth, high-stakes exams and accountability have led to a slowdown in the growth of student success in the United States. Reardon, Greenberg, Kalogrides, Shores, & Valentino (2012) found that improvement in our NAEP scores was more rapid before the implementation of NCLB and determined that it will take 80 more years to close the achievement gap. Finally, NCLB and test-driven accountability paved the way for the current conversation about school choice and the private control and privatization of education. The test-driven accountability approach to education not only deprived communities of democratically controlled neighborhood schools, it failed to improve educational outcomes while empowering and increasing segregation via school choice (Vasquez Heilig, 2013). Clearly, the social implications of high-stakes tests suggest that they are a noble lie.

The Dangers: Accountability and High-Stakes Testing

Dworkin and Tobe (2015) point out that accountability concerns focus primarily on trust (or the lack thereof). They outline that trust is either organic or contractual. In organic trust, individuals trust one another through social relationships. The converse of organic trust is contractual trust, in which the terms and conditions of contracts outline the parameters of expectations and provide the opportunity for recourse should that trust be broken. Dworkin and Tobe suggest that the rise of accountability by way of standardized testing in American schools represents a shift from organic trust to a more rigid understanding of the relationship of society to the teacher as one of contractual trust. The trust relationship between a society and its teachers was, as Dworkin and Tobe point out, initially one of organic trust, in which it was understood that the best interests of their students informed the daily practices of teachers. However, the rise of standardized testing as a mechanism for greater accountability represents not only a shift toward a contractual trust arrangement but also suggests that teachers are primarily “motivated by self-interest at the expense of their students” (p. 184). The broader shift toward contractual trust and accountability in education coincides with the growth of the business ideology that has driven much of education reform nationally and internationally.

Again, with ideological roots in the hysteria trumpeted by the release of ANAR, a slew of policy prescriptions related to accountability began to focus even more on the nation’s schools, teachers, and students. The release of ANAR in the 1980s continued what had become an increasing distrust of teachers and schools following their apparent failure to allow us to beat the Soviets into space. The launch of Sputnik in the 1950s coincided with the rise of an accountability philosophy directed at governments, promoted by Milton Friedman, and ushered in a new era of pushing for more accountability (deMarrais, Brewer, Atkinson, Herron, & Lewis, in press). The release of ANAR renewed the fear that schools and teachers had failed our nation’s students—suggesting it would have been considered an act of war if another country had done to us what we had allowed our teachers and schools to do—because they were not being held accountable. In short, ANAR claimed that U.S. schools were trapped in mediocrity and were not necessarily operating efficiently or effectively. The passage of NCLB in the early 2000s—promoted by then President George W. Bush, who purportedly oversaw the “Texas miracle”—created a new era of high-stakes accountability directly linked to standardized testing.

The high-stakes testing accountability that came with NCLB and the incessant push to meet “adequate yearly progress” lest a school lose funding was followed by a rise in teach-to-the-test pedagogy. Additionally, many school districts in large urban centers found that the mandate to implement high-stakes testing was not accompanied by an increase in funds for targeting the out-of-school factors, like poverty, that inform student performance in school. As a result, educators in Atlanta, for example, were pushed or incentivized to change student answers on tests to avoid losing even more funding for the very schools that often received the least amount of funds.

However, the threat of losing funds is a necessary component of the push to inject market- and business-oriented ideology into schools. The rise of punitive measures after poor test results comes straight from the playbook of what educator Jesse Hagopian termed the “testocracy.” In a TEDx talk, Hagopian outlined the fundamental damage that the testing regime—or “testocracy”—does to students; the average student will take 112 standardized tests, many of which are high-stakes tests, between kindergarten and the senior year of high school. The requirement to undergo this battery of exams results in students and teachers spending upward of 16 hours per week in test preparation or test taking (Hagopian, 2016).

Another dangerous component of high-stakes testing is the narrowing of curriculum, which is divided into atomized components geared specifically toward specific tests. The reductionistic practice of linking curriculum and testing puts constraints not only on teacher autonomy to direct and create curriculum but also on the time and flexibility needed to design a curriculum responsive to student interests. And while the reductionistic nature of testing and test preparation pedagogy likely encourages teacher burnout, as Dworkin and Tobe (2015) point out, the general shift toward contractual trust accountability in and of itself may also exacerbate teacher burnout.

High-stakes testing accountability is not limited to curriculum-specific testing. Increasingly, the average SAT score of students at a high school have become a metric for accountability across various levels. Yet, the SAT itself is mired in covert racial bias that traces its very roots back to the eugenics movement (Sacks, 1999) and the assumption that non-Whites are not as intelligent as Whites, regardless of their economic status (Hernstein & Murray, 1994).

Addressing and Debunking: Accountability and High-Stakes Testing

In his discussion of the “testocracy,” Jesse Hagopian chronicles the rise of the opt-out movement that is growing across the country as educators and parents begin fighting back against the rise of standardized testing. In fact, the boycott of the Measures of Academic Progress (MAP) test that began in Hagopian’s high school came from a commitment to “refuse to do harm to students” (Hagopian, 2016).

Furthermore, much of the growth of “no excuses” charter schools and fast-entry teacher preparation programs like Teach For America has rested on the assumption that the best way to overcome poverty is to raise student test scores (Vasquez Heilig, Cole, & Springel, 2011). The logic, as it were, is that a student’s best opportunity to escape generational poverty is through schooling that reduces the process down to test scores. These assumptions intentionally overlook concepts in educational psychology (e.g., Maslow’s Hierarchy of Needs) and the effect that the pangs of poverty have on student performance in schools (Berliner & Biddle, 1995; Biddle, 2014; Brewer & Myers, 2015; Brill, 2011; Coleman, 1990; Coleman et al., 1966; Jencks et al., 1972; Ladson-Billings, 2006; Rothstein, 2004).

The assertion that the best way to alleviate poverty is to increase accountability by way of test scores (1) ignores the fact that two-thirds of all educational outcomes are informed by out-of-school factors (Rothstein, 2010) and (2) reduces poverty to individual failure. Operating under the myth of meritocracy, the assumption that test scores are the ticket out of poverty necessarily requires an assumption that the persistence of generational poverty is due not to systemic inequality but rather to bad teachers and a poor work ethic on the part of students—most often students of color. As a result, we must continue to push back against and debunk the detrimental myths surrounding the expansion of high-stakes testing. Doing so will require an ongoing discussion of the effects of out-of-school factors that testing simply does not address, in addition to further efforts by educators like Hagopian, who refuse to cause more harm to students by way of testing.

Conclusion

In this article, we have outlined how notions of accountability and the achievement gap have relied upon the massive expansion of high-stakes exams in our nation’s schools. The state of Texas has been a hotbed for experimentation with school reform, including the expansion of high-stakes testing. As explicated above, the “Texas miracle” never happened. Nevertheless, a decade of national education policy focused on high-stakes testing and accountability—despite that the fact that the rise of high-stakes testing also involved considerable legal, ethical, and social considerations. Most importantly, Texas-style test and punish accountability manifested in various ways within schools and school culture across the nation via NCLB, which has undermined notions of trust within the teaching profession. The shift from organic to contractual trust has reimagined the role of the teacher to be that of a service provider who, being informed by his or her own self-interest, cannot be trusted to provide sufficient and quality education. The lack of trust that necessitates the need for contractual arrangements of accountability aligns with a business-oriented view of school reform and practices and pushes schools away from humanistic practices and toward market commodification.

Ideology dating back to the 1950s and Milton Friedman’s assertion that government-run schools are innately inefficient and ineffective allowed reformers during the years and decades that followed to continue to find reasons to justify the implementation of policies of accountability. The logic behind the reductionistic nature of high-stakes testing is that it provides a standard quantified metric by which educators can, purportedly, gauge student improvement over time and compare them with one another. And what follows from the ability to compare one student with another is the ability to compare one school with another, or one state with another. The goal of comparison is a key component of market-oriented notions of competition.

In conclusion, the practice of spending large amounts of time on test preparation and test taking must be reversed lest we continue on the path of maintaining schools solely as machinery for stratification. The foundation of high-stakes testing in the United States clearly has roots connecting the practice of sorting with the eugenics movement, which sought to “prove” through testing the existence of a racial hierarchy of intelligence. This foundation, in addition to market- and business-oriented ideology, has reinforced the racist under- and overtones of testocracy in the United States and has neither closed the achievement gap nor fomented meaningful accountability or success.

References

Allington, R. L., & McGill-Franzen, A. (1992). Unintended effects of educational reform in New York. Educational Policy, 6(4), 397–414.

Berliner, D. C., & Biddle, B. J. (1995). The manufactured crisis: Myths, fraud, and the attack on America’s public schools. Reading, MA: Addison-Wesley.

Biddle, B. (2014). The unacknowledged disaster: Youth poverty and educational failure in America. Rotterdam, The Netherlands: Sense Publishers.

Brewer, T. J., & Myers, P. S. (2015). How neoliberalism subverts equality and perpetuates poverty in our nation’s schools. In S. N. Haymes, M. V. d. Haymes, & R. Miller (Eds.), The Routledge handbook of poverty in the United States (pp. 190–198). New York, NY: Routledge.

Brill, S. (2011). Class warfare: Inside the fight to fix America’s schools. New York, NY: Simon & Schuster.

Carnoy, M., Loeb, S., & Smith, T. L. (2003). The impact of accountability policies in Texas high schools. In M. Carnoy, L. S. Siskin, & R. F. Elmore (Eds.), The new accountability: High schools and high-stakes testing (pp. 147–175). New York, NY: RoutledgeFalmer.

Cohen, D. (1996). Standards-based school reform: Policy, practice, and performance. In H. F. Ladd (Ed.),  Holding schools accountable: Performance-based reform in Education (pp. 99-127). Washington, DC: Brookings Institution Press.

Coleman, J. (1990). Equality and achievement in education. Boulder, CO: Westview Press.

Coleman, J., Campbell, E. Q., Hobson, C. J., McPartland, J., Mood, A. M., Weinfeld, F. D., & York, R. L. (1966). Equality of educational opportunity. Washington, DC: U.S. Government Printing Office.

Debra P. v. Turlington, 644 F.2d 397 (5th Cir., 1981).

Debra P. v. Turlington, 730 F.2d 1405 (11th Cir., 1984).

deMarrais, K., Brewer, T. J., Atkinson, J. C., Herron, B., & Lewis, J. (in press). Philanthropy, hidden strategy, and collective resistance: A primer for concerned educators. Borham, ME: Myers Education Press.

Dworkin, A. G., & Tobe, P. E. (2015). Does school accountability alter teacher trust and promote burnout? In J. H. Ballantine & J. Z. Spade (Eds.), School and society: A sociological approach (5th ed.). Los Angeles, CA: Sage.

Figlio, D. N., & Getzer, L. S. (2002). Accountability, ability, and disability: Gaming the system? Cambridge, MA: National Bureau of Economic Research.

Hagopian, J. (2016). More than a score: Giving students a solid chance.  Retrieved from https://www.youtube.com/watch?v=gL64chNiuJQ

Haney, W. (2000). The myth of the Texas miracle in education. Education Policy Analysis Archives, 8, 41. doi:10.14507/epaa.v8n41.2000

Hernstein, R., & Murray, C. (1994). The bell curve: Intelligence and class structure in American life. New York, NY: Free Press.

Holme, J. J., & Vasquez Heilig, J. (2012). High-stakes decisions: The legal landscape of high school exit exams and the implications for schools and leaders. Journal of School Leadership, 22(6), 1177-1197.

Jencks, C., Smith, M., Acland, H., Bane, M. J., Cohen, D., Gintis, H., . . . Michelson, S. (1972). Inequality: A reassessment of the effect of family and schooling in America. New York, NY: Basic Books.

Ladson-Billings, G. (2006). From the achievement gap to the education debt: Understanding achievement in U.S. schools. Educational Researcher, 35(7), 3–12.

Losen, D., Orfield, G., & Balfanz, R. (2006). Confronting the graduation rate crisis in Texas (Civil Rights Project at Harvard University).

Massachusetts Department of Elementary and Secondary Education. (2006). Settlement allows MCAS to stand as graduation requirement [Press release]. Retrieved from http://www.doe.mass.edu/news/news.aspx?id=2907

McNeil, L., & Valenzuela, A. (2001). The harmful impact of the TAAS system of testing in Texas: Beneath the accountability rhetoric. In M. Kornhaber & G. Orfield (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education (pp. 127–150). Washington, DC: Brookings Institution Press.

Nichols, S. L., Glass, G. V., & Berliner, D. C. (2006). High-stakes testing and student achievement: Does accountability pressure increase student learning?. Education Policy Analysis Archives/Archivos Analíticos de Políticas Educativas, 14.

Plato. The Republic. (trans. 1942 by B. Jowett). In L. R. Loomis (Ed.), The great dialogues (pp. 217–477). Roslyn, NY: Walter J. Black.

Reardon, S., Greenberg, E., Kalogrides, D., Shores, K., & Valentino, R. (2012). Left behind? The effect of no child left behind on academic achievement gaps (Working paper). Stanford, CA: Stanford University Press.

Rothstein, R. (2004). Class and schools: Using social, economic, and educational reform to close the Black-White achievement gap. Washington, DC: Economic Policy Institute.

Rothstein, R. (2010). Rothstein: Why teacher quality can’t be only centerpiece of reform. Retrieved June 11, 2018 from http://voices.washingtonpost.com/answer-sheet/school-turnaroundsreform/rothstein-on-the-manifestos-ma.html

Sacks, P. (1999). Standardized minds: The high price of America’s testing culture and what we can do to change it. New York, NY: Da Capo Press.

Skrla, L., Scheurich, J. J., & Johnson, J. F. (2000). Equity-driven achievement-focused school districts: A report on systemic school success in four Texas school districts serving diverse student populations. Austin, TX: Charles A. Dana Center.

Smith, F. (1986). High school admission and the improvement of schooling. New York, NY: New York City Board of Education.

Smith, M. S., & O’Day, J. (1991). Educational equality: 1966 and now. In D. A. Verstegen & J. G. Ward (Eds.), Spheres of justice in education. New York, NY: Harper Collins.

Vasquez Heilig, J. (2013). Reframing the refrain: Choice as a Civil Rights issue. Texas Education Review, 1(1), 83–94.

Vasquez Heilig, J., Cole, H., & Springel, M. (2011). Alternative certification and Teach For America: The search for high quality teachers. Kansas Journal of Law and Public Policy, 20(3), 388–412.

Vasquez Heilig, J., & Darling-Hammond, L. (2008). Accountability Texas-style: The progress and learning of urban minority students in a high-stakes testing context. Educational Evaluation and Policy Analysis, 30(2), 75–110.

Vasquez Heilig, J., Jez, S., & Reddick, R. (2012). Is Texas leading its peers and the nation?: A decadal analysis of educational data. Austin, TX: The Institute for Urban Policy Research and Analysis, University of Texas at Austin.

Vasquez Heilig, J., Young, M., & Williams, A. (2012). At-risk student averse: Risk management and accountability. Journal of Educational Administration, 50(5), 562–585.

Vasquez Heilig, J,. Brewer, T. J., & White, T. (2018). What Instead?: Reframing the debate about charter schools, Teach For America, and testing. In R. Ahlquist, P. Gorski, & T. Montano (Eds.), Assault on kids and teachers: Countering privatization, deficit ideologies and standardization of U.S. schools (pp. 201–217). New York, NY: Peter Lang.

A New Approach to Remedy Education Inequity?: Opportunity to Learn (OTL) “State Minimums” for School Finance

In my recent School Law and Policy course at California State University Sacramento, I challenged my EDD students to work with me to detail a new input orientation, empirically-based idea for school finance based on Opportunity to Learn (OTL) “state minimums.” I believe that we have come up with a jumping off point for a promising approach to thinking about the ingredients necessary to improve student success and address longstanding inequality in US schools.

Revisiting Opportunity to Learn (OTL) is potentially a vehicle to remake the US educational system. OTL is a way of measuring and reporting whether students from all economic backgrounds have access to the different ingredients that make quality schools. Derek W. Black, Law Professor at the University of South Carolina, related in his book Education Law: Equality, Fairness, and Reform that core opportunities to learn include high quality Early Childhood Education, highly effective teachers, and a broad college bound curriculum designed to prepare all students to participate effectively in the US democracy.

OTL matters because learning is essential to the economy and the nation as a whole. However, some districts and schools provide students with greater opportunities to learn while others offer less opportunities. In essence, OTL is not equally distributed throughout the US. Many districts and schools have trouble meeting basic OTL standards. For example, decades of research has demonstrated that schools with the highest numbers of Latino/a and African American students enrolled often have textbook shortages and the lowest levels of qualified teachers. Because there are persisting learning opportunity disparities at the state, district and school-level, it is imperative that national OTL standards be implemented.

The 1994 reauthorization of the Elementary and Secondary Education Act (ESEA) included OTL standards, but they were voluntary and vague. The states could reject the national standards and implement their own. While OTL standards were voluntary, the 1990s saw a the rise of academic standards linked to codified high-stakes testing and accountability formulas. 

During the NCLB-era, high-stakes testing and accountability proponents posited that the US could test its way to closing achievement gaps. What the testing regimes underscored was the vast difference in students success relative to students race/ethnicity and socio-economic status. Research has long shown the impact of poverty on children’s readiness for learning is profound. The poverty rate among children is not random but is unequally distributed across racial/ethnic backgrounds. To improve learning opportunities for disadvantaged children and substantially improve their educational outcomes, a proactive national policy agenda must focus on ensuring the coordinated provision of opportunities in a broad range of equity areas, including not only qualified teachers, up-to-date textbooks, adequate facilities, and other aspects of K-12 education, but also in regard to areas like health, nutrition, housing, and family supportBy developing and implementing OTL national standards, the policymaking community will help students, parents, communities, and school officials discover and correct disparities—especially as it relates to poverty—in schools. Having national OTL minimum standards would ensure that all school officials across the country are accountable for the educational inputs.

In most states, insurance (car, home, etc.) is governed by state minimums for each policyholder. The core of this approach from insurance laws undergirds the OTL state minimums approach—essentially, based on the OTL literature, we seek to develop state minimums for inputs across a variety of priorities. School funding should be input oriented, working forward from the ingredients necessary for student success instead of backwards from legislative whims. Once these minimums categories are established, it can then be determined what minimum level is allowable for every school. Then, districts and the state would be held accountable for providing the minimum OTL state minimum standards in each school. Districts and schools could of course go above the guaranteed minimums, but they must provide at least the minimums. As a result, this proposal is a first take to detail potential OTL state minimum standards which would then underpin school finance conversations.

Table. 1 Overview of Opportunity to Learn (OTL) “State Minimums” Targets

Targets
A. School Climate 

  • Yearly measurement of climate and safety (students, teachers, administrators, and parents)
  • Yearly measurement of Diversity, Inclusion, and Equity (students, teachers, administrators, and parents)
  • Strategic school climate plan
B. Parent and Community Involvement 

  • Parent liaison
  • Communication system
  • Parent advisory committee
  • Parent development opportunities
C. Assessment and Evaluation 

  • Accreditation
  • Parent and community reporting
  • Strategic plan (i.e. LCAP)
D. Teacher Quality 

  • Professional development, induction and mentoring
  • Staffing strategies (recruitment and retention)
  • Qualifications (credentials, knowledge, and experience)
E. Administrative Quality

  • Credentialed
  • Yearly measurement of quality (students, teachers, and parents)
  • Cross-site mentorship
F. Curriculum and Instruction

  • Articulated career and college pathways
  • STEAM opportunities
  • Visual and Performing Arts Electives
  • Ethnic studies
  • Foreign language
  • Secondary dual enrollment
G. Transportation, Facilities and Maintenance

  • Well-maintained
  • Yearly measurement of good repair (students, teachers, administrators and parents)
  • Integrated technology
  • Transportation
H. Wrap Around Services 

  • Counselors
  • Academic Coaches
  • Health and Wellness Services (i.e. nurses, mental health)
I. Extra and Co-Curricular Opportunities 

  • Athletics
  • Community volunteerism
  • Student government, clubs and other activities

School Climate

School climate includes safety as one of the dimensions for creating a sheltered environment. Maslow (1943) indicated that feeling safe—socially, emotionally, intellectually and physically—is a fundamental human need. Additionally, feeling safe in school promotes student learning and healthy development (Devine & Cohen, 2007). There are multiple conducts of safety, one being rules and norms. School with set discipline guidelines and enforcement have a lower rate of violence (Payne, & Gottfredson, 2005). This fact leads to an increase in the positive climate of a school. Another form of safety is school space. The quality of school facilities has been found to positively affect student achievement (Uline & Tschannen-Moran, 2008). Moreover, variables such as classroom layout, activity schedules and student-teacher interactions can influence student behaviors and the feelings of safety. In sum, a positive school climate promotes cooperative learning, group cohesion, respect and mutual trust, which directly improves the learning environment.

Parent and Community Involvement

Family and community engagement has a positive influence on student achievement and behavior. Research has found that schools with family and community partnerships are more successful in improving students’ academic achievement and their college and career readiness compared to schools that do not engage families and community. The positive influence of school practices to engage families is greatest for low-income children; in fact, the disparity between middle- and low-income families’ readiness to work effectively with schools contributes to the achievement gap.

Assessment and Evaluation

Accreditation serves to establish trust in the quality of public schools. Accreditation criteria often include defining clear educational missions and goals, systems and resources to achieve objectives, and processes  to ensure continuous improvement. These criteria empower educators to reflect upon their current practices and engage in innovation. Consequently, it is vital that all schools undergo accreditation and develop a plan for meeting accreditation standards. In the process of preparing for accreditation, schools should engage their local community members. Inviting the community to visit and observe the school will promote transparency and establish a network through which information can be developed and shared. Studies have suggested that increasing community involvement improves educational outcomes for students. The data gathered through accreditation and the information shared by the community will prepare schools to develop relevant and applied strategic plans. Schools should be allowed freedom to allocate resources to address identified areas for improvement while maintaining existing services. A system of local control will promote ownership of the accreditation process.

Teacher Quality 

Students’ opportunity to learn depends on many factors one of which is teachers’ quality. As for college degrees and subject-matter knowledge, research has shown that teachers’ subject-matter knowledge association with student achievement varied by grade level. Furthermore, not only teachers’ experience with years affect student’s learning positively, but also teachers’ ability to motivate their students and to manage their classrooms improves with time resulting in better students’ attendance and in a decrease in the number of students’ violations to school rulesAfter the passage of NCLB, districts have hired of hundreds of thousands more teachers on emergency permits without quality preparation (or no preparation at all) in high- minority and high poverty schools which has negatively impacted students’ opportunity to learn and increased the achievement gap between them and their more affluent peers.

Administrative Quality

Today, school administrators are expected to do more than just leading the school. An administrator is expected to not only be a school leader but also a student advocate, a social worker, a community activist, a conflict manager, while simultaneously fostering student achievement. As a result, in order to improve educational outcomes, it is vital that school administrators be trained and provided mentorship to become skilled in their job duties. An administrative credential should be a requirement for all school administrators.  A credential ensures that the person in charge of a school site has met certain requirements in order to lead. The ability to gain a credential is not just completing a check-list. A credential is one tool to build the capacity of leaders. For example, administrators should be able to expertly demonstrate the skills outlined in the California Administrator Performance Expectations will improve teaching and learning for all students.

Curriculum and Instruction

Curriculum and Instruction  defines the content and pedagogical practices that each school will include to ensure equity in the quality of education that every student will experience. All students will be provided with seven primary components in addition to core content instruction. This will require the inclusion of ethnic studies, foreign language, visual and performing arts, Science Technology Engineering Arts and MATH (STEAM), Career Technical Education (CTE), articulated career and college ready pathways, and secondary dual enrollment. Just as the currently adopted Common Core State Standards (CCSS) add to the linguistic and academic development from year to year, the C & I state minimums will include progressing stages across the grade-levels.

Transportation, Facilities and Maintenance

There is little doubt that school transportation improves the school attendance rate and academic performance. A recent research by UC Santa Barbara professor Michael Gottfried shows the effect of school bus transportation on chronic absenteeism, in some cases a 20 percent increase in attendance. The state should provide free of charge transportation to all students.  Good facilities maintenance cost money in the short-run and save money in the long-run. Facilities maintenance produces savings by:  (1) Decreasing equipment replacement costs over time, (2) Decreasing renovation costs because fewer large-scale repair jobs are needed, and (3) Decreasing overhead costs (such as utility bills) because of increased system efficiency. The state should guarantee all public schools well-maintained facilities and increase spending for school facilities as highlighted in the research report that 80% of students attend districts that are failing to meet minimum industry standards due to lack of spending.

Career Ready and College Pathways

Guarantee all students will have access to well articulated pathways that will prepare them to succeed in  the job market, college or university. Strive to develop internship opportunities with industry and dual-enrollment opportunities with local colleges and universities.

Wrap-Around Services

Critical to student success is the school’s provision of  Socio-emotional Learning services beyond the classroom. It is important that specialized support is given as students face barriers to learning in achieving their educational goals.  Counseling, academic coaching, as well as health and wellness services are wrap-around support that contribute to students’ academic, health and well-being. One-on-one interaction of student with academic coach to focus on strengths, goals, study skills, and school engagement would encourage the student to stay on the path of learning. Counselors on the other hand can guide the students choose relevant courses that affect their life options after graduation. Additionally, health and wellness services staff, which consist of nurses and mental health professionals, ensures that students have access to the physical, emotional and psychological care to function effectively in and out of the classroom.  These wrap-around services iwork hand-in-hand with instructional services to ensure students achieve academic success.

Extra and Co-Curricular Opportunities

Extracurricular activities offer extensive benefits for students. Studies show that participation in extracurricular activities is associated with positive youth outcomes, including higher education attainment and greater future earnings. These opportunities are especially vital for youth from immigrant backgrounds, as they help to build peer relationships and academic motivation.  Maintaining diverse extracurricular offerings within schools will increase accessibility and inclusion for students. Schools should offer a range of athletic, social, and academic extracurricular options. Inviting community members to participate in the leadership and implementation of these offerings will also help to establish a community which prioritizes civic engagement.

Conclusion

High-stakes testing, accountability and the academic standards linked to them have been the primary focus of education reform for the past two decades. Such reforms have done little to address inequities within our educational system— in fact, it can be argued that they have purposefully ignored resource disparities. It is time to move away from reforms that are uni-directional accountability, primarily placing the burden of achievement upon students and educators. We need to focus our attention on creating OTL that will promote student growth and success an create bi-directional accountability that will also extend the press of accountability to policymakers to provision the resources necessary to provide OTL minimum standards.

In summary, Opportunity to Learn standards will establish equitable conditions for all students by outlining key elements and core values that every neighborhood public school should possess to promote student learning and success such as School Climate, Parent and Community Involvement, Assessment and Evaluation, Teacher Quality, Administrative Quality, Curriculum and Instruction, Facilities and Maintenance, Wrap Around Services, and Extra and Co-Curricular Opportunities. The OTL minimum standards reflect education research and proven practices; they evidence a commitment to equity and inclusion as integrative components in advancing student success.

So now, just as I did with the community-based accountability idea five years ago, I am handing off the OTL “state minimums” idea to the policy community to ponder, revise and potentially implement to create more equity in our nation’s schools.

I was honored to work on this project with my California State University Sacramento EDD student co-authors. Here they are in alphabetical order:

 

Sandra Ayón

Zeeshan Ayub

Pete Benitti

Karen Bridges

Suzie Dollesin

Fred Evangelisti

Thomas Herman

Matt Kronzer

Ikbal Nourddine

Rochelle A. Perez

Theresa G. Reed

Irit Winston

 

Breaking News: Community-based Funding and Accountability working in California

I am currently sitting in the Policy Analysis for California Education (PACE) annual conference being held in Sacramento. A new study just dropped that show money clearly matters in California school finance and that it has had a positive impact on student achievement and graduation rates across the state.

https://www.instagram.com/p/BetB8VTl25C/?taken-by=professorjvh

California has been engaged in community-based funding and accountability for the past several years. I have been writing about it for five years now. (See Trumpeting Local Accountability Idea for 5 years!)

Here is the press release from the Learning Policy Center detailing the finding in the new school finance study:

California’s Local Control Funding Formula (LCFF), the school finance overhaul enacted in 2013, is having a measurable positive impact on students’ academic achievement and graduation rates, improving outcomes and narrowing  gaps, according to a study released today by the Learning Policy Institute. The findings were discussed at a meeting of Policy Analysis for California Education in Sacramento. LCFF reallocated school finances based on students need and gave school districts significantly more flexibility in spending.  Schools receive greater funding for each student who is low-income, an English learner, or in foster care. The new formula has come with an increase in k-12 funding—a total of $18 billion by the time LCFF is fully implemented. This is one of the first studies on the impact of LCFF on students’ academic achievement and graduation rates.

The study, Money and Freedom: The Impact of California’s School Finance Reform, examines high school graduation rates, and student achievement by grade and subject (mathematics and reading) in the years before and after the implementation of LCFF for all public schools in California. The study authors found significant increases in all of these areas that track the implementation of LCFF. They also found that students who received higher “dosages” of LCFF (that is, attend school in highest-poverty districts, which receive greater funding under the formula) showed greater academic gains.

Not only did LCFF improve student achievement across the board, the formula¾which provides greater funding for high-poverty schools than for low-poverty schools¾helped to reduce the achievement gap for low-income students and students of color. The authors found that a $1,000 increase in per-pupil revenue for students in grades 10 – 12 increased graduation rates by 5.3 percentage points for students overall and by 6.1 percentage points for low-income children.

The study’s authors also examined the areas in which school districts increased their investments under LCFF. Those increased investments resulted in lower student-to-teacher ratios, increased per-pupil expenditures, increased teacher salaries, and increased instructional expenditures. A significant proportion of districts’ expenditures under LCFF were focused on the classroom. The authors hypothesize that higher teacher salaries may help schools and districts attract and retain better-prepared, high-quality teachers. Recruitment and retention of a high-quality teacher workforce is associated with greater student academic success.

The study concludes that, “Money targeted to students’ needs can make a significant difference in outcomes and narrow achievement gaps.” More succinctly, “Money matters.”

This new study is fantastic news and is important push back again the constituency that has been arguing money doesn’t matter in education for decades and the crowd that has been opposed to community-based approaches to education policy.

The implications for your state is that research is showing that the community-based approach to school finance and accountability should lead to greater student academic success. Please weaponize this information in your local communities and legislatures. To learn even more about community-based accountability click here.

Check out and follow my YouTube channel here.

Please Facebook Like, Tweet, etc below and/or reblog to share this discussion with others.

Want to know about Cloaking Inequity’s freshly pressed conversations about educational policy? Click the “Follow blog by email” button on the home page.

Twitter: @ProfessorJVH

Click here for Vitae.

Thank you for reading Cloaking Inequity.

 

Mismatched Assumptions: Motivation, Grit, and High-Stakes Testing

Since the onset of No Child Left Behind over a decade ago, a lynchpin of accountability formulas for U.S. schools has included some form of a state-mandated exam. Accountability policies have utilized standardized tests as the basis of decisions that determine progression through grade levels, access to higher education, progress in achievement, and resource allocation to schools (Darling-Hammond, 2003). Considering the predominance of high-stakes exams in the current ESSA educational policy environment, a promising avenue of discussion lies in marshaling psychological research to conceptualize how grit or resiliency may or may not interact with high-stakes exams. In this chapter we discuss the (in)adequacy of the current testing and accountability environment for stimulating student success, and marshal established psychological research to consider the paradigm of assessment beyond the uneasy dichotomy that currently pits assessment as a technical exercise incentivizing the measurement of cognitive abilities versus assessment as a potential disincentive to learners’ (especially students of color) academic persistence and success.

Vasquez Heilig, J., Marachi, R., & Cruz, D. (2016). Mismatched Assumptions: Motivation, Grit, and High-Stakes Testing. In S. Nichols (Ed.), Educational Policies and Youth in the 21st Century: Problems, Potential, and Progress, (pp. 145-157).  Charlotte, NC: Information Age Publishing.

Screen Shot 2018-01-23 at 11.26.23 PM.png

We discuss these issues in the book edited by Sharon Nichols entitled Educational Policies and Youth in the 21st Century: Problems, Potential, and Progress. In the chapter “Mismatched Assumptions: Motivation, Grit, and High-Stakes Testing”  we discuss it is profoundly problematic to link underperformance on tests to “grit, growth mindset” or effort-based remedies when the core assessments being administered fail to meet basic standards for testing and accountability. Many of the new, experimental computerized assessments administered to millions of children in “field” tests have been fraught with technological user-access barriers (Marachi, 2015; Rasmussen, 2015; Furman, 2015). As discussed in this chapter, grit and high-stakes tests should be understood within the current context of poverty and other structural factors, the fact that failure rates have arbitrarily been set to fail a majority of students, and the resulting disengagement, frustration, anger, stress, and feelings of despair from “learned hopelessness.”  Is it fair or just for millions of students of color to fail an unfair state-mandated test, despite working hard in the classroom, and this failure be blamed on a lack of grit rather than the real issue— the structure and scoring of unreliable and un-validated tests?

The prevailing theory of action behind the exam requirements and accountability movement is that schools and students held accountable to these measures will automatically increase educational output due to the accountability pressure. The assumption inherent in these policies is that when students and educators are faced with the pressure of examinations, they will simply try harder. Pressure to improve test scores is assumed to produce gains in student achievement as schools work to improve their instruction for low‐achieving students (Vasquez Heilig & Darling-Hammond, 2008).

Despite two decades of high-stakes testing linked to accountability formulas, the U.S. has not closed achievement gaps. At the miniscule rate that the gaps are closing under NCLB, it would take 80 more years for the achievement gaps to close (Reardon, Greenberg, Kalogrides, Shores, & Valentino, 2012) A possible explanation for the stagnant gaps may be that assumptions about human behavior based on test-based accountability systems fundamentally ignore decades of research on human development and motivation. 

High-stakes Testing and Adversity

Current research investigations have considered student achievement in the midst of testing (Vasquez Heilig, Young & Williams, 2012), but,it is also necessary understand how high-stakes testing may impact student’s psychosocial well-being. Understanding whether and how high-stakes examinations diminish achievement motivation is a hypothesis that runs contrary to the prevailing theory of motivation underlying No Child Left Behind and subsequent high-stakes testing policies. However, the lack of improvement of student success in the midst of accountability warrants this careful examination as several prominent policy reports have documented the detrimental impacts of high-stakes testing pressures on youth. For example, Holbein and Ladd (2015) explored how high stakes accountability pressures influenced “non-achievement student behaviors” and conclude the following:

Accountability pressure has the unintended effect… of increasing the number of student misbehaviors such as suspensions, fights, and offenses reportable to law enforcement. Further, this negative response is most pronounced among minorities and low performing students, who are most likely to be left behind. (Holbein & Ladd, 2015, p. iii)

Earlier research also documented the harms of overreliance on accountability-based systems. In “Raising Standards or Raising Barriers? McNeil and Valenzuela wrote,

Those who promote state systems of standardized testing claim that these systems raise the quality of education and do so in ways that are measurable and generalizable. They attribute low test scores to management’s failure to direct its “lowest level” employees (i.e., the teachers) to induce achievement in students. In Texas, the remedy to this situation has been to create a management system that will change behavior, particularly the behavior of teachers, through increased accountability. The means of holding teachers and administrators accountable is the average scores of each school’s children on the state’s standardized test, the Texas Assessment of Academic Skills, or TAAS… this over-reliance on test scores has caused a decline in educational quality for those students who have the greatest educational need.”… (McNeil and Valenzuela, 2001, p. 2)

In a 2010 report, Advancement Project outlined data from the intersections of high-stakes testing and “zero-tolerance” policies highlighting the double-hit of harmful policies that funnel youth into the school-to-prison pipeline.

Perhaps more important is the damage done by high-stakes testing to the student experience in school. Not only do formulaic, test-driven reforms neglect the important role schools have to play in helping students become well-rounded citizens, they also turn school into a much less engaging, even hostile, place for youth by eliminating the components of education they find most interesting. Additionally, the emphasis placed on test results above all other priorities has an alienating and dehumanizing effect on young people, who resent being viewed and treated as little more than test scores…The effects can accumulate even more when additional consequences are attached to the tests. For example, there is a long record of research demonstrating the consistent association of high-stakes exit exams with decreased graduation rates and increased dropout rates. Additionally, the results from standardized tests are often used to retain students in grade. Yet, grade retention has been shown to be the greatest predictor of student dropout. (Advancement Project, 2010, p. 5)

Researchers have argued that resilience is the process (Olsson, 2003) of overcoming the negative effect of risk exposure, coping successfully with traumatic experiences, and avoiding the negative trajectories associate with those risks (Masten & Powell, 2003). Considering the predominance of high-stakes exams in the current educational policy environment, a promising avenue of discussion lies in marshaling psychological research to conceptualize how grit or resiliency may or may not interact with high-stakes exams. In this chapter we discuss the (in)adequacy of the current testing and accountability environment for stimulating student success, and marshal established psychological research to consider the paradigm of assessment beyond the uneasy dichotomy that currently pits assessment as a technical exercise incentivizing the enhancement of cognitive abilities versus assessment as a potential disincentive to learners’ academic persistence and success.

Resiliency and Environment

In recent years there has been growing public interest in understanding why some children grow up to be healthy and well-functioning adults despite having to overcome various forms of adversity in their lives. The phenomenon of successful development under high risk conditions is known as “resilience” in the research literature and much research has been devoted to identifying the protective factors and processes that might account for children’s successful outcomes (Masten, 2001). In short, resilience theory seeks to address the strengths that people and systems demonstrate that enable them to rise above adversity.

Emmy Werner, a University of California child psychologist, conducted a groundbreaking resiliency study in the early 1990s. Werner followed a group of Hawaiian students into adulthood (1955-1986) while monitoring the impact of a variety of biological and psychosocial risk factors, stressful life events, and protective factors on their development (Werner, 1992). She found that about one third of the students who were affected by conditions of “risk” escaped to adulthood without much permanent damage. Werner noted that children who emerged from the risk conditions had at least one person who accepted them as they were such as, teachers, counselors, and other adults who served as role models.

Frequently, resilience studies focus on specific subgroups that represent marginalized communities and their achievements. From an educational perspective, these are usually students from low-socioeconomic status (SES) and students from communities which are statistically less likely to achieve academically (Moote & Wodarski, 1997). Examples of specific groups who have been studied related to resilience include high-achieving African American middle school children participating in athletics (Hawkins & Mulkey, 2005), Mexican American students from low-socio-economic backgrounds who excelled in high school (Gonzalez & Padilla, 1997), and bilingual Latinos who excelled in academic situations (Hassinger & Plourde, Lee, 2005).

Academic resilience can be defined as “the process and results that are part of the life story of an individual who has been academically successful, despite obstacles that prevent the majority of others with the same background from succeeding”  (Morales, 2008, p. 198). Henderson and Milstein (2003) emphasized the importance of the educational environment in the development of resilience when they said, more than any institution (except the family) schools can provide the environment and conditions that foster resiliency in today’s youth and tomorrow’s adults. Achieving the stated goals of academic and life success for all students and an enthusiastic, motivated, change-oriented staff involves increasing student and staff resiliency.

More recently, an emerging area of research that intersects many related research fields overlapping with resilience is in social, affective, and educational neuroscience. Immordino-Yang and Damasio (2007) posited in the inaugural article of Mind, Brain & Education that,

The neurobiological evidence suggests that the aspects of cognition that we recruit most heavily in schools, namely learning, attention, memory, decision making, and social functioning, are both profoundly affected by and subsumed within the processes of emotion; we call these aspects emotional thought. Moreover, the evidence from brain-damaged patients suggests the hypothesis that emotion-related processes are required for skills and knowledge to be transferred from the structured school environment to real-world decision making because they provide an emotional rudder to guide judgment and action. Taken together, the evidence we present sketches an account of the neurobiological underpinnings of morality, creativity, and culture, all topics of critical importance to education.” (Immordino-Yang & Damasio, 2007, p.3.)

While there is no single encompassing definition of resilience, numerous authors, both inside and outside the field of education, have developed their own perspectives over the past several decades. In summary, resiliency is characterized as the heightened likelihood of success in school and other life accomplishments despite environmental adversities brought about by early traits, conditions, and experiences (Wang, Haertel, & Walberg, 1994).

You already knew “grit”?

The conceptualization of grit is not new. Stemming from long history of theorizing about the nature of resilience, it has been addressed by researchers, social workers, psychologists, sociologists, educators and many others over the past few decades. More recently, however, the  concept of grit has been discussed as a “hidden power” in student educational success (Tough, 2013) with many using the idea to imply that if American students had more grit would they find more success in a testing and accountability environment. This attribution of responsibility provides an ideal scapegoat for the chronic failures of test-based accountability because if students fail, they might have greater chances to develop grit. And, with all the empowering notions associated with grit (resiliency, efficacy, mastery, growth mindsets), it offers a seemingly positive spin on situations where students actually experience chronic failure. Although an enticing framework, we need to be aware of the potential drawback of taking such a narrow approach. As grit has become popularized in the public narrative, so too have critiques of how it may be (mis)applied.

Discussions of student “grit” that focus on protective, positive factors of success such as wellness, adaptation, protective factors, capacity building, and improvement to emphasize the possible and the belief that things will work, seem to offer an alternative to deficit oriented models of development (Duckworth et al., 2007). However, many would assert that the Grit narrative actually perpetuates a deficit approach since it assumes the responsibility for learning as a character trait located within the child. The ensuing message is that as long as the child works hard and puts forth persistent effort (despite any other hardships they may be enduring), they should/will be able to succeed academically (Gow, 2014)[1]. Although the notion of grit seems proactive, it actually serves as just another way to blame children for their failures rather than their social circumstances or opportunities.

Schwartz (2015) discussed controversies in grit and refers to teachers who have expressed concerns that the grit narrative ignores many of the structural barriers that make it difficult for some children from low-income homes — or those who have learning differences — to succeed in school. She noted that many educators have questioned whether the current definition of grit is more about compliance with predetermined norms in schools settings than about possessing personal determination, particularly amid pressures on academic achievement.

Do High-Stakes tests and Accountability Lead to more Grit?

Despite soaring rhetoric in support of high-stakes tests by policymakers and others, to date, there is a dearth of empirical research detailing the relationships between high-stakes testing and student emotional responses. The initial theory of action underlying testing and accountability was that students would be motivated to try harder when faced with feedback that they have not performed to some standards (Vasquez Heilig & Darling-Hammond, 2008). However, ten years after the nationwide implementation of Texas-style accountability, all students did not reach proficiency and proponents are looking for explanation for why the regime has not performed better.

How a student responds to the experience of challenge or failure will depend on a host of contextual, cognitive, and emotional variables. If school leaders do not create healthy learning conditions that foster success and allow for ‘safe’ experiences of failure, we may well be undermining students’ motivation and exacerbating disparities that already exist in midst of testing. Furthermore, if students are given constant feedback of failure from testing and accountability monikers of failure assigned their school, with a default assumption that it means something about their intelligence (rather than effort), then lessons in ‘grit’, effort, or other attempts to put forth effort may be dismissed as pointless.

Why high-stakes testing and accountability have failed to deliver on their promise is an open question with many possible explanations. Basch (2010) documented extensive evidence from the fields of neuroscience, child development, epidemiology, and public health that highlight health disparities that disproportionately affect educational opportunities and outcomes of youth in urban settings and that significantly contribute to the existence and exacerbation of achievement gaps. Basch provides compelling evidence that unless we address the deep and  systemic health gaps that drive the roots of student functioning and learning, we will likely not see improvements despite the best of intentions to close the “achievement” gaps.

Yes, resiliency and grit matter. However, so too do other critical factors including resources, opportunities for enrichment, social supports, health, and guidance that would strengthen opportunities for youth to succeed despite the odds. The key rests with unlocking how these features come together. We know poverty is a sizable barrier for many (see Biddle this volume). However we also know that a sizable percentage of economically disadvantage children and adolescents overcome this adversity, exhibit competence in the face of economic hardship in their lives and go on to lead highly successful, well-adjusted and productive lives (Werner & Smith, 1982; 1992; 2001). The challenge becomes how best to coordinate economic, social, and psychological opportunities along with resilience building messages that build on student strengths in guiding them to optimal, positive student developmental outcomes.

Waxman’s (2004) review of recent studies provided persuasive evidence of a growing body of research points to the conclusion that students exhibiting academic success have family and peer support, have supportive feedback, and are involved in school life. Conversely, students who exhibit low self-esteem have little parental support and involvement, are not engaged positively with their schools, are not usually motivated to succeed, and do not achieve good academic results. Much discussion among educators has centered on the search for strategies that reduce adversity and advance opportunities for learning. Two major guidelines have received increasing recognition for potentially reducing the risk factors associated with urban life and the achievement gap in urban schools (Williams, 1996). First, schools need to forge better connections with families and the community to support resilience development and student learning. Second, reducing educational segregation within schools and implementing responsive and powerful instructional practices also result in improved student retention, a more positive school climate, and improved academic outcomes (Milstein & Henry, 2008).

Absent addressing the above issues, grit has the potential to be a vehicle for education leaders and policy makers continuing to drive blind focus on tests scores while ignoring health and opportunity gaps. There is no research to support the assumption that high-stakes tests and accountability ratings lead to higher levels of “grit”, perseverance, and/or motivation. Similarly, we have no way of knowing the role “grit” may play in persevering through ongoing test-based experiences. On the contrary, decades of research in the field of educational psychology document the harm of shame-based, competitive, punitive, and/or fear-based learning environments that often coincide with high-stakes testing experiences. Interpretation, context, support, and resources matter in determining how scores will be perceived, what beliefs will result, and what resulting behaviors will be most likely. Thus, future research in the fields of human development and motivation should consider whether widening student success gaps in the future— especially as standards are artificially raised without any corresponding supports to authentically improve student learning or engagement— are due to mismatched assumptions about motivation, grit, and high-stakes testing.

Implications for Educational Policy

Accountability was born in Texas based on a “gut feeling” about how tests and a rating system would impact the motivation of students (Vasquez Heilig, Young & Williams, 2012). Considering decades of research, testing and accountability may not foment grit, academic resiliency, or increase achievement motivation. For the many students who put forth maximum effort, who face ongoing difficulties and limited resources at home, and who may be repeatedly receiving failing scores on these high stakes assessment, we need to acknowledge the possibility that the conditions being created would be ripe for the development of “learned helplessness” that can explain a great deal of academic disengagement among youth. The experience of learned helplessness has been found to strongly relate to depression, poor health, and motivational problems. Individuals who have failed at tasks in the past have a tendency to conclude erroneously that they are incapable of improving their performance in the future (Stipek, 1988). Children experiencing learned helplessness are more likely to fail academic subjects and are less intrinsically motivated than others and students experiencing repeated failures will often in turn give up trying to gain respect or promotion through academic performance (Ramirez, Maldonado, & Martos, 1992). The symptoms of helplessness and uncontrollability, most commonly felt by people who are depressed, are also correlated with the experience of learned helplessness (Maier & Watkins, 2005).

When defining and striving for excellence, it is best to focus on all students. However, our current public educational system fails to meet the needs of many students of underserved communities. This is apparent when we discuss the achievement gap or disparities seen in academic performance between various groups of students. Unfortunately, for many students of marginalized communities, the achievement gap increases until they drop out of school. With the passage of the No Child Left Behind Act (NCLB), closing the achievement gap demands that all students learn, stay in school, and meet state standards. In addition, NCLB’s framework of accountability, assessment, and evaluation has become a driving force in education as educators attempt to close the achievement gap that exists between Anglo students and students representing the minority (Fuller, Wright, Gesicki, & Kang, 2007).

According to Horsford (2011), the politicization of education has resulted in a high-stakes accountability culture, and in some cases privatization of public schools that distract efforts from meaningful systemic education reform. Our children have become commodities and a means to an end, rather than an opportunity to improve an educational end. Furthermore, when addressing the achievement gap and the needs of students from marginalized communities educational leaders should seek to address structural and institutional manifestations of exclusion and segregation that permeate administrative structures, policies, processes, and practices (Horsford, 2011). If we focus solely on “grit”, perseverance, and/or motivation and ignore structural realities in policy, by default we maintain racialized hierarchies and inequities in schools and school systems. Educational policy must address school structures and foster school climates and cultures that support school, family, and community relations built on the mutual respect, caring, and trust of communities of color (Horsford, 2011).

Another educational policy solution often discussed is the integration of technology in schools. However, the current policy environment pressed by foundations and the numerous educational technology startups also portends a variety of computer-based assessments aimed at measuring learning and enhancing “college and career.” While user-interface design issues on computerized tests may not currently be at the forefront of concern for policymakers and test developers, future research is warranted to examine user experiences with the interface of the tests (i.e. serious flaws documented by Rasmussen, 2015 for tests administered to over 10 million children in 19 states). Factors to consider include students’ (and teachers’) facility with using the technology as well as potential negative cognitive and affective impacts on their testing experience. If technology is to be integrated into assessment, it must be efficacious and valid. Additionally, educational decisions should not be based one form of test scores, such as a single score on a high-stakes test. Educational progress for all students regardless of their background, will involve the use of multiple forms of assessment data (Valencia, 2011), developing resiliency (Milstein & Henry, 2008; Williams, 1996), and evaluating structural and institutional barriers (Horsford, 2011).

This chapter also suggests important implications for practice. Teachers should communicate to their teacher organizations and other allies the real life lived experiences of students of color with exams. Currently, teacher organizations, foundations and policymakers and other influential organizations have pledged support to Common Core and the high-stakes exams that are married to the standards. However, the lived of experience of students of color in relation to the new gauntlet of Common Core exams it still unknown in the literature, but the potentially deleterious impact of the new regime of exams on students of color is predictable considering the history of standards and testing in the US (Vasquez Heilig & Darling-Hammond, 2008). As a result, teachers should be mindful and communicate to their teacher organizations, local communities, policymakers, researchers and other stakeholders the challenges of handling student motivation in the new Common Core high-stakes test based environment.

In conclusion, it is profoundly problematic to link underperformance on tests to “grit, growth mindset” or effort-based remedies when the core assessments being administered fail to meet basic standards for testing and accountability. Many of the new, experimental computerized assessments administered to millions of children in 2015 “field” tests have been fraught with technological user-access barriers (Marachi, 2015; Rasmussen, 2015; Furman, 2015). As discussed in this chapter, grit and high-stakes tests should be understood within the current context of poverty and other structural factors, the fact that failure rates have arbitrarily been set to fail a majority of students, and the resulting disengagement, frustration, anger, stress, and feelings of despair from “learned hopelessness.”  In conclusion, is it fair or just for millions of students of color to fail an unfair state-mandated test, despite working hard in the classroom, and this failure be blamed on a lack of grit rather than the real issue— the structure and scoring of unreliable and un-validated tests?

References

Adams, C. (2014). Report calls for states to rethink high stakes exams. EdWeek. Retrieved at http://blogs.edweek.org/edweek/college_bound/2014/07/report_calls_for_states_to_rethink.html

Advancement Project (2010). Test, Punish, and Push Out: How “Zero-Tolerance” and High Stakes Testing Funnel Youth Into the School-To-Prison Pipeline. Advancement Project. Retrieved at http://b.3cdn.net/advancement/50071a439cfacbbc8e_suxm6caqe.pdf

Basch, C. E. (2010). Healthier students are better learners: A missing link in school reforms to close the achievement gap. Equity Matters, Research Review 6., Campaign for Educational Equity, Teachers College, Columbia University

Duckworth, A.L., Peterson, C., Matthews, M.D., & Kelly, D.R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92(6), 1087-1101.

Fuller, Wright, Gesicki, & Kang, (2007) Gauging Growth:How to Judge No Child Left Behind? Educational Research, 36 (5), 268-278.

Gonzalez, R., & Padilla, A. M. (1997). The academic resilience of Mexican American

High School Students. Hispanic Journal of Behavioral Sciences, 19(3), 301-317.

Gow, P. (2014). What’s dangerous about the grit narrative and how to fix it. Education Week, Retrievable online at http://blogs.edweek.org/edweek/independent_schools/2014/03/whats_dangerous_about_the_grit_narrative_and_how_to_fix_it.html

Hassinger, Mark & Plourde, Lee A (2005) Beating the odds: How bilingual Hispanic yourth work through adversity to become high achieving students. Education. Project Innovation.

Hawkins, R., & Mulkey, L. (2005). Athletic investment and academic resilience in a

national sample of African American females and males in the middle grades. Education and Urban Society, 38(1), 62-88.

Henderson, N., & Milstein, M.M. (2003). Resiliency in schools: Making it happen for students and educations. Thousand Oaks, CA: Corwin Press.

Holbein, J. B. & Ladd, H. (2015). Accountability Pressure and Non-Achievement Student Behaviors. Working Paper 122, Center for Analysis of Longitudinal Data in Education Research, American Institutes for Research. Retrieved from http://www.caldercenter.org/sites/default/files/WP%20122.pdf

Horsford, S. (2011). Learning in a Burning House: Educational Inequality, Ideology, and (Dis)Integration. New York, NY: Teachers College Press.

Immordino-Yang, H. & Damasio, A. (2007). We feel, therefore we learn: The relevance of affective and social neuroscience to education. Mind, Brain, and Education, 1 (1), 3-10.

Maier S.F. & Watkins, L.R. (2005). Stressor controllability and learned helplessness: The roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor. Neuroscience and Biobehavioral Reviews, 29, 829-841. Retrieved from http://www.uvm.edu/~shammack/Maier%20and%20Watkins%202005%20review.pdf

Masten, A. (2001). Ordinary magic: Resilience processes in development. American Psychologist, 56, 227-238.

Masten, A. & Powell, J. (2003). A resilience framework for research, policy, and practice. In S.S. Luthar (Ed.). Resilience and vulnerability: Adsaptation in the context of childhood adversities (pp. 1-28). New York: Cambridge University Press.

McNeil, L. & A. Valenzuela (2001). “The Harmful Impact of the TAAS System of Testing in Texas: Beneath the Accountability Rhetoric,” pp. 127-150 in M. Kornhaber and G. Orfield, eds., Raising Standards or RaisingBarriers? Inequality and High Stakes Testing in Public Education. New York: Century Foundation. Retrieved at  http://www.edb.utexas.edu/latino/McNeil%20&%20Valenzuela.pdf

Milstein, M., & Henry, D. (2008). Leadership for Resilient Schools and Communities. Thousand Oaks, CA: Corwin Press.

Moote, G. T., & Wodarski, J. S. (1997). The acquisition of life skills through adventure-based activities and programs: A review of the literature. Adolescence, 32(125), 143-67).

Morales, E. E (2008). Exceptional Female Students of Color: Academic Resilience and

Gender in Higher Education. Innovative Higher Education, 33 no (3), 197-213.

Olsson, C.A. (2003). Adolescent resilience: A concept analysis. Journal of Adolescence. 26, 1-11.

Reardon, S., Greenberg, E., Kalogrides, D., Shores, K., & Valentino, R. (2012). Left Behind? The Effect of No Child Left Behind on Academic Achievement Gaps Working Paper. Stanford, CA: Stanford University Press.

Schwartz, K. (2015). Does the grit narrative blame students for school’s shortcomings? KQED Mindshift, Retrieved online at http://ww2.kqed.org/mindshift/2015/05/05/does-the-grit-narrative-blame-students-for-schools-shortcomings/.

Tough, P. (2013). How children succeed: Grit, curiosity, and the hidden power of character. Boston: Mariner Books.

Valencia, R. (2011) Chicago School Failure and Success: Past, Present and Future. New York, NY: Routledge.

Vasquez Heilig, J. & Darling-Hammond, L. (2008). Accountability Texas-style: The progress and learning of urban minority students in a high-stakes testing context. Educational Evaluation and Policy Analysis. 30(2), 75-110.

Vasquez Heilig J. & Holme, J. (2013). Nearly 50 Years Post-Jim Crow: Persisting and Expansive School Segregation for African American, Latina/o and ELL students in Texas. Education and Urban Society. doi: 10.1177/0013124513486289

Vasquez Heilig, J., Young, M. & Williams, A. (2012). At-risk student averse: Risk management and accountability. Journal of Educational Administration, 50(5), 562-585.

Wang, M. C., Haertel, G. D., & Wahlberg, H. J. (1993/94). What helps students learn?  Educational Leadership, 51(4),    74-79.

Waxman, H.C., Gray, J.P., & Padron, Y.N. (2004).Educational resiliency: student, teacher, and school perspectives. Charlotte, NC: Information Age Publishing.

Werner, E. & Smith, R. (1982). Vulnerable but Invincible: A Longitudinal Study of Resilient Children and Youth. New York: Adams, Bannister, and Cox.

Werner, E. & Smith, R. (1992). Overcoming the Odds: High-Risk Children from Birth to Adulthood. New York: Cornell University Press.

Williams, B. (1996). Closing the Achievement Gap: A Vision for Changing Beliefs and Practices. Alexandria, Virginia: Association for Supervision and Curriculum Development.