Press release: Results from the National Study of Learning Mindsets
Lisa Quay
AUSTIN, Texas and PALO ALTO, Calif. – Each year, nearly 20% of students in the U.S. do not finish high school on time. These students are at high risk for poverty, poor health, and early mortality.
The transition to high school in 9th grade represents an important point in adolescents’ paths toward high school completion and long-term success. What can be done at this time to improve their outcomes?
Researchers have developed psychological “interventions” to improve student success in the transition to high school. These interventions do not change the curriculum or teachers, but rather change how adolescents think or feel about themselves or their schoolwork in ways that encourage them to stay motivated when school is challenging and take advantage of the learning opportunities available in their school environment. Prior research had found that such interventions can improve academic outcomes in smaller samples, but it was not yet clear if these interventions could work on a national level.
A groundbreaking new experimental study with more than 12,000 9th grade students in the U.S. confirmed that a low-cost online program that takes less than an hour to complete can help students develop a growth mindset—the belief that intellectual abilities are not fixed but can be developed. This is important because student motivation often suffers when students have been exposed to the idea that their intellectual abilities can’t change.
Both lower- and higher-achieving students benefited academically from the program. On average, lower-achieving students who took the program earned significantly higher grades in 9th grade, and both higher- and lower-achieving students selected more challenging math courses in 10th grade.
The research also revealed important insights about how school context can affect the impact of the growth mindset program.
Lower-achieving students who attended schools in which the peer climate (the “norms”) supported the pursuit of challenging work registered the largest improvements in grades as a result of receiving the program.
The results of the growth mindset intervention in the National Study of Learning Mindsets (NSLM) are summarized in a new paper published today in the journal Nature.
A Milestone for Mindset Science
The pioneering work of Stanford University psychology professor Carol Dweck revealed a critical insight about education: Students who believe they can grow their intellectual ability tend to perform better academically than students who believe intelligence is simply a fixed trait, like height or eye color. Since Dweck’s early work in the 1990s, many carefully done studies have observed a link between growth mindset and academic performance and shown that students can be taught a growth mindset.
Many exciting questions grew out of this work: Under what conditions can students be taught a growth mindset most effectively? Can a brief growth mindset program have an impact on students’ longer-term success?
To find answers to these questions a multi-disciplinary team of researchers led by University of Texas at Austin Associate Professor of Psychology David Yeager conducted the National Study of Learning Mindsets, the largest-ever randomized controlled trial of a growth mindset program in the U.S. in K-12 settings. The researchers on the study team included internationally-recognized experts from the fields of education, psychology, sociology, economics, and statistics, many of whom are members of the Student Experience Research Network.
The NSLM used a nationally-representative probability sample of U.S. high schools to evaluate a carefully developed and extensively pilot-tested online growth mindset program. Like most high-quality educational evaluations, this study was able to isolate the causal impact of the program through use of a randomized experiment. Unlike most other educational evaluations, however, this study took place in a sample of schools that was selected randomly, thus ensuring that generalizations from the sample to the U.S. population of high schools could be made. This use of random sampling in the NSLM therefore gives greater confidence that the results can be applied to the nation than any other past study.
“The National Study of Learning Mindsets is a major milestone for science,” said David Yeager. “The research cemented a striking finding from multiple earlier studies: A short intervention can have an unlikely outcome—it can change adolescents’ grades many months later. The study also showed us something new. Students who already get high grades don’t get higher grades when they get the treatment, but they are more likely to take harder mathematics classes that can set them up for long-term success.
“Additionally,” Yeager continued, “the National Study offered a novel way to understand what is called ‘treatment-effect heterogeneity,’ or the tendency for an intervention to be more or less effective in certain contexts or with different populations. This is important because in the past researchers have been happy to say that their effects were good, overall, in the particular sample they studied and move on. We went the next step to identify schools where effects were stronger or weaker, so that we could begin to assess changes schools could make to magnify growth mindset effects on student outcomes.”
“I am absolutely delighted to see how far mindset science has come,” said Carol Dweck. “The early research showed that helping students develop a growth mindset could be a new way to help more students succeed. Now, as a field we are starting to understand how to do this at scale—and we are understanding the role of supportive learning environments that can maximize the benefits of a growth mindset. I am proud to be part of the team that designed and carried out this new and important study.”
“The National Study is the most important study we’ve ever done” said Yeager. “Not only did it confirm the effects of the growth mindset in the most rigorous way we could think of, it also showed us how much more there is to learn. It marks the beginning of the next phase of mindset research—a phase that will focus on how to make growth mindset truly come alive in learning environments.”
Key Findings
Here are some of the most notable conclusions from the article published in Nature:
- Positive effects on mindsets. The intervention reduced the prevalence of self-reported fixed mindsets (the belief that intellectual ability cannot be developed), replicating multiple earlier studies conducted with smaller, convenience samples of students. The effects were consistent across all student subgroups.
- Positive effects on key academic predictors of high school graduation and college success. The intervention had benefits for both lower- and higher-achieving students. It improved grades in core academic subjects (mathematics, English language arts, science, and social studies) in 9th grade among previously lower-achieving students. It also increased enrollment in advanced mathematics courses in 10th grade among both higher- and lower-achieving students (this result was obtained in a sub-sample of 41 schools that shared 10th grade enrollment data).
- Positive effects on grades of lower-achieving students. For students whose grades were below the median in their school, the intervention improved their GPA in core courses by 0.10 grade points relative to similar students in the control condition. The intervention also reduced the proportion of these students with a D or F average in their core courses by over 5 percentage points. These effects are substantial when compared to the most successful large-scale, time-consuming, and rigorously evaluated interventions with adolescents in the educational research literature, and they are particularly notable given the low cost and time investment of the online program.
- Effects on grades were related to school factors. Effects were larger in some types of schools and smaller in others. In medium- and lower-performing schools[1] in which the peer climate (the “norms”) supported the pursuit of challenging academic work, the intervention increased core course GPA by 0.15 points and STEM course GPA by 0.17 points on average among lower-achieving students. In these schools, the intervention also reduced the likelihood of D or F averages in core courses by 8 percentage points among these students. Again, these effects compare very favorably to those documented in rigorous experimental studies of education interventions with adolescents (see Kraft 2018), many of which are time and cost intensive.
- Positive effects on advanced mathematics course-taking were observed among both higher- and lower-achieving students. The intervention increased students’ likelihood of taking Algebra II or higher in 10th grade by 3 percentage points, elevating advanced course-taking from a base rate of 33% to a rate of 36% (this result was obtained in a sub-sample of 41 schools that shared 10th grade enrollment data). In the highest performing quarter of schools, the intervention increased the likelihood of taking Algebra II or higher in 10th grade by 4 percentage points.
Findings from the National Study of Learning Mindsets suggest that a carefully developed and tested but brief online growth mindset intervention can offer a way to improve key academic indicators and promote the pursuit of more challenging coursework as students make the critical transition to high school. The results also suggest that educators in all schools should pay particular attention to cultivating norms that value the pursuit of challenging schoolwork.
SUPPLEMENTARY INFORMATION
Methodology
The NSLM included a nationally representative sample of 76 regular public high schools; 65 of the schools reported academic data and were included in the analysis reported in Nature.[2] The schools were selected using sophisticated sampling techniques to ensure the results of the study can be generalized to the more than 12,000 regular public high schools in the U.S.
During the 2015-16 school year, 9th grade students at these schools were randomly assigned to complete either the growth mindset program or a control activity during two, 25-minute sessions. The carefully-crafted and extensively pilot-tested growth mindset activity vividly conveyed to students that intellectual abilities are not fixed but can be developed. Students were asked to reflect on ways to strengthen their brains by persisting on challenges, and to describe how they could use a stronger brain to make a difference for things that matter to them, such as their family, community, or a social issue.
An independent firm (ICF International) delivered the program and collected the data. The predictions and analyses were pre-registered according to scientific best practices to minimize potential sources of bias and enhance reproducibility. None of the authors stand to benefit financially from the intervention because it will be given away at no cost.
Funders
Funding for this first phase of the National Study of Learning Mindsets was provided by the Bezos Family Foundation, Character Lab, Houston Endowment, The Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institutes of Health, National Science Foundation, Raikes Foundation, Spencer Foundation, the Center for Advanced Study in the Behavioral Sciences and the President and Dean of Humanities and Social Sciences at Stanford University, and William T. Grant Foundation.
Additional Resources
The Growth Mindset for 9th Graders intervention tested in the study is now freely available to schools in the U.S. and Canada here.
More information about the National Study of Learning Mindsets and the intervention is available on our website here.
[1] Medium- and lower-performing schools represent the bottom 75% of schools nationally in terms of performance, as determined by combining several sources of data: within-state rankings based on test scores, average PSAT scores, and AP test-taking data (including the proportion of students at the school who take AP tests and their test scores).
[2] Schools that were excluded from the sampling frame include charter and private schools, schools with specialized missions or populations (e.g., ‘suspension’ schools or schools for students who are visually impaired), schools with fewer than 25 9th graders, and schools that do not have 9th grade as the lowest grade. These regular public schools serve more than 80% of 9th grade students in the U.S.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.