Study from math learning platform shows difficulty in motivating teachers to change behaviors
'Today is perfect for checking your Pace Report!'
'Keep Zearning!'
'By opening this email, you've earned another 100 digital raffle tickets in the Zearn Math Giveaway!'
In partnership with Zearn Math, a nonprofit online math instruction platform used by roughly 25% of U.S. elementary school students, Duckworth and a team of researchers from the University of Pennsylvania's Behavior Change for Good Initiative launched a megastudy, published in March 2025, that peppered 140,000 teachers with different email prompts to log into the platform's dashboard each week and check their students' progress.
Behavioral scientists like Duckworth, who popularized the 'power of grit' about a decade ago, spend a lot of time trying to pinpoint what, exactly, it is that prompts an individual to sign a form, become an organ donor or click an ad that promises a secure and safe retirement now.
'In the case of education there's the idea of nudging the students directly,' Duckworth said. 'But there's also the idea that's less commonly studied, which is, what do you do to nudge the teachers, who are not in complete charge, but have a lot of authority about what is going to happen in the classroom that day? It was clear to us that if we could get the students onto the Zearn platform that their learning would progress. But are they actually going to log in?'
To that end, Duckworth and the team developed 15 types of intervention emails featuring things like planning prompts, teaching tips, learning goals, digital swag and celebrity endorsements. The goal was to change behavior without mandates, bans or substantial financial incentives — though teachers were enrolled in a giveaway and earned digital raffle tickets every time they opened an email, increasing their chances of winning such prizes as autographed children's books, stickers and gift cards.
The researchers then compared the average number of lessons the teachers' students completed on the Zearn Math platform over four weeks to a control group using Zearn that received only a simple weekly email.
So did it work? Did the emails prompt teachers to log in more regularly? And if so, did the number of lessons their students completed increase? To some degree, yes, it did work. But not at all to the extent that Duckworth and the researchers had anticipated.
The best-performing intervention, which encouraged teachers to log into Zearn Math for an updated report on how their students were doing that week, produced a 5% increase in students' math progress. Emails that referenced data specific to a teacher's students — versus those without that information — boosted students' progress by 2.3%. And teachers who received any of the behaviorally informed email nudge saw their students' math progress increase by an overall average of 1.9%
Duckworth was sure that the emails featuring famed astrophysicist Neil deGrasse Tyson and literary rockstar Judy Blume would move the needle more than anything else. But teachers were virtually unaffected.
'We had sexier treatment conditions,' she said. 'But no, it turns out, a simple message that says, 'Hey, your students' data are here, remember to log in,' that is what worked the best.'
Notably, the intervention effects were consistent across school socioeconomic status and school type, both public and private. Moreover, the impact persisted for eight weeks after the email intervention period ended. Collectively, the reminders resulted in students completing an estimated 80,424 additional lessons during the four weeks their teachers received emails, and an estimated 156,117 additional lessons during the following eight weeks.
Yet the limited impact of the email reminders surprised virtually everyone involved with the study: Students whose teachers received any type of behaviorally informed email reminder only marginally outperformed students whose teachers received a simple email reminder. In fact, the effect on both Zearn Math staff and a sample of elementary school teachers was at least 30 times smaller than the behavioral scientists who designed the interventions forecasted.
'It's a sober reminder that big effects are very rare,' Duckworth said. 'In general, we're finding in our megastudies and what's emerging across the social sciences is that intervention effects tend to be very small.'
'One of the things that this megastudy has reinforced is a kind of humility about how complicated human beings are and how challenging it is to durably change behavior. A kid is a complicated organism. Teachers are complicated. Schools are complicated,' she continued. 'It would be naive to think that you could radically change behavior with these like light touch interventions.'
The findings not only underscore the difficulty of changing behavior, but also the need, Duckworth said, for large-scale, rigorous, empirical research on how to drive impact in math, which is a high-priority subject for education policy experts at the moment.
Indeed, the findings come at an inflection point for math in the U.S.
The most recent release of the National Assessment of Educational Progress showed that, nationally, average mathematics scores in 2024 were lower by 3 points among fourth-grade students and lower by 8 points among eighth-grade students compared to their scores in 2019—the most significant drop since 1990. School districts have struggled to rebound after significant academic setbacks incurred by the COVID-19 pandemic. For math in particular, by the spring of 2022, the average public school student in grades three to eight had lost the equivalent of a half-year of learning.
Compared to students in other developed countries, Americans have ranked in the bottom 25% of students globally on standardized tests of mathematics for decades. U.S. students saw a 13-point drop in their 2022 Programme for International Student Assessment math results when compared to the 2018 exam — 'among the lowest ever measured by PISA in mathematics' for the U.S., according to the Organisation for Economic Co-operation and Development, which administers the exam.
As a result, a contentious debate has erupted surrounding whether educators are effectively teaching the subject — and whether they themselves are being effectively taught how to teach it.
'There was a dawning realization that there's a real urgency around math achievement in the United States,' Duckworth said when her team decided to design the megastudy. 'This very light touch nudge was helpful, but it does underscore how hard behavior is to change. And if there are bigger levers to influence teacher behavior, I think we would have found a bigger downstream effect on student achievement.'
This story was produced by The 74 and reviewed and distributed by Stacker.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
3 days ago
- Yahoo
Top US colleges sued in class action over ‘early decision' admissions
By Mike Scarcella (Reuters) -Columbia University, Duke University, the University of Pennsylvania and 29 other elite U.S. colleges and universities were accused on Friday in a proposed class action of conspiring to inflate tuition costs for tens of thousands of students through the popular "early decision" admissions process. The lawsuit, filed in federal court in Boston by former students at Wesleyan University and two other schools, said colleges are using early-decision commitments to charge more for both early and regular-admission students. Early decision students face earlier deadlines to apply to college but a greater chance of acceptance. They agree to attend if admitted, forfeiting future offers or aid packages from other schools. The 32 defendants are violating antitrust law by agreeing not to compete with each other for early-decision students, the lawsuit said. The universities also mislead applicants by presenting early decision offers as legally binding, it said. 'Early decision applicants lose choice and negotiation leverage, while regular decision applicants are left to scramble for an artificially diminished number of admission slots doled out at lower acceptance rates,' said Benjamin Brown, an attorney for the plaintiffs. The University of Pennsylvania and Columbia declined to comment. Duke, Vassar, Wesleyan and other defendants including Amherst, Northwestern, University of Chicago and Johns Hopkins University did not immediately respond to requests for comment. The defendants also include the Consortium on Financing Higher Education, an organization of private liberal arts schools that helps facilitate information-sharing among them. The consortium did not immediately respond to a request for comment. The plaintiffs asked the court to grant class action status for early decision applicants since 2021 and some students who enrolled through the regular decision process. The lawsuit seeks unspecified monetary damages for tuition overcharges and to bar the use of binding early decision programs. Solve the daily Crossword
Chicago Tribune
3 days ago
- Chicago Tribune
A look at colleges with federal money targeted by the Trump administration
Several elite U.S. colleges have made deals with President Donald Trump's administration, offering concessions to his political agenda and financial payments to restore federal money that had been withheld. Ivy League schools Columbia, Brown and the University of Pennsylvania reached agreements to resolve federal investigations. The Republican administration is pressing for more, citing the deal it negotiated with Columbia as a 'road map' for other colleges. There is a freeze on billions of dollars of research money for other colleges including Harvard, which has been negotiating with the White House even as it fights in court over the lost grants. And on Friday, a White House official said the Trump administration is seeking a $1 billion settlement from the the University of California, Los Angeles. Like no other president, Trump has used the government's control over federal research funding to push for changes in higher education, decrying elite colleges as places of extreme liberal ideology and antisemitism. Here's a look at universities pressured by the administration's funding cuts. Columbia said on July 23 that it had agreed to a $200 million fine to restore federal funding. The school was threatened with the potential loss of billions of dollars in government support, including more than $400 million in grants canceled earlier this year. The administration pulled the money because of what it described as Columbia's failure to address antisemitism on campus during the Israel-Hamas war. Columbia agreed to administration demands such as overhauling its student disciplinary process and applying a federally backed definition of antisemitism to teaching and a disciplinary committee investigating students critical of Israel. Federal officials said the fine will go to the Treasury Department and cannot be spent until Congress appropriates it. Columbia also agreed to pay $21 million into a compensation fund for employees who may have faced antisemitism. The deal includes a clause that Columbia says preserves its independence, putting in writing that the government does not have the authority to dictate 'hiring, admission decisions, or the content of academic speech.' An agreement last month calls for Brown to pay $50 million to Rhode Island workforce development organizations. That would restore dozens of lost federal research grants and end investigations into allegations of antisemitism and racial bias in Brown admissions. Among other concessions, Brown agreed to adopt the government's definition of 'male' and 'female' and remove any consideration of race from the admissions process. Like the settlement with Columbia, Brown's does not include a finding of wrongdoing. It includes a provision saying the government does not have authority to dictate Brown's curriculum or 'the content of academic speech.' The Trump administration suspended $584 million in federal grants to UCLA, the university said this week, after the Department of Justice said the college had violated civil rights 'by acting with deliberate indifference in creating a hostile educational environment for Jewish and Israeli students.' On Friday, a White House official said the Trump administration was seeking a $1 billion settlement from the university. The official was not authorized to speak publicly about the request and spoke on the condition of anonymity. UCLA is the first public university to have its federal grants targeted by the administration over alleged civil rights violations. Under a July agreement resolving a federal civil rights case, Penn modified three school records set by transgender swimmer Lia Thomas and said it would apologize to female athletes 'disadvantaged' by Thomas' participation on the women's swimming team. The Education Department investigated Penn as part of the administration's broader attempt to remove transgender athletes from girls and women's sports. As part of the case, the administration had suspended $175 million in funding to Penn. The administration has frozen more than $2.6 billion in research grants to Harvard, accusing the nation's oldest and wealthiest university of allowing antisemitism to flourish. Harvard has pushed back with several lawsuits. In negotiations for a possible settlement, the administration is seeking for Harvard to pay an amount far higher than Columbia. The White House announced in April that it froze more than $1 billion of Cornell's federal funding as it investigated allegations of civil rights violations. The Ivy League school was among a group of more than 60 universities that received a letter from the Education Department on March 10 urging them to take steps to protect Jewish students or else face 'potential enforcement actions.' Like Cornell, Northwestern saw a halt in some of its federal funding in April. The amount was about $790 million, according to the administration. The administration this week froze $108 million in federal money for Duke. The hold on funding from the National Institutes of Health came days after the departments of Health and Human Services and Education sent a joint letter alleging racial preferences in Duke's hiring and admissions. Dozens of research grants were suspended at Princeton without a clear rationale, according to an April 1 campus message from the university's president, Christopher Eisgruber. The grants came from federal agencies such as the Department of Energy, NASA and the Pentagon.
CNBC
4 days ago
- CNBC
29-year-old Army Reservist in Washington, D.C. earns $82,000—how he manages to save more than 20% of it
Corey Retell was always aware of a certain level of privilege. By the standards of Buffalo, New York, his parents fell short of "crazy wealthy," he says. But Retell and his brother enjoyed the familiar trappings of what he calls a silver-spoon upbringing: regular vacations, a big house, luxury cars and enrollment at an elite private high school. By 2017, having graduated from the University of Pennsylvania debt-free with a degree in philosophy, politics and economics, he'd figured he'd been given enough of a head start. He told his parents he no longer wanted their financial support. "It was kind of incumbent upon me, for my own self-esteem," he says. "[I was] trying to show myself that I could build my life from that point as much as possible." Things didn't go according to plan at first. Retell took out student loans to attend law school at Emory University straight out of undergrad, but soon withdrew due to health issues. He quickly found himself with $23,000 in debt and no savings to pay it back with. "I needed to transition from leaving law school to making money basically as soon as possible if I didn't want to move back home and live with my parents," Retell says. He managed to scrape things together for six months or so, spending 60 to 70 hours a week driving for Lyft around Atlanta, then took a short-term internship before joining the Peace Corps in Ukraine. The move was formative, if not particularly lucrative. Now 29, Retell shares a Washington, D.C. apartment with his boyfriend, a Ukrainian he met during his time overseas. In addition to his job at a small economic nonprofit, which pays him $75,000 per year, Retell serves in the civil affairs branch of the Army Reserve, and hopes to deploy back to Eastern Europe in the next few years. The second gig, which includes base and bonus pay, brings Retell's annual income to about $82,000, and he saves as much of it as he can — he managed to stash away 21% of his pre-tax income in June. But the way he sees it, he has some catching up to do. "I'm not in a hole, but behind for sure," he says. Retell says money wasn't top-of-mind when he made the decision to join the Peace Corps in 2018. In fact, he'd internalized his Jesuit high school's emphasis on service and even considered signing up right after college. The move came with one big financial upside: volunteering allowed him to defer repaying his student loans. Still, the excitement of living abroad in his early 20s resulted in some poor money decisions, Retell says. "It's very easy to want to travel throughout Europe when you're so close and flights are seemingly so cheap. But on a $300, $350 a month stipend, there's just really no room to afford that," he says. He got into around $6,000 in credit card debt, he says, which was "at the time was astronomical for me." Retell says he played a "shell game" with the debt, moving it between 0% balance-transfer credit cards. "I was just kicking the can down the road, and eventually had to pay the piper when I came back," he says. Retell returned from Ukraine in March 2020 when the Covid-19 pandemic hit. After a two-week quarantine at his parents' house, he moved to Seattle, where he paid down his credit card debt by driving and shopping for Instacart. Retell had considered joining the military when law school fell through, but decided the Peace Corps was the better path at the time. But when Russia invaded Ukraine in 2022, he reached back out to his recruiters. "With my connections and sympathy for Ukraine, feeling heavily invested there, the war just felt like a kick in the butt," he says. "But it takes a long time to join the military." In the meantime, he'd landed the nonprofit role in D.C., relocating to the capital in fall of 2022. He opted to keep that job and sign up for the Army Reserve in 2023. Retell's army contract came with a $20,000 enlistment bonus, half paid out upon completion of his initial training, and the rest divided over the remainder of his contract, which runs through 2029. Retell earns a $5,321 annual base salary as a reservist. His student loans have been in forbearance during his service and are slated to be paid off in annual installments throughout his contract as part of his bonus package — though his loan servicer has yet to receive repayment. Retell's end of the bargain: He attends training one weekend out of every month and does more in-depth work two weeks out of every year. Although there are fitness tests, Retell's training in the Civil Affairs division is more academic and less running through tires. He estimates he spends roughly 20 to 25 hours a month on Army-related activities. He also has to be willing to be called for active duty, a likely outcome, Retell says, over the course of a reservist's contract. "Some locations and some timings are more enthusiastic than others, as [is the case for] anyone with a civilian life and job and other responsibilities," Retell says. Though things can change, his unit is currently scheduled to deploy to Eastern Europe in 2028. Retell makes more money than his boyfriend, who fled Ukraine for Poland before the Russian invasion, and who currently works as a shift supervisor at Starbucks. Nevertheless, the two approach finances as a team, covering each other on day-to-day expenses and each looking to save north of 20% of their respective incomes. Saving that aggressively means occasionally feeling strapped, especially in a city where things can get expensive. Living in D.C., "I have been able to save more than I have ever saved in my entire life," Retell says. "Having said that, it makes my month-to-month feel uncomfortable because I'm trying to save as much as possible. So there is breathing room, but I try to make it seem like there's no breathing room." Here's how he spent his money in June 2025. As with many urban-dwelling professionals his age, the biggest chunk of Retell's budget goes toward living expenses. He pays $1,518 of the $2,018 he and his boyfriend pay in rent on a studio apartment. The $398 Retell spent on dining amounts mostly to workday lunches, and the $487 he spent on groceries comprises his share of the couple's near nightly shopping trips before preparing dinner at home — a European custom he picked up from his boyfriend. It hasn't made him any handier in the kitchen, however. "My boyfriend is definitely the better cook," Retell says. "I cannot cook anything but Kraft mac and cheese, and that's about it." A few common line items are missing from the budget altogether. Retell's workplace covers his insurance premiums, so no payout for medical, dental or vision. Instead of paying a phone bill, Retell connects his devices to Wi-Fi when he can and otherwise pays a fee to receive texts on his Apple Watch. The budget is also missing, well, fun — but that doesn't mean the couple doesn't have any. Retell and his boyfriend are homebodies, but still hang with friends, stroll the city's many parks and occasionally tour the landmarks and museums, which are all free to visit. Their biggest splurge, Retell says, is travel. When his boyfriend wanted to see Billie Eilish in Los Angeles this summer, the pair sprung for cheap flights and a budget hotel stay. However, they usually tighten their belts as much as they can. Last summer, on a 19-day road trip, they paid for four nights' accommodation. They slept in the SUV they rented for the remainder. "That's an adventure for me. For other people, maybe not so much," Retell says. For the most part, Retell and his boyfriend aim to save as much as they can, even if it means making what he calls "manageable sacrifices." In June, everything went according to plan. Retell contributed 6% of his pre-tax nonprofit salary, $375, to a Roth 401(k), receiving a full matching contribution from his employer. Another $1,087 went into his brokerage account, in which he holds a portfolio of index funds. Not every month is quite as strong. Retell says that Army pay — especially when it comes to bonuses — can be inconsistent. He is theoretically due $4,800 a year as a foreign language bonus, for instance, but hasn't seen any of the money thus far. Retell says it's tough to rely on his military pay when managing his finances from month to month. "[It's] more of a bonus when I'm able to access it on time," he says. Still, Retell is slowly but surely building toward his long-term goals, which include homeownership and, eventually, a quiet retirement. Over the short-term, he hopes to buy a car and plans to re-enroll in law school, hopefully completing his coursework just in time for his military deployment. "Graduating in 2028 or 2029 would be ideal, so that I can finish both around the same time and decide if I do want to re-enlist or explore the possibility of becoming an officer, or end my time there and be free to start the next chapter," Retell says. No matter what the future looks like, Retell says he'll navigate the financial side of it without help from his family. "I can't say I've never taken money from my parents. I mean, they've paid for things for me before and stuff like that. But it's been about as close to a hard and fast rule as I've maintained since being 21."
