logo
Researchers call for new way of thinking about content moderation

Researchers call for new way of thinking about content moderation

Washington Post29-04-2025

Happy Tuesday! I'm Jeremy Merrill, stepping in for my colleague Will Oremus on today's Tech Brief. Send news tips to: jeremy.merrill@washpost.com.
Below: Congress passes a revenge porn law, but some advocates are left frustrated. But first:
Researchers call for new way of thinking about content moderation
Facebook's loosening of its content moderation standards early this year got lots of attention and criticism. But a new study suggests that it might matter less what is taken down than when.
The research finds that Facebook posts removed for violating standards or other reasons have already been seen by at least three-quarters of the people who would be predicted to ever see them.
'Content takedowns on Facebook just don't matter all that much, because of how long they take to happen,' said Laura Edelson, an assistant professor of computer science at Northeastern University and the lead author of the paper in the Journal of Online Trust and Safety.
Social media platforms generally measure how many bad posts they have taken down as an indication of their efforts to suppress harmful or illegal material.
The researchers advocate a new metric: How many people were prevented from seeing a bad post by Facebook taking it down?
To measure the 'prevented dissemination' from Facebook's content moderation, the researchers collected more than 1.7 million posts from U.S. news-focused Facebook pages and identified the approximately 13,000 posts of them that had been taken down.
'Removed content we saw was mostly garden-variety spam — ads for financial scams, [multilevel marketing] schemes, that kind of thing,' Edelson said.
The predominance of spam and scam content puts the heated public dispute over content moderation and online censorship in context.
Civil rights groups have criticized Meta, Facebook's owner, for not taking down enough posts. The Anti-Defamation League last year found that only a tiny fraction of antisemitic posts were removed when reported as a regular Facebook user. Leanna Garfield of the LGBTQ+ advocacy organization GLAAD said: 'Meta takes anywhere from several days to weeks to sometimes even months' to review posts with 'anti-LGBTQ slurs and posts promoting violence.'
Before this year's changes, free-expression advocates, in contrast, criticized the company for taking down too much content. 'Arbitrary and unfair enforcement practices … reduce users' confidence both in platforms and in the state of free expression online,' wrote the Foundation for Individual Rights and Expression.
Meta CEO Mark Zuckerberg agreed, saying that while there is 'a lot of legitimately bad stuff out there,' the platform's previous policy caused 'too many mistakes and too much censorship.'
The new research is a reminder that platforms inadvertently host lots of posts that everyone agrees are bad.
The company has said that content that violates its rules is only a tiny fraction of all content on the platform, and that it blocks a lot of bad content before it's successfully posted. It also says it puts substantial effort into stopping fraud and scams.
Edelson and her colleagues at research group Cybersecurity for Democracy focused not on whether a removal was justified, but on when posts were removed. Her group identified all posts from about 10,000 U.S. news pages in July 2023 and collected data on the number of times the posts were liked, commented on or otherwise engaged with, every six hours for two days.
Popular posts got half of their engagement in less than eight hours, they found. But the typical bad post was only removed after more than 20 hours.
After creating a machine learning model that predicts how many engagements a post would likely have after two days, the researchers concluded that Facebook's removals prevented at most only 24 percent of the removed posts' predicted engagement — probably much less. (The paper uses engagement as a proxy for views, because Meta doesn't publish view counts for Facebook posts. Facebook does not disclose why a post was taken down, so it's possible that some of the removed posts were deleted by the poster.)
Facebook has a hard job in finding bad posts amid the sea of acceptable ones, and it's all the harder to do so quickly.
Edelson, who has collaborated with The Washington Post on a project analyzing TikTok users' feeds, suggests a tighter focus would help. Facebook could better predict which posts its algorithms will show to lots of people and have moderators 'prioritize posts with high predicted future views.' That may not be a silver bullet, but it could help Facebook reduce the amount of bad content it shows to users.
Congress passes a revenge porn law, but some advocates are left frustrated
The internet is about to get a new federal online safety law, as your usual host Will Oremus reported Monday. But not all online safety advocates are overjoyed.
The House of Representatives voted 409-2 on Monday evening to pass the Take It Down Act, which President Donald Trump has already indicated he plans to sign. The act criminalizes the publication of nonconsensual intimate imagery, or NCII, including revenge porn and AI deepfake nudes, and requires online platforms to take it down within 48 hours of a valid report.
The vote followed the bill's unanimous passage in February in the Senate, where it was coauthored by Sens. Ted Cruz (R-Texas) and Amy Klobuchar (D-Minnesota). There was no debate on the House floor, where it passed under an expedited process called suspension of rules that requires a two-thirds majority.
The bill had support from an unusually wide swath of the political spectrum, from First Lady Melania Trump to Columbia Law Professor Tim Wu. And it thrilled advocates who have experienced the nightmare of NCII themselves, among them Elliston Berry, who was 14 when classmates distributed deepfake nudes of her on Snapchat.
'With the passage of the TAKE IT DOWN Act, we can protect future generations from having to experience the pain I went through,' Berry said in a statement.
Still, a contingent of tech policy wonks, including free expression advocates and digital rights groups, was left frustrated. Among them was Mary Anne Franks, president of the Cyber Civil Rights Initiative (CCRI), who has long been a leading advocate of a federal law criminalizing revenge porn.
In a statement Monday, CCRI called the criminalization of revenge porn 'long overdue' but said it has 'serious concerns about the constitutionality, efficacy, and potential misuse' of the provision in the Take It Down Act that requires online platforms to remove reported content within 48 hours. Those provisions, the group argued, are 'likely to be selectively and improperly misused for political or ideological purposes that endanger the very communities most affected by image-based sexual abuse.'
Wikipedia's nonprofit status questioned by D.C. U.S. attorney (Will Oremus and Julian Mark)
Government customer service shake ups have the less tech-savvy on edge (Heather Kelly)
Elon Musk had the government in his grasp. Then it unraveled. (Dan Diamond, Faiz Siddiqui, Trisha Thadani and Jeff Stein)
Tech tips for Defense Secretary Pete Hegseth (and everyone else) (Heather Kelly)
Congress passes Take It Down Act to fight deepfake nudes, revenge porn (Will Oremus)
Critics fear the Trump administration could weaponize the Take It Down Act (The Verge)
Meta's 'Digital Companions' Will Talk Sex With Users—Even Children (Wall Street Journal)
Researchers secretly ran a massive, unauthorized AI persuasion experiment on Reddit users (404 Media)
Wall Street banks sell final slug of Elon Musk's X debt (Wall Street Journal)
China's Huawei develops new AI chip, seeking to match Nvidia (Wall Street Journal)
ChatGPT goes shopping with new product-browsing feature (Ars Technica)
Duolingo will replace contract workers with AI (The Verge)
These autistic people struggled to make sense of others. Then they found AI. (Andrea Jiménez)
The group chats that changed America (Semafor)
That's all for today — thank you so much for joining us! Make sure to tell others to subscribe to the Tech Brief. Get in touch with Will (via email or social media) for tips, feedback or greetings!

Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

Activist arrested at Monday night protest says she's ready for Saturday event
Activist arrested at Monday night protest says she's ready for Saturday event

Yahoo

time27 minutes ago

  • Yahoo

Activist arrested at Monday night protest says she's ready for Saturday event

AUSTIN (KXAN) — Alexandra Haddix left jail Tuesday after Austin Police arrested her during an anti-ICE protest Monday night. 'I was tear-gassed while being pulled out of a car,' Haddix said. Despite her time in custody, she's fired up to continue protesting. She's ready for another protest on Saturday that she helped organize. It's part of a national day of protests called, 'No Kings Day,' with large crowds expected to turn out in protest of the Trump administration. 'No Kings' protest organizer calls Texas National Guard deployment an overreaction by Governor 'I just think that it's going to be so funny seeing the dichotomy between our jubilee protests and the National Guard holding their massive guns,' Haddix said. Haddix is a part of the group called the 50501 Movement. She said members of the group go through protest training and have planned seminars to educate people on protest safety. According to Haddix, there will be a seminar before Saturday's protest. 'We are going to have another seminar for crowd control for the organizers and people in charge,' Haddix said. 'We also will have a de-escalation seminar.' Haddix criticized the way police handled the Monday protest, which was organized by another group. However, she said her organization will encourage peaceful protest. 'Do I understand why we have police? Yes. Do I feel like they maybe are overstepping? Absolutely,' Haddix said. 'The safety of the people at our protest is our number one concern, and if that requires me to work a little bit with the police, then that is what I'm going to do.' Copyright 2025 Nexstar Media, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.

Self-proclaimed 'Jew hater' pleads guilty after targeting victims at NYC protests
Self-proclaimed 'Jew hater' pleads guilty after targeting victims at NYC protests

Yahoo

time27 minutes ago

  • Yahoo

Self-proclaimed 'Jew hater' pleads guilty after targeting victims at NYC protests

A New York man charged with federal hate crimes after repeatedly assaulting Jewish counter-protesters at anti-Israel protests in New York City between 2024 and 2025, pleaded guilty to one count as part of an agreement during a court hearing Wednesday. Tarek Bazrouk, 20, appeared Wednesday afternoon for a status hearing in federal court, where he was facing three counts of committing hate crimes for allegedly targeting and assaulting Jewish people at three NYC protests related to the ongoing war between Israel and Hamas. A grand jury indicted him last month. During the status hearing, Bazrouk pleaded guilty to one count as part of an agreement in which a superseding information document was presented. In essence, the document replaces a previously filed indictment in a criminal case. A bearded Bazrouk appeared in court wearing a tan jumpsuit and black eyeglasses and shuffled through papers while waiting for the hearing to get underway. Rise In Antisemitic Extremism Fuels Wave Of Terror Plots In The United States Since 2020 Judge Richard M. Berman presided over the hearing and began by saying he was informed Bazrouk was planning to plead guilty. After going through some documents and verifying with Bazrouk that was the route he wanted to take, Berman asked him if he wished to plead guilty. Read On The Fox News App "I wish to plead guilty," Bazrouk said. Bazrouk then read a statement saying, between April 2024 and January 2025, he assaulted others because of their identity. He further admitted to punching someone Jan. 6. "I am very sorry," Bazrouk said. Boulder Terror Attack Latest In Antisemitic Incidents Rising Across Us In 2025 He continued, explaining he is Palestinian and started to protest as a way to express outrage over Israel's actions in Gaza. Bazrouk apologized to his family and community before the judge asked if he was pleading to the superseding information. "Yes, your honor," Bazrouk said. The plea was then accepted, and he was found guilty. Sentencing is tentatively scheduled for Oct. 1. Boulder, Colorado Suspected Terror Attack Suspect Mohamed Sabry Soliman Faces Murder, Assault, Other Charges Bazrouk was arrested for three instances of assaulting Jewish people but "remained undeterred and quickly returned to using violence to target Jews in New York City," according to U.S. Attorney Jay Clayton of the Southern District of New York. The first instance took place April 15, 2024, when Bazrouk, who the DOJ said was wearing a green headband "typically worn by Hamas terrorists," allegedly attended a protest outside the New York Stock Exchange in lower Manhattan. Virginia Man Charged With Planning 'Mass Casualty' Attack At Nyc Israeli Consulate He was arrested by the NYPD for lunging at a group of pro-Israel protesters, the DOJ said, and kicked a Jewish college student in the stomach while being taken to a patrol vehicle. The person he kicked was standing near Jewish protesters wearing kippahs, waving Israeli flags and singing Jewish songs. Bazrouk allegedly assaulted another Jewish student Dec. 9, 2024, during a protest near a university in upper Manhattan, the DOJ said. The second victim was with his brother – both were wearing kippahs – and had an Israeli flag draped across his shoulders while singing Jewish songs. Bazrouk was accused of stealing their flag and running off. The victim and his brother chased him through the crowd to retrieve it, and after they got it back, Bazrouk allegedly sneaked up beside the second victim and punched him in the face. At the beginning of this year, on Jan. 6, Bazrouk allegedly committed his third assault on a Jewish person at a protest in Manhattan. The third victim had an Israeli flag draped around his shoulders and was wearing a hat with the flag and a chain with the Star of David. Bazrouk was wearing a keffiyeh on his face when he allegedly "made contact" with the third victim's shoulder and wrapped his foot around his ankle. When the victim attempted to push him away, Bazrouk allegedly cursed at him and punched him in the nose. Law enforcement obtained warrants to search a cellphone allegedly used by Bazrouk, which revealed an "antisemitic bias" and "support for anti-Jewish terrorist groups, including Hamas," the DOJ said, citing court documents. Bazrouk allegedly identified himself as a "Jew hater" in text messages, called Jewish people "worthless" and said "Allah" wanted "us [to] rid of [Jews]," among other vulgar statements, according to the documents. The documents added he told a friend he was "mad happy" when he found out family members overseas were part of Hamas. The DOJ described his phone as "littered with pro-Hamas and pro-Hizballah (sic) propaganda." Fox News Digital's Kirill Clark and Elizabeth Pritchett contributed to this article source: Self-proclaimed 'Jew hater' pleads guilty after targeting victims at NYC protests

Will US protests escalate amid more deployed ICE agents?
Will US protests escalate amid more deployed ICE agents?

Yahoo

time42 minutes ago

  • Yahoo

Will US protests escalate amid more deployed ICE agents?

(NewsNation) — Leaders in some Democratic-led cities are bracing for an increased presence of U.S. Immigration and Customs Enforcement agents as demonstrations protesting the Trump administration's immigration enforcement policies and ICE tactics continue across the country, with more planned for this weekend. Published reports on Wednesday stated that specialized ICE tactical teams would be sent to Chicago, Philadelphia, Seattle, New York and Northern Virginia after anti-ICE protests in Los Angeles reached a 'tipping point' with hundreds being arrested. More than two dozen protests nationwide this week have led to arrests as demonstrators rally against migrants being taken into federal custody. Federal officials insist ICE enforcement efforts will continue across the country despite the rallies, as advocates for migrant rights push back against what they say are deceptive practices being used by ICE. Inside largest ICE workplace operation in Omaha: NewsNation exclusive 'We will not be deterred,' Department of Homeland Security Assistant Secretary Tricia McLaughlin told NewsNation this week. More protests, including hundreds of No Kings events, are slated for Saturday amid reports that ICE is ramping up enforcement efforts, including during workplace raids in cities with sanctuary policies in place. That has raised concerns among some city leaders that clashes between federal agents and protesters, like those in Los Angeles, could spread. California Gov. Gavin Newsom predicted Tuesday that other left-leaning areas of the country could be targeted by the Trump administration by using similar tactics. 'What we have seen in Los Angeles is really not about immigration, this is not about policy, this is about power,' Chicago Mayor Brandon Johnson said Wednesday. 'We have a tyrant in the White House that has a complete disregard for our Constitution and the dismissing of our democracy.' ICE is prepared to deploy Special Response Teams to several Democratic-run cities to continue to carry out immigration enforcement practices, according to NBC News. No timeline for the troops being sent to those cities has been laid out. ICE did not respond to a request for comment from NewsNation on Wednesday. However, Chicago city officials confirmed on Wednesday that they had been alerted on Tuesday that agents had been given notice that they would be sent out within the next 48 hours. Johnson said his main priority is keeping everyone safe and that the city's practice of 'constitutional policing' would continue. Johnson said that because Trump is 'determined to insert chaos', the city's response would be to 'provide calm and structure'. 'We have an absolutely criminalized approach towards governance, and this president clearly continues to show how low he will stoop in order to protect the interests of a handful of people,' Johnson said. Johnson said at a news conference that he has been in contact with Illinois Gov. JB Pritzker and other leaders about a unified stance but said that the city and state are committed to protecting the right of people to assemble and to help preserve their constitutional rights. 2 charged for alleged Molotov cocktail possession at LA protests Johnson said that the city's strategic approach will remain in place Saturday when No Kings protests are scheduled both in Chicago's downtown district as well as in several suburbs. He said that demonstrators who act 'outside of their constitutional protections' would be held responsible and accountable. Johnson's comments followed demonstrations that took place in Chicago, where 17 people were taken into custody, including four who were charged with felonies, NewsNation affiliate WGN reported. No Kings organizers did not respond to an email from NewsNation seeking comment about plans to keep demonstrations safe amid concerns of increased ICE presence in cities like Chicago. Johnson said that the Chicago Police will continue to protect local residents and protesters alike while also adhering to the Illinois Trust Act, which prevents local officers from cooperating with federal immigration officials. But other city leaders hope that despite the tensions felt in places like Los Angeles, demonstrations can remain peaceful while getting their message across. 'The level of rage, the level of righteous anger that (protesters) might feel out there is genuine,' Chicago Ald. Andre Vasquez told NewsNation. 'So, trying to make sure that people don't feel further oppressed while also recognizing that there's clearly a strategy of having crowds look like they're chaotic is how the (Trump) administration is moving, it's very challenging to try to communicate that.' In New York City, where 86 people were arrested by city police officers on Tuesday during anti-ICE protests that involved about 2,500 participants, Mayor Eric Adams said that the escalation of protests in Los Angeles is 'unacceptable' and would not be tolerated if attempted in New York. 'I understand that some New Yorkers may be angry, afraid, and I understand, NYC will always be a place to peacefully protest, but we will not allow lawlessness,' Adams said, according to NewsNation affiliate Pix11. Earlier this week, 24 people were arrested during a sit-in at Trump Tower in New York, while seven people were taken into custody at another demonstration, three of whom were criminally charged. Yet with more protests planned in the coming days, city officials do not expect things to rise to the level they have in Los Angeles, an Adams spokeswoman told NewsNation on Wednesday. The spokeswoman said the city has not received any notification that additional ICE agents would be arriving in New York in the coming days. She added that the city does not anticipate involving the National Guard or the U.S. military being sent to New York, both of which have been called into action in Los Angeles by the Trump administration. The mayor's spokeswoman said that the city has made it clear to the federal government that no federal assistance is required to help maintain law and order and that city officials do not expect protests to escalate out of control. 'There's no invasion': California AG on Los Angeles protests 'What we're seeing in (Los Angeles) and what the feds are doing over there, we're not seeing that here. The NYPD has it under control,' she told NewsNation. 'The NYPD is literally prepared for anything.' Despite hearing rumors and media reports about ICE tactical teams being sent to Seattle, city officials told NewsNation on Wednesday that they have not yet received official word about increased federal agents arriving. In a statement sent to NewsNation on Wednesday, Mayor Bruce Harrell said that the city remains in close contact with the governor's and state attorney general's offices, as well as other local officials, to coordinate a response should ICE tactical teams arrive in Seattle in the coming days. Harrell called the Trump administration's actions in Los Angeles 'an extreme and egregious overreach of federal authority meant to escalate tensions' and to distract from the promises Trump hasn't lived up to. The mayor said he is working with Seattle's police department to prepare for any demonstrations that may arise. 'Seattle strongly supports the First Amendment rights of our residents, and we encourage residents to stand up for their values peacefully,' Harrell said. 'There is no room for violence. Violence and property damage are exactly what Trump wants to spin his false narrative of our city.' After anti-ICE protests took place in Austin and San Antonio and with more demonstrations planned, Texas Gov. Greg Abbott announced plans on social media to dispatch the Texas National Guard to those cities. Abbott wrote on X on Tuesday that the troops will use 'every tool and strategy' to help law enforcement maintain order. Abbott wrote that while peaceful protest is legal, harming others and damaging or destroying property will lead to arrests. Abbott's declaration followed a demonstration earlier this week at the state capitol building in Austin, which was attended by 500 people and in which local and state authorities used pepper spray and flashbang grenades. More than a dozen people were arrested, according to reports. This weekend's planned protests include No Kings demonstrations that are part of the nationwide collection of protests that decry the Trump administration's policies. The deployment of the National Guard, which will remain on standby, is an attempt to prevent civil unrest from taking place, an Abbott spokesman told NewsNation on Wednesday. 'Peaceful protests are part of the fabric of our nation, but Texas will not tolerate the lawlessness we have seen in Los Angeles,' the spokesman, Andrew Mahaleris, said Wednesday. 'Anyone engaging in acts of violence or damaging property will be swiftly held accountable to the full extent of the law.' Copyright 2025 Nexstar Media, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into the world of global news and events? Download our app today from your preferred app store and start exploring.
app-storeplay-store