Problematic Paper Screener: Trawling for fraud in the scientific literature
Have you ever heard of the Joined Together States? Or bosom peril? Kidney disappointment? Fake neural organizations? Lactose bigotry? These nonsensical, and sometimes amusing, word sequences are among thousands of 'tortured phrases' that sleuths have found littered throughout reputable scientific journals.
They typically result from using paraphrasing tools to evade plagiarism-detection software when stealing someone else's text. The phrases above are real examples of bungled synonyms for the United States, breast cancer, kidney failure, artificial neural networks, and lactose intolerance, respectively.
We are a pair of computer scientists at Université de Toulouse and Université Grenoble Alpes, both in France, who specialize in detecting bogus publications. One of us, Guillaume Cabanac, has built an automated tool that combs through 130 million scientific publications every week and flags those containing tortured phrases.
The Problematic Paper Screener also includes eight other detectors, each of which looks for a specific type of problematic content.
Several publishers use our paper screener, which has been instrumental in more than 1,000 retractions. Some have integrated the technology into the editorial workflow to spot suspect papers upfront. Analytics companies have used the screener for things like picking out suspect authors from lists of highly cited researchers. It was named one of 10 key developments in science by the journal Nature in 2021.
So far, we have found:
Nearly 19,000 papers containing at least five tortured phrases each.
More than 280 gibberish papers – some still in circulation – written entirely by the spoof SCIgen program that Massachusetts Institute of Technology students came up with nearly 20 years ago.
More than 764,000 articles that cite retracted works that could be unreliable. About 5,000 of these articles have at least five retracted references listed in their bibliographies. We called the software that finds these the 'Feet of Clay' detector after the biblical dream story where a hidden flaw is found in what seems to be a strong and magnificent statue. These articles need to be reassessed and potentially retracted.
More than 70 papers containing ChatGPT 'fingerprints' with obvious signs such as 'Regenerate Response' or 'As an AI language model, I cannot …' in the text. These articles represent the tip of the tip of the iceberg: They are cases where ChatGPT output has been copy-pasted wholesale into papers without any editing (or even reading) and has also slipped past peer reviewers and journal editors alike. Some publishers allow the use of AI to write papers, provided the authors disclose it. The challenge is to identify cases where chatbots are used not just for language-editing purposes but to generate content – essentially fabricating data.
There's more detail about our paper screener and the problems it addresses in this presentation for the Science Studies Colloquium.
Read The Conversation's investigation into paper mills here: Fake papers are contaminating the world's scientific literature, fueling a corrupt industry and slowing legitimate lifesaving medical research
This article is republished from The Conversation, a nonprofit, independent news organization bringing you facts and trustworthy analysis to help you make sense of our complex world. It was written by: Guillaume Cabanac, Institut de Recherche en Informatique de Toulouse; Cyril Labbé, Université Grenoble Alpes (UGA), and Frederik Joelving, Retraction Watch
Read more:
Fake papers are contaminating the world's scientific literature, fueling a corrupt industry and slowing legitimate lifesaving medical research
When scientific citations go rogue: Uncovering 'sneaked references'
A new 'AI scientist' can write science papers without any human input. Here's why that's a problem
Guillaume Cabanac receives funding from the European Research Council (ERC) and the Institut Universitaire de France (IUF). He is the administrator of the Problematic Paper Screener, a public platform that uses metadata from Digital Science and PubPeer via no-cost agreements. Cabanac has been in touch with most of the major publishers and their integrity officers, offering pro bono consulting regarding detection tools to various actors in the field including ClearSkies, Morressier, River Valley, Signals, and STM.
Cyril Labbé receives funding from the European Research Council. He he has also received funding from the French National Research Agency (ANR), and the U.S. Office of Research Integrity. Labbé has been in touch with most of the major publishers and their integrity officers, offering pro-bono consulting regarding detection tools to various actors in the field including STM-Hub and Morressier.
Frederik Joelving does not work for, consult, own shares in or receive funding from any company or organization that would benefit from this article, and has disclosed no relevant affiliations beyond their academic appointment.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
6 hours ago
- Yahoo
OpenAI cofounder tells new graduates the day is coming when AI 'will do all the things that we can'
OpenAI cofounder Ilya Sutskever says "the day will come when AI will do all the things that we can." He spoke about the state of AI at the University of Toronto convocation last week. Sutskever also advised graduates to "'accept reality as it is and try not to regret the past." Ilya Sutskever says it might take years, but he believes AI will one day be able to accomplish everything humans can. Sutskever, the cofounder and former chief scientist of ChatGPT maker OpenAI, spoke about the technology while giving a convocation speech at the University of Toronto, his alma mater, last week. "The real challenge with AI is that it is really unprecedented and really extreme, and it's going to be very different in the future compared to the way it is today," he said. Sutskever said that while AI is already better at some things than humans, "there are so many things it cannot do as well and it's so deficient, so you can say it still needs to catch up on a lot of things." But, he said, he believes "AI will keep getting better and the day will come when AI will do all the things that we can do." "How can I be so sure of that?" he continued. "We have a brain, the brain is a biological computer, so why can't a digital computer, a digital brain, do the same things? This is the one-sentence summary for why AI will be able to do all those things, because we have a brain and the brain is a biological computer." As is customary at convocation and commencement ceremonies, Sutskever also gave advice to the new graduates. He implored them to "accept reality as it is, try not to regret the past, and try to improve the situation." "It's so easy to think, 'Oh, some bad past decision or bad stroke of luck, something happened, something is unfair,'" he said. "It's so easy to spend so much time thinking like this while it's just so much better and more productive to say, 'Okay, things are the way they are, what's the next best step?'" Sutskever hasn't always taken his own advice on the matter, though. He's said before that he regrets his involvement in the November 2023 ousting of OpenAI CEO Sam Altman. Sutskever was a member of the board, which fired Altman after saying it "no longer has confidence" in his ability to lead OpenAI and that he was "not consistently candid in his communications." A few days later, however, Sutskever expressed regret for his involvement in the ouster and was one of hundreds of OpenAI employees who signed an open letter threatening to quit unless Altman was reinstated as CEO. "I deeply regret my participation in the board's actions," Sutskever said in a post on X at the time. "I never intended to harm OpenAI." Altman was brought back as CEO the same month. Sutskever left OpenAI six months later and started a research lab focused on building "safe superintelligence." Read the original article on Business Insider
Business Insider
7 hours ago
- Business Insider
OpenAI cofounder tells new graduates the day is coming when AI 'will do all the things that we can'
Ilya Sutskever says it might take years, but he believes AI will one day be able to accomplish everything humans can. Sutskever, the cofounder and former chief scientist of ChatGPT maker OpenAI, spoke about the technology while giving a convocation speech at the University of Toronto, his alma mater, last week. "The real challenge with AI is that it is really unprecedented and really extreme, and it's going to be very different in the future compared to the way it is today," he said. Sutskever said that while AI is already better at some things than humans, "there are so many things it cannot do as well and it's so deficient, so you can say it still needs to catch up on a lot of things." But, he said, he believes "AI will keep getting better and the day will come when AI will do all the things that we can do." "How can I be so sure of that?" he continued. "We have a brain, the brain is a biological computer, so why can't a digital computer, a digital brain, do the same things? This is the one-sentence summary for why AI will be able to do all those things, because we have a brain and the brain is a biological computer." As is customary at convocation and commencement ceremonies, Sutskever also gave advice to the new graduates. He implored them to "accept reality as it is, try not to regret the past, and try to improve the situation." "It's so easy to think, 'Oh, some bad past decision or bad stroke of luck, something happened, something is unfair,'" he said. "It's so easy to spend so much time thinking like this while it's just so much better and more productive to say, 'Okay, things are the way they are, what's the next best step?'" Sutskever hasn't always taken his own advice on the matter, though. He's said before that he regrets his involvement in the November 2023 ousting of OpenAI CEO Sam Altman. Sutskever was a member of the board, which fired Altman after saying it "no longer has confidence" in his ability to lead OpenAI and that he was "not consistently candid in his communications." A few days later, however, Sutskever expressed regret for his involvement in the ouster and was one of hundreds of OpenAI employees who signed an open letter threatening to quit unless Altman was reinstated as CEO. "I deeply regret my participation in the board's actions," Sutskever said in a post on X at the time. "I never intended to harm OpenAI."
Yahoo
7 hours ago
- Yahoo
AI should unlock clinical trial data, say experts
Artificial intelligence (AI) has the potential to uncover valuable insights hidden in protocols and clinical study reports across the pharmaceutical industry, according to experts at the Outsourcing in Clinical Trials East Coast 2025 conference in King of Prussia. During a panel discussion on AI in clinical research, Prasanna Rao, Chief Products and Innovation officer at Saama emphasised the importance of making protocol data available to large language models (LLMs), so tools such as ChatGPT can support informed patient decision-making. 'Companies are very protective of clinical protocol data, and I'm not sure why,' said Rao. 'These documents are already distributed broadly, including to patients. There's nothing particularly sensitive in them. I believe the real concern is that big pharma is nervous about AI analysing these protocols and potentially uncovering insights that people might overlook - but there's no real reason for that fear.' Rao urged the industry to be more transparent: 'We need to make this kind of data available. Patients in a trial want to fully understand what they're signing up for. Imagine a patient uploads a protocol and asks, 'What will I go through in this study?' AI could then analyse related data and provide a clear summary, helping them make better decisions.' Cole Eshbach, Senior Clinical Trial Manager at Endo cautioned that while AI is powerful, it's not always the right tool for every trial situation. 'There's a popular saying right now - AI can be like a nail looking for a hammer,' said Eshbach. 'Just because AI is available doesn't mean it's the best solution for your needs. If you don't have a large trial database or the necessary infrastructure, it might not be the most cost-effective option. Sometimes, a simpler tool you already have can do the job just as well.' Bryan Clayton, founder and CEO of BC Consulting Group, encouraged attendees to experiment with AI tools through everyday conversation. 'My advice to people is simple: talk to ChatGPT, or whatever AI tool you're using like you would talk to a person. First, treat it like a conversation. Second, ask it what you should be asking. It might sound odd, but say, 'Hey ChatGPT, what should I ask you about this protocol or topic?' It'll guide you. If you keep the dialogue going, you'll start to see its potential - and realise, 'Wow, I can actually use this to do something valuable.' Looking ahead, Rao pointed to agentic AI - AI systems that can autonomously plan and execute complex tasks – as a major advancement poised to transform clinical trials. 'I built an agent to help with a specific task - checking if anyone else was running a similar Phase III trial. It gave me answers in seconds,' shared Rao. 'That's the power of this technology. It's the same kind of deep research AI others use, but you can build your own with open-source tools, which is more cost-effective.' He added that Saama is actively deploying such agents across its platform. 'It's still early, but in the next year or two, we'll see major time and cost savings. Tasks like data gathering that used to take a lot of manual effort can now be automated. That frees up knowledge workers to focus on more important work.' Cole Eshbach closed the discussion with a long-term perspective. 'We're not where we need to be yet, but five years from now, the impact of AI could be enormous. Every industry shift now includes AI. It's going to transform our field, and the sooner we adapt, the more we'll benefit - saving money, speeding up timelines, and improving things for sites and participants.' "AI should unlock clinical trial data, say experts" was originally created and published by Clinical Trials Arena, a GlobalData owned brand. The information on this site has been included in good faith for general informational purposes only. It is not intended to amount to advice on which you should rely, and we give no representation, warranty or guarantee, whether express or implied as to its accuracy or completeness. You must obtain professional or specialist advice before taking, or refraining from, any action on the basis of the content on our site. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
