Authors of paper claiming Irish judges use Wikipedia as a source for rulings dispute ‘flawed' research criticisms
The authors of a controversial academic paper that claimed Irish judges use Wikipedia as a source for their rulings have published a new paper disputing suggestions that their research is flawed.
The original paper
was published in 2022
and was criticised in
a subsequent study published
in May 2023, co-authored by High Court judge Mr Justice Richard Humphreys, which said citations in judgments are driven mainly by legal submissions and maintained there was no 'Wikipedia effect'.
The authors disagreed with the study's criticisms and on Monday published a detailed paper, entitled Trial by Internet – a response to judicial critics, standing over their research methodology.
In the original paper, researchers at Massachusetts Institute of Technology (MIT) and
Maynooth University
arranged for 154 articles on Irish
Supreme Court
decisions to be written by law students. Half were uploaded to Wikipedia and the rest were kept offline as a control group.
READ MORE
The authors said the cases mentioned in the uploaded articles were 20 per cent more likely to be cited as precedents in court rulings than similar cases that had not been uploaded.
They also claimed an analysis of the language used in the judgments found the 'linguistic fingerprints' of the Wikipedia articles.
The later research, carried out by Mr Justice Humphreys and six judicial assistants who worked with judges of the superior courts, criticised the 'headline-grabbing claims' in the 2022 paper.
Mr Justice Humphreys said there were 'fundamental problems' with that paper rendering its conclusions unreliable and that 'baseless speculations' seemed to come from a lack of knowledge about how judgments are produced.
It was claimed the 2022 paper worked off a commercial website rather than the official courts.ie website where judgments are published, leading to the possibility of consistency issues.
Among other criticisms, it argued the authors compared too long a period of citations before the articles appeared on Wikipedia with a short period of about two years afterwards.
Using different methodology to compare citations of the cases mentioned on Wikipedia and those in the control group, the 2023 paper said the citations rose by the same amount and that meant no effect from the cases being mentioned on Wikipedia.
In response to that research, one of the original authors of the 2022 paper, Dr Brian Flanagan, an associate professor at the school of law and criminology at Maynooth University, said their analysis stood up to the criticism levelled at it.
In their latest paper, the original authors say their use of commercial data was cross-checked against the court's own records and a small difference of less than 1 per cent did not change their conclusions and was not a research 'flaw'.
They said further analysis provided support for their findings that cases added to Wikipedia jumped immediately in terms of citations by judges after being added.
Despite claiming to 'debunk' their research, the 2023 paper did not do the work necessary for that, they said. What the 2023 paper did instead was to attempt 'an entirely different analysis, with far less data and supporting argument'.
They said a 'notable benefit' of the type of analysis in their 2022 paper – a randomised control trial – 'is that it can establish causation without having to rule out all other possibilities'.
This was why such analysis is used in medical trials 'and why, when a drug is approved for treatment, no one objects by saying not all other medical explanations were checked'.
The 2023 paper 'read more like legal submissions than social science' and did not provide the research needed to show whether the critics' objections would undercut the arguments advanced in the 2022 paper.
Their reframing of their research results as concerning 'legal professionals' rather than 'judges' was made in response to feedback, they also said.
'Some had interpreted our original wording as indicating that the discovered effect must stem from judges/assistants alone. We had always understood that it was likely that lawyers were also playing a role. Our rewording simply reflected the need to clarify that we were not limiting the mechanism to judges and their staff.'
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Irish Times
13 hours ago
- Irish Times
Leaving Cert biology: Plenty of choice but challenging in places
The Leaving Cert biology paper (higher level) has been well-received by teacher and students alike, with praise for the layout and choice. Killian Keegan, a student at Athlone Community College and one of this year's Irish Times student diarists, said that it was the most accessible paper in years . Liam Hennelly, subject expert and a biology teacher at Belvedere College in Dublin, said that it was well-laid out. 'It gave students plenty of choice across all three units of the course, and allowed them to show off what they know. READ MORE 'Some of the questions were challenging in places and required an in-depth knowledge of subject material, as you would expect with any higher-level paper,' said Mr Hennelly. Biology, higher level, sections A and B: David O'Brien, ASTI subject representative and a teacher at Ballincollig Community School in Co Cork, said that it was a very fair paper. 'The students I spoke to were happy with the exam,' he said. 'They were well-prepared. They were delighted with the experiment question about habitat study in question eight. 'There was a question about vaccination and immunity in section C, which is very relevant,' he said. 'With so much choice on the marking paper, and a good balance between anatomy, plants, cells and genetics, the marking scheme will ultimately distinguish between the H1 and H2 candidates.' Biology, higher level, section C: Wesley Hammond, a biology teacher at the Institute of Education, said that students who were diligent in their past papers and didn't cut corners when revising chapters will be happy with this paper. 'Many of the areas that students consider as 'bankers' for their marks were nicely represented,' he said. The questions in section A won't have thrown anyone, said Mr Hennelly. 'There were no surprises and if you had put in the time to work through past papers you will recognise much of it. While all questions might not suit everyone (Q2's longitudinal section of the root may challenge those less confident in plant biology), there were plenty of viable alternatives to let them demonstrate their efforts over the last two years,' he said. Ordinary level On the ordinary-level paper, Mr Hennelly said that it also had a wide selection of questions that ranged across a broad number of topics. 'Short questions included food, ecology, a true/false question, cell structure, tropisms, the nervous system and mitosis. Experiment questions included food tests, enzymes and factors that affect germination,' he said. 'The long questions gave students a lot of choice across ecology, genetics & protein synthesis, photosynthesis & respiration, plant structure, human reproduction and microbiology among other topics,' Mr Hennelly said. From September 2025, senior cycle students will start a new curriculum for all science subjects, with an increased focus on experimentation, and 40 per cent of marks awarded for project work. Biology, ordinary level, sections A and B: Mr O'Brien, the ASTI subject representative, said that schools have yet to receive health and safety guidelines or risk assessments for practical investigation. 'Schools have not received sufficient funding for purchasing equipment and chemicals, which are expensive, and will need annual funding. We're also concerned about digital inequality in the system, as students or schools with more access to computers will be at a disadvantage,' Mr O'Brien said. Biology, ordinary level, section C: Try this one at home: LEAVING CERT BIOLOGY, QUESTION 16 (D) Lymphocytes mature in the lymphatic system, which is part of the human defence system. (i) 1. Name two organs of the lymphatic system. 2. Other than maturation of lymphocytes, give two functions of the lymphatic system. (ii) Lymphocytes play a role in the specific defence system. State the precise location in the body where lymphocytes are produced. 3. Name two types of lymphocyte and describe the role of each. 4. Explain the term 'vaccination'.
Irish Times
16 hours ago
- Irish Times
Impact of AI on Ireland's energy demands ‘not going to be as steep' as feared
The impact of the proliferation of artificial intelligence (AI) on Ireland's energy demands is 'not going to be as steep as many people believe', Research Ireland has told an Oireachtas committee. Research Ireland, which was established last year by an amalgamation of Science Foundation Ireland and the Irish Research Council, was before the newly formed Joint Committee on Artificial Intelligence on Tuesday. The International Energy Agency expects data centres to consume close to a third of total electricity in Ireland by 2026. They used about 22 per cent of all metered electricity here in 2024, according to Central Statistics Office data. The current boom in AI is rapidly fuelling increased need for data centre capacity, as AI relies on vast consumption of data, and, by extension, energy. A ChatGPT query is said to consume 10 times more electricity than a Google search. READ MORE [ Data centres accounted for more than fifth of Ireland's electricity usage last year Opens in new window ] Asked about the need for more data centres and the impact of this on resources, Ciarán Seoighe, deputy chief executive of Research Ireland, said a price 'will have to be paid', but that evidence is emerging it may not be 'as steep' as current projections suggest. 'The projections are based on a straight line increase or even a curve up increase in the energy demands, but already we are seeing in the research area examples where that is not only deflected down, but hopefully even pivoted down,' he said. 'I'm not going to say this is a problem that is going to disappear, but I expect it to be less demanding than what the current projections would be. It is still a huge consumption of resources, not just of electricity. 'It's not going to go away. We are going to have to pay for this in some sense, but I don't think the penalty is going to be as steep as many people believe.' Separately, Mr Seoighe said he had concerns over the 'dominance of Big Tech' and the resources multinational companies have to invest in AI, which could leave state actors playing catch-up. 'There was talk at one point of a CERN [the European Organisation for Nuclear Research] for AI, because, as a small state, we are not at that level where we can invest the many, many millions required to be able to do this level of research,' he said. 'But, if at a European level, we had a large scale centralised investment, of which we could be a part, then we have the scale and the power to do real research in the area, and stay ahead of the curve.' Research Ireland's Susan Leavy, who is also an assistant professor with the School of Information and Communication Studies at UCD, said the issue that 'keeps me awake at night' is the use of AI by 'pernicious actors' to influence political viewpoints and elections. 'You have that possibility for pernicious actors to interfere [and] generate loads of AI content, and it could be super personalised to sway people's beliefs, voting patterns, polarise people, and that undermines democracy,' she said. 'The AI-generated content on social media hasn't yet been shown to have had an effect in elections. However, what we do know is the political polarisation in society coincides with the proliferation of the recommender algorithms.'
Irish Times
2 days ago
- Irish Times
Leaving Cert Irish paper one: a topical paper with some notable absences
Higher-level Irish paper one was topical and covered the key areas of the course, although not all anticipated topics appeared, according to teachers. Stephen Doyle, subject expert and a teacher at Moyle Park College said that, while the questions were generally fair, some detailed questions in Cuid C required careful listening skills. 'The composition section provided excellent choices that any well-prepared student could tackle confidently,' Mr Doyle said. 'The essay options gave students a wide range of current and relevant topics including people they admire, whether Ireland is a good place to live, environmental issues, and timely topics like world politics and current news stories.' READ MORE Artificial intelligence, which was expected to appear, provided opportunities for students on a paper most students would be happy with, said Mr Doyle. Lorraine Finn, ASTI subject representative for Irish, said that she found the artificial intelligence question a bit niche, while the climate change question provided limited scope. 'Otherwise, there was more or less everything you might expect. Most students would have an essay prepared on their topic of their lives today,' she said. But Danielle O'Connell, an Irish teacher with , said that expected topics such as An Ghaeilge (the Irish language) and córas oideachais (the education system) were notably absent from the exam. 'One welcome inclusion for many students was the essay prompt scéalta nuachta na linne seo (news stories of our time), which allowed candidates to adapt their prepared content across a range of issues,' said Ms O'Connell. 'This flexibility meant that topics such as géarchéim na tithíochta (the housing crisis) and even education or climate issues could be woven into the question Éire – an tír mhaith í le cónaí inti? (Ireland – is it a good country to live in?), provided students took time to plan their approach carefully.' Overall, Mr Doyle said that this was a fair and balanced paper. 'There was a wide variety of options that gave students good opportunities to succeed,' he said. Ordinary level On the ordinary-level paper, Mr Doyle said it was very accessible. 'The composition section offered simple choices including writing a blog on shopping, an interesting place or their favourite sports person. 'On the other hand, the vocabulary needed for section C (the letter, would have challenged any sixth year ordinary-level student. Section D, the conversation, allowed students to talk about a part-time job; however, the question was very specific. 'The story option would be welcomed by students as it allowed them to discuss music and a concert they attended. Overall, this was a manageable paper,' Mr Doyle said. Try this one at home: Scríobh AISTE nó ALT NUACHTÁIN/IRISE ar cheann amháin de na hábhair seo. A - Daoine a bhfuil meas agam orthu. B - Éire – an tír mhaith í le cónaí inti? C - An comhshaol – ábhar imní do phobail an domhain. D - Polaiteoirí agus cúrsaí polaitíochta ar fud an domhain. E - Scéalta móra nuachta na linne seo.
