'Hopeless' to potentially handy: law firm tests chatbots
A future for 'fleshy bits'
This was the second time Linklaters had run its LinksAI benchmark tests, with the original exercise taking place in October 2023.In the first run, OpenAI's GPT 2, 3 and 4 were tested alongside Google's Bard.The exam has now been expanded to include o1, from OpenAI, and Google's Gemini 2.0, which was also released at the end of 2024.It did not involve DeepSeek's R1 - the apparently low cost Chinese model which astonished the world last month - or any other non-US AI tool.The test involved posing the type of questions which would require advice from a "competent mid-level lawyer" with two years' experience.The newer models showed a "significant improvement" on their predecessors, Linklaters said, but still performed below the level of a qualified lawyer.Even the most advanced tools made mistakes, left out important information and invented citations - albeit less than earlier models.The tools are "starting to perform at a level where they could assist in legal research" Linklaters said, giving the examples of providing first drafts or checking answers.However, it said there were "dangers" in using them if lawyers "don't already have a good idea of the answer".It added that despite the "incredible" progress made in recent years there remained questions about whether that would be replicated in future, or if there were "inherent limitations" in what AI tools could do.In any case, it said, client relations would always be a key part of what lawyers did, so even future advances in AI tools would not necessarily bring to an end what it called the "fleshy bits in the delivery of legal services".
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Daily Record
28 minutes ago
- Daily Record
easyJet, British Airways and Wizz Air travellers to Spain facing major disruption
The union UGT has already announced repeated walkouts in Ryanair's baggage handling department, starting on August 15 - with the prospect of delays and flight cancellations made worse by another strike British holidaymakers travelling to Spain face a double blow as further strike action has been confirmed affecting major airports and airlines. The union UGT has already declared repeated walkouts in Ryanair's baggage handling department, commencing on August 15. However, the threat of delays and flight cancellations has worsened after 1,500 workers with another firm, Menzies, announced their own industrial action, also beginning this month. Menzies provides services to airlines including Emirates, British Airways, American Airlines, easyJet, Turkish Airlines, Norwegian and Wizz Air. The UGT union has announced a strike by ground staff of the Menzies group that will impact five Spanish airports, including Barcelona-El Prat, Alicante, Palma, Malaga and Tenerife South, on August 16, 17, 23, 24, 30 and 31. The workers' representatives are objecting to what they regard as "serious and repeated breaches of labour agreements and the conditions established by agreement" by Menzies, they said in a statement. Amongst these "violations", UGT highlights "salary breaches, violation of subrogation rights, disorganisation in working hours and schedules." It also alleges "constant errors in the management of personnel and payroll", reports the Express. The union also argues that there is a shortage of staff to handle the workload and an "arbitrary imposition of holidays." It alleges that Menzies is violating the sectoral handling agreement, the company's own agreement, and the sectoral agreement ratified by the Interconfederal Mediation and Arbitration Service (SIMA) in December 2024, which led to the cancellation of a previous strike. The UGT union has already called for multiple strikes in Ryanair's handling department. This comes during a period when Spain is teeming with tourists at the peak of the season and school holidays. This strike, involving over 3,000 workers who load and unload luggage, will take place on August 15, 16, and 17 and then every Wednesday, Friday, Saturday, and Sunday. In even more concerning news, unless a resolution is reached, the Ryanair strikes could continue until next January. Under legal rules, the workers are required to provide a "minimum service" which is yet to be determined, but the action will still significantly affect travellers. The protests are "against the sanctions imposed on workers and the abuse of hours." Ryanair's bases are situated in Valencia, Alicite, Madrid, Barcelona, Seville, Malaga, Ibiza, Palma, Girona, Tenerife South, Lanzarote and Santiago. The strike at Azul Handling (Ryanair's handling subsidiary) is set for August 15, 16 and 17 and will continue every Wednesday, Friday, Saturday and Sunday until at least December 31, as confirmed by the UGT in a statement. The actions could potentially extend into January. The strike will take place between 5am and 9am, noon and 3pm and 9pm to 11.59pm. The FeSMC-UGT airline sector is requesting mediation before the Interconfederal Mediation and Arbitration Service (SIMA). The union has outlined the reasons for the call. It says these are: Lack of stable job creation and consolidation of working hours for permanent part-time staff Imposition and coercion in the performance of complementary hours, both ordinary and voluntary, apply in some cases, with disproportionate sanctions Repeated failure to comply with the opinions of the Joint Committee of the Sectoral Agreement on guarantees and bonuses Illegal restrictions on reinstatement after medical discharge and on the adaptation of working hours to exercise the right to family conciliation It says: "UGT regrets having to go to these extremes and all the damages that may occur, for which the direct responsibility will be solely and exclusively the company and its reckless action with the workforce." Jose Manuel Perez Grande, Federal Secretary of the FeSMC-UGT Air Union, has accused Azul Handling of maintaining "a strategy of precariousness and pressure on the workforce that violates basic labour rights and systematically ignores union demands." The FeSMC-UGT Air Sector is calling for the company to retract the sanctions, adhere to the recommendations of the Joint Commission, and start a real negotiation process aimed at enhancing the working conditions for over 3,000 employees across the country.
The Guardian
30 minutes ago
- The Guardian
Staff at UK's top AI institute complain to watchdog about its internal culture
Staff at the UK's leading artificial intelligence institute have raised concerns about the organisation's governance and internal culture in a whistleblowing complaint to the charity watchdog. The Alan Turing Institute (ATI), a registered charity with substantial state funding, is under government pressure to overhaul its strategic focus and leadership after an intervention last month from the technology secretary, Peter Kyle. In a complaint to the Charity Commission, a group of current ATI staff raise eight points of concern and say the institute is in danger of collapse due to government threats over its funding. The complaint alleges that the board of trustees, chaired by the former Amazon UK boss Doug Gurr, has failed to fulfil core legal duties such as providing strategic direction and ensuring accountability, with staff alleging a letter of no confidence was delivered last year and not acted upon. A spokesperson for ATI said the Charity Commission had not been in touch with the institute about any complaints that may have been sent to the organisation. They added that a whistleblower complaint had been filed last year to the government's UK Research and Innovation body, which funds ATI, and a subsequent independent investigation found no concerns. The complaint comes after ATI, which is undergoing a restructuring, notified about 50 staff – or approximately 10% of its workforce – that they were at risk of redundancy. It claims ATI's funding is at risk, citing 'privately raised concerns' from unnamed industry partners, while warning that Kyle has made clear that future government support is contingent on improved delivery and leadership change. In a letter to Gurr this month, Kyle called for a switch in focus to defence and national security at ATI, as well as leadership changes. While the letter stated ATI should 'continue to receive the funding needed to implement reforms', it said its 'longer-term funding arrangement' could be reviewed next year. The complaint claims there has been no internal or external accountability for how ATI funds have been used. It alleges there is an internal culture of 'fear, exclusion, and defensiveness'. It also alleges the board has not provided adequate oversight of a series of senior leadership departures under the chief executive, Jean Innes, nor of senior leadership appointments, and that ATI's credibility with 'staff, funders, partners, and the wider public has been significantly undermined', as shown by the letter of no confidence and Kyle's intervention. The Guardian has also learned that ATI is shutting projects related to online safety, tackling the housing crisis and reducing health inequality as part of its restructuring, which is resulting in the closure or mothballing of multiple strands of research. The restructuring has triggered internal upheaval at ATI, with more than 90 staff sending a letter to the board last year warning that cost cuts were putting the organisation's reputation at risk. Sign up to First Edition Our morning email breaks down the key stories of the day, telling you what's happening and why it matters after newsletter promotion Among the projects slated for closure are work on developing AI systems to detect online harms, producing AI tools that can help policymakers tackle issues such as inequality and affordability in the housing market and measuring the impact in health inequality of major policy decisions like lockdowns. Other projects expected to close include an AI-based analysis of how the government and media interact. A project looking at social bias in AI outcomes will also be dropped. Projects being paused include a study into how AI might affect human rights and democracy, as well as research into creating a global approach to AI ethics. A spokesperson for ATI said: 'We're shaping a new phase for the Turing, and this requires substantial organisational change to ensure we deliver on the promise and unique role of the UK's national institute for data science and AI. As we move forward, we're focused on delivering real-world impact across society's biggest challenges, including responding to the national need to double down on our work in defence, national security and sovereign capabilities.' A Charity Commission spokesperson said the organisation could not confirm or deny whether it had received a complaint, in order to protect the identity of any whistleblowers.
The Guardian
an hour ago
- The Guardian
Staff at UK's top AI institute complain to watchdog about its internal culture
Staff at the UK's leading artificial intelligence institute have raised concerns about the organisation's governance and internal culture in a whistleblowing complaint to the charity watchdog. The Alan Turing Institute (ATI), a registered charity with substantial state funding, is under government pressure to overhaul its strategic focus and leadership after an intervention last month from the technology secretary, Peter Kyle. In a complaint to the Charity Commission, a group of current ATI staff raise eight points of concern and say the institute is in danger of collapse due to government threats over its funding. The complaint alleges that the board of trustees, chaired by the former Amazon UK boss Doug Gurr, has failed to fulfil core legal duties such as providing strategic direction and ensuring accountability, with staff alleging a letter of no confidence was delivered last year and not acted upon. A spokesperson for ATI said the Charity Commission had not been in touch with the institute about any complaints that may have been sent to the organisation. They added that a whistleblower complaint had been filed last year to the government's UK Research and Innovation body, which funds ATI, and a subsequent independent investigation found no concerns. The complaint comes after ATI, which is undergoing a restructuring, notified about 50 staff – or approximately 10% of its workforce – that they were at risk of redundancy. It claims ATI's funding is at risk, citing 'privately raised concerns' from unnamed industry partners, while warning that Kyle has made clear that future government support is contingent on improved delivery and leadership change. In a letter to Gurr this month, Kyle called for a switch in focus to defence and national security at ATI, as well as leadership changes. While the letter stated ATI should 'continue to receive the funding needed to implement reforms', it said its 'longer-term funding arrangement' could be reviewed next year. The complaint claims there has been no internal or external accountability for how ATI funds have been used. It alleges there is an internal culture of 'fear, exclusion, and defensiveness'. It also alleges the board has not provided adequate oversight of a series of senior leadership departures under the chief executive, Jean Innes, nor of senior leadership appointments, and that ATI's credibility with 'staff, funders, partners, and the wider public has been significantly undermined', as shown by the letter of no confidence and Kyle's intervention. The Guardian has also learned that ATI is shutting projects related to online safety, tackling the housing crisis and reducing health inequality as part of its restructuring, which is resulting in the closure or mothballing of multiple strands of research. The restructuring has triggered internal upheaval at ATI, with more than 90 staff sending a letter to the board last year warning that cost cuts were putting the organisation's reputation at risk. Sign up to First Edition Our morning email breaks down the key stories of the day, telling you what's happening and why it matters after newsletter promotion Among the projects slated for closure are work on developing AI systems to detect online harms, producing AI tools that can help policymakers tackle issues such as inequality and affordability in the housing market and measuring the impact in health inequality of major policy decisions like lockdowns. Other projects expected to close include an AI-based analysis of how the government and media interact. A project looking at social bias in AI outcomes will also be dropped. Projects being paused include a study into how AI might affect human rights and democracy, as well as research into creating a global approach to AI ethics. A spokesperson for ATI said: 'We're shaping a new phase for the Turing, and this requires substantial organisational change to ensure we deliver on the promise and unique role of the UK's national institute for data science and AI. As we move forward, we're focused on delivering real-world impact across society's biggest challenges, including responding to the national need to double down on our work in defence, national security and sovereign capabilities.' A Charity Commission spokesperson said the organisation could not confirm or deny whether it had received a complaint, in order to protect the identity of any whistleblowers.
