Courts aren't ready for AI-generated evidence
Why it matters: Courts can't keep up, and there aren't enough forensic analysts to verify AI-faked evidence.
The big picture: AI-generated evidence can take many forms. Consider the following hypotheticals:
A divorce case where one parent edits a photo's background to imply the child was in an unsafe environment.
A murder investigation where deepfake video falsely puts an innocent person at the scene the crime.
A wrongful termination lawsuit where someone creates a deepfake audio recording of a coworker making comments that got them fired (which happened in Baltimore County).
Between the lines: As AI tools improve, proving that a photo, video or audio snippet was manipulated will get more challenging, if not impossible.
Like financial fraud cases that rely on expert testimony to unpack accounting records, courts will now depend on digital forensics experts to spot the telltale signs of tampered media.
But even expert analysis may not be enough to persuade a jury beyond a reasonable doubt.
Threat level: Photos, videos and audio have long been the gold standard for evidence in any legal case.
"Everybody has images, everybody has voice recordings, CCTV cameras, police body cameras, dash cams," Hany Farid, co-founder and chief science officer at GetReal Security, told Axios. "It's just everything. It's bonkers."
The other side: Defendants will also face challenges in proving their media hasn't been altered by AI.
For example, lawyers could argue that body camera footage from a police officer was tampered with, even if it wasn't.
"In parts of the country where the police are not trusted, that could gain some traction," Farid said.
The intrigue: This isn't the first time courts have had to adapt to new technology, Farid added.
When photo and video evidence first emerged, judges often required negatives or scrutinized timestamps.
But today's legal standards haven't caught up to the speed and sophistication of deepfake tools, which are evolving far faster than past media forms.
Zoom in: Even for forensics investigators, the technology isn't there yet to help track the chain-of-custody for deepfakes, Joseph Pochron, managing director of digital investigations and cyber risk at Nardello & Co., said at the Deepfake Resilience Symposium in San Francisco last week.
Each AI verification tool on the market is a black box in terms of how it determines what percentage of a piece of content was AI generated, creating an opening for manipulation and misinterpretation of images, videos and audio, Pochron said.
Now, investigators have to get creative with how they prove something is or is not AI-manipulated.
Pochron's team has begun transcribing audio and analyzing sentence structure to see if it matches patterns popular with AI tools. But even that method will be moot within a year as deepfakes become more humanlike.
The bottom line: Experts urge people to preserve as many original files — voicemails, text messages, photos — on their devices as possible in case they're needed in court.
"We've had a couple [cases] where it's an email that's been emailed again, but where's the original?" Pochron said. "The metadata or any other supporting artifacts may be crucial to help us figure this out."
What's next: AI tools have already perfected the art of deepfake images and audio, but it will be less than two years until they fine-tune fake videos, too, Farid said.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Axios
an hour ago
- Axios
Exclusive: Financial sector most susceptible to AI-powered cyberattacks
Firms in the financial sector were more likely to face an AI-powered cyberattack in the last 12 months than any other sector, according to new research from Deep Instinct. Why it matters: Financial services companies are ripe targets for cyber criminals because of their vast customer networks, from everyday consumers to major corporations. By the numbers: 45% of financial services organizations faced an AI-powered cyberattack in the last 12 months, according to the Deep Instinct survey shared exclusively with Axios. Meanwhile, just 38% of experts who work in other industries said the same. 55% of financial services organizations also reported a rise in deepfake attacks in the last year, compared to 43% of those in other industries. Deep Instinct, a cybersecurity company that offers AI tools to prevent cyberattacks, conducted the survey in April among 500 cybersecurity experts across various sectors. The respondents all work at companies with at least 1,000 employees. Driving the news: OpenAI CEO Sam Altman warned of an "impending, significant fraud crisis" at a Federal Reserve event in Washington last week. Altman noted that the crisis is coming "very, very soon" in part because of the ways AI can be manipulated to impersonate people. The big picture: The financial sector is facing an array of AI-enabled phishing, deepfake and malware attacks, Carl Froggett, chief information officer at Deep Instinct, told Axios. AI tools have lowered the barrier to entry for these attacks, making it possible for even lower-level cyber criminals to pursue sophisticated attacks, Froggett added. Yes, but: The finance sector is more resilient to these types of attacks because of their long history of cybersecurity investments, said Froggett, who also spent nearly 25 years working on security at Citi. "Financials really started treating cyber as an upcoming threat in the early '90s," he said. "They've got a big head start on everybody else, they built it into their organizations." Between the lines: Most organizations, including in finance, have started shifting their cybersecurity strategies from detection and remediation to a fully predictive and preemptive strategy. In another Deep Instinct report published last month, 82% of organizations said they've shifted to a prevention-focused strategy. Doing this has forced companies to quickly adapt and update their security playbook. "They went off-cycle [in purchasing new tools] probably because of the success of the attacks," Froggett said. What to watch: Cyber criminals are still early in adopting these tools, and their skills will only improve as their AI adoption matures.
Axios
2 hours ago
- Axios
Exclusive: DOE alums look to speed energy, climate tech deployments
Senior officials from the Biden -era Department of Energy loan office are publicly launching a nonprofit on Wednesday that aims to speed deployment of low-carbon tech in the U.S. and abroad. Why it matters: It's the latest example of how the federal policy U-turn on energy and climate is creating new efforts in response. Driving the news: Months after starting work, the group Constructive is announcing itself with a goal of "reshaping how leaders and experts collaborate to scale clean energy and climate infrastructure." It has a model for creating "connective tissue" by weaving together stakeholder events, dialogues and strategies — and then ensuring there's follow-up. The intrigue: The goal of the nonpartisan group's "stakeholder engagement model" is to fill a gap, not just offering more documents and meetings. "What's missing ... is follow-through and an understanding of how you create events and convenings and reports that are connecting the dots and building on each other towards some target outcome, and are creating clarity in doing that," Jonah Wagner, the group's president, tells Axios exclusively. "When we're thinking about how you put an event together, we're thinking, what happens when everybody wakes up the day after they went home?" he said in an interview. State of play: Constructive works with governments, industry, think tanks, philanthropies and others. Areas of focus include demand response; "clean firm" sources like next-generation geothermal and advanced nuclear; transmission and other grid-enhancing tech; and advanced manufacturing. "Our primary focus is going to be those energies or sources that drive energy abundance and a thriving planet, which often, but not always, excludes fossil fuel-driven [energy]," CEO Susan Kish tells Axios. Funding has come from "fee for service" with groups it's already working with, but Wagner expects philanthropic grants will ultimately be a significant source. Between the lines: Kish said that if last year's election had gone differently, the "convening" function that Constructive provides would have likely remained within DOE. She was the executive producer of the Energy Department's Deploy23 and Deploy24 events, while Wagner was chief strategist at LPO and helped create the department's Pathways to Commercial Liftoff roadmaps. The team of roughly a half-dozen includes other LPO vets. The big picture: Wagner and Kish gave a glass-half-full take on U.S.-focused work despite the federal pullbacks under Trump 2.0. They note there's now more certainty with the budget law passed, along with the need to meet rising power demand. Constructive would also like to work with the Trump administration on areas of alignment, Wagner said. Catch up quick: Its work to date includes organizing an "energy and resilience" summit in Santa Barbara in May and producing the Distributed Energy Resources (DER) Task Force's upcoming summit in New York.
Forbes
2 hours ago
- Forbes
The Post-AI Workforce Will Be Paid Digitally
Nikhil Jathar, CTO & Co-founder at expert in SaaS, XR, & AI, shaping tech in space and digital realms. While today's leaders are fixated on how artificial intelligence will automate routine tasks, most are missing the far more profound story: how AI will fundamentally redefine the nature of human work and value. The true disruption isn't just about the jobs we will lose, but about the new economy we will create. As AI handles the predictable, a new workforce is emerging—one that thrives on creativity, community and personality. And this digitally native economy will ultimately be built on a digitally native currency. The Great Shift: From Routine Tasks To Creative Careers For decades, we've built our careers around predictable, process-oriented work. That era is rapidly coming to a close. AI's primary economic function is to master and automate these very tasks—from data analysis and administrative support to customer service and logistics. This isn't a threat to be feared, but a liberation of human capital from the drudgery of the routine. The real question is, what will people do with this newfound freedom? They will do what AI cannot: create, inspire, entertain and build communities. We are already witnessing the dawn of this shift. The 'creator economy,' once considered a niche, is exploding into a formidable economic force. It's the independent Substack writer delivering unique analysis, the TikTok creator building a global audience from their bedroom, the expert podcaster and the artist designing immersive goods for virtual worlds. This isn't a fleeting trend; it is the logical and necessary evolution of work in a post-AI world, placing a premium on the very things that make us human. The Economic Mismatch: Why Old Money Fails The New Economy The problem is that this 21st-century digital workforce is being forced to rely on 20th-century financial infrastructure. The existing system of bank transfers, credit card processors and centralized payment apps is fundamentally ill-suited for the creator economy, creating friction that stifles growth and innovation. The first major hurdle is the inefficiency of microtransactions. In a world where showing appreciation might mean tipping a creator $0.50 for a brilliant idea, traditional transaction fees can consume a crippling percentage of the payment, making direct support impractical. Second is the immense platform risk. Creators are held captive by the centralized giants—YouTube, Meta, Twitch—that control their access to their audience and their ability to monetize. With the stroke of a key, a platform can change its algorithm, demonetize a channel or increase its revenue share, leaving creators powerless. They build their empires on rented land. Finally, the system lacks true ownership. A creator's digital work, from a viral video to a custom virtual asset, cannot be verifiably owned or sold in a peer-to-peer fashion. It exists only within the walled garden of the platform it was created on, limiting its economic potential. The Digital Solution: A Native Financial Layer For Creators This is where the often-misunderstood world of digital assets becomes not just relevant, but essential. Digital assets and Web3 technologies provide the missing financial and ownership rails that this new economy desperately needs. It's not about speculation; it's about utility. For micropayments, some digital assets offer a solution. Imagine instantly and globally sending a podcaster a dollar for their work, with the creator receiving nearly the entire amount. This fosters a direct and more equitable relationship between creators and their supporters. For ownership, NFTs provide the breakthrough. Far beyond digital art, an NFT acts as an unbreakable, verifiable certificate of ownership for any digital asset. A musician can sell a limited-edition version of a song directly to a fan. A designer can sell custom furniture for an apartment in a virtual world, with the owner's rights recorded permanently on a blockchain. This transforms digital content from a licensable good into a true asset. Most importantly, these tools provide a path to independence. Social tokens, for example, allow creators to build their own sovereign economies, transforming their audience from passive followers into vested stakeholders who hold a direct interest in the creator's success. This is the ultimate answer to platform risk. Acknowledging The Hurdles On The Path To Adoption The path to this future is not without its challenges. The volatility of digital assets is a valid concern for anyone relying on them for income, which is why stablecoins will be the crucial bridge for everyday transactions. Furthermore, the user experience of many applications remains too complex for mass adoption. This, however, represents a massive business opportunity for SaaS and fintech companies to build intuitive wallets, payment gateways and creator platforms that abstract away complexity, making transactions as simple as using Apple Pay. Regulation, too, remains a developing landscape, but its progression is a sign of the industry's maturation—a necessary step toward building the trust required for a global system. The Mandate For Today's Leaders The seismic shift toward a creator-centric economy, accelerated by AI, is inevitable. The only open question is whether we will shackle it to an archaic financial system or empower it with digitally native tools. Leaders must look past the market noise and understand the fundamental economic utility being forged. The challenge is no longer about debating digital asset validity, but about architecting its integration into the future of work. The businesses and innovators who build the platforms, tools and financial products for this emerging world won't just be leading the next wave of tech—they will be building the foundations of our post-AI economy. Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?
