PromptQL Partners with UC Berkeley to Develop New Data Agent Benchmark for Reliability of Enterprise AI Agents
A recent McKinsey study revealed that 78% of organizations use AI in at least one business function, however, more than 80% say their organization hasn't seen a tangible impact on enterprise-level Earnings Before Interest and Taxes (EBIT). The partnership – led by Aditya Parameswaran, Professor and Co-Director of UC Berkeley's EPIC Data Lab , along with his students – addresses this fundamental challenge organizations face when deploying AI systems in business-critical environments.
While existing agentic data benchmarks like GAIA, Spider, and FRAMES test specific AI tasks, they overlook the complexity, reliability demands, and messy, siloed data that define real business environments. The forthcoming data agent benchmark aims to offer a solution by creating a framework that reflects real-world complexities.
'Our customer conversations reveal a clear pattern—they're ready to move from proof-of-concepts to production AI, yet they lack the evaluation tools to make confident deployment decisions,' said Tanmai Gopal, CEO of PromptQL. 'The data agent benchmark changes that by using representative datasets from our work in telecom, healthcare, finance, retail, and anti-money laundering to reflect the real complexity of enterprise AI.'
UC Berkeley's EPIC Data Lab brings expertise to this collaboration. Professor Parameswaran is a leading authority on the use of AI for next-gen usable data analysis tools and has received numerous prestigious awards. His research group has created widely-adopted data tools with tens of millions of downloads.
'Current benchmarks suffer from what I call the '1% problem'—they're built for tech giants and ignore the 99% of organizations grappling with real-world data complexity,' Parameswaran said. 'The data agent benchmark marks a shift toward evaluating AI based on the reliability, transparency, and practical value enterprises actually need. This collaboration bridges academic rigor with the production insights PromptQL brings from real deployments.'
The data agent benchmark beta will be revealed later this year. Organizations interested in early access or contributing use-cases or datasets can reach out to the research team at [email protected] .
PromptQL will be at AI Engineer World's Fair , June 3-6 in San Francisco. Tanmai Gopal, PromptQL's co-founder and CEO, will present a session, 'Al Automation that Actually Works: $100M Impact on Messy Data with Zero Surprises,' on June 4 at 11:15 a.m. PT. To learn more or schedule a demo at the PromptQL booth, visit https://hasura.io/events/ai-engineer-worlds-fair-2025 .
About PromptQL
PromptQL is a next-generation AI platform from the makers of Hasura, the company behind the pioneering GraphQL Engine. Built for enterprise-grade reliability, PromptQL enables natural language analysis and automation on internal business data — with an industry-first accuracy SLA. By learning the unique language of your business and planning tasks before executing them deterministically, PromptQL brings human-level precision to AI agents.
About UC Berkeley EPIC Data Lab
The EPIC Data Lab at UC Berkeley develops low-code and no-code interfaces for data work, powered by Gen AI. Co-Led by Professor Aditya Parameswaran, the lab follows Berkeley's tradition of multidisciplinary systems research with emphasis on real-world impact and practical deployment. The lab's tools, including DocETL and other widely-adopted systems, demonstrate Berkeley's leadership in democratizing data science capabilities.
Media Contact:Erica Anderson Offleash for PromptQL
[email protected]
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Fast Company
15 minutes ago
- Fast Company
Mark Cuban and Sam Altman just warned about disappearing jobs and the need to learn AI
OpenAI CEO Sam Altman isn't shy about discussing the future of AI. As the CEO of a market leading company, his predictions carry plenty of weight, such as his worry that AI could make things go 'horribly wrong,' or that AI agents will completely transform the workplace. Nor is billionaire Mark Cuban, who also sees vast changes to an AI-dominated workplace. Altman's recent remarks to finance executives at a Federal Reserve conference on large banks and capital requirements included his belief that entire job categories will be eaten up by AI. He said customer service is all but completely ready for an AI takeover right now, as reported by the Guardian newspaper. 'That's a category where I just say, you know what, when you call customer support, you're on target and AI, and that's fine,' he said. When a user calls a hotline now, AI answers, and it's like 'a super-smart, capable person,' Altman explained, adding that 'there's no phone tree, there's no transfers. It can do everything that any customer support agent at that company could do. It does not make mistakes. It's very quick. You call once, the thing just happens, it's done.' You may have already encountered an AI customer service system, or at the very least spoken briefly to one before being forwarded to a person with the info you're seeking. And anecdotally, if Altman's promise of no mistakes proves true, then that's a huge sell for customer service departments—and consumer satisfaction. (We all know how frustrating it can be calling these lines.) What an AI can offer under these circumstances is also clearly defined: customers probably call with a discrete set of common issues, and the AI can be trained on what to do. Subscribe to the Daily newsletter. Fast Company's trending stories delivered to you every day Privacy Policy | Fast Company Newsletters But the next industry Altman said was ripe for an AI takeover is more complex, requiring deep knowledge and empathy, and there are much higher stakes at play. According to the AI CEO, AI is already better than human doctors. It can, 'most of the time,' surpass human physician skills, he argued, suggesting it's 'a better diagnostician than most doctors in the world.' But then he pointed out a very human truth: 'people still go to doctors,' he said, and he added that he felt the same, 'maybe I'm a dinosaur here, but I really do not want to, like, entrust my medical fate to ChatGPT with no human doctor in the loop.' That at least aligns with warnings from medical experts who say that while AI may be useful for medical advice under some circumstances, like helping to make medical notes, it's just too subject to misinformation errors to be trusted to give mental health advice or diagnoses, for example. In fact a group of therapists recently warned of the danger in doing so. Altman also told the bankers that he's worried near future AIs could be used by bad actors, perhaps based overseas, to attack the U.S. financial system. He cited the issue of AI voice clones as a direct risk. While he's not predicting AI will steal banking jobs here, he is essentially warning that the entire industry could be upended by AI, used the wrong way. You may think Altman is being unnecessarily doomy here. In this case, you may be more aligned with the thinking of billionaire entrepreneur Mark Cuban. He's just suggested that in his expert mind, AI will become a 'baseline' workplace skill inside five years. Essentially he thinks that 'like email or Excel,' everyone, from fresh graduates to practiced entrepreneurs, will have to master AI to succeed at their tasks. in an interview with Fortune, Cuban predicted that thanks to the force multiplying effects AI can have, 'we'll see more people working for themselves' thanks to the rise of AI assistants, possibly powered by agent AI tech, which can transform 'solo founders into full teams.' And worse, if you're note already using AI to 'move faster or make smarter decisions, you're behind,' he said. While framed more positively than Altman's statements, a closer look says Cuban is still predicting whole classes of jobs will disappear inside five years. Why would a startup CEO need a personal assistant, a coding expert or a marketing adviser if all those tasks could be done by next-gen AI? advertisement All of this, while interesting, could be dismissed as mere PR for the AI industry, but you should actually care about this expert advice. Altman's warnings could have you looking at what tasks you already feel comfortable outsourcing to an AI tool instead of a human worker. And then, taking Cuban's advice, you should consider taking time to properly educate yourself about the promises and risks of AI technology, and also plan on upskilling or reskilling your existing staff. The potential efficiencies AI promises mean they could — By Kit Eaton This article originally appeared on Fast Company's sister publication, Inc. Inc. is the voice of the American entrepreneur. We inspire, inform, and document the most fascinating people in business: the risk-takers, the innovators, and the ultra-driven go-getters that represent the most dynamic force in the American economy.
Entrepreneur
15 minutes ago
- Entrepreneur
Your Brand Deserves Better Images, So Get Them for $20 with This Photo-Editing App
Disclosure: Our goal is to feature products and services that we think you'll find interesting and useful. If you purchase them, Entrepreneur may get a small share of the revenue from the sale from our commerce partners. When you're running a business, every photo you put out into the world is part of your brand story. Whether it's a product image on your website, a team photo for LinkedIn, or a behind-the-scenes Instagram shot, visual quality matters—and it can mean the difference between "just scrolling" and "click to buy." Luminar Mobile makes pro-level photo editing accessible, affordable, and ridiculously easy. For a one-time $19.99 payment, you'll have lifetime access to an AI-powered editing toolkit that can replace skies, relight scenes, retouch portraits, and even remove that random coffee cup from your product flat lay. And yes, it works seamlessly on your iOS or Android device—so you can edit from anywhere. For entrepreneurs, marketers, real estate agents, content creators, and small-business owners, this is the kind of tool that pays for itself fast. Need to polish product shots before uploading them to your eCommerce site? Want to make sure your LinkedIn headshot looks confident and approachable? Launching a social media campaign that requires cohesive, high-quality visuals? Luminar Mobile puts all that power in your pocket. With features like EnhanceAI to instantly boost color and clarity, SkinAI to refine portraits, and Erase to remove distractions, you can produce client-ready visuals in minutes—without expensive software or outsourcing. In today's market, where attention spans are short and competition is fierce, looking polished isn't optional. Luminar Mobile makes it effortless. Get lifetime access to one of the following versions: StackSocial prices subject to change.
Business Insider
16 minutes ago
- Business Insider
Here's why Google might have to sell Chrome, and which companies want to buy it
Chrome is the world's most popular web browser. But how much longer it belongs to Google is an open question. A court last year ruled that Google had violated antitrust laws by maintaining a monopoly on internet search. A second ruling in April found Google also monopolized open-web digital ad markets. The Justice Department asked a judge to force Google to divest its premier web browser to remedy the case. A court is expected to rule on that by the end of this month. Chrome, a free web browser developed by Google, is an important distribution tool for Google Search and its other services. It also provides insights into users' search habits and is the most popular web browser on the market. Being forced to sell Chrome would be an undeniable blow to Google and its parent company, Alphabet Inc. Analysts at Barclays said such an action could be a black swan scenario for Google stock, sparking an estimated 15% to 25% decline. Google denies it's a monopoly. It said in a blog post in May that offloading the web browser to another party could render it "obsolete" and "expose billions of people to cyber-attacks." Although the judge has not yet decided Chrome's ultimate fate, competitors are already lining up to gladly take it off Google's hands. an AI search chat platform, confirmed to Business Insider that it made a $35 billion bid for Chrome this week. JP Morgan and several private equity firms backed the bid. is a division of the digital marketing company Public Good, which acquired in July. Public Good President Melissa Anderson and CEO Danny Bibi told Business Insider they reached out to Google on Wednesday. "Given the number of worldwide users Chrome has, it's a really just phenomenal way to scale user adoption," Anderson said. The pair said they're committed to using AI ethically, which means offering its search for free in an effort to make knowledge accessible for all. They also said founded in 1998, already has a network of clients, so finding potential advertisers wouldn't be a heavy lift. Perplexity Perplexity, an AI search startup, made a $34.5 billion bid for the web browser this week. The company launched an AI-native browser, Comet, in July. Although the bid is higher than Perplexity's entire valuation, The Wall Street Journal reported that several investors have agreed to back the potential deal. Perplexity said it would continue supporting Chromium, Google's open-source web browser project that's the foundation of Chrome, as part of the deal, according to the outlet. The outlet reported that Perplexity would continue to keep Google as the default search engine, but users could change that through settings. OpenAI Although OpenAI's ChatGPT turned it into the leading AI startup in Silicon Valley, the company is a tiny fraction of the size of a Big Tech mammoth like Google. Purchasing Chrome, however, would help even the playing field. During Google's antitrust hearing in April, OpenAI's head of ChatGPT testified that the company would be interested in acquiring Chrome if Google were forced to divest. "Yes, we would, as would many other parties," Nick Turley told the court, according to Bloomberg. OpenAI CEO Sam Altman also recently said he'd be interested in snapping up Chrome. "If Chrome is really going to sell, we should take a look at it," Altman told a group of journalists on Thursday, according to The Verge. Yahoo Yahoo, a direct competitor of Google, would also be interested in bidding on Chrome, Bloomberg reported. Brian Provost, the general manager for Yahoo Search, said Chrome is "arguably the most important strategic player on the web" during a hearing for Google's antitrust case in April. "We would be able to pursue it with Apollo," Provost said, referring to Yahoo's owner, Apollo Global Management Inc.
