logo
The Real AI Investment – Prioritizing Data Quality Over Model Hype

The Real AI Investment – Prioritizing Data Quality Over Model Hype

Forbes15-05-2025

AI Hype
We are almost three years past the fanfare of ChatGPT's big debut and the emergence of generative AI (GenAI) models in the workplace. With broader accessibility to the technology, and the bell curve of the hype cycle pushing early operational innovations – like GenAI-enabled virtual assistants – over the hump of inflated expectations, it is worth taking a thorough look at where the market is today and what can be improved.
Worrying over models distracts from data issues
Enterprise adoption of GenAI has surged in these last few years, with more organizations integrating GenAI tools into their operations and deploying them in production environments. Yet, even as usage expands rapidly, many companies continue to grapple with uncertainties and concerns tied to the arrival of the latest GenAI models.
When a new, exciting GenAI model gets released, many businesses fall distressed over which model is best and if they should jump ship to a 'better' one. In fact, according to recent survey findings from Qlik, a global data, analytics and AI company, nearly half (47%) of AI professionals now worry their organizations has overinvested in costly, inefficient models, leading them to reassess their AI approach. However, placing significant weight on choosing one model over another is a misstep.
Industry disruptions like DeepSeek will continue to arise with offers of 'better' or 'cheaper' models. For a business to reassess its current model that satisfies its needs, just because a new, shiny option comes along, would be a material misuse of resources – and an infinite loop. Furthermore, GenAI models are quickly becoming commoditized. As this trend continues, the importance of whether a business leverages a model from OpenAI, Meta or DeepSeek will continue to diminish.
Rather than expending effort on model comparisons, enterprises should acknowledge and focus their time on the true foundation of all good AI: data quality. A company can sign up for the most state-of-the-art technology to power business processes and strategies, but if its data foundation isn't sound, it will be impossible to make any meaningful progress.
'As AI projects continue to drive excitement, growth, and possibility in the enterprise, it can be easy to get swept up in the hype,' empathizes Mike Capone, CEO of Qlik. 'However, one bad, rushed experience can erode organizational trust in AI and deflate enthusiasm for future innovation.' To succeed well into the future, leaders need to first understand GenAI, its capabilities and its limitations, and then take a bottoms-up approach to discovery and implementation. This starts with a strong data foundation.
Use cases beyond operations
According to a recent Prosper Insights & Analytics survey, over 40% of executives report they're already using GenAI.
Prosper - Heard of Genetrative AI
The current scope of GenAI in the enterprise today, however, largely focuses on operations – acting as a virtual assistant, automating repetitive tasks, amplifying customer service, and improving logistics. The aforementioned Prosper Insights & Analytics survey reveals that research and writing are other popular areas where GenAI comes into play. This is where the cautionary tale of an 'operational trap' comes in.
Prosper - Use Generative Artifical Intelligence For
Businesses will limit the technology simply out of comfort, lack of understanding, or a little of both. While streamlining operations is a legitimate business goal, GenAI has the potential to provide much more value – especially when considering use cases like augmented analytics to drive better decision-making at the executive level.
A business can apply AI techniques and algorithms to automate analysis processes, analyze, and interpret data, derive insights, and make recommendations. AI-augmented analytics has two main advantages over traditional analytics: first, it can leverage advanced algorithms and machine learning models to handle complex and unstructured data, identify patterns, and make accurate predictions. Second, it can accomplish analytics tasks significantly faster than a human could. Things like data processing will cease to take up the majority of a data professionals' day – freeing up their time to focus on more strategic tasks. This nirvana state, however, can only be accomplished if issues like data quality are addressed first.
The current state of AI data quality
'The foundation of any strong AI investment is data quality, which business leaders unfortunately under-prioritize,' Capone commiserated. The aforementioned Qlik survey showed that AI initiatives in the enterprise are at serious risk due to poor data quality and ROI expectations. While AI adoption is accelerating and AI investment is increasing, most companies do not have the proper data foundations to fully capture the value and capabilities of AI.
This isn't just a management problem – it is one that can be a company-wide plague. Four out of five (81%) professionals who deal with data, analytics, and AI models know their organization has more to do to overcome data quality issues, with either a moderate or a large amount of work. Furthermore, concern about data quality is the top reason organizations are limiting their employees' usage or outright access to GenAI tools today, according to a 2025 research report from Avanade, global professional services company.
Building AI on flawed data will, at best, produce unreliable results. At worst, companies will endure financial waste and increased business risk from biased models, unreliable insights, and poor ROI. According to Gartner, at least 30% of GenAI projects will be abandoned after proof of concept by the end of 2025, due to poor data quality, inadequate risk controls, escalating costs or unclear business value.
Those closest to AI implementation are taking heed of data quality issues, but in a lot of cases, without the serious support of executives – 90% of directors and managers believe leadership is failing to focus on the issue, Qlik found in its aforementioned AI survey. This juxtaposition between a workers' lack of confidence and executives' overconfidence in AI strategy is creating a tension that must be addressed to harness everything that GenAI has to offer the enterprise.
One parting piece of advice
The single most important action that business leaders can implement today if they truly want to make gains from their GenAI investment is focusing their energy on data quality first. Think of it this way: if you want to ride a bike, you had better first make sure that there's air in the tires and grease on the chain.
We have yet to tap into the full power of AI. Those who make strategic and decisive moves to build a trusted data foundation today will be the ones that harness its advanced applications tomorrow, driving a competitive edge and a sustainable, more efficient business well into the future.

Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

ChatGPT Built a Budget for Me ASAP, but It Has Several Limitations
ChatGPT Built a Budget for Me ASAP, but It Has Several Limitations

CNET

time34 minutes ago

  • CNET

ChatGPT Built a Budget for Me ASAP, but It Has Several Limitations

ChatGPT can help you set budget categories, spending limits and savings goals. But it still leaves much to be desired. Getty Images/Zooey Liao/CNET Artificial intelligence can help you manage your money in lots of different ways. It can show you how to cut grocery costs, save for a vacation and even negotiate your bills. But just because it can doesn't necessarily mean it succeeds. And with something as important as your finances, it's essential to know where it falls short. Last year, I asked ChatGPT to help me create a budget, a task that can be tedious and overwhelming. It was useful in some ways, but not so great in others. I tried the experiment again this year, and while I noticed minor improvements -- mainly that icons and improved formatting made the answers more visually appealing -- the overall result was still mixed. Here's how it went. Read more: How to Create and Master Your 2025 Budget Building a budget with ChatGPT These are the steps I took to test ChatGPT's budget-making abilities. 1. State your monthly income, expenses and savings goals To get started, you'll need to give ChatGPT your monthly financial numbers: take-home income, expenses and savings goals. I already have a budget I made using Rocket Money, so to see how ChatGPT builds a budget from scratch, I had it create one for a hypothetical person. My prompt: "My monthly income after taxes is $3,500. Each month, I spend $1,000 on rent, $15 on renters insurance, $100 on utilities, $300 on my car payment, $150 on car insurance, $100 on gas, $200 on my student loans, $40 on my phone bill, $300 on groceries, $100 on personal items and $100 on dining out. I'd also like to put some money toward savings." The result: Screenshot by Kelly Ernst/CNET ChatGPT ran the numbers and told me I'd have $1,095 left each month. I'd intentionally left my savings goals vague to see what ChatGPT would recommend. It suggested ways to allocate this amount toward savings, including building an emergency fund, contributing to retirement savings, paying down debt and making extra student loan payments. It also showed me how I could split my $1,095 between these savings buckets. 2. Clarify and adjust I'd also intentionally left some spending categories out of my initial prompt -- something someone creating a budget for the first time might easily do -- to see if ChatGPT would catch them. It didn't. So I asked it to help me. My prompt: "Have I missed any other common budget categories?" The result: Screenshot by Kelly Ernst/CNET ChatGPT generated a list of potential additions and asked if I wanted it to create a revised budget with placeholders for these categories. The revised budget, including estimates for savings goals and budget categories ChatGPT recommended adding, left me with $5 remaining. That's not a ton of wiggle room, but I could always ask the AI to tweak things to give me a bigger cushion. Pro tip To avoid forgetting expenses, review your bank and credit card statements from the past 12 months to spot your regular monthly, seasonal and annual expenses. 3. Import the data into a spreadsheet There are several ways to track your spending and monitor how well you're sticking to your budget, including budgeting apps and the old paper-and-pencil method. One easy -- and free -- method is to create a spreadsheet, which ChatGPT can also help you with. My prompt: "Create a Google spreadsheet for my budget." The result: ChatGPT created some code I could copy and paste into Google Sheets. Screenshot by Kelly Ernst/CNET It also provided instructions on how to format it. Screenshot by Kelly Ernst/CNET I followed these instructions, but all the data showed up in column A of the spreadsheet, and I couldn't figure out what to do next. I had to ask ChatGPT how to fix this. Screenshot by Kelly Ernst/CNET It was more work than I was hoping to do, and I still had to make some formatting changes to the spreadsheet so it was easier to read. But in the end, I did have a working budget I could adjust as needed. Pros and cons of creating a budget with ChatGPT Using ChatGPT to create a budget was fairly simple. It required some fine-tuning on my part, but overall, the AI's recommendations made sense and were easy to understand. That said, it's not for everyone, and it has its pitfalls. Here's what you should keep in mind. Pros It's free. ChatGPT doesn't cost anything, and neither does Google Sheets if you choose to move your budget numbers there. ChatGPT doesn't cost anything, and neither does Google Sheets if you choose to move your budget numbers there. You can keep it simple. ChatGPT's initial budget suggestions are basic, which can make budgeting more approachable if you're a beginner. You're free to dive deeper into any answer, but you can also use it to create a basic budget to get started. ChatGPT's initial budget suggestions are basic, which can make budgeting more approachable if you're a beginner. You're free to dive deeper into any answer, but you can also use it to create a basic budget to get started. It can help you customize your budget. ChatGPT can suggest everything from how to save on utilities to how much to put toward retirement at various ages. But you need to ask it to do so. It probably won't offer these tips unprompted. Cons Its answers are only as good as your prompts. If you don't word your prompts correctly or you provide incomplete or inaccurate information, ChatGPT's answers won't be as helpful as they could be. For instance, when I omitted some common budget categories, it identified them only when I asked it to. It didn't automatically alert me that I may have left something out. Many budgeting apps offer preset categories you can use as guidance. If you don't word your prompts correctly or you provide incomplete or inaccurate information, ChatGPT's answers won't be as helpful as they could be. For instance, when I omitted some common budget categories, it identified them only when I asked it to. It didn't automatically alert me that I may have left something out. Many budgeting apps offer preset categories you can use as guidance. It's more work on your part. Budgeting apps can import your bank account transactions, sort them into common categories and suggest monthly spending limits based on your past spending. With ChatGPT, you must enter your numbers yourself. And if you move your budget to a spreadsheet, you'll need to manually track each transaction and sort it into the right category, which can be tedious. Budgeting apps can import your bank account transactions, sort them into common categories and suggest monthly spending limits based on your past spending. With ChatGPT, you must enter your numbers yourself. And if you move your budget to a spreadsheet, you'll need to manually track each transaction and sort it into the right category, which can be tedious. It's not suitable for ongoing budget maintenance. ChatGPT can generate your budget, but it won't track your transactions. And if you want to adjust your budget categories, you'll need to do it manually on your spreadsheet or ask the bot to generate a new budget. (Thankfully, ChatGPT saves your previous chats if you're logged in, so you can ask it to tweak the information in your initial chat rather than having to enter everything all over again.) If you want ongoing help managing and maintaining your budget, you're better off with a budgeting app. ChatGPT can generate your budget, but it won't track your transactions. And if you want to adjust your budget categories, you'll need to do it manually on your spreadsheet or ask the bot to generate a new budget. (Thankfully, ChatGPT saves your previous chats if you're logged in, so you can ask it to tweak the information in your initial chat rather than having to enter everything all over again.) If you want ongoing help managing and maintaining your budget, you're better off with a budgeting app. Its answers may vary. I created a couple of budgets in ChatGPT to see how consistent its suggestions were, and its answers differed from chat to chat. If the initial answer ChatGPT gives you is confusing, seems incomplete or doesn't feel right to you, ask it to restate it. I created a couple of budgets in ChatGPT to see how consistent its suggestions were, and its answers differed from chat to chat. If the initial answer ChatGPT gives you is confusing, seems incomplete or doesn't feel right to you, ask it to restate it. Your information is not confidential. Anything you tell ChatGPT could be used to train the AI model, which means it could become publicly available. In addition, ChatGPT is susceptible to hackers and information leaks and doesn't have the security measures you'll find with reputable budgeting apps. You can disable chat history to prevent your info from being used to train the bot, but OpenAI still saves it for up to 30 days. Pro tip Don't give ChatGPT any sensitive financial details, such as your Social Security number or bank account number. If you wouldn't want to see certain personal information published online, don't enter it into your prompts. Tips for using ChatGPT to build a budget AI is powerful, but you need to know how to use it for the best results. Here are some best practices for creating a budget with ChatGPT. Double-check everything. Make sure your prompts have the correct information and that ChatGPT's answers make sense. Do the numbers add up? Do the recommendations seem reasonable? A quick Google search of your question can help you compare ChatGPT's advice against reputable sources. Make sure your prompts have the correct information and that ChatGPT's answers make sense. Do the numbers add up? Do the recommendations seem reasonable? A quick Google search of your question can help you compare ChatGPT's advice against reputable sources. Be specific. The more information the chatbot has, the more fitting its answers will be for your financial situation. Including details like your age, where you live and the hobbies you prioritize spending on can help it customize its recommendations. The more information the chatbot has, the more fitting its answers will be for your financial situation. Including details like your age, where you live and the hobbies you prioritize spending on can help it customize its recommendations. Clarify. Don't hesitate to ask ChatGPT to clarify or reword its answers. It doesn't always state information in a way that's easy to understand. Don't hesitate to ask ChatGPT to clarify or reword its answers. It doesn't always state information in a way that's easy to understand. Drill down. ChatGPT can not only help you create a budget; it can also help you stick to it. For instance, you can ask it how to reduce your phone bill, boost your income or free up more money for savings. ChatGPT can not only help you create a budget; it can also help you stick to it. For instance, you can ask it how to reduce your phone bill, boost your income or free up more money for savings. Adjust. Revisit your budget regularly to make sure it's still serving you well. If anything changes -- for example, you get a side hustle that brings in more income -- update your budget to reflect that. Verdict: Should you use ChatGPT to build a budget? While ChatGPT can help you create a budget, it has plenty of limitations, and there are easier and more effective ways to do it. If you're new to budgeting, simply Googling "basic budget" will give you lots of template ideas and tips. If you'd like more guidance, budgeting apps are designed to do a lot of the work for you and help you stick to your budget on an ongoing basis. That said, ChatGPT can help you with some of the basics you need as you tweak your budget, such as suggesting ways to trim common expenses and how much you should save each month for a particular savings goal. However, you should double-check any advice it gives you on more complex financial topics, such as how much you should put toward retirement for your personal situation. Rocket Money See at Rocket Money Perfect your 2024 budget with CNET's Editors' Choice budgeting app pick

OpenAI Appeals ‘Sweeping, Unprecedented Order' Requiring It Maintain All ChatGPT Logs
OpenAI Appeals ‘Sweeping, Unprecedented Order' Requiring It Maintain All ChatGPT Logs

Gizmodo

timean hour ago

  • Gizmodo

OpenAI Appeals ‘Sweeping, Unprecedented Order' Requiring It Maintain All ChatGPT Logs

Last month, a federal judge ordered OpenAI to indefinitely maintain all of ChatGPT's data as part of an ongoing copyright lawsuit. In response, OpenAI has filed an appeal to overturn the decision stating that the 'sweeping, unprecedented order' violates its users' privacy. The New York Times sued both OpenAI and Microsoft in 2023 claiming that the companies violated copyrights by using its articles to train their language models. However, OpenAI said the Times' case is 'without merit' and argued that the training falls under 'fair use'. Previously, OpenAI only kept chat logs for users of ChatGPT Free, Plus, and Pro who didn't opt out. However, in May, the Times and other news organizations claimed that OpenAI was engaging in a 'substantial, ongoing' destruction of chat logs that could contain evidence of copyright violations. Judge Ona Wang responded by ordering ChatGPT to maintain and segregate all ChatGPT logs that would otherwise be deleted. In a court appeal, OpenAI argued that Wang's order 'prevent[s] OpenAI from respecting its users' privacy decisions.' According to Ars Technica, the company also claimed that the Times' accusations were 'unfounded', writing, 'OpenAI did not 'destroy' any data, and certainly did not delete any data in response to litigation events. The order appears to have incorrectly assumed the contrary.' 'The [Times] and other plaintiffs have made a sweeping and unnecessary demand in their baseless lawsuit against us,' COO Brad Lightcap said in a statement. He added that the demand for OpenAI to retain all data 'abandons long-standing privacy norms and weakens privacy protections.' On X, CEO Sam Altman wrote that the 'inappropriate request…sets a bad precedent.' He also added that the case highlights the need for 'AI privilege' where 'talking to an AI should be like talking to a lawyer or a doctor.' we have been thinking recently about the need for something like "AI privilege"; this really accelerates the need to have the conversation. imo talking to an AI should be like talking to a lawyer or a doctor. i hope society will figure this out soon. — Sam Altman (@sama) June 6, 2025 The court order triggered an initial wave of panic. Per Ars Technica, OpenAI's court filing cited social media posts from LinkedIn and X where users expressed concerns about their privacy. On LinkedIn, one person warned their clients to be 'extra careful' about what information they shared with ChatGPT. In another example, someone tweeted, 'Wang apparently thinks the NY Times' boomer copyright concerns trump the privacy of EVERY @OPENAI USER – insane!!!' On one hand, I couldn't imagine having a ChatGPT log sensitive enough data that I'd care if someone else read it. However, people do use ChatGPT as a therapist, for life advice, and even treat it as a romantic partner. Regardless of whether I'd personally do the same, they deserve the right to keep that content private. At the same time, the Times' case isn't as baseless as OpenAI claims. It is absolutely worth discussing how artificial intelligence is trained. Remember when Clearview AI scraped 30 billion images from Facebook to train its facial recognition? Or reports that the federal government uses images of vulnerable people to test facial recognition software? Yes, those examples exist outside of journalism and copyright law. However, it highlights the need for conversations about whether companies like OpenAI should need explicit consent to utilize content rather than scraping whatever they want from the internet.

At Secret Math Meeting, Researchers Struggle to Outsmart AI
At Secret Math Meeting, Researchers Struggle to Outsmart AI

Scientific American

timean hour ago

  • Scientific American

At Secret Math Meeting, Researchers Struggle to Outsmart AI

On a weekend in mid-May, a clandestine mathematical conclave convened. Thirty of the world's most renowned mathematicians traveled to Berkeley, Calif., with some coming from as far away as the U.K. The group's members faced off in a showdown with a 'reasoning' chatbot that was tasked with solving problems the had devised to test its mathematical mettle. After throwing professor-level questions at the bot for two days, the researchers were stunned to discover it was capable of answering some of the world's hardest solvable problems. 'I have colleagues who literally said these models are approaching mathematical genius,' says Ken Ono, a mathematician at the University of Virginia, who attended the meeting. The chatbot in question is powered by o4-mini, a so-called reasoning large language model (LLM). It was trained by OpenAI to be capable of making highly intricate deductions. Google's equivalent, Gemini 2.5 Flash, has similar abilities. Like the LLMs that powered earlier versions of ChatGPT, o4-mini learns to predict the next word in a sequence. Compared with those earlier LLMs, however, o4-mini and its equivalents are lighter-weight, more nimble models that train on specialized datasets with stronger reinforcement from humans. The approach leads to a chatbot capable of diving much deeper into complex problems in math than traditional LLMs. To track the progress of o4-mini, OpenAI previously tasked Epoch AI, a nonprofit that benchmarks LLMs, to come up with 300 math questions whose solutions had not yet been published. Even traditional LLMs can correctly answer many complicated math questions. Yet when Epoch AI asked several such models these questions, which they hadn't previously been trained on, the most successful were able to solve less than 2 percent, showing these LLMs lacked the ability to reason. But o4-mini would prove to be very different. On supporting science journalism If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today. Epoch AI hired Elliot Glazer, who had recently finished his math Ph.D. to join the new collaboration for the benchmark, dubbed FrontierMath, in September 2024. The project collected novel questions over varying tiers of difficulty, with the first three tiers covering, undergraduate-, graduate- and research-level challenges. By February 2025, Glazer found that o4-mini could solve around 20 percent of the questions. He then moved on to a fourth tier: 100 questions that would be challenging even for an academic mathematician. Only a small group of people in the world would be capable of developing such questions, let alone answering them. The mathematicians who participated had to sign a nondisclosure agreement to communicate solely via the messaging app Signal. Other forms of contact, such as traditional e-mail, could potentially be scanned by an LLM and inadvertently train it, thereby contaminating the dataset. The group made slow, steady progress in finding questions. But Glazer wanted to speed things up, so Epoch AI hosted the in-person meeting on Saturday, May 17, and Sunday, May 18. There, the participants would find the final 10 challenge questions. The meeting was headed by Ono, who split the 30 attendees into groups of six. For two days, the academics competed against themselves to devise problems that they could solve but would trip up the AI reasoning bot. Any problems the o4-mini couldn't solve would garner the mathematician who came up with them a $7,500 reward. By the end of that Saturday night, Ono was frustrated with the team's lack of progress. 'I came up with a problem which everyone in my field knows to be an open question in number theory—a good Ph.D.-level problem,' he says. He asked o4-mini to solve the question. Over the next 10 minutes, Ono watched in stunned silence as the bot unfurled a solution in real time, showing its reasoning process along the way. The bot spent the first two minutes finding and mastering the related literature in the field. Then it wrote on the screen that it wanted to try solving a simpler 'toy' version of the question first in order to learn. A few minutes later, it wrote that it was finally prepared to solve the more difficult problem. Five minutes after that, o4-mini presented a correct but sassy solution. 'It was starting to get really cheeky,' says Ono, who is also a freelance mathematical consultant for Epoch AI. 'And at the end, it says, 'No citation necessary because the mystery number was computed by me!'' Defeated, Ono jumped onto Signal that night and alerted the rest of the participants. 'I was not prepared to be contending with an LLM like this,' he says, 'I've never seen that kind of reasoning before in models. That's what a scientist does. That's frightening.' Although the group did eventually succeed in finding 10 questions that stymied the bot, the researchers were astonished by how far AI had progressed in the span of one year. Ono likened it to working with a 'strong collaborator.' Yang Hui He, a mathematician at the London Institute for Mathematical Sciences and an early pioneer of using AI in math, says, 'This is what a very, very good graduate student would be doing—in fact, more.' The bot was also much faster than a professional mathematician, taking mere minutes to do what it would take such a human expert weeks or months to complete. While sparring with o4-mini was thrilling, its progress was also alarming. Ono and He express concern that the o4-mini's results might be trusted too much. 'There's proof by induction, proof by contradiction, and then proof by intimidation,' He says. 'If you say something with enough authority, people just get scared. I think o4-mini has mastered proof by intimidation; it says everything with so much confidence.' By the end of the meeting, the group started to consider what the future might look like for mathematicians. Discussions turned to the inevitable 'tier five'—questions that even the best mathematicians couldn't solve. If AI reaches that level, the role of mathematicians would undergo a sharp change. For instance, mathematicians may shift to simply posing questions and interacting with reasoning-bots to help them discover new mathematical truths, much the same as a professor does with graduate students. As such, Ono predicts that nurturing creativity in higher education will be a key in keeping mathematics going for future generations. 'I've been telling my colleagues that it's a grave mistake to say that generalized artificial intelligence will never come, [that] it's just a computer,' Ono says. 'I don't want to add to the hysteria, but these large language models are already outperforming most of our best graduate students in the world.'

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into the world of global news and events? Download our app today from your preferred app store and start exploring.
app-storeplay-store