ChatGPT hallucinated about music app Soundslice so often, the founder made the lie come true
Once he solved it, he realized that ChatGPT had become one of his company's greatest hype men – but it was also lying to people about what his app could do.
Holovaty is best known as one of the creators of the open-source Django project, a popular Python web development framework (though he retired from managing the project in 2014). In 2012, he launched Soundslice, which remains 'proudly bootstrapped,' he tells TechCrunch. Currently, he's focused on his music career both as an artist and as a founder.
Soundslice is an app for teaching music, used by students and teachers. It's known for its video player synchronized to the music notations that guide users on how the notes should be played.
It also offers a feature called 'sheet music scanner' that allows users to upload an image of paper sheet music and, using AI, will automatically turn that into an interactive sheet, complete with notations.
Holovaty carefully watches this feature's error logs to see what problems occur, where to add improvements, he said.
That's where he started seeing the uploaded ChatGPT sessions.
Techcrunch event
Save up to $475 on your TechCrunch All Stage pass Build smarter. Scale faster. Connect deeper. Join visionaries from Precursor Ventures, NEA, Index Ventures, Underscore VC, and beyond for a day packed with strategies, workshops, and meaningful connections.
Save $450 on your TechCrunch All Stage pass Build smarter. Scale faster. Connect deeper. Join visionaries from Precursor Ventures, NEA, Index Ventures, Underscore VC, and beyond for a day packed with strategies, workshops, and meaningful connections.
Boston, MA
| REGISTER NOW
They were creating a bunch of error logs. Instead of images of sheet music, these were images of words and a box of symbols known as ASCII tablature. That's a basic text-based system used for guitar notations that uses a regular keyboard. (There's no treble key, for instance, on your standard QWERTY keyboard.)
Image Credits:Adrian Holovaty
The volume of these ChatGPT session images was not so onerous that it was costing his company money to store them and crushing his app's bandwidth, Holovaty said. He was baffled, he wrote in a blog post about the situation.
'Our scanning system wasn't intended to support this style of notation. Why, then, were we being bombarded with so many ASCII tab ChatGPT screenshots? I was mystified for weeks — until I messed around with ChatGPT myself.'
That's how he saw ChatGPT telling people they could hear this music by opening a Soundslice account and uploading the image of the chat session. Only, they couldn't. Uploading those images wouldn't translate the ASCII tab into audio notes.
He was struck with a new problem. 'The main cost was reputational: new Soundslice users were going in with a false expectation. They'd been confidently told we would do something that we don't actually do,' he described to TechCrunch.
He and his team discussed their options: Slap disclaimers all over the site about it — 'No, we can't turn a ChatGPT session into hearable music' — or build that feature into the scanner, even though he had never before considered supporting that offbeat musical notation system.
He opted to build the feature.
'My feelings on this are conflicted. I'm happy to add a tool that helps people. But I feel like our hand was forced in a weird way. Should we really be developing features in response to misinformation?' he wrote.
He also wondered if this was the first documented case of a company having to develop a feature because ChatGPT kept repeating, to many people, its hallucination about it.
The fellow programmers on Hacker News had an interesting take about it: Several of them said that it's no different than an over-eager human salesperson promising the world to prospects and then forcing developers to deliver new features.
'I think that's a very apt and amusing comparison!' Holovaty agreed.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
11 minutes ago
- Yahoo
Big Bank CEOs see consumer strength, but signs of stress remain
Big Bank CEOs seem upbeat about the consumer, but some signals tell a different story. Dory Wiley, CEO of Commerce Street Holdings, joins Market Catalysts to weigh in on mixed market data and explain why he's cautious about the true state of the US consumer. To watch more expert insights and analysis on the latest market action, check out more Market Catalysts here. I'm curious asking about the consumer side of banking, too, because even as you say, maybe the net interest margin wasn't great. The rhetoric around the consumer side of the banks was decent, right? You had Brian Moynihan of, um, Bank of America saying consumers remained resilient. You had Jamie Diamond sounding a little more positive. What do you make of those comments? Yeah, I noticed that both kind of went out of their way on that. And I'm getting mixed signals from the market on that, particularly in the housing, you know, housing is down, pricing is down, uh, delinquencies are up, uh, your your mortgage payment is, uh, double what it was five years ago. Uh, so there's still a lot of pressure out there on the consumer. The consumer, the American consumer in particular, drives everything for the whole world, not just here. So we do have to watch that. Uh, I thought those comments were interesting and positive from those banks, but I would I'm still a little bit suspect on quite how how the consumer is really doing. Related Videos Nvidia, ARK Invest buys more Tesla, Bitmine: Trending Tickers Fed independence faces a 'showdown' between Trump & the market How to play financials: Large vs. regional banks Unity Software, Ford, silver: Trending tickers Sign in to access your portfolio
Yahoo
11 minutes ago
- Yahoo
What to know about Bill Berrien, latest Republican to jump into Wisconsin governor race
A second Republican has officially joined next year's race for Wisconsin governor, though current Democratic Gov. Tony Evers hasn't announced whether he'll run for a third term. Bill Berrien, a Navy SEAL veteran and manufacturing CEO, launched his campaign July 9. He joins Washington County Executive Josh Schoemann, who's also running as a Republican. More candidates could join the GOP primary field. In his first campaign ad, Berrien likened himself to President Donald Trump as "an outsider and a businessman." "The globalists shipped our jobs in factories to China and the career politicians let it happen. Not us. We went all-in on Wisconsin," Berrien says, referring to his manufacturing business. Here's what to know about Berrien, the latest Republican to declare a run for governor: What is Bill Berrien's political experience? Berrien describes himself as a "political outsider" and hasn't campaigned for or held elected office. In April, Berrien formed a political action committee, making him the first Republican to make a public move toward running for governor. What is Bill Berrien's military background? Berrien was a Navy SEAL for nine years, according to his campaign website, and served as a team officer and platoon commander. He attended Army Ranger School and the SEAL Sniper Course. His PAC is called "Never Out of the Fight," inspired by the Navy SEAL team ethos. What is Bill Berrien's manufacturing business? Berrien is the CEO of Pindel Global Precision and Liberty Precision, which is based in New Berlin. He acquired the company in 2012. The company is a contract manufacturer of precision machined components for industries like aerospace, defense and agriculture. Pindel also manufactured parts for ventilators during the COVID pandemic. What is Bill Berrien's platform? Among Berrien's top priorities are promoting Wisconsin's manufacturing industry, lowering taxes and ensuring local law enforcement work with federal agencies to carry out deportations. Berrien criticized Evers for vetoing legislation that blocks transgender students from participating in sports teams that align with their gender identity, calling it "radical social experimentation." In an interview with the Milwaukee Journal Sentinel, Berrien said he was opening to legalizing marijuana in some capacity and keeping Wisconsin's current 20-week abortion law. More: Where Wisconsin GOP governor candidate Bill Berrien stands on Trump, abortion, marijuana and more How old is Bill Berrien? Berrien is 56. Who is in Bill Berrien's family? Berrien and his wife, Betsie, have three children — Grace, Will and Joe. He coaches his son's high school lacrosse team. Where did Bill Berrien go to college? Berrien received his bachelor's degree in politics from Princeton University, a master's from Johns Hopkins University, and an MBA from Harvard Business School, according to his LinkedIn profile. While attending Princeton, he was captain of the school's water polo team. Where is Bill Berrien from? Berrien, who grew up in New York City, describes himself as a Wisconsin "convert" who moved to the state two decades ago for his career and chose to raise his family here. He lives with his family in Whitefish Bay, a northern suburb of Milwaukee. Does Bill Berrien support Trump? Berrien is seeking to align himself with Trump. In the 2024 Republican presidential primary, he supported former United Nations Ambassador Nikki Haley but switched his support to Trump in the general election. Berrien told the Journal Sentinel he supports Trump's tariff policies and posture toward China, saying he wants to replicate such policies at the state level. What are Democrats saying about Bill Berrien? In a statement, Democratic Party of Wisconsin chairman Devin Remiker said Berrien is "rich enough to buy himself some attention and clueless enough to think that's going to work — just like Elon Musk did this past April only to see his political career end." Who else is running for governor in Wisconsin? Evers hasn't announced whether he'll seek a third term, telling reporters July 7 his decision would come in a "couple weeks." If he chooses not to run, it could open up a Democratic primary. Attorney General Josh Kaul, Milwaukee County Executive David Crowley and Lt. Gov. Sara Rodriguez are among the potential Democratic contenders. On the Republican side, possible candidates include Senate President Mary Felzkowski, former U.S. Senate candidate Eric Hovde, former U.S. Senate and governor candidate Tim Michels, and U.S. Rep. Tom Tiffany. More: Businessmen Tim Michels, Eric Hovde considering return to politics with runs for Wisconsin governor This article originally appeared on Milwaukee Journal Sentinel: Who is Bill Berrien, Republican candidate for Wisconsin governor?
Yahoo
11 minutes ago
- Yahoo
The bond market is on edge as Trump's threat to fire Powell resurfaces
The bond market remains on edge after multiple outlets reported that President Trump was seriously considering firing Federal Reserve Chair Jerome Powell — only for the president to downplay the possibility as stocks fell and Treasury yields jumped. The 10-year Treasury yield (^TNX) climbed near 4.8% after the headlines started to percolate, while the 30-year yield (^TYX) surged above the critical 5% threshold. Later, speaking to reporters in the Oval Office, Trump appeared to soften his stance, saying he's "not talking about" firing Powell and pointing out that Powell's term ends in May. Still, yields remained elevated, underscoring the market's unease over potential political interference at the Fed. Notably, the Trump administration has been highly sensitive to movements in the bond market, keeping a close watch on the 10-year Treasury yield. According to Larry Tentarelli, chief technical strategist at Blue Chip Daily, the 10-year yield is still trading within a reasonable range, but there are key levels to watch. "We would prefer to see TNX not test 4.6% or higher," Tentarelli said on Tuesday, noting that technical indicators still suggest an upward bias in yields, even within a defined range. And as the chart below from Piper Sandler illustrates, 10-year Treasury yields above 4.6% have historically posed headwinds for US equities, specially for rate-sensitive and low-growth sectors. Yields' warning signal Bond prices move inversely to yields, so rising yields suggest investors are selling bonds. One catalyst behind the recent move, as Wednesday's reaction made clear, has been renewed concern over the Federal Reserve's independence, with political pressure on the central bank stoking fears about US economic stability. The US dollar also fell on the speculation, reflecting broader market unease. The idea that the bond market itself serves as a check on political interference at the Fed was echoed by Jon Hilsenrath, senior adviser at StoneX and longtime Fed watcher. "Ultimately I think that the people who are going to decide whether Jay Powell keeps his job or not are in the bond market," he told Yahoo Finance. "What we saw back in April, when the president was threatening to fire Powell, was bond yields rose. People were concerned about the stability and independence of the Fed, and the administration backed off." Another driver of rising yields: expectations that the Fed will keep interest rates elevated. When rate cuts are off the table, there's less urgency to lock in current yields, and investors may choose to reallocate capital elsewhere. Rising inflation, often the reason rates stay elevated, also pushes yields higher, as investors demand greater compensation for eroding purchasing power. All of these forces were at play this week. Earlier on Wednesday, yields edged lower after a softer-than-expected reading on wholesale prices (PPI) added to a string of mixed signals on the inflation front. The day before, yields surged following a firmer-than-expected CPI print that prompted markets to reassess the Fed's rate-cutting path. According to the CME FedWatch Tool the probability of a September rate cut has now slipped below 60%, compared to nearly 70% just one week ago. "We expect the Federal Reserve to remain on pause until December as the upward pressure on core goods prices becomes more apparent," Matthew Martin, senior US economist at Oxford Economics, wrote in a note to clients on Wednesday. Core goods prices within PPI rose 0.2% in June, a potential early sign that tariffs are starting to filter through the economy. Categories like household furnishings and appliances, which are more exposed to trade policy, saw some of the largest price increases. By contrast, apparel and toys remained mostly flat. "There is a lag between tariffs and when they begin to influence businesses' pricing behavior," Martin said. "For example, wholesale prices for used vehicles began to climb in late April, but it will take a couple of months for that to appear in consumer prices." Allie Canal is a Senior Reporter at Yahoo Finance. Follow her on X @allie_canal, LinkedIn, and email her at Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
