Ads ruined social media; now they're coming to AI
CHATBOTS might hallucinate and sprinkle too much flattery on their users. 'That's a fascinating question!' one recently told me, but at least the subscription model that underpins them is healthy for our well-being. Many Americans pay about US$20 a month to use the premium versions of OpenAI's ChatGPT, Google's Gemini Pro or Anthropic's Claude, and the result is that the products are designed to provide maximum utility.
Don't expect this status quo to last. Subscription revenue has a limit, and Anthropic's new US$200-a-month 'Max' tier suggests even the most popular models are under pressure to find new revenue streams.
Unfortunately, the most obvious one is advertising – the web's most successful business model. Artificial intelligence (AI) builders are already exploring ways to plug more ads into their products, and while that's good for their bottom lines, it also means we're about to see a new chapter in the attention economy that fuelled the Internet.
If social media's descent into engagement-bait is any guide, the consequences will be profound.
One cost is addiction. Young office workers are becoming dependent on AI tools to help them write e-mails and digest long documents, according to a recent study, and OpenAI says a cohort of 'problematic' ChatGPT users are hooked on the tool. Putting ads into ChatGPT, which now has more than 500 million active users, won't spur the company to help those people reduce their use of the product. Quite the opposite.
Advertising was the reason companies like Mark Zuckerberg's Meta Platforms designed algorithms to promote engagement, keeping users scrolling so they saw more ads and drove more revenue. It's the reason behind the so-called 'enshittification' of the web, a place now filled with clickbait and social media posts that spark outrage.
BT in your inbox
Start and end each day with the latest news stories and analyses delivered straight to your inbox.
Sign Up
Sign Up
Baking such incentives into AI will almost certainly lead its designers to find ways to trigger more dopamine spikes, perhaps by complimenting users even more, asking personal questions to get them talking for longer or even cultivating emotional attachments.
Millions of people in the Western world already view chatbots in apps like Character.ai, Chai, Talkie, Replika and Botify as friends or romantic partners. Imagine how persuasive such software could be when its users are beguiled. Imagine a person telling their AI about feeling depressed, and the system recommending some affordable holiday destinations or medication to address the problem.
Is that how ads would work in chatbots? The answer is subject to much experimentation, and companies are indeed experimenting. Google's ad network, for instance, recently started putting advertisements in third-party chatbots. Chai, a romance and friendship chatbot, on which users spent 72 minutes a day, on average, in September 2024, serves pop-up ads.
And AI answer engine Perplexity displays sponsored questions. After an answer to a question about job hunting, for instance, it might include a list of suggested follow ups including, at the top, 'How can I use Indeed to enhance my job search?'
Perplexity's chief executive officer Aravind Srinivas told a podcast in April that the company was looking to go further by building a browser to 'get data even outside the app' to track 'which hotels are you going (to), which restaurants are you going to', to enable what he called 'hyper-personalised' ads.
For some apps, that might mean weaving ads directly into conversations, using the intimate details shared by users to predict and potentially even manipulate them into wanting something, then selling those intentions to the highest bidder.
Researchers at Cambridge University referred to this as the forthcoming 'intention economy' in a recent paper, with chatbots steering conversations toward a brand or even a direct sale. As evidence, they pointed to a 2023 blog post from OpenAI calling for 'data that expresses human intention' to help train its models, a similar effort from Meta, and Apple's 2024 developer framework that helps apps work with Siri to 'predict actions someone might take in the future'.
As for OpenAI's Sam Altman, nothing says 'we're building an ad business' like hiring the person who built delivery app Instacart into an advertising powerhouse. Altman recently poached CEO Fidji Simo to help OpenAI 'scale as we enter a next phase of growth'. In Silicon Valley parlance, to 'scale' often means to quickly expand your user base by offering a service for free, with ads.
Tech companies will inevitably claim that advertising is a necessary part of democratising AI. But we've seen how 'free' services cost people their privacy and autonomy – even their mental health. And AI knows more about us than Google or Facebook ever did – details about our health concerns, relationship issues and work. In two years, they have also built a reputation as trustworthy companions and arbiters of truth. On X, for instance, users frequently bring AI models Grok and Perplexity into conversations to flag if a post is fake.
When people trust AI that much, they're more vulnerable to targeted manipulation. AI advertising should be regulated before it becomes too entrenched, or we'll repeat the mistakes made with social media – scrutinising the fallout of a lucrative business model only after the damage is done. BLOOMBERG
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Straits Times
2 hours ago
- Straits Times
Continuity or reset? Japan, China seek clues to S. Korea President Lee Jae-myung's foreign policy
South Korean President Lee Jae-myung speaking during a media conference at the Presidential Office in Seoul on June 4. PHOTO: REUTERS – South Korea's East Asian neighbours Japan and China on June 4 quickly congratulated President Lee Jae-myung on his resounding election win, even as both countries are closely watching for clues to how the liberal leader will approach bilateral relations. This scrutiny stems from perceptions that South Korean diplomacy oscillates wildly depending on the ruling party of the day. Liberals are judged to be hostile towards Japan and friendly towards China and North Korea, while conservatives hold an opposite view. Ties between Tokyo and Seoul plunged into a deep freeze under the previous liberal President Moon Jae-in, only to thaw rapidly under Mr Lee's ousted predecessor, Yoon Suk Yeol, who is now facing insurrection charges for his martial law debacle. Mr Lee had previously described Japan as an 'enemy nation' and gone on a 24-day hunger strike to oppose Yoon's conciliatory policies, which he termed 'humiliating diplomacy'. He has also criticised Yoon for worsening ties with China by moving closer to the United States on positions such as Taiwan, which Beijing regards as part of its territory to be reunited with. But Mr Lee adopted a more centrist agenda on the campaign trail, saying that he wanted to repair fraying ties with China, while also insisting that he held a 'very favourable impression of the Japanese people'. His approach to this diplomatic tightrope will have ramifications from Washington to Tokyo, as the US corrals its Indo-Pacific allies for support in its big-power competition with China. Both Japan and South Korea are US security allies, while China is their largest trading partner. On June 4, Mr Lee said : 'I will strengthen cooperation between South Korea, the US and Japan, based on the solid South Korea-US alliance, and will approach relations with neighbouring countries from the perspective of national interest and practicality.' All eyes will be on Mr Lee's likely diplomatic debut on June 15 at the Group of Seven (G-7) summit in Canada, where South Korea has been invited as an obser ver. There, he could potentially meet bilaterally with US and Japan's leaders. Amid the diplomatic ambiguity, analysts in China were sanguine about Beijing-Seoul ties, while Japanese observers were more circumspect over Tokyo-Seoul relations. In a congratulatory message to Mr Lee, Chinese President Xi Jinping stressed that he attaches 'great importance' to China-South Korea relations. The two countries, he said, are close neighbours and partners that have overcome ideological and social differences in the 33 years since establishing diplomatic ties to develop stable and healthy relations. This partnership 'not only improved the well-being of the citizens in both countries, but also promoted regional peace and stability', Mr Xi added, according to state media reports. 'China is willing to work with South Korea to adhere to the original intention of the establishment of diplomatic ties and firmly follow the rules of good neighbourliness and friendship,' Mr Xi said, noting that this is to the benefit of both countries at a time of growing regional and international uncertainty. Over in Tokyo, Japanese Prime Minister Shigeru Ishiba delivered a similar message of working together as 'partners' and close neighbours to tackle global challenges, as the countries celebrate the 60th anniversary of bilateral ties in 2025. 'The importance of holding summit talks at an early date and engaging in 'shuttle diplomacy' won't change,' Mr Ishiba said, referring to the practice of the leaders regularly visiting each other's countries, while expressing his hopes to 'further invigorate bilateral exchanges' at all levels. Yet, Japanese officials are wary that Mr Lee's election would portend a dramatic shift in bilateral ties, given that he has said he would broach wartime issues over Japan's colonial rule of the Korean peninsula from 1910 to 1945, and the territorial dispute over the Dokdo/Takeshima islets. This is especially since 2025 marks the 80th year since Japan's wartime surrender, an anniversary year that could be weaponised to stoke tensions by raising historical grievances. Japan's position is that all wartime reparations have been 'completely and finally' settled under a 1965 agreement to normalise ties, with Tokyo paying US$500 million (worth about US$5 billion today, or S$6.4 billion) in grants and low-interest long-term loans to South Korea. But past South Korean administrations have repeatedly brought up historical issues, including comfort women and wartime labour, casting a pall over bilateral relations. 'Even if the administration takes a conciliatory stance towards Japan at the start, it could gradually evolve into a hardline stance towards Japan,' a Japanese Foreign Ministry official was quoted as telling the Mainichi newspaper. Another official was cautiously optimistic, saying it would be foolhardy to stoke anti-Japan sentiment at this time, given the positive public opinion. North Korea's military involvement in Russia's invasion of Ukraine also means that geopolitical calculations would have changed, the official was cited as saying. Kobe University's Professor Kan Kimura told The Straits Times that the way forward is unpredictable, given that invoking history would be a non-starter for Japan. 'Lee's language over history and territorial disputes is going to be provocative,' he said. 'The question is whether both countries can delink history with economic and security issues.' He saw it in Seoul's interests to maintain close ties with Tokyo, saying: 'Given that South Korean public opinion towards China is worsening, North Korea is refusing to engage in dialogue with South Korea, and the US is exerting pressure including through tariffs, objectively speaking, South Korea has almost no diplomatic options.' Analysts in China told ST that ties will likely thaw between Beijing and Seoul under Mr Lee, whom they expect will strike a better balance amid US-China competition. Associate Professor Zhang Guangxin at Zhejiang Gongshang University's East Asian Institute in Hangzhou noted that despite Yoon's pivot to the US that had chilled bilateral relations with China, trade between the two countries remains robust. Exports from South Korea to China grew 6.6 per cent in 2024 from a year ago, which underscores the robust trade relations, Prof Zhang noted. 'Mr Lee's clear victory over the People Power Party (which Yoon belonged to) shows the South Korean public's desire for economic stability,' he said. Prof Kim Chang Hyun of the China-Europe International Business School in Shanghai, meanwhile, said business elites in South Korea no longer see China as solely a big market for their products but 'an important partner to learn from', pointing to China's advances in green technology and artificial intelligence. The two experts said that public opinion in South Korea towards the US is likely deteriorating, given US President Donald Trump's demands that Seoul pay more for defence, and the threat of 'reciprocal tariffs' of 25 per cent. Students from South Korea – the third-largest source of foreign students to the US – are also facing heightened uncertainty over Mr Trump's immigration policies. 'There will be some rebalancing in public opinion in South Korea towards the US now,' Prof Kim said. Walter Sim is Japan correspondent at The Straits Times. Based in Tokyo, he writes about political, economic and socio-cultural issues. Aw Cheng Wei is The Straits Times' China correspondent, based in Chongqing. Join ST's Telegram channel and get the latest breaking news delivered to you.
CNA
3 hours ago
- CNA
Hackers abuse modified Salesforce app to steal data, extort companies, Google says
Hackers are tricking employees at companies in Europe and the Americas into installing a modified version of a Salesforce-related app, allowing the hackers to steal reams of data, gain access to other corporate cloud services and extort those companies, Google said on Wednesday. The hackers – tracked by the Google Threat Intelligence Group as UNC6040 – have 'proven particularly effective at tricking employees' into installing a modified version of Salesforce's Data Loader, a proprietary tool used to bulk import data into Salesforce environments, the researchers said. The hackers use voice calls to trick employees into visiting a purported Salesforce connected app setup page to approve the unauthorized, modified version of the app, created by the hackers to emulate Data Loader. If the employee installs the app, the hackers gain 'significant capabilities to access, query, and exfiltrate sensitive information directly from the compromised Salesforce customer environments,' the researchers said. The access also frequently gives the hackers the ability to move throughout a customer's network, enabling attacks on other cloud services and internal corporate networks. Technical infrastructure tied to the campaign shares characteristics with suspected ties to the broader and loosely organized ecosystem known as 'The Com,' known for small, disparate groups engaging in cybercriminal and sometimes violent activity, the researchers said. A Google spokesperson did not share additional details about how many companies have been targeted as part of the campaign, which has been observed over the past several months. A Salesforce spokesperson told Reuters in an email that 'there's no indication the issue described stems from any vulnerability inherent in our platform.' The spokesperson said the voice calls used to trick employees 'are targeted social engineering scams designed to exploit gaps in individual users' cybersecurity awareness and best practices.' The spokesperson declined to share the specific number of affected customers, but said that Salesforce was "aware of only a small subset of affected customers," and said it was "not a widespread issue."
Straits Times
3 hours ago
- Straits Times
Singapore can leverage trust premium, crisis readiness for new growth opportunities: Chee Hong Tat
Minister for National Development Chee Hong Tat (right) and Nomura Asia-Pacific chief executive Nags Sankaranarayanan taking part in a fireside chat at the Nomura Investment Forum Singapore on June 4. PHOTO: NOMURA SINGAPORE - Concerns are mounting that hiring in Singapore – especially of fresh graduates – may slow as investors and companies delay investment decisions amid ongoing uncertainty over US President Donald Trump's fluctuating tariff policies. However, Singapore's reputation as a trusted financial hub will enable it to continue attracting global investments, talent and technologies, while a new task force to prepare companies and workers for volatility has positioned the Republic well to navigate the uncertainty, said Minister for National Development Chee Hong Tat on June 4. Speaking at Nomura's annual investor forum at the Ritz-Carlton, Mr Chee, who is also deputy chairman of the Monetary Authority of Singapore (MAS), said that while it is understandable for companies to adopt a wait-and-see approach in the current environment, this could affect jobs if adopted on a broader scale. 'We are worried,' Mr Chee said, noting that a persistent slowdown could impact job opportunities for workers as well as students who are about to graduate. Access to financing is also an emerging concern. 'There are companies who actually have viable businesses, products and services but, because of the uncertainty, may face more difficulties in drawing financing,' he said. Mr Chee was responding to a question from Nomura Asia-Pacific chief executive Nags Sankaranarayanan on the impact of the US-China trade war on Singapore, and the Government's assessment of the situation. He noted that Singapore's overall factory activity is now at its lowest levels in months, reflecting the concerns businesses have with regard to the more uncertain environment. While there's still a need to provide support in weathering the current volatility, particularly in areas like financing and hiring, that alone isn't enough, Mr Chee said. There is also a need for companies and workers to look ahead and be ready for a landscape with new challenges and opportunities. The Singapore Economic Resilience Taskforce (Sert), announced in April, was set up for this purpose. 'We have a team that's looking at how to help companies and workers, how to provide some interventions on top of what we have already announced in the Budget earlier this year,' Mr Chee said. Sert is also helping companies adapt to a shifting landscape by identifying emerging opportunities and potential challenges, as well as equipping workers with the skills required to stay relevant, he added. Meanwhile, MAS has been consistently reviewing Singapore's rules and processes to identify the barriers to business, and improve the Republic's attractiveness to businesses and investors. 'We have new services, new business models, new requirements, and it's important for us to be able to keep up with these new changes and in doing so, improve our efficiency and reduce business costs,' Mr Chee said. In wealth management, for example, the time taken for tax incentive applications by family offices has been 'significantly shortened', in response to industry feedback on the long processing time in the past, he said. Efforts are also being made to deepen Singapore's capital markets, with MAS now seeking feedback on proposals to streamline disclosure requirements and broaden investor outreach channels during initial public offerings. Asked further about how Singapore can maintain its competitiveness and resilience as a financial centre, Mr Chee noted that the Republic remains a stable, well-regulated and trusted hub for financial services and is more conservative than other economies. However, he added that being overly conservative may mean missing out pockets of opportunities in new technologies, business models, products and services – areas that Singapore should be prepared to explore with the appropriate safeguards in place. 'This is is where balance needs to be struck, and for us, moving from where we are to where we want to be, my view is we can probably afford to take a little bit more risk, but not all the way, because we don't want to affect our overall reputation as a trusted, stable financial centre.' Kang Wan Chern is deputy business editor at The Straits Times. Join ST's Telegram channel and get the latest breaking news delivered to you.
