
Mission critical: Expert eye on frightening fallacies and fantasies behind tech titans' AI visions
Billionaire pseudo-libertarian tech-bros with their utopian fever dreams terrify me. They clearly read a lot of William Gibson and Nietzsche while getting the wrong end of the stick. The likes of Elon Musk, Jeff Bezos, Mark Zuckerberg, Peter Thiel and Sam Altman labour under the delusion that some lucky investments in other people's ideas make them natural Übermenschen to 'benignly' micromanage the destiny of humanity.
American author, science philosopher and trained astrophysicist Adam Becker, in his compulsive, brilliantly written book More Everything Forever: AI Overlords, Space Empires and Silicon Valley's Crusade to Control the Fate of Humanity, comes at the subject with the exasperated contempt it deserves. Think of it as Fear and Loathing in Silicon Valley. Becker digs into these fanboy fantasias of the future and squashes the plausibility of most of the 'science'.
It helps that Becker moves in the same elevated circle of intellectuals and consultants, and speaks with first-hand understanding. Rather than presenting real science, it's a toxic red-blooded protein shake of authoritarian ambition, Spenglerian pseudoscience, eugenics, back-of-the-envelope futurism and raging megalomaniacal narcissism. What's more, it's a cynical distraction from genuine issues like the climate crisis and social inequality.
Usefully, Becker breaks the bilge down into the key ideas and players into digestible slices before demolishing them. For example, a central concept to the mindset (or snow job) is a philosophical argument called 'effective altruism'. On one level it sounds thoroughly anodyne – the evidence-based maximising of limited resources for the greater good. That's all fine and dandy until it gets into its logical cups and heads into 'useless eaters' territory and obsessing about demographic IQ scores.
This dangerously unempathetic, utilitarian take on ethics underpins much of the tech-broligarchy's thinking, but paradoxically, it seems to co-exist with the notion that an infinitely expanding post-scarcity society is just around the corner. The tech-broligarchs, like Lewis Carroll's White Queen, believe as many as six impossible things before breakfast. Often what it renders down to is highly privileged, poorly socialised, rather immature individuals from engineering backgrounds blundering with a utilitarian hammer into other specialities from biology to the humanities, each with their own subtleties and nuances, and just seeing fields of nails.
However, a lot of what these would-be messiahs are pushing is just not scientifically feasible in the near future or even as a pipe dream. Becker is very good at pouring cold water on favourite hobby-horses such as AI singularity – the point where AI surpasses human intelligence and controls its own technological advance. Futurist Ray Kurzweil's mind-uploads-to-computers nonsense is similarly debunked (too fundamentally different and incompatible), along with spreading out into the universe to infinity and beyond (not enough energy and too far away). The numbers never add up.
Think about it. Musk wants to colonise Mars in a decade, but we still have no feasible way of shielding against the radiation, there's no industrial base there to keep the whole thing functioning, and we don't even know if human beings can survive long term at about a third of Earth's gravity.
Yet Musk, typical of the movement, gives the impression it's just a matter of Schopenhauerian willpower and throwing enough government subsidies at it.
It's never entirely clear how seriously the tech bros actually take these fancies, or whether it's just window dressing for something more concrete: political control. Becker is forensic in dissecting the putsch for power, all the more impressive given the bulk of the book must have been completed before it became crystal clear Trump was a sort of Trojan donkey for these people.
So no, we aren't all going to be golden immortal cyborg demigods colonising the stars with our perfect AI husbandos and waifus. It's not going to be Star Trek. It's not even going to be like Ben Elton's 1989 satire Stark, in which a bunch of billionaires decide to tank planet Earth and escape to the moon.
If you found Douglas Rushkoff's 2022 book Survival of the Richest: Escape Fantasies of the Tech Billionaires as morbidly fascinating as I did, More Everything Forever is a thoroughly worthy companion volume. It will leave you wishing they'd all get on Elon's rocket to Mars, while also wondering who will scrub the gold toilets for them when the robots rebel. It's a must-read if you want to understand the dangerous new world we find ourselves in.
'The futures of technological salvation,' says Becker, 'are sterile impossibilities, and they would be brutally destructive if they did come to pass. The cosmos is more than a giant well of resources, and humans are more than siphons sucking it dry. But I can't offer a specific future as an alternative. What I can tell you is that anyone who claims to know the one inevitable future, or the one good path for humanity, is someone who deserves your deepest scepticism.'
More Everything Forever: AI Overlords, Space Empires and Silicon Valley's Crusade to Control the Fate of Humanity, by Adam Becker (Hachette, $39.99), is out now.
Hashtags

Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles


NZ Herald
2 days ago
- NZ Herald
ChatGPT got a big upgrade. Here's what to know about OpenAI's GPT-5
How much does it cost to access GPT-5? All ChatGPT users will get access to GPT-5, even those using the free version. But only those with a US$200-a-month ($335) 'Pro' subscription get unlimited access to the newly released system. GPT-5 will be the default mode on all versions. Users not paying for ChatGPT will only be able to ask a certain number of questions answered by GPT-5 before the chatbot switches back to using an older version of OpenAI's technology. How will GPT-5 change ChatGPT? GPT-5 responds to questions faster than OpenAI's previous offerings and is less likely to 'hallucinate' or make up false answers, OpenAI executives said at a news briefing before its release. It gives ChatGPT 'better taste' when generating writing, said Nick Turley, who leads work on the chatbot. OpenAI's new AI software can also answer queries using a process dubbed reasoning that shows the user a series of messages attempting to break down a question into steps before giving its final answer. 'GPT-5 is the first time that it really feels like talking to an expert, a PhD-level expert,' OpenAI CEO Sam Altman said. Altman said GPT-5 is particularly good at generating computer programming code, a feature that has become a major selling point for OpenAI and rival AI developers and has transformed the work of programmers. In a demo, the company showed how two paragraphs of instruction was enough to have GPT-5 create a simple website offering tutoring in French, complete with a word game and daily vocabulary tests. Execs say ChatGPT users can now connect the app with their Google calendars and email accounts. Photo / Getty Images Altman predicted that people without any computer science training will one day be able to quickly and easily generate any kind of software they need to help them at work or with other tasks. 'This idea of software on demand will be a defining part of the new GPT-5 era,' Altman said. Turley also claimed the upgrade made ChatGPT better at connecting with people. 'The thing that's really hard to put into words or quantify is the fact that just feels more human,' he said. In a livestream Thursday, OpenAI execs said ChatGPT users could now connect the app with their Google calendars and email accounts, allowing the chatbot to help people schedule activities around their existing plans. What does it mean for an AI chatbot to 'reason?' GPT-5 could give many people their first encounter with AI systems that attempt to work through a user's request step-by-step before giving a final answer. That so-called 'reasoning' process has become popular with AI companies because it can result in better answers on complex questions, particularly on math and coding tasks. Watching a chatbot generate a series of messages that read like an internal monologue can be alluring, but AI experts warn users not to confuse the technique with a peek into AI's black box. The self-chatter doesn't necessarily reflect an internal process like that of a human working on a problem, but designing chatbots to create what are sometimes dubbed 'chains of thought' forces the software to allocate more time and energy to a query. OpenAI released its first reasoning model in September for its paying users, but Chinese start-up DeepSeek in January released a free chatbot that made its 'chain of thought' visible to users, shocking Silicon Valley and temporarily tanking American tech stocks. The company said ChatGPT will now automatically send some queries to the 'reasoning' version of GPT-5, depending on the type of conversation and complexity of the questions asked. Is GPT-5 the 'super intelligence' or 'artificial general intelligence' OpenAI has promised? No. Tech leaders have for years been making claims that AI is improving so fast it will soon become able to learn and perform all tasks that humans can at or better than our own ability. But GPT-5 does not perform at that level. Super intelligence and artificial general intelligence, or AGI, remain ill-defined concepts because human intelligence is very different from the capabilities of computers, making comparisons tricky. OpenAI CEO Altman has been one of the biggest proponents of the idea that AI capabilities are increasing so rapidly that they will soon revolutionise many aspects of society. 'This is a significant step forward,' Altman said of GPT-5. 'I would say it's a significant fraction of the way to something very AGI-like.' Some people have alleged that loved ones were driven to violence, delusion or psychosis by hours spent talking to ChatGPT. Photo / Getty Images Does GPT-5 change ChatGPT's personality? Changes OpenAI made to ChatGPT in April triggered backlash online after examples of the chatbot appearing to flatter or manipulate users went viral. The company undid the update, saying an attempt to enhance the chatbot's personality and make it more personalised instead led it to reinforce user beliefs in potentially dangerous ways, a phenomenon the industry calls 'sycophancy'. OpenAI said it worked to reduce that tendency further in GPT-5. As AI companies compete to keep users engaged with their chatbots, they could make them compelling in potentially harmful ways, similar to social media feeds, The Washington Post reported in May. In recent months, some people have alleged that loved ones were driven to violence, delusion or psychosis by hours spent talking to ChatGPT. Lawsuits against other AI developers claim their chatbots contributed to incidents of self-harm and suicide by teens. OpenAI released a report on GPT-5's capabilities and limits Thursday that said the company looked closely at the risks of psychosocial harms and worked with Microsoft to probe the new AI system. It said the reasoning version of GPT-5 could still 'be improved on detecting and responding to some specific situations where someone appears to be experiencing mental or emotional distress'. Earlier this week, OpenAI said in a blog post it was working with physicians across more than 30 countries, including psychiatrists and paediatricians, to improve how ChatGPT responds to people in moments of distress. Turley, the head of ChatGPT, said the company is not optimising ChatGPT for engagement.


Scoop
3 days ago
- Scoop
Defunding Of mRNA Vaccine Research In The US
This week, the US Health Department announced the cancellation of several mRNA vaccine development contracts. The cuts and restructuring of collaborations affect 22 projects worth about half a billion US dollars, and no new mRNA projects will be funded. The US Secretary of Health, Robert F. Kennedy, Jr., claimed mRNA vaccines don't provide effective protection against upper respiratory tract infections and said that funding would be shifted towards 'safer, broader vaccine platforms'. The SMC asked experts to comment on how this affects NZ and local mRNA vaccine research. Professor Kjesten Wiig, Co-director of the RNA Development Platform and Director of the Malaghan Institute of Medical Research, comments: 'The recent decisions out of the US to cut funding for mRNA vaccine development represent a new low for the American medical and scientific community, one that risks undermining decades of progress in public health and infectious disease preparedness. 'At the Malaghan Institute, our research is not directly affected by US funding cuts. Likewise, the national RNA Development Platform continues to receive sustained support from the New Zealand Government. This backing allows us to focus on developing safe and effective RNA vaccines and therapeutics not just for human medicine but also for treatments that will benefit our primary industries, and for New Zealand specific problems. 'RNA is a proven, safe and transformative technology. Its potential extends well beyond the pandemic. In the absence of US leadership, there is an unprecedented opportunity for countries like New Zealand to step up to ensure this breakthrough science continues to benefit people globally.' No conflicts of interest. Our colleagues at the UK SMC have also gathered comments. A small selection follows—see their website for the full expert reaction. Prof Christopher Chiu, Professor of Infectious Diseases, Imperial College London, said: 'Hundreds millions of people received mRNA vaccines during the pandemic with no major ill effects, dramatically reducing the risk of severe COVID-19, hospitalisation and death. In this way, they played a critically important part in allowing society to return to normal. Overall, the mRNA vaccines have been shown to be very safe, although like all treatments they can cause side effects, mostly mild but including some rare severe reactions. It is misleading to single out mRNA vaccines for promoting mutations and failing to protect against common cold-like symptoms; this is true for all respiratory virus vaccines that are given by injection and can stimulate a protective immune response. Better protection is needed but until we have next-generation alternatives that can completely block infection in the nose and lung, mRNA vaccines will continue to be important and valuable.' No conflicts of interest. Dr David Elliman, Honorary Associate Professor, UCL, said: 'This is a very worrying development. mRNA vaccines were an extremely important tool in saving the lives of people from COVID. There is no reliable published evidence that supports RFK Jr's assertion that the vaccines encourage new mutations and, in so doing, may prolong pandemics. The evidence to support this should be made public, so that it can be examined, by experts in the field who have not been picked because of their anti-vaccine views. 'While this development is not only a retrograde step for the development of mRNA vaccines, of greater concern, perhaps, is that it reinforces the impression that, in spite of his protestations, RFK Jr is antivaccine. This has implications, not only for vaccination programmes in USA, but around the world. At a time when vaccination rates are falling globally, we need to follow the evidence, not ideologically led beliefs. Such misguided beliefs are likely to cause unnecessary suffering and death, particularly in children.' No conflicts of interest. Prof Robin Shattock, Professor of Mucosal Infection and Immunity, Imperial College London, said: What do we know about the safety and efficacy of mRNA vaccines? 'Following their use in millions of individuals during the pandemic and using current technology, we have an extraordinary level of detail on the safety and efficacy of mRNA vaccines. In the context of COVID-19, these vaccines prevented millions of deaths and hospitalisations. As for mRNA vaccines against other infectious these would need to be evaluated on a case-by-case basis. Do mRNA vaccines increase the mutation rate of viruses? 'No, there is no scientific evidence that this is the case. Different viruses mutate at different rates, for example influenza virus changes on a seasonal basis, SARS-CoV2 continues to vary irrespective of whether individuals have received mRNA vaccines. What are the impacts of this funding cut on public health and health research in the US and globally? 'This will impoverish American resilience to future pandemics. But more importantly, it will be used by some to legitimise unfounded claims that mRNA vaccines and vaccines in general are unsafe. This is directly opposite to the scientific evidence-based approach to science. This technology offers real benefits not only against infectious diseases, but also in our fight against cancer, autoimmunity, and hereditary diseases. If known, what data might he [R.F. Kennedy Jr] be referring to and how does it compare with other existing evidence? 'It is unclear as to what evidence he is referring to, given that these vaccines have been highly scrutinised by regulatory bodies on an ongoing basis (FDA, EMEA, MHRA). He has provided no evidence to show that alternative vaccines are any different to mRNA vaccines concerning claims of safety and the unfounded claim that mRNA vaccines drive the mutation rate of viruses. Any other considerations you have about the claims being made? 'This is another blow against vaccine uptake in general, where for example, we are seeing the return of Measles outbreaks in the US and unnecessary deaths.' Conflict of interest statement: 'I work on RNA vaccines in an academic setting, but have no associations with any of the work that is being axed by RFK or the companies involved.'


NZ Herald
3 days ago
- NZ Herald
Apple pledges $1 trillion US investment, boosts domestic supply chain
Apple chief Tim Cook appeared at the White House to announce the tech giant's US$600b commitment to domestic manufacturing. Photo / Getty Images Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech. Apple chief Tim Cook appeared at the White House to announce the tech giant's US$600b commitment to domestic manufacturing. Photo / Getty Images Apple will invest an additional US$100 billion ($168b) in the United States, taking its total pledge to US$600b ($1 trillion) over the next four years, says US President Donald Trump. Trump announced the increased commitment at the White House alongside the tech giant's chief executive, Tim Cook, calling it 'the largest investment Apple has made in America'. 'Apple will massively increase spending on its domestic supply chain,' Trump added, highlighting a new production facility for the glass used to make iPhone screens in Kentucky. In February, Apple said it would spend more than US$500b in the US and hire 20,000 people, with Trump quickly taking credit for the decision. It builds on plans announced in 2021, when the company founded by Steve Jobs said it would invest US$430b in the country and add 20,000 jobs over the next five years.