
Behind the Curtain: The scariest AI reality
The wildest, scariest, indisputable truth about AI's large language models is that the companies building them don't know exactly why or how they work.
Sit with that for a moment. The most powerful companies, racing to build the most powerful superhuman intelligence capabilities — ones they readily admit occasionally go rogue to make things up, or even threaten their users — don't know why their machines do what they do.
Why it matters: With the companies pouring hundreds of billions of dollars into willing superhuman intelligence into a quick existence, and Washington doing nothing to slow or police them, it seems worth dissecting this Great Unknown.
None of the AI companies dispute this. They marvel at the mystery — and muse about it publicly. They're working feverishly to better understand it. They argue you don't need to fully understand a technology to tame or trust it.
Two years ago, Axios managing editor for tech Scott Rosenberg wrote a story, "AI's scariest mystery," saying it's common knowledge among AI developers that they can't always explain or predict their systems' behavior. And that's more true than ever.
Yet there's no sign that the government or companies or general public will demand any deeper understanding — or scrutiny — of building a technology with capabilities beyond human understanding. They're convinced the race to beat China to the most advanced LLMs warrants the risk of the Great Unknown.
The House, despite knowing so little about AI, tucked language into President Trump's "Big, Beautiful Bill" that would prohibit states and localities from any AI regulations for 10 years. The Senate is considering limitations on the provision.
Neither the AI companies nor Congress understands the power of AI a year from now, much less a decade from now.
The big picture: Our purpose with this column isn't to be alarmist or " doomers." It's to clinically explain why the inner workings of superhuman intelligence models are a black box, even to the technology's creators. We'll also show, in their own words, how CEOs and founders of the largest AI companies all agree it's a black box.
Let's start with a basic overview of how LLMs work, to better explain the Great Unknown:
LLMs — including Open AI's ChatGPT, Anthropic's Claude and Google's Gemini — aren't traditional software systems following clear, human-written instructions, like Microsoft Word. In the case of Word, it does precisely what it's engineered to do.
Instead, LLMs are massive neural networks — like a brain — that ingest massive amounts of information (much of the internet) to learn to generate answers. The engineers know what they're setting in motion, and what data sources they draw on. But the LLM's size — the sheer inhuman number of variables in each choice of "best next word" it makes — means even the experts can't explain exactly why it chooses to say anything in particular.
We asked ChatGPT to explain this (and a human at OpenAI confirmed its accuracy): "We can observe what an LLM outputs, but the process by which it decides on a response is largely opaque. As OpenAI's researchers bluntly put it, 'we have not yet developed human-understandable explanations for why the model generates particular outputs.'"
"In fact," ChatGPT continued, "OpenAI admitted that when they tweaked their model architecture in GPT-4, 'more research is needed' to understand why certain versions started hallucinating more than earlier versions — a surprising, unintended behavior even its creators couldn't fully diagnose."
Anthropic — which just released Claude 4, the latest model of its LLM, with great fanfare — admitted it was unsure why Claude, when given access to fictional emails during safety testing, threatened to blackmail an engineer over a supposed extramarital affair. This was part of responsible safety testing — but Anthropic can't fully explain the irresponsible action.
Again, sit with that: The company doesn't know why its machine went rogue and malicious. And, in truth, the creators don't really know how smart or independent the LLMs could grow. Anthropic even said Claude 4 is powerful enough to pose a greater risk of being used to develop nuclear or chemical weapons.
OpenAI's Sam Altman and others toss around the tame word of " interpretability" to describe the challenge. "We certainly have not solved interpretability," Altman told a summit in Geneva last year. What Altman and others mean is they can't interpret the why: Why are LLMs doing what they're doing?
Anthropic CEO Dario Amodei, in an essay in April called "The Urgency of Interpretability," warned: "People outside the field are often surprised and alarmed to learn that we do not understand how our own AI creations work. They are right to be concerned: this lack of understanding is essentially unprecedented in the history of technology." Amodei called this a serious risk to humanity — yet his company keeps boasting of more powerful models nearing superhuman capabilities.
Anthropic has been studying the interpretability issue for years, and Amodei has been vocal about warning it's important to solve. In a statement for this story, Anthropic said: "Understanding how AI works is an urgent issue to solve. It's core to deploying safe AI models and unlocking [AI's] full potential in accelerating scientific discovery and technological development. We have a dedicated research team focused on solving this issue, and they've made significant strides in moving the industry's understanding of the inner workings of AI forward. It's crucial we understand how AI works before it radically transforms our global economy and everyday lives." (Read a paper Anthropic published last year, "Mapping the Mind of a Large Language Model.")
Elon Musk has warned for years that AI presents a civilizational risk. In other words, he literally thinks it could destroy humanity, and has said as much. Yet Musk is pouring billions into his own LLM called Grok.
"I think AI is a significant existential threat," Musk said in Riyadh, Saudi Arabia, last fall. There's a 10%-20% chance "that it goes bad."
Reality check: Apple published a paper last week, "The Illusion of Thinking," concluding that even the most advanced AI reasoning models don't really "think," and can fail when stress-tested.
The study found that state-of-the-art models (OpenAI's o3-min, DeepSeek R1 and Anthropic's Claude-3.7-Sonnet) still fail to develop generalizable problem-solving capabilities, with accuracy ultimately collapsing to zero "beyond certain complexities."
But a new report by AI researchers, including former OpenAI employees, called " AI 2027," explains how the Great Unknown could, in theory, turn catastrophic in less than two years. The report is long and often too technical for casual readers to fully grasp. It's wholly speculative, though built on current data about how fast the models are improving. It's being widely read inside the AI companies.
It captures the belief — or fear — that LLMs could one day think for themselves and start to act on their own. Our purpose isn't to alarm or sound doomy. Rather, you should know what the people building these models talk about incessantly.
You can dismiss it as hype or hysteria. But researchers at all these companies worry LLMs, because we don't fully understand them, could outsmart their human creators and go rogue. In the AI 2027 report, the authors warn that competition with China will push LLMs potentially beyond human control, because no one will want to slow progress even if they see signs of acute danger.
The safe-landing theory: Google's Sundar Pichai — and really all of the big AI company CEOs — argue that humans will learn to better understand how these machines work and find clever, if yet unknown ways, to control them and " improve lives." The companies all have big research and safety teams, and a huge incentive to tame the technologies if they want to ever realize their full value.
Hashtags

Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles


Black America Web
4 minutes ago
- Black America Web
Donald Trump Stumbles On Air Force One Steps, Social Media Trolls Him With Old Man Jokes
Source: SAUL LOEB / Getty President Donald Trump's having a pretty stressful week. First, he had a very public spat with his former best friend, Elon Musk, on social media, and now he has fanned the flames of Los Angeles' immigration policy protests by deploying the National Guard. But if there's one thing he despises above all, weakness is probably up there, and nearly falling in public falls under that umbrella. It came after he faced a bunch of questions from the media about the Los Angeles uprising. He said that while there's no need to invoke the Insurrection Act currently, there are 'violent people,' a nd 'We are not going to let them get away with it.' He added, 'We are not going to let our country be torn apart like it was under Biden.' Ironically, the comment was made moments before his near tumble, as former President Joe Biden's steadiness on his feet was also a constant issue. Trump was in Hagerstown, Maryland, boarding Air Force One heading to Camp David, and while climbing the steps, he tripped and caught himself before falling over. Seconds later, Secretary of State Marco Rubio tripped while going up the steps, too. Biden's mental acuity was questioned due to his balance issues, brain fog, and being the eldest president ever at 82, and Trump used it against him, even nicknaming him sleepy Joe. 'Could we take a vote, please? Who wants to call him crooked Joe? Who wants to call him sleepy Joe? That's my problem, they work like the same,' Trump said at a National Republican Congressional Committee (NRCC) fundraising event in April. ' Joe had one ability that I didn't have. He could sit down on a beach and he could fall asleep. Who the hell could do that? I could never fall asleep under these circumstances, I would be very conscious of my body.' But now, the tables have turned, and 78-year-old Trump's mentions have been flooded with old jokes. See the reactions below. Donald Trump Stumbles On Air Force One Steps, Social Media Trolls Him With Old Man Jokes was originally published on Black America Web Featured Video CLOSE
Yahoo
4 minutes ago
- Yahoo
Marines arrive in LA under Trump orders as protests spread to other cities
By Brad Brooks, Jorge Garcia, Phil Stewart and Idrees Ali LOS ANGELES (Reuters) -Hundreds of U.S. Marines arrived in Los Angeles overnight and more were expected on Tuesday under orders from President Donald Trump, who has also activated 4,000 National Guard troops to quell protests despite objections from California Governor Gavin Newsom and other local leaders. The city has seen days of public outrage since the Trump administration launched a series of immigration raids on Friday, though local officials said the demonstrations on Monday were largely peaceful. About half of the roughly 700 Marines that Trump ordered to Los Angeles arrived on Monday night, and the remaining troops will enter the city on Tuesday, a U.S. official told Reuters. The U.S. military did not immediately respond to a request for comment. Los Angeles Mayor Karen Bass told KABC that more than 100 people had been arrested on Monday but that the majority of protesters were nonviolent. Over the weekend, protesters threw rocks and other objects at officers and vehicles and set several cars ablaze. Police responded by firing projectiles like pepper balls as well as flash bang grenades and tear gas. Trump has justified his decision to deploy active military troops to Los Angeles by describing the protests as a violent occupation of the city, a characterization that Newsom and Bass have said is grossly exaggerated. Newsom said that Trump's deployment of National Guard troops has only inflamed the situation and made it more difficult for local law enforcement to respond to the demonstrations. In a statement on Monday, Los Angeles Police Chief Jim McDonnell said the department had not been notified that any Marines were traveling to the city and that their possible arrival "presents a significant logistical and operational challenge" for police. Trump's decision to mobilize 700 Marines based in Southern California escalated his confrontation with Newsom, who filed a lawsuit on Monday asserting that Trump's deployment of Guard troops without the governor's consent was illegal. The Guard deployment was the first time in decades that a president activated the Guard absent a request from a sitting governor. While the Marines are only tasked with guarding federal property temporarily until the full contingent of 4,000 Guard troops arrives, the use of active military to respond to civil disturbances is extremely rare. "This isn't about public safety," Newsom wrote on X on Monday. "It's about stroking a dangerous President's ego." The top Democrat on the Senate Armed Services Committee, Senator Jack Reed, said he was "gravely troubled" by Trump's deployment of active-duty Marines. "Since our nation's founding, the American people have been perfectly clear: we do not want the military conducting law enforcement on U.S. soil," he said. In a post on Tuesday morning on Truth Social, Trump claimed Los Angeles would be "burning to the ground right now" if he had not deployed troops to the city. DEMONSTRATIONS AND ARRESTS The raids are part of Trump's sweeping immigration crackdown, which Democrats and immigrant advocates have said are indiscriminately breaking up families. U.S. Homeland Security Secretary Kristi Noem pledged on Monday to carry out more operations to round up suspected immigration violators. Trump officials have branded the protests as lawless and blamed state and local Democrats for protecting undocumented immigrants with sanctuary cities. Hundreds of demonstrators gathered on Monday outside a federal detention center in downtown Los Angeles where immigrants have been held, chanting "free them all" and waving Mexican and Central American flags. National Guard forces formed a human barricade to keep people out of the building, and late on Monday, police began dispersing the crowd using gas canisters and arrested some protesters. At dusk, officers had running confrontations with protesters who had scattered into the Little Tokyo section of the city. As people watched from apartment patios above street level and as tourists huddled inside hotels, a large contingent of LAPD and officers and sheriff's deputies fired several flash bangs that boomed through side streets along with tear gas. Protests spread to neighboring Orange County on Monday night after immigration raids there, with demonstrators gathering at the Santa Ana Federal building, according to local officials and news reports. Protests also sprang up in at least nine other U.S. cities on Monday, including New York, Philadelphia and San Francisco, according to local news reports. In Austin, Texas, police fired non-lethal munitions and detained several people as they clashed with a crowd of several hundred protesters.


Black America Web
4 minutes ago
- Black America Web
Doechii Slams Trump Administration In Powerful BET Awards Acceptance Speech
Source: Kevin Winter / Getty Doechii was all smiles as she accepted the 2025 BET Awards for 'Best Female Hip Hop Artist.' After all, it's the 'Anxiety' artist's first BET Award. But instead of a traditional acceptance speech, she used her platform to bring awareness to the peaceful protest outside the Peacock Theater, which is being forcefully interrupted by authorities. 'I do want to address what's happening right now, outside the building,' she said passionately.'These are ruthless attacks that are creating fear and chaos in our communities. In the name of law and order, Trump is using military forces to stop a protest, and I want you all to consider what kind of government it appears to be — when every time we exercise our democratic right to protest, the military is deployed against us.' Dozens of people have been detained and taken into custody during raids by Immigration and Customs Enforcement, prompting protests in the DTLA area, NBC News reports. 'People are being swept up and torn from their families, and I feel it is my responsibility as an artist to use this moment to speak up for all oppressed people,' she added. Per AP, an initial 2,000 Guard troops ordered by Trump started arriving Sunday, which saw the most violence during three days of protests driven by anger over Trump's stepped-up enforcement of immigration laws that critics say are breaking apart migrant families. These attacks on our civil liberties is more evidence of the Trump Administration's failure to the people. 'This isn't about public safety,' Gov. Gavin Newsom said. 'It's about stroking a dangerous President's ego.' SEE ALSO Doechii Slams Trump Administration In Powerful BET Awards Acceptance Speech was originally published on Black America Web Featured Video CLOSE