Amazon's AGI Lab Reveals Its First Work: Advanced AI Agents
Mar 31, 2025 9:00 AM Led by a former OpenAI executive, Amazon's AI lab focuses on the decision-making capabilities of next generation of software agents—and borrows insights from physical robots. The Amazon logo on the façade of one of their global headquarters. Photograph:Amazon is still seen as a bit of a laggard in the race to develop advanced artificial intelligence, but it has quietly created a lab that is now setting records when it comes to AI performance. Amazon's AGI SF Lab, which is located in San Francisco and dedicated to building artificial general intelligence, or AI that surpasses the capabilities of humans, revealed the first fruits of its work today: A new AI model capable of powering some of the most advanced AI agents available anywhere.
The new model, called Amazon Nova Act, outperforms ones from OpenAI and Anthropic on several benchmarks designed to gauge the intelligence and aptitude of AI agents, Amazon says. On the benchmarks GroundUI Web and ScreenSpot, Amazon Nova Act performs better than Claude 3.7 Sonnet and OpenAI Computer Use Agent. A major part of Amazon's plan to compete in the AI market is to focus on building agents, and the new model's abilities reflect its efforts to build a generation of tools that can measure up to the very best available.
'I believe that the basic atomic unit of computing in the future is going to be a call to a giant [AI] agent,' says David Luan, who leads Amazon's AGI SF Lab. He was previously a vice president of engineering at OpenAI and later cofounded Adept, a startup that pioneered work on AI agents, before joining Amazon in 2024 when the ecommerce giant took a stake in the company.
Most of the leading AI labs are now focused on building increasingly capable AI agents. Getting AI to master independent actions, as well as conversation, promises to make the technology more useful and valuable. The shift from chat to action is still very much a work in progress, however.
In the past six months, OpenAI, Anthropic, Google, and others have demonstrated web-browsing agents that take actions in response to a prompt. But for the most part, these agents are still unreliable, and they can easily be tripped up by open-ended requests.
Luan says that Amazon's goal is building AI agents that are dependable rather than flashy. The thing holding agents back is not the need for 'more cool demos of interesting capabilities that work 60 percent of the time, it's the Waymo problem,' he says, referring to how self-driving cars needed to be trained to deal with unusual edge cases before they could take to the streets unsupervised.
Many so-called agents are built by combining large language models with multiple human-written rules that are designed to prevent them from veering off course, but also makes their behavior brittle. Amazon Nova Act is a version of the company's most powerful homegrown model Amazon Nova that has received additional training to help it make decisions about what actions to take and at what time. In general, Luan says, AI models struggle to decide when they should intervene in a task.
To improve Nova's agential abilities, Amazon is using reinforcement learning, a method that has helped other AI models better simulate reasoning.
Amazon is also taking inspiration from physical robots with its new models. Laun's team is working with another group at Amazon based in San Francisco led by Pieter Abbeel, a professor at University of California, Berkeley who works on finding AI applications for robotics. Abbeel, a fellow early OpenAI employee, joined Amazon in August 2024 after it invested in his startup, Covariant. Amazon is well positioned to make progress in robotics given the vast numbers of those already deployed in its fulfillment centers.
The release of Amazon Nova Act suggests that Amazon could emerge as a dark horse in the race to create useful software agents. The company was slow in responding to ChatGPT, but it has more recently shown signs of getting its act together. In February, the company announced a new version of its voice assistant Alexa with improved conversational abilities as well as the capacity to automate certain web tasks.
One use case Amazon cited is Alexa helping to book a repair service for a broken oven. Luan says Alexa's new agentic capabilities were developed by his team.
As WIRED revealed last October, Amazon has also done research on how agents might eventually improve ecommerce by automating the process of finding and buying things. Such an agent might preemptively add items to a user's cart based on their interests and habits, Amazon's engineers said.
Besides unveiling the new model, Amazon today announced a software development kit (SDK) designed to make it easier for computer engineers to use Amazon Nova Act to build software agents. The SDK lets developers give their agent specific instructions to help them navigate an internet built for human users. For example, an agent can be instructed 'don't accept the insurance upsell' when booking a rental car.
Ultimately, Luan says, Amazon's agents should become smart enough not to fall for the upsell on their own. 'Nova Act is really like the very first step in that vision,' he says.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Business Insider
an hour ago
- Business Insider
Sam Altman says the energy needed for an average ChatGPT query can power a lightbulb for a few minutes
Altman was writing about the impact that AI tools will have on the future in a blog post on Tuesday when he referenced the energy and resources consumed by OpenAI's chatbot, ChatGPT. "People are often curious about how much energy a ChatGPT query uses; the average query uses about 0.34 watt-hours, about what an oven would use in a little over one second, or a high-efficiency lightbulb would use in a couple of minutes," Altman wrote. "It also uses about 0.000085 gallons of water; roughly one-fifteenth of a teaspoon," he continued. Altman wrote that he expects energy to "become wildly abundant" in the 2030s. Energy, along with the limitations of human intelligence, have been "fundamental limiters on human progress for a long time," Altman added. "As data center production gets automated, the cost of intelligence should eventually converge to near the cost of electricity," he wrote. OpenAI did not respond to a request for comment from Business Insider. This is not the first time Altman has predicted that AI will become cheaper to use. In February, Altman wrote on his blog that the cost of using AI will drop by 10 times every year. "You can see this in the token cost from GPT-4 in early 2023 to GPT-4o in mid-2024, where the price per token dropped about 150x in that time period," Altman wrote. "Moore's law changed the world at 2x every 18 months; this is unbelievably stronger," he added. Tech companies hoping to dominate in AI have been considering using nuclear energy to power their data centers. In September, Microsoft signed a 20-year deal with Constellation Energy to reactivate one of the dormant nuclear plants located in Three Mile Island. In October, Google said it had struck a deal with Kairos Power, a nuclear energy company, to make three small modular nuclear reactors. The reactors, which will provide up to 500 megawatts of electricity, are set to be ready by 2035. Google's CEO, Sundar Pichai, said in an interview with Nikkei Asia published in October that the search giant wants to achieve net-zero emissions across its operations by 2030. He added that besides looking at nuclear energy, Google was considering solar energy.
Business Insider
2 hours ago
- Business Insider
Sam Altman says the energy needed for an average ChatGPT query can power a lightbulb for a few minutes
OpenAI's CEO, Sam Altman, said the energy needed to power an average ChatGPT query can keep a lightbulb on for a few minutes. Altman was writing about the impact that AI tools will have on the future in a blog post on Tuesday when he referenced the energy and resources consumed by OpenAI's chatbot, ChatGPT. "People are often curious about how much energy a ChatGPT query uses; the average query uses about 0.34 watt-hours, about what an oven would use in a little over one second, or a high-efficiency lightbulb would use in a couple of minutes," Altman wrote. "It also uses about 0.000085 gallons of water; roughly one-fifteenth of a teaspoon," he continued. Altman wrote that he expects energy to "become wildly abundant" in the 2030s. Energy, along with the limitations of human intelligence, have been "fundamental limiters on human progress for a long time," Altman added. "As data center production gets automated, the cost of intelligence should eventually converge to near the cost of electricity," he wrote. OpenAI did not respond to a request for comment from Business Insider. This is not the first time Altman has predicted that AI will become cheaper to use. In February, Altman wrote on his blog that the cost of using AI will drop by 10 times every year. "You can see this in the token cost from GPT-4 in early 2023 to GPT-4o in mid-2024, where the price per token dropped about 150x in that time period," Altman wrote. "Moore's law changed the world at 2x every 18 months; this is unbelievably stronger," he added. Tech companies hoping to dominate in AI have been considering using nuclear energy to power their data centers. In September, Microsoft signed a 20-year deal with Constellation Energy to reactivate one of the dormant nuclear plants located in Three Mile Island. In October, Google said it had struck a deal with Kairos Power, a nuclear energy company, to make three small modular nuclear reactors. The reactors, which will provide up to 500 megawatts of electricity, are set to be ready by 2035. Google's CEO, Sundar Pichai, said in an interview with Nikkei Asia published in October that the search giant wants to achieve net-zero emissions across its operations by 2030. He added that besides looking at nuclear energy, Google was considering solar energy. "It was a very ambitious target, and we are still going to be working very ambitiously towards it. Obviously, the trajectory of AI investments has added to the scale of the task needed," Pichai said.
Business Insider
4 hours ago
- Business Insider
Starbucks (SBUX) Unveils New AI Assistant for Baristas That's Powered by Microsoft
Coffee making is going high tech. Confident Investing Starts Here: Starbucks (SBUX) is rolling out a new generative artificial intelligence (AI) assistant for its coffee baristas that's powered by Microsoft (MSFT) Azure's OpenAI platform. The AI assistant will initially be deployed in a trial at 35 Starbucks locations in the U.S. as part of a strategy to simplify baristas' jobs and speed-up service at the company's coffee shops. The global coffee chain showed off the new technology to more than 14,000 North American store managers at an event held in Las Vegas, Nevada on June 10. A broader rollout of what Starbucks is calling the 'Green Dot Assist' platform across the U.S. and Canada is slated to begin this autumn. News of the AI assistant comes as Starbucks tries to revive its sluggish sales under new CEO Brian Niccol. Improved Service Niccol has set a goal of improving Starbucks' service times to four minutes per order. The hope is that quick, accurate answers to barista questions will help speed-up service and improve quality at Starbucks locations. With the AI assistant, Starbucks' baristas will be able to use a tablet to get answers to questions such as how to make an iced espresso and troubleshoot equipment errors. As the AI assistant evolves, Starbucks has even bigger plans for its use, including automatically creating a ticket with information technology (IT) for equipment issues. Starbucks is expanding its relationship with Microsoft about a year after the tech giant's CEO Satya Nadella stepped down from Starbucks' board of directors. SBUX stock has risen 2% this year. Is SBUX Stock a Buy? The stock of Starbucks has a consensus Moderate Buy rating among 23 Wall Street analysts. That rating is based on 12 Buy and 11 Hold recommendations issued in the last three months. The average SBUX price target of $93.25 implies 1.99% upside from current levels.
