Ai2 unveils MolmoAct: Open-source robotics system reasons in 3D and adjusts on the fly
The Allen Institute for AI released a new AI robotics system that uses novel approaches to help robots navigate messy real-world environments, while making all of the model's code, data, and training methods publicly available under open-source principles.
The system, called MolmoAct, converts 2D images into 3D visualizations, previews its movements before acting, and lets human operators adjust those actions in real time. It differs from existing robotics models that often work as opaque black boxes, trained on proprietary datasets.
Ai2 expects the system to be used by robotics researchers, companies, and developers as a foundation for building robots that can operate in unstructured environments such as homes, warehouses, and disaster response scenes.
In demos last week at Ai2's new headquarters north of Seattle's Lake Union, researchers showed MolmoAct interpreting natural language commands to direct a robotic arm to pick up household objects, such as cups and plush toys, and move them to specific locations.
Researchers described it as part of AI2's broader efforts to create a comprehensive set of open-source AI tools and technologies. The Seattle-based research institute was founded in 2014 by the late Microsoft co-founder Paul Allen, and is funded in part by his estate.
Ai2's flagship OLMo large language model is a fully transparent alternative to proprietary systems, with openly available training data, code, and model weights, designed to support research and public accountability in AI development.
The institute's projects are moving in 'one big direction' — toward a unified AI model 'that can do reasoning and language, that can understand images, videos, that can control a robot, and that can make sense of space and actions,' said Ranjay Krishna, Ai2's research lead for computer vision, and a University of Washington Allen School assistant professor.
MolmoAct builds on AI2's Molmo multimodal AI model — which can understand and describe images — by adding the ability to reason in 3D and direct robot actions.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
New York Post
24 minutes ago
- New York Post
MTA doubles LIRR passenger seating at Grand Central Madison but passengers say there ‘should definitely be more'
Long Island-bound straphangers can finally take a load off. The MTA unveiled 70 new seats at Grand Central Madison's Long Island Rail Road mezzanine on Tuesday, effectively doubling the number of seats at the station. The scores of two-seat benches near 45th and 46th streets — available only to ticketed LIRR customers within a 90-minute window — bring the number of available seats in the station to 106, MTA reps said — and riders were quick to notice the new addition. 'They're not optimal, but they're pretty comfortable,' said Long Island-based chiropractor Randi Jaffe on Tuesday afternoon, pointing to the 'odd' curvature of the seats. 4 LIRR President Rob Free and Chief Customer Officer Shanifah Rieara announce new seating areas Tuesday on the mezzanine level of Grand Central Madison. LIRR 'It beats standing.' Jaffe, 53, who called the new benches 'fantastic,' added: 'It would be good if they had a back, just for support, but I imagine people aren't sitting on these benches for too long.' 4 Commuters sit on the new metal benches — without backs — at the newly-built Grand Central LIRR hub, designed for brief seating. Kevin C Downs forThe New York Post The station — which didn't have any seating when it opened in 2023 — began the rollout with 28 seats near 47th Street last October, with 14 seats at 45th Street and 28 seats at 46th Street installed this month, the MTA said. The expansion comes after a surge in LIRR ridership — with a record 1.72 million riders during the week of July 23 and an 89% return to pre-pandemic ridership numbers — and a resulting slew of customer feedback, LIRR President Rob Free said at a Tuesday press conference at the station. 'Improving the customer experience is one of our top priorities,' Free said. 4 Passengers waiting on benches at Grand Central Madison. Kevin C Downs forThe New York Post The seats are evidently already so much of a hit with some riders that there was already a resounding call for more. 'I think they're a good addition – I think there could be more of them. Otherwise there's no complaints,' said student Liam Hosey, 20, from Rockville Centre, who was sitting on the floor due to a lack of open seats. 'I was kind of dreading coming down here, not having anything to sit on,' said straphanger Megan Riley, 34. 'I think they're great.' 'There should definitely be more,' said CUNY worker Jean Ryan, 56. 'Especially for people who have mobility issues, and people who are in pain, who have arthritis.' Others, like 30-year-old health care worker Ashley, worried the seats could be taken over by homeless individuals without proper enforcement — but noted the armrest or divider used between seats 'kind of eliminates the possibility.' Another straphanger, Chris Conway of Vermont, refused to sit because of food scraps already soiling the brand-new seat. 4 New seating areas at Grand Central Madison, located on the mezzanine level at 45th and 46th Street. LIRR Despite obvious waste left behind on some of the new seats, the MTA argues customer satisfaction with the 'cleanliness' of the station is up one point from its Fall 2024 survey to 96%. 'Making sure the station is clean and well lit, clear signage as well as improved wayfinding and announcements that can certainly move the needle,' said MTA Senior Advisor for Communications and Policy Shanifah Rieara. Aside from more seats, MTA officials are working to usher in more retail to the terminal – a TRAX restaurant is poised to open at the end of the month, and the MTA is 'in the process of negotiating other leases,' Rieara said. 'We want Grand Central Madison to be a bustling terminal,' she added, 'just like our neighbors upstairs at Grand Central Terminal.'
San Francisco Chronicle
an hour ago
- San Francisco Chronicle
Kimball Electronics: Fiscal Q4 Earnings Snapshot
JASPER, Ind. (AP) — JASPER, Ind. (AP) — Kimball Electronics Inc. (KE) on Wednesday reported net income of $6.6 million in its fiscal fourth quarter. The Jasper, Indiana-based company said it had net income of 26 cents per share. Earnings, adjusted for one-time gains and costs, were 34 cents per share. The electronics manufacturing services company posted revenue of $380.5 million in the period. Kimball Electronics expects full-year revenue in the range of $1.35 billion to $1.45 billion. _____
USA Today
an hour ago
- USA Today
Does Olive Garden offer 25-cent wine samples? Yes, the rumors are true
What's better than free breadsticks? Breadsticks with free (or heavily discounted) wine, of course. Over the past week, rumors have circulated online that Olive Garden offers 25-cent wine samples to guests ages 21 and older. Some content creators have shared their experiences at their local Olive Garden locations, but understandably, some are skeptical. "I haven't been inside of Olive Garden for years because I don't like the quality of their food, but okay, Olive Garden did something with this 25-cent wine tasting. I was able to taste all the wine I was interested in," a content creator who goes by Kay's KK said in a recent TikTok video. In her video, she shows that she tried six wine samples for a total of about $1.60. So what's the deal – does Olive Garden offer wine for just a quarter? Does Olive Garden offer 25-cent wine samples? It's complicated. Olive Garden does offer complimentary 1-ounce samples of wine to guests 21 and up with their meal. In some states, this sample is free. But in other states, where free alcohol samples are not permitted, these start at 25 cents, Jaime Bunker, Olive Garden senior vice president of marketing, told USA TODAY. The samples aren't a full glass, though. In comparison to the 1-ounce sample, a traditional glass of wine is 5 ounces, according to New York-based wine retailer Millesima. How many 25-cent wine samples is one guest limited to? Guests are welcome to a "few" wine samples with their meal, Bunker said. She did not specify the exact number of samples a guest is limited to. Greta Cross is a national trending reporter at USA TODAY. Story idea? Email her at gcross@
