Latest news with #CosmosTransfer-2
Hans India
6 days ago
- Business
- Hans India
Nvidia Unveils Cosmos Reason AI to Give Robots Human-Like Thinking and Planning Skills
Nvidia has taken a bold step toward the future of robotics with the introduction of Cosmos Reason AI, a next-generation reasoning vision language model (VLM) built to help robots think, plan, and act more like humans in the physical world. The 7-billion-parameter open and customizable model is tailored specifically for physical-world AI and robotics, offering far more than traditional VLMs. According to Nvidia, while models like OpenAI's CLIP excel at identifying objects and patterns, they often struggle with complex or ambiguous instructions. Cosmos Reason aims to bridge that gap by incorporating prior knowledge, physics-based understanding, and common sense reasoning—skills crucial for breaking down tricky commands into smaller steps, adapting to unfamiliar surroundings, and making deliberate, methodical choices. 'By combining AI reasoning with scalable, physically accurate simulation, we're enabling developers to build tomorrow's robots and autonomous vehicles that will transform trillions of dollars in industries,' said Rev Lebaredian, vice president of Omniverse and simulation technologies at Nvidia. Real-World Uses and Early Adoption The company says Cosmos Reason can handle a range of tasks including data curation and annotation, robot planning and reasoning, and video analytics. For instance, it could help automate the labeling of massive, varied datasets, serve as a robot's 'brain' integrating vision, language, and actions, or process huge volumes of video to extract insights or detect problems. Already, Nvidia's robotics and DRIVE teams are employing the technology for training data filtering and annotation. Major companies such as Uber, Magna, VAST Data, Milestone Systems, and Linker Vision are exploring its potential for applications like autonomous driving, delivery robots, traffic monitoring, industrial inspection, and safety enhancements. Nvidia notes that in autonomous vehicles, Cosmos Reason could add 'world understanding' to improve trajectory planning. Part of a Larger AI Ecosystem Cosmos Reason has been developed alongside Nvidia's Cosmos world foundation models (WFMs), which have been downloaded more than two million times. Alongside this launch, Nvidia introduced Cosmos Transfer-2, an upgraded synthetic data platform that streamlines photorealistic 3D scene creation. This improvement reduces the process from 70 steps to just one, enabling much faster AI training using Nvidia RTX PRO servers. Simulation and Hardware Boosts To support the new AI model, Nvidia has also rolled out updates to its Omniverse simulation platform, adding SDKs and libraries for industrial AI and robotics. New features include interoperability between MuJoCo (MJCF) and Universal Scene Description (OpenUSD), plus Omniverse NuRec libraries for 3D Gaussian splatting. In robotics simulation, Isaac Sim 5.0 and Isaac Lab 2.2—now open source on GitHub—come with integrated NuRec rendering. These tools are already being linked with simulators like CARLA for autonomous vehicle testing. On the hardware side, Nvidia unveiled RTX PRO Blackwell Servers, designed to handle unified robot development workloads, and expanded DGX Cloud availability on Microsoft Azure Marketplace for Omniverse developers. With Cosmos Reason AI, Nvidia is not just teaching robots to 'see' the world—it's training them to truly understand and navigate it with intelligence and adaptability.
Mint
6 days ago
- Business
- Mint
Nvidia just taught robots to think, roam, and simulate reality: Here's how
Ever wanted to see what an AI-powered robot 'thinks'? Nvidia just made that happen—pretty much. At this year's SIGGRAPH, they ripped the wraps off a suite of Cosmos world models and infrastructure designed specifically to bring physical AI to life. The attraction here is Cosmos Reason, a 7-billion-parameter reasoning vision-language model (VLM) that adds real-world physics and common sense to robotic decision-making. Think of it as giving robots a low-key IQ test: analyse an environment, break down a task, and plan its next move, all without getting lost in translation. Next in line is Cosmos Transfer-2, a synthetic data powerhouse for generating endless 3D scenes in varying lighting, textures, and weather. Perfect for training self-driving cars, drones, or warehouse bots, without touching the real world. The fast distilled version lets developers scale at speed. Alongside the models, Nvidia rolled out new neural reconstruction libraries for ultra-realistic scene building from sensor data. They've also plugged these into popular simulators like CARLA for immediate testing. On the hardware front, the RTX Pro Blackwell Server delivers raw power for training and simulation, while DGX Cloud opens the door to scalable AI deployment, no on-prem hardware required. This isn't just about fancier robots, it's about collapsing the gap between training and deployment. By giving AI systems both reasoning skills and a realistic virtual sandbox, Nvidia's ecosystem could accelerate everything from autonomous deliveries to industrial inspections. Expect faster prototyping, fewer real-world risks, and AI that can adapt to unpredictable environments before ever leaving the lab. Nvidia's Cosmos ecosystem brings reasoning, world-building, and deployment into one loop. If your AI project needs a brain, a playground, and a launchpad, this is it.
Yahoo
6 days ago
- Business
- Yahoo
Nvidia unveils new Cosmos world models, infra for robotics and physical uses
Nvidia on Monday unveiled a set of new world AI models, libraries, and other infrastructure for robotics developers, most notable of which is Cosmos Reason, a 7-billion-parameter 'reasoning' vision language model for physical AI applications and robots. Also joining the existing batch of Cosmos world models are Cosmos Transfer-2, which can accelerate synthetic data generation from 3D simulation scenes or spatial control inputs, and a distilled version of Cosmos Transfers that is more optimized for speed. During its announcement at the SIGGRAPH conference on Monday, Nvidia noted that these models are meant to be used to create synthetic text, image, and video datasets for training robots and AI agents. Cosmos Reason, per Nvidia, allows robots and AI agents to 'reason' thanks to its memory and physics understanding, which lets it 'serve as a planning model to reason what steps an embodied agent might take next.' The company says it can be used for data curation, robot planning, and video analytics. The company also unveiled new neural reconstruction libraries, which includes one for a rendering technique that lets developers simulate the real world in 3D using sensor data. This rendering capability is also being integrated into open source simulator CARLA, a popular developer platform. There's even an update to the Omniverse software development kit. There are new servers for robotics workflows, too. The Nvidia RTX Pro Blackwell Server offers a single architecture for robotic development workloads, while Nvidia DGX Cloud is a cloud-based management platform. These announcements come as the semiconductor giant is pushing further into robotics as it looks toward the next big use case for its AI GPUs beyond AI data centers. We're always looking to evolve, and by providing some insight into your perspective and feedback into TechCrunch, you can help us! Fill out this survey to let us know how we're doing.
