Alibaba introduces open-source model for video creation and editing
Alibaba has unveiled Wan 2.1-VACE (Video All-in-one Creation and Editing), its latest open-source model for video creation and editing. This innovative tool combines multiple video processing functions into a single model, to streamline the video creation process, boosting efficiency and productivity.
As part of Alibaba's video generation large model – the Wan2.1 series – VACE is the first open-source model in the industry to provide a unified solution for various video generation and editing tasks.
Wan2.1-VACE supports video generation with multi-modal inputs spanning text, image, and video while offering creators comprehensive video editing capabilities. These editing features include referencing images or frames, video repainting, modifying selected areas of the video and spatio-temporal extension, all of which enable the flexible combination of various tasks to enhance creativity.
With this advanced tool, users can generate video containing specific interacting subjects based on image samples and bring static images to life by adding natural movement effects. They can also enjoy advanced video repainting functions such as pose transfer, motion control, depth control, and recolorization.
The model also supports adding, modification or deletion to selective specific areas of a video without affecting the surroundings. It also allows for the extension of video boundaries while intelligently filling in content to enrich the visual experience.
As an all-in-one AI model, Wan2.1-VACE delivers unparalleled versatility, enabling users to seamlessly combine multiple functions and unlock innovative potential. Users can turn a static image into video while controlling the movement of objects by specifying the motion trajectory. They can seamlessly replace characters or objects with specified references, animate referenced characters, control poses, and expand a vertical image horizontally to create a horizontal video while adding new elements through referencing.
Innovative Technologies
Wan2.1-VACE leverages several innovative technologies, to take into account the needs of different video editing tasks during construction and design. Its unified interface, called Video Condition Unit (VCU), supports unified processing of multimodal inputs such as text, images, video, and masks.
The model employs a Context Adapter structure that injects various task concepts using formalized representations of temporal and spatial dimensions. This innovative design enables it to flexibly manage a wide range of video synthesis tasks.
Thanks to advancements in model architecture, Wan2.1-VACE can be widely applied in the rapid production of social media short videos, content creation for advertising and marketing, post-production and special effects processing in film and television, and for educational training video generation.
Training video foundation models requires immense computing resources and vast amounts of high-quality training data. Open access helps lower the barrier for more businesses to leverage AI, enabling them to create high-quality visual content tailored to their needs, quickly and cost-effectively.
Alibaba is open-sourcing the Wan2.1-VACE model in two versions; a 14-billion(B)-parameter and a 1.3-billion(B)-parameter. The models are available to download for free on Hugging Face and GitHub, as well as Alibaba Cloud's open-source community, ModelScope.
As one of the earliest major global tech companies to open source its self-developed large-scale AI models, Alibaba open sourced four Wan2.1 models in February 2025 and, last month, a video generation model that supports video creation with start and end frames. To date, the models have attracted over 3.3 million downloads on Hugging Face and ModelScope.
About Alibaba Group
Alibaba Group's mission is to make it easy to do business anywhere. The company aims to build the future infrastructure of commerce. It envisions that its customers will meet, work and live at Alibaba, and that it will be a good company that lasts for 102 years. www.alibabagroup.com
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Al Etihad
14 hours ago
- Al Etihad
China vice premier to meet US delegation for trade talks: Beijing
7 June 2025 23:12 Beijing (AFP)Chinese Vice Premier He Lifeng will meet a US delegation for talks next week in Britain, Beijing announced on Saturday amid a fragile truce in the trade dispute between the two will visit the United Kingdom from June 8 to 13 at the invitation of the British government, China's foreign ministry said in a said He and American representatives will co-chair the first meeting of the China-US economic and trade consultation President Donald Trump had already announced on Friday that a new round of trade talks with China would kick off in London beginning Monday, after he spoke by phone with Chinese counterpart Xi Jinping in a bid to end a bitter battle over posted on his Truth Social platform that Treasury Secretary Scott Bessent, Commerce Secretary Howard Lutnick and US Trade Representative Jamieson Greer would meet the Chinese discussions will mark the second round of such negotiations between the world's two biggest economies since Trump launched his trade war shortly after returning to the White House in January.A first meeting, held in mid-May in Geneva, brought a pause to the US-China trade Thursday the Republican president finally discussed the issues with Xi for the first time since the trade tensions soared, assuring that the conversation had been positive. Xi for his part told Trump the two should "correct the course" of bilateral relations, according to remarks quoted by official Chinese media.
Zawya
16 hours ago
- Zawya
IntelliDent AI and Woxsen University forge strategic alliance to advance AI research, leadership & innovation in healthcare
IntelliDent AI, a Dubai-based healthtech company at the forefront of artificial intelligence solutions in dentistry, has signed a Memorandum of Understanding (MoU) with Woxsen University's AI Research Centre, Hyderabad, India. The five-year strategic partnership aims to drive collaborative innovation through joint research, live project exposure, and advanced technical training. This collaboration is designed to fuel co-innovation, AI-driven entrepreneurship, and cutting-edge research in digital healthcare. Under this agreement, IntelliDent AI and Woxsen University will engage in joint academic-industry initiatives focused on AI-driven healthcare solutions, consultancy-based projects, and the commercialization of technology innovations. The MoU outlines cooperation in the following key areas: Real-World AI Projects: IntelliDent will provide students from Woxsen's AI Research Centre hands-on exposure to live, real-time projects from the healthcare domain—preparing them to address real-world challenges with AI-driven solutions. Joint Research & Publications: Both institutions will collaborate on research grants, white papers, product prototypes, and academic publications that shape the future of medical technology. Entrepreneurship & Product Commercialization: Special focus will be placed on developing products from ideation to market readiness, with guidance on building startups and commercializing AI health tech solutions. Cross-Training & Knowledge Exchange: Faculty and industry professionals will exchange expertise in best practices, fostering a culture of mutual growth and continuous innovation. Strategic Awareness Initiatives: Co-hosted awareness programs, leadership bootcamps, and innovation challenges will promote ethical AI, responsible leadership, and entrepreneurship across emerging markets. Speaking on the occasion, Mr. Affaan Shaikh, Founder and CEO of IntelliDent AI, stated: 'This MoU with Woxsen isn't just about technology, it's about inspiring a generation of AI leaders who blend deep tech knowledge with entrepreneurial thinking and purpose-driven leadership. By embedding awareness, education, and innovation into every layer of this partnership, we are not only building smarter healthcare systems, but also empowering future changemakers.' The MoU was signed by Dr. Raul V. Rodriguez, Vice President of Woxsen University, and Mr. Affaan Shaikh, with oversight by Dr. Hemachandran K, Director of the AI Research Centre, and Mr. Khalid Shaikh, Advisor to IntelliDent AI. This milestone underscores IntelliDent AI's commitment to shaping global talent in healthcare AI and highlights Woxsen's ongoing mission to blend business, technology, and innovation through meaningful industry collaborations. Together, IntelliDent AI and Woxsen University are setting the foundation for impactful, future-forward education —where research, leadership, and real-world problem-solving converge.
Gulf Today
18 hours ago
- Gulf Today
Asian equities see largest monthly foreign inflow in 15 months
Asian equities attracted strong foreign inflows in May as concerns over an immediate economic hit from higher US tariffs eased, prompting a return by investors who had previously exited large and concentrated positions in the region. The inflows marked a sharp reversal after four consecutive months of net foreign selling. According to data from LSEG, foreign investors bought approximately $10.65 billion worth of equities across India, Taiwan, South Korea, Thailand, Indonesia, Vietnam, and the Philippines, registering their largest monthly net purchase since February 2024. US President Donald Trump's announcement of reciprocal tariffs in early April stoked concerns over the impact on Asian exports, exporter margins, and regional supply chains, but a subsequent 90-day pause for most countries later in the month helped ease investor fears and revive interest in regional assets. Goldman Sachs said it has revised its earnings growth forecast for MSCI Asia Pacific ex-Japan (MXAPJ) to 9 per cent for both 2025 and 2026, raising estimates by 2 and 1 percentage points, respectively, citing stronger macro growth in China and US-exposed markets. The upgrade was also supported by $600 billion in AI-related investments from Saudi Arabia to US firms, which are expected to benefit Taiwan and Korea, though the impact may be partially offset by a weaker dollar, the brokerage said. Taiwan equities witnessed $7.28 billion worth of foreign inflows, the largest monthly cross-border net purchase since November 2023. Foreigners also acquired a significant $2.34 billion worth of Indian stocks in their largest monthly net purchase since September 2024. South Korean, Indonesian and Philippine stocks also saw foreign inflows worth a net $885 million, $338 million and $290 million, respectively, while Thai stocks suffered $491 million of net selling. Despite heightened market volatility in the first half of the year driven by concerns over President Trump's trade policies, the MSCI Asia-Pacific Index has risen about 8.8 per cent year-to-date, outperforming both the MSCI World Index, which is up 5.4 per cent, and the S&P 500 Index, which has gained 0.98 per cent. Asian currencies were steady on Friday and poised for weekly gains after a phone call between US President Donald Trump and Chinese leader Xi Jinping signalled further trade talks, while most regional equities tracked Wall Street's overnight losses. In India, equities reversed course to rise 0.9 per cent after the Reserve Bank of India delivered a larger-than-expected cut to its key repo rate and lowered the cash reserve ratio to bolster economic growth. 'The RBI may have decided to move quickly to a more appropriate policy rate level. A shift towards neutral stance means more rate cuts may be unlikely in the near-term,' Jeff Ng, Head of Asia Macro Strategy at SMBC, said. The rupee inched up 0.1 per cent to 85.74 per dollar. Other regional currencies moved within a narrow band. The Thai baht and Singapore dollar were largely flat but were on track for weekly gains of 0.5 per cent and 0.4 per cent, respectively. The Malaysian ringgit was up nearly 0.6 per cent for the week. MSCI's index of emerging market currencies was flat after touching an all-time high on Thursday. The index is up 0.5 per cent for the week. The dollar index was little changed, after hitting a six-week low on Thursday, and was headed for a weekly loss of 0.5 per cent. Trump's erratic tariff moves and a worsening US fiscal outlook have triggered a flight from the dollar, prompting analysts to expect most emerging market currencies will retain or build on their gains over the next six months. In their closely watched hour-long phone call on Thursday, Xi pressed Trump to ease trade tensions that have rattled the global economy and warned against provocative moves on Taiwan, according to a summary released by the Chinese government. But Trump said on social media that the talks, focused primarily on trade, led to 'a very positive conclusion'. 'The talks look positive, and coupled with Federal Reserve rate cut expectations due to weak US data, might lead to further USD softening,' said Saktiandi Supaat, Head of FX research at Maybank. Markets are now bracing for the US jobs and non-farm payrolls report due later in the day, with concerns that a downside surprise could stoke stagflation fears and boost pressure on the Federal Reserve to quickly ease policy. Reuters
