AI Research Company Tavus Debuts Hummingbird-0, Ushering in a New Era of Zero-Shot Lip Sync
SAN FRANCISCO--(BUSINESS WIRE)-- Tavus, a leading AI video research company backed by Sequoia, today announced the release of Hummingbird-0 into research preview, a zero-shot lip sync model created from components of its flagship Phoenix-3 replica model. Now, with just one video and any voice track, developers can bring faces to life—instantly—without model training or manual tweaking. This step up in quality opens the door to high-quality user-generated content, foreign language dubbing for localization, and personalized videos created at scale, in minutes.
Once developers get a taste of Hummingbird-0, they want to know more about what our entire family of models can do. Hummingbird-0 barely scratches the surface of our capabilities as we continue developing the human layer of AI. -- Hassaan Raza, Tavus CEO
Share
'Lip sync technology has been around for years, but until now, it's never really been great — open source or otherwise,' said Effie Goenawan, Head of Product at Tavus. 'With Hummingbird-0, we're giving developers access to a state-of-the-art lip sync model that unlocks an entirely new level of creative potential. It actually emerged as a happy accident while we were developing our full-face replica rendering model, Phoenix-3, and it's a testament to the brilliance and curiosity of our research team.'
Helping Content Creation Take Flight
The Hummingbird model is designed to modify the lip movements in a given video to match the content of a driving audio signal. The guiding principle is to preserve the original identity, expressions, and visual quality of the person in the video while synchronizing their lip movements with the new audio.
Notably, with Hummingbird-0, users can create content much faster because they don't have to train a model. All that's needed is a video of a person speaking–one already in existence or one created using a video generator like Veo or Kling. From making memes talk to instantly localizing thousands of B2B videos, Hummingbird-0 puts high-quality lip sync just an API call away.
'Text-to-video generation models have become enormously popular for content creation, but there is a problem in that the video is muted; there's no voice,' said Hassaan Raza, CEO of Tavus. 'We are adding that voice that can go on top of any video where there is a human. This serves as an enabler not just for more, different, or better content, but for new types of products and experiences altogether. Once developers get a taste of Hummingbird-0, they want to know more about what our entire family of models can do. Hummingbird-0 barely scratches the surface of our capabilities as we continue developing the human layer of AI.'
Hummingbird-0 specifically gives developers the tools to overcome challenges associated with video content creation. For example, it offers:
Scalable Personalization: Transform a single source video into thousands of personalized versions with different audio tracks, dramatically reducing production costs for marketing, educational, and localized content.
Editing Video Dialogue in Post: Build editing workflows into any video app. Users can update or adapt existing footage of dialogue using text or audio—no reshoots, no heavy post-production.
Integrate with Video Generation: Build an AI film studio. Add dialogue, the missing puzzle piece to videos generated by Sora, Veo, Runway, Kling, and more.
Efficient Content Repurposing: Leverage existing footage to generate new videos with updated messaging or corrections without costly reshoots or complex post-production workflows.
Unparalleled Performance
Hummingbird-0 is already demonstrating best-in-class performance in visual quality, lip sync accuracy, and identity preservation— outperforming all other lip sync models on the market. Because it was built using Phoenix-3 components, Hummingbird-0 yields state-of-the-art results. Tavus tested Hummingbird-0 against industry-leading zero-shot lip sync solutions, displaying:
Superior Visual Quality: FID score of 63.92 (37% better than closest competitor)
Strong Lip Synchronization: LSE-D score of 6.74 (7% better than closest competitor)
Exceptional Identity Preservation: Arcface score of 0.84 (7% better than closest competitor).
'The Tavus team was able to take an existing product and transform it into a complementary solution. By being nimble, knowledgeable, and committed to pushing the envelope through research, Tavus now enables developers to quickly and easily add native-quality voice to any video, unlocking limitless video editing possibilities,' added Goenawan.
Learn more about how Hummingbird-0 works here and find Hummingbird-0 on Tavus or FAL today.
About Tavus
Tavus is a market-leading generative AI video research company building foundational models and operating systems for human-AI interaction. Inspired by the human brain, Tavus' cognitive architecture enables developers to build hyper-realistic AI video agents that see, listen, and respond, bringing the human touch to digital experiences at scale. Its AI models and APIs power virtual humans for real-time conversations and lifelike video generation, transforming industries like education, healthcare, recruiting, marketing, sales, financial services, and more. Tavus' technology is used by Fortune 500 companies and innovative startups alike to create AI-driven experiences that feel truly engaging and interactive. Headquartered in San Francisco, Tavus is backed by Sequoia Capital, Scale Venture Partners, Y Combinator, HubSpot, and other leading investors.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
an hour ago
- Yahoo
YuJa Accessibility Platforms and Modules Accelerate European Accessibility Act Compliance as June 28 Deadline Approaches
SAN JOSE, Calif., June 06, 2025--(BUSINESS WIRE)--With just weeks until the European Accessibility Act (EAA) takes effect, YuJa, Inc., a leader in cloud platforms and applications for regulated sector clients, highlights how its proven accessibility solutions can help organizations streamline their compliance efforts and meet the Act's stringent requirements. The European Accessibility Act, which takes effect June 28, mandates that a wide range of products and services including websites, mobile applications, e-commerce platforms, e-banking services, digital content, and consumer electronics comply with accessibility requirements. The Act applies to all economic providers, public or private, providing products or services in the European Union, including companies outside the European Union that serve EU customers. The EAA aims to improve the functioning of the internal market for accessible products and services by removing barriers created by divergent rules in different member states, while also improving access for persons with disabilities and the elderly, the European Commission states online. "With the EAA deadline just weeks away, organizations need proven, scalable accessibility solutions that can help institutions deliver compliance quickly and effectively," said Nathan Arora, Chief Executive Officer at YuJa, Inc. "YuJa's comprehensive suite of accessibility platforms and modules was designed to help regulated sector organizations not only meet compliance requirements, but create truly inclusive digital experiences for all users." YuJa's portfolio of solutions provides organizations with the tools needed to achieve EAA compliance across their digital ecosystem: The YuJa Panorama LMS Accessibility Platform offers accessibility scanning, real-time remediation guidance, and comprehensive institutional reporting to help organizations identify and resolve accessibility barriers in their learning management systems and digital content. YuJa EqualGround Accessibility Governance Platform provides enterprise-wide accessibility monitoring, compliance tracking, and workflow management capabilities essential for maintaining ongoing EAA compliance across large organizations. The YuJa AutoPilot AI Remediation Module uses artificial intelligence to automatically remediate common accessibility issues at scale, significantly reducing the time and resources required to achieve compliance. The YuJa Structural Remediation Max Module enables organizations to efficiently remediate PDFs and other document formats to meet accessibility standards, addressing one of the most challenging aspects of digital accessibility compliance. ABOUT YUJA, INC. YuJa is a leader in cloud platforms and compliance applications for regulated sector clients including higher-ed, K12, healthcare, and government. We enable enterprises to deliver engaging and compliant media experiences. We have legal headquarters in Delaware with primary offices in Silicon Valley, California, and Toronto, Canada. Learn more at View source version on Contacts Hannah Johnson1-888-257-2278 Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Business Wire
an hour ago
- Business Wire
YuJa Accessibility Platforms and Modules Accelerate European Accessibility Act Compliance as June 28 Deadline Approaches
SAN JOSE, Calif.--(BUSINESS WIRE)--With just weeks until the European Accessibility Act (EAA) takes effect, YuJa, Inc., a leader in cloud platforms and applications for regulated sector clients, highlights how its proven accessibility solutions can help organizations streamline their compliance efforts and meet the Act's stringent requirements. The European Accessibility Act, which takes effect June 28, mandates that a wide range of products and services including websites, mobile applications, e-commerce platforms, e-banking services, digital content, and consumer electronics comply with accessibility requirements. The Act applies to all economic providers, public or private, providing products or services in the European Union, including companies outside the European Union that serve EU customers. The EAA aims to improve the functioning of the internal market for accessible products and services by removing barriers created by divergent rules in different member states, while also improving access for persons with disabilities and the elderly, the European Commission states online. "With the EAA deadline just weeks away, organizations need proven, scalable accessibility solutions that can help institutions deliver compliance quickly and effectively," said Nathan Arora, Chief Executive Officer at YuJa, Inc. "YuJa's comprehensive suite of accessibility platforms and modules was designed to help regulated sector organizations not only meet compliance requirements, but create truly inclusive digital experiences for all users." YuJa's portfolio of solutions provides organizations with the tools needed to achieve EAA compliance across their digital ecosystem: The YuJa Panorama LMS Accessibility Platform offers accessibility scanning, real-time remediation guidance, and comprehensive institutional reporting to help organizations identify and resolve accessibility barriers in their learning management systems and digital content. YuJa EqualGround Accessibility Governance Platform provides enterprise-wide accessibility monitoring, compliance tracking, and workflow management capabilities essential for maintaining ongoing EAA compliance across large organizations. The YuJa AutoPilot AI Remediation Module uses artificial intelligence to automatically remediate common accessibility issues at scale, significantly reducing the time and resources required to achieve compliance. The YuJa Structural Remediation Max Module enables organizations to efficiently remediate PDFs and other document formats to meet accessibility standards, addressing one of the most challenging aspects of digital accessibility compliance. ABOUT YUJA, INC. YuJa is a leader in cloud platforms and compliance applications for regulated sector clients including higher-ed, K12, healthcare, and government. We enable enterprises to deliver engaging and compliant media experiences. We have legal headquarters in Delaware with primary offices in Silicon Valley, California, and Toronto, Canada. Learn more at
Yahoo
2 hours ago
- Yahoo
Suffolk Releases White Paper to Accelerate Climate Tech Adoption in the Built World
White Paper addresses key challenges for adoption and offers owners, investors and practitioners thoughtful strategies for implementing climate technology solutions throughout the building process BOSTON, June 06, 2025--(BUSINESS WIRE)--Suffolk, one of the most innovative and successful builders in the country, has released a new white paper, "Accelerating Climate Tech Adoption in the Building Industry: A Framework for Owners, Investors, and Practitioners". The white paper offers practical, action-oriented approaches to the industry's pressing sustainability challenges, including ways for climate technologies to move beyond pilot projects and accelerate the adoption of proven technologies across entire portfolios. A key takeaway from the whitepaper includes a five-step framework for implementing climate tech solutions at scale throughout the entire construction process. The framework is based on discussions from the recently-held Climate Tech Forum which gathered startups, investors, contractors, designers and public officials to discuss common challenges and potential solutions. The building industry is at a critical stage for addressing climate variability. Nearly 40 percent of global greenhouse gas emissions are attributed to the construction and operation of buildings. The white paper discusses the role of stakeholders – including owners and developers; investors and financial stakeholders; architects and designers; and contractors and builders – in implementing climate solutions and technologies. Ultimately, the decision and ability to implement sustainable solutions is most critical in the early stages during the design and preconstruction phases of a project. As projects reach the construction phase, contractors and site teams often lack access or authority to implement new technologies, which creates a barrier to adoption. The white paper also addresses ways the building industry commitment to sustainability can be deepened from emerging trends such as advancements in AI and machine learning, particularly by enhancing energy efficiency and an emphasis on circular economy principles. "The construction industry faces a critical juncture to address its environmental impact through innovative technologies and practices," said Steven Burke, Senior Director of Sustainability at Suffolk. "Our new white paper provides a structured framework for implementing climate technologies that can not only improve our own projects but help transform standard practices across the entire industry." The white paper examines challenges and opportunities implementing climate technologies. While regulatory and policy frameworks continue to lag innovation, the research identifies significant opportunities for accelerating pilot approvals and creating knowledge-sharing platforms for successful implementations. The document also addresses persistent misconceptions about climate tech solutions as high-risk investments with prohibitive costs, demonstrating how these technologies can offer substantial savings across labor, logistics, and material lifecycle expenses when properly implemented. To accelerate adoption, the white paper proposes a five-step "adoption framework" focused on identifying viable climate tech solutions, strengthening cross-industry collaboration, establishing metrics for success, securing funding and scaling from pilots to industry standards. Through the collaboration and gathering of key stakeholder insights throughout the climate tech building lifecycle, Suffolk is leading the industry into a new phase of climate tech solution adoption that will help address the world's environmental challenges by leveraging economically-viable solutions. For more information and to download the complete white paper, visit here. About Suffolk TechnologiesSuffolk Technologies is a venture capital platform funding the next generation of companies solving built environment challenges. Led by Managing Partners Wan Li Zhu, Jit Kee Chin, and Puneet Mahajan, Suffolk Technologies invests in early and growth-stage startups transforming the built world across real estate and development, architecture, engineering and construction, property management, and smart cities. Leveraging Suffolk's expertise and broad network of industry leaders, Suffolk Technologies partners with visionary founders to accelerate industry-wide adoption of breakthrough innovations ranging from pre-product to growth stages. For more information about Suffolk Technologies' strategy and investments, visit About SuffolkSuffolk – America's Contractor – is a national company with more than $6.5 billion in annual revenue, 3,000 employees, and offices in Boston (headquarters); New York City and Westchester County, New York; Miami, West Palm Beach, Tampa and Estero in Florida; Dallas; Los Angeles, San Francisco and San Diego; Las Vegas; Portland, Maine; New Haven, Connecticut; Herndon, Virginia; and Salt Lake City. Suffolk manages some of the most complex, sophisticated projects in the country, serving clients in every major industry sector, including healthcare, life sciences, education, gaming, transportation/aviation, federal government and public work, mission critical, advanced technology and commercial. Suffolk is privately held and is led by Founder, Chairman and CEO John Fish. Suffolk is ranked #8 on ENR's list of "Largest Domestic Builders" and #10 on its list of "Top CM-at-Risk Contractors." For more information, visit and follow Suffolk on Facebook, Twitter, LinkedIn and YouTube. View source version on Contacts Media Contact: Dan Antonellisdantonellis@ +1 (617) 517-4232 Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
