Adobe Firefly adds AI sound & video tools to boost creativity
New sound effects generation
The new Generate Sound Effects (beta) feature allows users to create bespoke sound effects either by entering a text prompt or using their voice. This tool is designed to enable creators to easily add custom audio elements that fit the emotional and atmospheric requirements of their videos. According to the company, Firefly listens to the timing and energy of the user's voice input to match the action in the corresponding video, providing more cinematic alignment between audio and visuals.
"Sound is a powerful storytelling tool that adds emotion and depth to your videos. Generate Sound Effects (beta) makes it easy to create custom sounds, like a lion's roar or ambient nature sounds, that enhance your visuals. And like our other Firefly generative AI models, Generate Sound Effects (beta) is commercially safe, so you can create with confidence. Just type a simple text prompt to generate the sound effect you need. Want even more control? Use your voice to guide the timing and intensity of the sound. Firefly listens to the energy and rhythm of your voice to place sound effects precisely where they belong - matching the action in your video with cinematic timing," the company said.
Expanded partner ecosystem
Firefly has broadened its partner ecosystem to include additional generative AI models. Users now have access to Moonvalley's Marey, Google's Veo 3 (with audio), and Runway's Gen-4 Video, allowing a greater range of creative options in video style and production without requiring users to move between different applications or workflows. Additional models from Topaz Labs and Luma AI are scheduled to become available soon in Firefly Boards and Generate Video.
The company stated, "Creatives enjoy experimenting with different styles, so we're continuously expanding the models we offer inside the Firefly app. Recently, we added Runway's Gen-4 Video and Google Veo3 with Audio to Firefly Boards and Veo3 with Audio in Generate Video. And there are more partner models coming soon to the Firefly app: Topaz Labs' Image and Video Upscalers and Moonvalley's Marey will be launching soon in Firefly Boards. Luma AI's Ray 2 and Pika 2.2, which are already available in Boards, will soon be added to Generate Video."
Enhanced video controls
Firefly has released advanced video controls that give users the ability to direct specific aspects of composition, pacing and style on a frame-by-frame basis. The app now supports flexible aspect ratio selection - vertical, horizontal, or square - streamlining the creation process for multiple formats such as mobile, widescreen, or social content.
Among the new tools is Composition Reference for Video, which enables creators to upload a reference video and a description, from which Firefly generates new content that maintains the original's visual structure. This is particularly helpful for repurposing content or maintaining consistency across scenes. The Style Presets tool allows users to apply visual styles such as claymation, anime, or line art with a single click, expediting the setting of tone for pitches, briefs, or final productions.
Keyframe Cropping provides an intuitive solution for managing framing transitions. Users set the initial and final frames and the intended crop, and Firefly handles the video generation to fit the format, aiming to make the entire process efficient without exiting the creative workflow. Composition Reference, Style Presets, and Keyframe Cropping are built to give you more control, more speed, and more creative freedom. And they're just the beginning. Even more enhancements are on the way to help you push your storytelling further.
Text to avatar and prompt enhancement
Firefly has also launched Text to Avatar (beta), which enables creators to generate avatar-led videos from scripts with a few clicks. The tool offers a library of avatars, customisable backgrounds, and a selection of accents to match the desired tone or audience.
The company said, "With Text to avatar (beta), you can turn your scripts into engaging, avatar-led videos in just a few clicks. Choose from a diverse library of avatars, customise your background with a colour, image, or video, and select the accent that best fits your video. Firefly handles the rest." The tool is being used for video lessons, transforming written content for social media, and creating internal training materials with a virtual presenter.
Recognising the challenges some users face in crafting prompts, the new Enhance Prompt feature in Generate Video takes user input and augments it for greater clarity and direction, reducing the time spent refining prompt language.
Commercial safety and creative rights
Adobe maintains that all generative AI models within Firefly are trained only on assets for which it holds the appropriate permissions. The company emphasises that user-generated content within Firefly will not be used for further model training, aiming to respect and protect creator rights.
A user guide and best practice tutorials are available to help users get started quickly and to assist with optimising their creative processes within the Firefly platform.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Techday NZ
01-08-2025
- Techday NZ
Adobe launches collaborative AI film project to empower creators
Adobe has announced The Unfinished Creator Film, a collaborative project encouraging creators from around the world to contribute to a single, evolving short film using generative artificial intelligence tools via the Adobe Firefly platform. The Unfinished Creator Film provides filmmakers, designers and storytellers access to Firefly's AI capabilities, enabling them to work together iteratively and express their unique artistic visions. Adobe collaborated on this initiative with multiple creatives, including AI artist and director Sam Finn, to explore possibilities for community-driven storytelling in a digital landscape. Collaboration at its core The project is described as "a remixable film started by one and completed by many", highlighting its open, collaborative model. Adobe highlights Firefly's role in supporting creative freedom, positioning it as an environment where participants across disciplines - including animators, sound designers and those new to filmmaking - can contribute their own interpretations to an unfinished film sequence. "It used to take years of learning - and a lot of money - to make a film. Now anyone with a vision can start. I'm excited to see what creators from non-traditional backgrounds will make when those barriers fall away. That's what The Unfinished Film is about: opening the door for new voices and unexpected perspectives." -Sam Finn, director of The Unfinished Film project The ethos of the initiative is to "turn unfinished into unforgettable" by allowing each participant to remix or reshape the original film using a set of digital tools. The process leverages Firefly's image and video generation technology, familiar to experienced users of Adobe products such as Photoshop, Premiere and Lightroom, while extending its use to a broader creative community. AI as collaborator, not creator Adobe's message underlines the use of AI as a tool to enhance - not replace - human creativity. Participants can use Firefly for ideation, mood boarding, as well as for producing final audio, video, or effects, with each AI-generated asset carrying direct attribution via Content Credentials, supporting transparency and control for the original creators. Sam Finn describes the transformation AI has brought to the creative process: "Before AI, creativity felt like a tradeoff - your imagination was shaped by time, tools, and complexity. With Firefly and generative tools, I can now create exactly what I envision, almost as quickly as I think it. For the first time, filmmaking feels like a stream-of-consciousness art form" -Sam Finn, director of The Unfinished Film project Adobe's campaign invites participants to download the starter sequence created by Finn and to apply Firefly's suite of features to put their own mark on the story, remixing and sharing their versions within the larger creative community. Contributions are then highlighted alongside tips and behind-the-scenes content from the original artists on Adobe's digital channels. Contributors' perspectives To demonstrate the range of outcomes achievable with this approach, Adobe has partnered with four creators: VFX artist Phil Cohen, creative director Noémie Pino, cinematographer Keenan Lam, and designer Jad Kassis. Each used Firefly to tailor Finn's original sequence to their own aesthetic and storytelling preferences. Noémie Pino combined claymation techniques with digital compositing using Firefly, Photoshop and After Effects. "I've always loved the tangible feel of clay, but the process is incredibly time-consuming - I never imagined I'd be able to bring it to life like this. With Firefly, Photoshop and After Effects I could blend the handcrafted with the digital and turn seconds of motion into something that feels real and emotionally textured." - Noémie Pino Phil Cohen, a creative director known for integrating fashion and visual effects, commented on the accessibility offered by AI tools: "We're entering a new era where imagination doesn't have to wait on budget or big teams. With tools like Firefly, designers can direct, photographers can animate - creativity becomes immediate and accessible. This project is a glimpse of what's next." -Phil Cohen Jad Kassis focused on how AI-driven workflows accelerated the pace of idea execution: "Firefly changed how I use time. What once took days now takes minutes - so I can chase ideas while they're still alive, still emotional. I'm not just designing frames; I'm directing fleeting moments before they disappear." -Jad Kassis Keenan Lam, both a creator and resource developer for digital tools, explored Firefly from the perspective of a cinematographer: "As someone who's spent years behind the camera, I've always been a perfectionist - so the idea of giving up control to AI was intimidating at first. But this project challenged me in the best way. I realised generative tools like Firefly can extend my creativity, not replace it. They unlock shots and transitions I couldn't easily achieve on my own." -Keenan Lam The Unfinished Creator Film is positioned as an ongoing, collaborative project designed to showcase and test the boundaries of creative engagement between human creators and AI technology within a globally accessible digital framework.
Techday NZ
18-07-2025
- Techday NZ
Adobe Firefly adds AI sound & video tools to boost creativity
Adobe Firefly has introduced a suite of new tools and partner models to streamline AI-driven video production and editing, emphasising flexibility, precision, and creative control for content creators. New sound effects generation The new Generate Sound Effects (beta) feature allows users to create bespoke sound effects either by entering a text prompt or using their voice. This tool is designed to enable creators to easily add custom audio elements that fit the emotional and atmospheric requirements of their videos. According to the company, Firefly listens to the timing and energy of the user's voice input to match the action in the corresponding video, providing more cinematic alignment between audio and visuals. "Sound is a powerful storytelling tool that adds emotion and depth to your videos. Generate Sound Effects (beta) makes it easy to create custom sounds, like a lion's roar or ambient nature sounds, that enhance your visuals. And like our other Firefly generative AI models, Generate Sound Effects (beta) is commercially safe, so you can create with confidence. Just type a simple text prompt to generate the sound effect you need. Want even more control? Use your voice to guide the timing and intensity of the sound. Firefly listens to the energy and rhythm of your voice to place sound effects precisely where they belong - matching the action in your video with cinematic timing," the company said. Expanded partner ecosystem Firefly has broadened its partner ecosystem to include additional generative AI models. Users now have access to Moonvalley's Marey, Google's Veo 3 (with audio), and Runway's Gen-4 Video, allowing a greater range of creative options in video style and production without requiring users to move between different applications or workflows. Additional models from Topaz Labs and Luma AI are scheduled to become available soon in Firefly Boards and Generate Video. The company stated, "Creatives enjoy experimenting with different styles, so we're continuously expanding the models we offer inside the Firefly app. Recently, we added Runway's Gen-4 Video and Google Veo3 with Audio to Firefly Boards and Veo3 with Audio in Generate Video. And there are more partner models coming soon to the Firefly app: Topaz Labs' Image and Video Upscalers and Moonvalley's Marey will be launching soon in Firefly Boards. Luma AI's Ray 2 and Pika 2.2, which are already available in Boards, will soon be added to Generate Video." Enhanced video controls Firefly has released advanced video controls that give users the ability to direct specific aspects of composition, pacing and style on a frame-by-frame basis. The app now supports flexible aspect ratio selection - vertical, horizontal, or square - streamlining the creation process for multiple formats such as mobile, widescreen, or social content. Among the new tools is Composition Reference for Video, which enables creators to upload a reference video and a description, from which Firefly generates new content that maintains the original's visual structure. This is particularly helpful for repurposing content or maintaining consistency across scenes. The Style Presets tool allows users to apply visual styles such as claymation, anime, or line art with a single click, expediting the setting of tone for pitches, briefs, or final productions. Keyframe Cropping provides an intuitive solution for managing framing transitions. Users set the initial and final frames and the intended crop, and Firefly handles the video generation to fit the format, aiming to make the entire process efficient without exiting the creative workflow. Composition Reference, Style Presets, and Keyframe Cropping are built to give you more control, more speed, and more creative freedom. And they're just the beginning. Even more enhancements are on the way to help you push your storytelling further. Text to avatar and prompt enhancement Firefly has also launched Text to Avatar (beta), which enables creators to generate avatar-led videos from scripts with a few clicks. The tool offers a library of avatars, customisable backgrounds, and a selection of accents to match the desired tone or audience. The company said, "With Text to avatar (beta), you can turn your scripts into engaging, avatar-led videos in just a few clicks. Choose from a diverse library of avatars, customise your background with a colour, image, or video, and select the accent that best fits your video. Firefly handles the rest." The tool is being used for video lessons, transforming written content for social media, and creating internal training materials with a virtual presenter. Recognising the challenges some users face in crafting prompts, the new Enhance Prompt feature in Generate Video takes user input and augments it for greater clarity and direction, reducing the time spent refining prompt language. Commercial safety and creative rights Adobe maintains that all generative AI models within Firefly are trained only on assets for which it holds the appropriate permissions. The company emphasises that user-generated content within Firefly will not be used for further model training, aiming to respect and protect creator rights. A user guide and best practice tutorials are available to help users get started quickly and to assist with optimising their creative processes within the Firefly platform.
Techday NZ
10-07-2025
- Techday NZ
Adobe brings AI-powered creative tools to Premier League fans
Adobe has announced a multi-year global partnership with the Premier League as its Official Creativity Partner and Digital Fan Experience Partner, introducing new technology and tools to enhance how fans interact with the League digitally. This partnership is designed to integrate Adobe's digital creativity and marketing technology into the Premier League's fan engagement platforms, with a focus on delivering personalised content and creative opportunities to a global fanbase of 1.8 billion. Digital integration Adobe Express, which features the Firefly generative AI toolset, will be incorporated into the Premier League app and website before the start of the 2025/26 Fantasy Premier League season. This will allow fans to design and share customised kits, badges, and other content using exclusive Premier League-themed templates. Adobe's Firefly AI is described as being commercially safe, trained solely on licensed and public domain content. The integration of Adobe Express will enable users to utilise features such as Generate Video, Clip Maker, Insert, and Remove Object, providing a suite of tools aimed at allowing fans to express their creativity and connect more personally with the sport. These features allow users to generate images and videos from text prompts, create highlight clips for social media, and edit photos directly within the app. Personalised fan experiences The partnership will also see the deployment of Adobe's enterprise technology, including Adobe Real-Time Customer Data Platform, Adobe Journey Optimizer, Adobe Customer Journey Analytics, and Adobe GenStudio for Performance Marketing, to enable the Premier League to deliver tailored content and match alerts based on individual fan preferences and behaviours. These capabilities aim to support the Premier League's digital transformation, creating a more connected understanding of fan needs by gathering data from across its digital ecosystem. This data-driven approach is expected to enrich the fan experience and improve engagement through the delivery of relevant news, match updates, and marketing content. Official statements "Adobe AI technology is empowering passionate fans to shape how they experience and share the unrivalled drama of matchday, through real-time news updates and fan-created content that stands out on social media, thanks to the creative magic of Adobe Express - the quick and easy content creation app," said Rachel Thornton, CMO, Enterprise at Adobe. "Bringing the power of Adobe to the most watched football league in the world, fans have new AI-powered ways to engage and experience the moments that matter, and the creative capabilities to express their love of the game." Will Brass, Chief Commercial Officer at the Premier League, said: "The Premier League is followed by millions of fans around the world – all of whom have very different reasons for doing so. Adobe is a global leader in digital experiences and creativity, and this exciting partnership provides us with the tools to better understand and deliver what our fans need and want digitally, ensuring we can provide the best of the Premier League directly to them. Our partnership aims to enrich the fan experience and providing them with new creative ways to express their passion for the league." Expanded capabilities In addition to creative tools, Adobe's marketing and analytics platforms will support the Premier League in creating on-brand marketing campaign content at scale using generative AI, enabling digital marketing teams to deliver campaigns that are both high quality and personalised. The technology also facilitates the delivery of timely news alerts and real-time updates via push notifications, tailored to each fan's settings. Variables such as geolocation and behavioural insights can trigger personalised messaging, such as location-based notifications when a fan enters a stadium or performance highlights for Fantasy Premier League team managers. Focus on engagement and loyalty Adobe Customer Journey Analytics and its Data Insights Agent will provide the Premier League with further insights into how fans interact with content across platforms, helping to identify which types of content drive loyalty and engagement. This approach will allow for more targeted fan outreach, such as serving video clips focused on fans' favourite players. The partnership aims to give fans greater creative agency and enhance connections between the League and its supporters, aligning with the Premier League's ongoing efforts to engage a diverse and global audience.
