Meta, the parent company of Facebook and Instagram, has revealed new capabilities in creating and editing content based on artificial intelligence (AI), and announced: Emu Edit for photo editing and Emu Video for video creation.
The company developed both tools as part of the Expressive Media Universe (Emu) project.
Emu Edit: A new level of creating image from text with AI
Emu Edit allows users to input text instructions to make changes to images. The tool can perform a variety of editing tasks such as adding or removing backgrounds, color and geometry changes, object identification and replacement, and more.
“The main goal should not just be to generate a believable image,” Meta researchers emphasized in their latest announcement. “Instead, the model should focus on precise changes only to the relevant pixels as requested for editing.”
Emu Edit was trained on a vast dataset consisting of 10 million synthetic samples, making it capable of providing high-quality results. For example, a user can input the text “I love basketball!” to an image of a hat, and Emu Edit will perform the task without altering the hat itself. To see examples of how it works, click here >> Emu Edit
Emu Video: Simplifying text-to-video production
In addition to photo editing, Meta’s AI team also worked on video creation. The Emu Video tool, based on diffusion models, provides a simple capability for text-to-video creation. The video creation process involves generating an image based on text guidance, followed by creating a video based on that image and additional text guidance. If you want to try out the new editing tool Emu Video, click here >> Emu video
With these new tools, the next time you want to create a GIF or edit your images, you can do so without relying on complex tools like Photoshop and edit the image yourself with text guidance, and AI will work its magic.
Launches based on Meta’s social strategy
The launches of Emu Video and Emu Edit are also based on Meta’s strategy to drive engagement across all its app family. By enabling editing and creation within the platform, Meta keeps users more and more within its social ecosystem. It is important to note that these tools are still in development, and no official announcement has been made regarding when they will be available on platforms like Facebook and Instagram. Meta stated that defense mechanisms remain a top priority amid rapid advancements in AI.
Emu Video and Emu Edit are still in development, and there is no set date for their public release, but you are welcome to join our newsletter and we will update you when it happens!