In the age of artificial intelligence (AI), complex photo editing can be done with the click of a button. Whether you want to remove an object from the background, change the color of your shirt or make your face appear flawless, AI can transform your pictures with simple text-to-image commands.
Editing videos with those same AI commands isn 麻豆精品 S檛 quite as simple, however, UCF researchers in the College of Engineering and Computer Science aim to change that.
Professor Nazanin Rahnavard, Associate Professor Chen Chen, and UCF alumni Nazmul Karim 麻豆精品 S�20MS 麻豆精品 S�23PhD and Umar Khalid 麻豆精品 S�20MS 麻豆精品 S�23PhD have developed novel text-to-video AI technology that can dramatically change videos in minutes.
麻豆精品 S淥ur system takes the 麻豆精品 S榖rain 麻豆精品 S� of an AI that 麻豆精品 S檚 already skilled at generating images from text and adapts it for video, without losing the creative power that makes it effective in the first place, 麻豆精品 S� Rahnavard says. 麻豆精品 S淥ur breakthrough came from recognizing a fundamental inefficiency in existing text-to-video editing approaches. Current systems either require massive text-to-video datasets for training or rely on computationally expensive, per-video adaptations of text-to-image models. We believed there had to be a more efficient and elegant solution. 麻豆精品 S�
With Rahnavard 麻豆精品 S檚 background in electrical engineering and Chen 麻豆精品 S檚 background in computer science, the team used linear algebra techniques to examine the numerical parameters of an AI model that are optimized and adjusted while learning a new task. They realized that instead of fine-tuning the entire parameter set, they could update only the singular values, preserving the AI model 麻豆精品 S檚 ability to generalize while speeding up its adaptation time.
麻豆精品 S淭he key was learning which parts of the AI 麻豆精品 S檚 麻豆精品 S榤emory 麻豆精品 S� to adjust, and which to preserve, 麻豆精品 S� Rahnavard says. 麻豆精品 S淏y focusing only on the most essential elements and leaving the rest untouched, we created a method that adapts much faster and more efficiently while still producing high-quality, expressive results. 麻豆精品 S�
The AI model works best on existing video clips and can edit them in minutes. It can change the colors of clothing, swap a cat for a dog or transform the clip into a cartoon. The more complex the commands, the longer the editing time. But Rahnavard says the process can still be completed in minutes, not hours.
The university was recently awarded a patent for the technology, which movie studios and social media companies could use.
麻豆精品 S淭his technology has the potential to revolutionize video editing across a wide range of industries, 麻豆精品 S� Rahnavard says. 麻豆精品 S淢ovie studios could use it for rapid scene modifications without the need for costly reshoots, while social media platforms could offer their users instant, highly sophisticated video filters far beyond what 麻豆精品 S檚 available today. 麻豆精品 S�
