2023年3月27日

Runway在公開的人工智能編輯領域一直處於領先地位。掩蔽、運動跟蹤、超慢動作和顏色分級都受益於人工智能輔助。這是一項基於訂閱的服務，所以它有額外的動力去挑戰極限。今年2月，Runway開始用Gen-1更新測試生成視頻，它可以讓你用文字重新設置視頻的風格。一段走在街上的視頻變成了一個動畫短片，似乎是由手工雕刻和擺姿勢的粘土人物製作的。Runway今天公開發布了Gen-1，並且已經在測試Gen-2，不需要參考視頻。很快，Runway將允許你用一個簡單的文本提示創建一個視頻。隻用文字生成視頻。如果你能說出來，現在你就能看到了。介紹，文本到視頻。 With Gen-2. You might recognize Picsart as a free photo editor , but it also offers video editing. Text2Video-Zero is a Picsart research tool that uses the Stable Diffusion AI image generator to create multiple frames with enough in common to look cohesive. This is significant progress. as early experiments at assembling AI images as video frames produced chaotic scenes where every detail constantly shifted. The effect was eye-catching, but distracted from the content. Video-P2P Video-P2P is an open-source project similar to Runway Gen-1. It takes video input and uses Stable Diffusion to style it with text prompts. The examples shown look good, with steady backgrounds and consistency in the altered elements. Video-P2P: Video Editing with Cross-attention Control @Gradio demo is out on @huggingface The videos have some flicker, but the results are promising. ControlNet took a big step toward producing predictable scenes, and TemporalNet might provide a nice alternative method of creating videos. Text-to-video Text-to-video is an AI model created by Alibaba. It’s clear that this model needs a bit more work, but having more options to explore is always a good thing. fast & longer text-to-video with diffusers you maybe saw fun junky text-to-video from the ModelScope's research model lately with diffusers you can control how long the video is – and fit it on smol VRAM GPUs, including free colab. Try out here: https://t.co/uPVd9hEOtr pic.twitter.com/mIFkGnGT5V Fast-paced innovation The rapid pace of AI innovation is phenomenal. Just months ago, we were teased with glimpses of the potential of similar videos created in AI labs . In 2022, one of the first public AI video generators simply superimposed tiny AI images over stock footage. Those “old school” methods, from a few months ago, are laughable when you see how far AI has progressed in such a short amount of time. Editors' Recommendations