"How did this video come from?
Want to use ComfyUI to make an AI video of people dancing? Don't rush to get started yet. Recently, many people have been asking how to play this thing. It's not difficult, but it has to be done step by step.
The first step is to know what ComfyUI does. It is an open source tool that allows you to build your own AI model. Unlike those one-click generated software, it has to adjust its own parameters. Sounds complicated? It's actually not that mysterious.
Install ComfyUI first. There are tutorials on the official website, just follow them. After installing and opening it, there is a black interface. Don't panic, this is the drawing board. You can build a model by dragging things into it.
Want to dance as a person? Use ControlNet. This is a plug-in that can control AI to generate images. For example, if you give a picture of dancing, AI can follow suit. But you have to train first.
Training models requires data. Where to find it? There are many ready-made ones on the Internet. For example, if you are dancing that is angry, cut off a few paragraphs. Be careful, don't use copyrighted ones, look for those that allow commercial use.
The data is ready and uploaded to ComfyUI. Then adjust the parameters. There are three key parameters: learning rate, number of steps, and resolution. Don't have too high the learning rate, otherwise it will easily be chaotic. If you take more steps, the effect will be better, but it will be slower. The resolution is as high as possible to make the picture clear.
Start training after adjustment. This process will have to wait, maybe several hours. Don't wait and do something else. Wait until the reminder training is completed.
After training, generate a video. At this time, use another plug-in: Deforum. It allows you to generate continuous pictures. Drag the trained model in and give an action prompt, such as "Dance alone".
After generating the picture, you still have to adjust the frame rate. If the frame rate is low, the movement will be stuck. Generally, more than 25 frames are smoother. Adjust the frame rate and export the video.
Pay attention to the format when exporting. MP4 is the most commonly used and has good compatibility. Try to use 1080P resolution. If it is too small, the details will not be clear.
Step by step, cut it. Use clipping or Premiere to delete unwanted parts. Add background music for better results. Choose music with strong rhythm, such as electronic music.
After the entire process, you may have to try several times. Don't strive for perfection the first time, let's get through first. Try it a few more times and you will feel it.
AI videos are very popular nowadays, but don't just chase hot spots. Practice your skills more so that you can use them in the future. For example, you can try to do other movements, running, jumping, and you can play it.
AI tools are just assistance. What's really great is your creativity. Think about new ideas so that videos won't be the same. "
