Logo
Junwoo
2023-09-07 20:27:27

Tutorial
Creating Characters with Midjourney and Editing Fairytale Videos with VideoStew

These days, we're seeing one or two examples of generative AI being well utilized.

We're going to explore how to use generative AI like Midjourney and VideoStew to create animated video fairytales.

First, because various solutions are used, I'll provide a general workflow.

  1. Create a fairytale script using chatGPT
  2. Generate characters and background images needed for the content via Midjourney
  3. Edit the video by dunking all the ingredients into VideoStew

While services that crop out background images and crop images web services appear along the way, they're not of major importance. So, just remember this three-step solution flow.

Now, let's get started.

Creating a Fairytale Script with ChatGPT

First, let's create a fairytale in chatGPT. This doesnโ€™t require any prompt know-how and is simple enough for you to freely test and generate fairytale scripts.

Use Prompt: Make a short fairytale that can give dreams and hopes to children, with a young boy as the protagonist.

We've made a simple fairytale script. The reason why "a young boy as the protagonist" is specifically mentioned in the prompt is because it's better for using generative AI like Midjourney when there is a definite character.

Creating Characters and Background Images with Midjourney

Now it's our turn to review the script and see what characters are needed and what background elements are needed.

Firstly, we need the protagonist "Minwoo" and his monkey friend "Ruby". As for the backdrop, it seems that we'll need a variety of places like "school classroom" or "zoo".

Shall we shoot one creation prompt at a time?

Creating Drafts for Main Characters in Midjourney

The first task is to generate various poses for the main character.

Basic Prompt: [Character Description], [Style], multiple expressions and poses, character sheet, [Outfit] --ar 16:9

Example of Use: Short boy, brown hair, Korean, black eyes, pixar styled, multiple expressions and poses, front view, side view, back view, character sheet, blue jean pants, pink t-shirt --ar 16:9

The important thing here is that we need to create a character sheet that includes front view, side view, and back view. Since the characters can't always face forward to blend in with the background.

Creating Emotion Variations for Main Character

If you want to create a character variation that has a crying facial expression, a smiling facial expression, or a celebratory pose, it's important to maintain the character's consistency.

You may think that you can just add expressions or poses to the same prompt, but this can lead to completely unexpected results. So remember the reference link if you don't want to suddenly change the protagonist in your fairytale.

First, you need to separate each of the 10 characters from the character sheet that we created earlier. You can use free online crop tools like iloveimg for this. Prepare 10 separate main character image files.

The prompt used to create character variations is as follows.

[Reference link], [Character Description], [Style], expressions and poses, character sheet, [Outfit] --ar 16:9

To get the reference link, you must upload all 10 images to Midjourney. For each uploaded image, right-clicking with the mouse allows you to copy the unique image address. This means you need to copy and paste the address for all 10 images one by one. Although it's a tedious task, it's extremely important for creating variations while ensuring character consistency.

Now, we'll use the /imagine command again to create a variation. In the basic prompt, instead of multiple expressions and poses, we're going to put in real actions or facial expressions. This time, let's try creating a character by putting in jumping with smiling face.

Like this, prepare the variations you need according to the fairytale script. But the images that Midjourney generates all have a background color. So now, we need to use a compositing tool to create only a PNG character image. You can simply blow off the background to transparent with a solution like remove.bg.

Creating Background Images

Once all the characters are prepared in this way, what's left is to create a backdrop. In fact, there's no big problem when writing a prompt for a backdrop as long as the style matches. However, always remember to generate it with a first person view so that the characters don't feel out of place standing in it.

Background Prompt Example: Pixar styled, horizontal path, zoo, first person view, tiger in the cage, bright and sunny day, ice cream truck --ar 16:9

Editing Fairytale Video by Infusing All Ingredients into VideoStew

Once all the image resources are prepared, now all we have to do is dunk them into VideoStew and mix them well. First, put the script on the backdrop via Wizard Mode.

The method of using VideoStew is explained in detail in the Starting with Wizard Mode Guide Document and in the videos on the VideoStew YouTube Channel because the article is getting too long.

<iframe src="https://www.youtube.com/embed/9kZrcLaJC2g" allowfullscreen=""></iframe>

Go to Article
๐Ÿ“– Create Your Christmas Greetings and Video Cards in a Snap with Generative AI Welcome to the holiday cheer of 2023! Here at VideoStew, we're bringing you the simplest way to craft a Christmas greeting video that's sure to spread joy.Gener...
Create Your Christmas Greetings and Video Cards in a Snap with Generative AI
Junwoo 2023-12-20
๐Ÿ“– Creating English Conversation Learning Videos using AI Voice and Movie Clips (English shadowing video) Have you watched a lot of shorts videos teaching useful English expressions?&lt;iframe src="https://www.youtube.com/embed/CzBwBVoTz-4" allowfullscreen=""&gt;&lt...
Creating English Conversation Learning Videos using AI Voice and Movie Clips (English shadowing video)
Junwoo 2023-10-13
๐Ÿ“– Send Your Chuseok Greetings with Our Chuseok Illustration Video Template Hello there! The grand national holiday of Chuseok is right around the corner. We wish all VideoStew customers a peaceful and joyous holiday.Even in 2023, we've...
Send Your Chuseok Greetings with Our Chuseok Illustration Video Template
Junwoo 2023-09-25
๐Ÿ“– Creating Characters with Midjourney and Editing Fairytale Videos with VideoStew These days, we're seeing one or two examples of generative AI being well utilized.We're going to explore how to use generative AI like Midjourney and VideoStew ...
Creating Characters with Midjourney and Editing Fairytale Videos with VideoStew
Junwoo 2023-09-07
๐Ÿ“– Pay Attention to the TTV (Text-to-Video) Feature that Transforms Blog Posts into Videos in No Time! Communicate Through Video Without Any HassleIf you have been dreading the operation of a Youtube channel despite maintaining a blog over a long period, start vi...
Pay Attention to the TTV (Text-to-Video) Feature that Transforms Blog Posts into Videos in No Time!
Junwoo 2023-06-27
๐Ÿ“– Have your YouTube Short ready in just 5 minutes What are YouTube Shorts?YouTube Shorts is a short-form video service that was introduced by YouTube in 2021 to compete with TikTok and Instagram reels. Allowing...
Have your YouTube Short ready in just 5 minutes
Junwoo 2023-01-09
๐Ÿ“– Creating New Year's Greeting Video Messages First, take a look at the New Year's greeting video from the VideoStew team.&lt;iframe src="https://www.youtube.com/embed/fM28h73E1uc" allowfullscreen=""&gt;&lt...
Creating New Year's Greeting Video Messages
Junwoo 2023-01-04
๐Ÿ“– Create a stunning Christmas video letter with just text input! We've prepared a Christmas video letter template for you.Try making a Christmas video letter on VideoStew now. With our splendid animations, you can rise to the...
Create a stunning Christmas video letter with just text input!
Junwoo 2022-12-22
[Stop]