2024-04-17 15:23:55

Mastering the "cref" parameter for MidJourney Character Consistency (feat. Creating a Spooky YouTube Short)

Great news for all MidJourney users! A new consistency parameter has been added to help maintain the same facial features across various poses and expressions of your characters.

Generative AI services like MidJourney, known for their randomness, require complex methods to maintain consistencyโ€”something weโ€™ve touched on in our previous VideoStew blog post.

We put this update to the test to quench our thirst (?) for character consistency.

Creating a Key Character (Reference Image)

Initially, we created a main character. Oh, and by the way, MidJourney has recently unveiled a web interface that allows image generation without needing Discord. (It is still in alpha phase and only available to heavy users.)

< MidJourney Web Interface >

We started by generating a reference image with the following prompt:

A Korean rapper passionately performing rap on stage, face tatoo, ear rings

The images generated were interesting, and we chose the second image to upscale for better resolution.

By right-clicking and copying the image address, the prep work for the reference image was completed.

Creating Image Variations

We then put our rapper in different scenarios and poses to test his versatility.

We used the following prompt with the --cref [reference image address] at the end of the prompt:

A korean rapper is reading a newspaper at home --cref [reference image address]

The results were quite satisfying.

< Our rapper reading at home >

It's also good to know about --cw (character weight). Without specifying, the default is --cw 100, which tries to retain all attributes of the reference. However, with --cw 0, we experimented again:

--cw value was set to 0, significantly altering the tattoos, hats, and other attributes except the face.

< Rapper with changed outfit and tattoos >

Can Character Consistency Be Used in Webtoon Production?

Since the basic functionality of the character consistency parameters worked, we quickly tried it out for webtoon production:

a Korean female university student, korean comics style

Out of the four results, we upscaled the second image and planned to try various poses and settings.

< Reference image in webtoon style >

We simplified the prompt to just โ€œa ladyโ€ while applying the --cref.

The result was a photorealistic version of the webtoon character, same style, same outfit, definitely the same person. Is this the real-life version of a webtoon character?

< The real-life webtoon girl appears>

Rechallenging with the Core Prompt

So, we tried again, maintaining the prompt but using the --cref to create an image of the protagonist sitting on a busโ€”and it was a huge success!

< The protagonist tearing out of and into the comics >

What if Two Characters Appear?

The prospect of using this for webtoons or storytelling is becoming more intriguing. What if we tried creating an image of a girl chatting with her boyfriend at a cafรฉ?

Wow, one out of four was a success, but strange images of clone-like characters chatting were generated.

We tried the Rerun function to regenerate 8 images. The result? It was disastrousโ€ฆ

Trying Style Consistency Prompts

If cref helps maintain character consistency, sref maintains stylistic consistency.

We attempted to create a scene with a horrifying atmosphere in a Korean comics style. First, we generated a terrifying setting:

An indoor setting with a terrifying atmosphere, korean comics style

After copying the address of the first reference image:

Then we applied both reference images together.

A Korean female college student running away in fear at subway station, korean comics style  --sref [reference image address] --cref [reference image address]

The result? A success! Our protagonist was created running in fear on a subway platform in the desired style.

Although the prompt was about fear and fleeing, it serendipitously played in our favor. Can we maintain the horrific style while depicting our Korean college student smiling and drinking coffee in a park?

Yes, it worked! The original color palette and feel of the style reference clearly manifested, even though the expression was smiling.

Creating Spooky YouTube Shorts

Building on our experiments, thereโ€™s potential to create a horror short. Simple scary stories were requested from GPT, and each matching image used the style and character consistency parameters.

The result after putting everything together on VideoStew?

Combine haunting background music and a suitable AI voice, and voilaโ€”a decent quality video is easily crafted. Preparing the required images for each sentence beforehand made the process incredibly fast.

So, what's the verdict?

Using cref and sref together, itโ€™s feasible to maintain graphic style and face consistency for single-character content production. However, for story progression that requires multiple characters, this still seems challenging. Combining it with the methods used in the past (refer to our past MidJourney Character Consistency Posting) might work to some extent, but donโ€™t get your hopes too high. With generative AI services evolving daily, let's hope for an update that handles multi-character consistency next time!

Go to Article
๐Ÿ—ž๏ธ [Product Update] Improved Stock Video Matching Accuracy The AI performance for finding stock videos and images that match the text content you enter has been improved.The AI vision search technology is integrated int...
[Product Update] Improved Stock Video Matching Accuracy
Junwoo 2024-06-20
๐Ÿ“ฃ Beyond Contact: Why a Former Performance Marketer is Focusing on Brand Marketing Beyond Contact (hereinafter referred to as B-Con) is a specialized book publishing marketing agency. Typically, when you think of a marketing agency, tasks like...
Beyond Contact: Why a Former Performance Marketer is Focusing on Brand Marketing
Junwoo 2024-06-03
๐Ÿ—ž๏ธ [Product Update] Blog Post to Video Feature Update Transforming your blog posts into videos just got easier! With our [Text Refinement] feature, original images from your posts are now seamlessly integrated into...
[Product Update] Blog Post to Video Feature Update
Junwoo 2024-05-31
๐Ÿ—ž๏ธ [Product Update] Improved Bulk Delete Function for User-Uploaded Resources The feature has been improved to allow you to specify a range using the `SHIFT` key after enabling the multiple selection option.For detailed usage instructions...
[Product Update] Improved Bulk Delete Function for User-Uploaded Resources
Junwoo 2024-05-28
๐Ÿ—ž๏ธ [Product Update] Find Similar Images Feature Update Want to find an image that vibes like the one you already have? Try our [Find Similar Image] feature.Simply select the image or video clip on your stage, right-...
[Product Update] Find Similar Images Feature Update
Junwoo 2024-05-24
๐ŸŽ“ YouTube Operation Strategy for Media Companies (feat. Media Companies Using VideoStew) Many media outlets are striving to capture the YouTube audience as a new challenge. There's particularly great interest in short-form videos that can reach a wi...
YouTube Operation Strategy for Media Companies (feat. Media Companies Using VideoStew)
Junwoo 2024-05-21
๐Ÿ“ฃ How the marketing manager of Wips, the leading IP company in Korea, single-handedly created 60 video contents WIPSCorp is leading the charge in the domestic market with an annual revenue of 38 billion won, operating the top patent search service, Wintelips, and WipsOn.A...
How the marketing manager of Wips, the leading IP company in Korea, single-handedly created 60 video contents
Junwoo 2024-05-13
๐Ÿ—ž๏ธ [Product Update] Guide to Changes in Auto Animation Policy We are informing you that the way animations work for elements such as text and sticker images has been changed.This policy change has resolved the issue of tex...
Junwoo 2024-05-10