You see it on Instagram, your favourite character has entered the multiverse!
You see a popular anime character, in other anime universes.
You see movie characters in other films, other shows, and cool reimagining of that character takes place.
I’ve had a number of people contact me asking how this is done?
It’s simple, you start with a prompt and work your way from there. So I’m covering:
- Prompt Formulas
- Tools that help make this work better
- Converting to AI Video
- Some examples that may help.
I also cover this on a YouTube video here.
So, let’s start with some Prompt Formulas.
But First, some things we need to get out of the way..
A few tips:
- For TikTok, Instagram Reels & Shorts – use an aspect ratio of 9:16
- For Instagram’s Image Feed – use an aspect ratio of 4:5
(when using images, I recommend a Creative or Subtle Upscale also) - For YouTube Long Form videos – use an aspect ratio of 16:9
- Use –niji for anime shows, but experiment with both the standard model as you can get solid results.
- Re-roll and create MANY images and choose what you like from the heap. That’s how the best images are made.
For the formulas below, swap out the [bracketed] information for what you want to see in your image.
If these formulas below fail, I have some follow up tips afterward.
Prompt Formula #1: Simple Screencap Multiverse Formula
Formula used: [character] as a character from [show], [show type] screencap
This is a simple case of prioritizing the character and pointing it a style. Adding ‘TV’ or ‘Anime cartoon’ screencap helps nail down the style better
Some examples:
Prompt: Mickey mouse as a character from Dragonball z, anime cartoon screencap –niji 6
Prompt: the terminator as a character from Dragonball z, anime cartoon screencap –niji 6
Prompt: super mario as a character from Jojo’s Bizarre Adventure, anime style screencap –ar 16:9 –niji 6
Prompt: super mario as a character from Mortal Kombat, screencap –ar 16:9
Prompt: Goku as a character from The Super Mario bros, videogame screencap –ar 16:9
As you can see this works pretty well when the subject or show is popular. It may be all you need, but I have a few more in case this formula doesn’t work.
You can expand on these prompts for more detail. This is really a way of getting started.
Prompt Formula #2: Changing Character type
Formula used: [character] as [character type]
Sometimes you need the describe the type of character. Transformers is a great example of this. As a character in the Transformers show, may not make them transformers.
Some examples:
Prompt: Mickey mouse as a transformer –niji 6
Prompt: The president as a transformer –niji 6
However, if it’s too much of an illustration, you can add in the screencap also.
Prompt: Hulk as a transformer, cartoon screencap –niji 6
Prompt: Mickey Mouse as a transformer, cartoon screencap –niji 6
Prompt: Super Mario as a transformer, cartoon screencap –niji 6
Prompt Formula #3: Character Reimagined
Formula used: [character] reimagined in the [show] universe
This is a different approach to transforming your character, instead of ‘as a’ ‘reimagined’ is more direct language you can work with. I ran with Mario a lot with this example.
Prompt: super Mario reimagined in the marvel cinematic universe
Prompt: super Mario reimagined in the mortal kombat universe
Prompt: super Mario reimagined in the Dragonball z universe
Again, try adding screencap on the end:
Prompt: super Mario reimagined in the Dragonball z universe, anime screencap –niji 6
Prompt Formula #4: Higher Style Complex Formula
Formula used: A [type] screencap from the [type] show [show name], showing [character name] reimagined in the [show name] universe
Until now, the order of the prompt has the character first – which prioritizes it in Midjourney’s eyes. By adding the show first and last, we create a higher priority to match the style of the show and the character becomes second priority.
This can lead to better results:
Prompt: A movie screencap from the original Star Wars movies, showing goku reimagined in the Star wars universe
Prompt: A movie screencap from the original Star Wars movies, showing hulk reimagined in the Star wars universe
Prompt: A movie screencap from the original Star Wars movies, showing super mario reimagined in the Star wars universe
Prompt: A screencap from the blockbuster movie Avengers Endgame, showing naruto reimagined in the Marvel cinematic universe
Prompt: A screencap from the blockbuster movie Avengers Endgame, showing goku reimagined in the Marvel cinematic universe
Prompt: A screencap from the anime show Naruto, showing the terminator reimagined in the naruto universe –niji 6
Prompt: A screencap from the anime show Naruto, showing super mario reimagined in the naruto universe –niji 6
Prompt: A screencap from the anime show Naruto, showing hulk reimagined in the naruto universe –niji 6
Prompt: A screencap from the anime show Attack on Titan, showing super mario reimagined in the Attack on Titan universe
Prompt: A screencap from the anime show Attack on Titan, showing hulk reimagined in the Attack on Titan universe
Prompt: A screencap from the anime show Attack on Titan, showing goku reimagined in the Attack on Titan universe
Sometimes, prompts aren’t enough…
So I recommend making use of midjourney’s Tools to maximize the effect. This includes:
- Style References
- Moodboards
- Conflicting Character References
Style References
I tried prompting for the Hulk in the Flintstones cartoon from the 1970s.
The prompt was: the incredible hulk as a character from The Flintsones, 1970s cartoon screencap –ar 3:2
What I got just didn’t match:
So I turned to style references.
You can add image URLS after –sref, or simply drag and drop images into the image icon on the left of the prompt bar on the Midjourney website (choose the paperclip icon).
So I uploaded these 3 Flintstone images as Style References:
Using the same prompt as before, with those 3 images as reference, what I got was a LOT closer:
Moodboards
This is a step up from Style References, this helps you to add a greater level of style reference and truly nail a style.
I decided to work with an Anime ‘Ghost in the Shell’ style.
So I started with the following images, using the prompt: the incredible hulk as a character from Ghost in the Shell, Anime screencap –ar 16:9 –v 6
This looks not too bad, but not entirely what I envisioned. I wanted it to resemble the look of the 1993 Film more directly.
So I uploaded about 50 screengrabs from the Ghost in the Shell anime film into a new Moodboard (the code is in the prompt below).
So I uploaded again, and go some results that match the look. Prompt now is the incredible hulk as a character from Ghost in the Shell, Anime screencap –ar 16:9 –profile khzwehw
I then experimented with other characters, switching out ‘Incredible Hulk’ for (in order) ‘Ryu from Streetfighter’, ‘The Terminator’, ‘Super Mario’, ‘Pikachu’, ‘Darth Vader’ & ‘Darth Maul‘ (see below).
Conflicting Character References
This time I tried for James Bond as a Titan, from the anime show, ‘Attack on Titan’.
I used the Prompt: james bond as a titan from attack on titan, anime screencap –ar 16:9 –niji 6
Results were nothing like James Bond, and mostly not Titan.
So I genereated the next town images, prompts were simply ‘james bond –ar 16:9’ and ‘titan from attack on titan –ar 16:9 –niji 6’
I then did a simple drag and drop on both into the image area as character references (click the small head and shoulders icon), both conflicting visually – but they combined successfully.
S
o now the prompt is the same, but with character reference: james bond as a titan from attack on titan –ar 16:9 –cref https://s.mj.run/nEoLNwpgSyQ https://s.mj.run/Ml17ttWNbpA –niji 6
I then got much better results:
So this can be a great way to mix characters up and get something a little different.
I did it with Mario & Goku. Prompt: super mario in the dragonball z universe, anime screencap –ar 16:9 –cref https://s.mj.run/6YkRE6TuGd4 https://s.mj.run/tNXWhuyu4X8 –niji 6
Converting to Video
Converting to video is easy, I recommend Kling AI for this.
For vertical videos, use 9:16 aspect ratio, for longform use 16:9. One Kiling, simply use IMage to video, drag and drop your image in and write a prompt describing:
- What the character should do
- How the camera should move
- describe small details of movement (breeze moves clothing, smoke billows past, etc)
If you’d like to see the videos I was able to make, check out the end of this YouTube video.
