Update README.md
Browse files
README.md
CHANGED
|
@@ -103,16 +103,25 @@ If the file won't open in ComfyUI, a node pack is missing. Install it, restart,
|
|
| 103 |
## Tips for good character replacement
|
| 104 |
|
| 105 |
- **Don't expect miracles.** - It is still H3 model and sometimes tempermental. Check your enhanced prompt and consider rolling again if it is not right.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 106 |
- **If the video is easy, replacement should be easy too.** H3 has a quirk though — if the original person and the new person look too similar, it sometimes converges back to the original. A prompt won't always fix that. If you hit it, consider changing the person to a intermediate step (faceless green person). The new body/face will transfer over better. Alternatively you can look into Sam3 character replacement method.
|
|
|
|
| 107 |
- **More than one person in the scene?** Describe the scene properly. `replace the man wearing white shorts with the man in <picture 1>` beats `replace the man with <picture 1>` every time.
|
|
|
|
| 108 |
- **Complex scenes?** It will be very difficult (I've tried), scenes with too many people, too many cuts, characters obstructed are very difficult for the model to properly identify and swap.
|
|
|
|
| 109 |
- **Give the LLM some context.** A one-liner in the user prompt like `<video 1> is a video of two girls eating a cup of chocolate ice cream` really helps the LLM understand what it's looking at. Especially useful with multiple scenes
|
| 110 |
-
|
| 111 |
-
- **Limit the resolution and length.** There seems to be an arbitrary token limit that's affected by higher res/longer time. Keep it smaller and your success rate goes up
|
| 112 |
-
- **Test! Test! Test!.** Sometimes less is more, sometimes more is more when it comes to the user prompt. You'll get a feel for it, tweak it until you get your desired results.
|
| 113 |
- **Use 24 FPS videos** you can trim, crop and edit the FPS before you send it to the WF. [I have a (unfortunately a bit buggy at times) tool for that](https://huggingface.co/PoopMan333/Video_Tools/tree/main). Alternatively you can use the VHS Load Video nodes
|
|
|
|
| 114 |
- **Use Character Sheets** through my testing, I have found that replacing a character is much easier when a character sheet is supplied. [Consider checking out my character generator to make a 360 orbit and generate a full sheet or individual shots](https://huggingface.co/PoopMan333/H3_Character_Sheet_Generator)
|
| 115 |
|
|
|
|
|
|
|
| 116 |
|
| 117 |
---
|
| 118 |
|
|
|
|
| 103 |
## Tips for good character replacement
|
| 104 |
|
| 105 |
- **Don't expect miracles.** - It is still H3 model and sometimes tempermental. Check your enhanced prompt and consider rolling again if it is not right.
|
| 106 |
+
|
| 107 |
+
- **H3 is a tool, you're the one using it.** If you don't specify emotions, expect expressionless results. This current setup will only do what you intend for it to do. **Slop prompt in, slop video out**
|
| 108 |
+
|
| 109 |
+
- **Limit the resolution and length.** There seems to be an arbitrary context window that may be linked to your specs, so the higher higher res/longer time your input/outputs. Keep it smaller and your success rate goes up
|
| 110 |
+
|
| 111 |
- **If the video is easy, replacement should be easy too.** H3 has a quirk though — if the original person and the new person look too similar, it sometimes converges back to the original. A prompt won't always fix that. If you hit it, consider changing the person to a intermediate step (faceless green person). The new body/face will transfer over better. Alternatively you can look into Sam3 character replacement method.
|
| 112 |
+
|
| 113 |
- **More than one person in the scene?** Describe the scene properly. `replace the man wearing white shorts with the man in <picture 1>` beats `replace the man with <picture 1>` every time.
|
| 114 |
+
|
| 115 |
- **Complex scenes?** It will be very difficult (I've tried), scenes with too many people, too many cuts, characters obstructed are very difficult for the model to properly identify and swap.
|
| 116 |
+
|
| 117 |
- **Give the LLM some context.** A one-liner in the user prompt like `<video 1> is a video of two girls eating a cup of chocolate ice cream` really helps the LLM understand what it's looking at. Especially useful with multiple scenes
|
| 118 |
+
|
|
|
|
|
|
|
| 119 |
- **Use 24 FPS videos** you can trim, crop and edit the FPS before you send it to the WF. [I have a (unfortunately a bit buggy at times) tool for that](https://huggingface.co/PoopMan333/Video_Tools/tree/main). Alternatively you can use the VHS Load Video nodes
|
| 120 |
+
|
| 121 |
- **Use Character Sheets** through my testing, I have found that replacing a character is much easier when a character sheet is supplied. [Consider checking out my character generator to make a 360 orbit and generate a full sheet or individual shots](https://huggingface.co/PoopMan333/H3_Character_Sheet_Generator)
|
| 122 |
|
| 123 |
+
- **Test! Test! Test!.** Sometimes less is more, sometimes more is more when it comes to the user prompt. You'll get a feel for it, tweak it until you get your desired results.
|
| 124 |
+
|
| 125 |
|
| 126 |
---
|
| 127 |
|