Comments (6)
You need to use rabbit-jump-p2p.yaml to edit. Thanks.
from video-p2p.
Sorry for the mistake I made. I have another error for run_videop2p.py following your instruction
DDIM inversion...
Null-text optimization...
Start Video-P2P!
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 50/50 [01:32<00:00, 1.84s/it]
run_videop2p.py:652: RuntimeWarning: invalid value encountered in cast
inversion.append( Image.fromarray((sequence1[i] * 255).numpy().astype(np.uint8)) )
run_videop2p.py:653: RuntimeWarning: invalid value encountered in cast
videop2p.append( Image.fromarray((sequence2[i] * 255).numpy().astype(np.uint8)) )
How can I fix this problem?
Thanks a lot!
from video-p2p.
Hi, in your logs, I only see some warnings. Can you clarify your problem and show me your running script?
from video-p2p.
It seems that the problem may lie in run_videop2p.py in the
with torch.no_grad():
--> sequence = ldm_stable(
prompts,
generator=generator,
latents=x_t,
uncond_embeddings_pre=uncond_embeddings,
controller = controller,
video_length=video_len,
fast=fast,
).videos
sequence1 = rearrange(sequence[0], "c t h w -> t h w c")
sequence2 = rearrange(sequence[1], "c t h w -> t h w c")
inversion = []
videop2p = []
the pixel values in sequence are all nan, making it impossible to generate the accurate gif file.
the config file I used is as follows:
pretrained_model_path: "./outputs/rabbit-jump"
image_path: "./data/rabbit"
prompt: "a rabbit is jumping on the grass"
prompts:
- "a rabbit is jumping on the grass"
- "a origami rabbit is jumping on the grass"
blend_word: - 'rabbit'
- 'rabbit'
eq_params:
words:- "origami"
values: - 2
save_name: "origami"
is_word_swap: False
- "origami"
Besides, when training, the step loss becomes nan after ~200 steps, and the output pixel values of validation_pipeline( line 332 in run_tuning.py) are also nan, I think there must be something wrong!
Thanks a lot!
from video-p2p.
Dose
python run_videop2p.py --config="configs/rabbit-jump-p2p.yaml" --fast
work for you?
from video-p2p.
I will temporally close this issue. You are welcome to reopen it if you still have this problem.
from video-p2p.
Related Issues (14)
- what is the VRAM requirement? HOT 2
- Error HOT 6
- Stage 2 Video Length
- Run run_videop2p.py but get nan HOT 1
- An error occurs when running to 20% HOT 2
- Cannot down load the pre-trained model HOT 1
- Complete dataset HOT 1
- The use of config HOT 2
- run_tuning.py cannot work HOT 2
- How to calculate quantitative metrics HOT 4
- have a error MODEL_LIBRARY_ORG_NAME HOT 2
- Version of xformers HOT 4
- I have completed the training, and the reasoning reports an error HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from video-p2p.