Comments (10)
from dynamicrafter.
First the
version
should be put underparams
like what I have mentioned here:cond_stage_config: target: lvdm.modules.encoders.condition.FrozenOpenCLIPEmbedder params: version: "xxxxx" freeze: true layer: "penultimate" img_cond_stage_config: target: lvdm.modules.encoders.condition.FrozenOpenCLIPImageEmbedderV2 params: version: "xxxx" freeze: true
Second, what files were originally in your folder of
blobs
(instead of .bin)?
thank you very much! it's worked.
stone01_01_sample0.mp4
very smooth
from dynamicrafter.
I am not sure about that, which is related to your own configuration.
One possible solution is adding
version: "<path to this bin file in your computer>"
under the params
of cond_stage_config
and img_cond_stage_config
in each config yaml:
cond_stage_config:
target: lvdm.modules.encoders.condition.FrozenOpenCLIPEmbedder
params:
version: "<path to this bin file in your computer>"
freeze: true
layer: "penultimate"
img_cond_stage_config:
target: lvdm.modules.encoders.condition.FrozenOpenCLIPImageEmbedderV2
params:
version: "<path to this bin file in your computer>"
freeze: true
I am not sure if it works or not and you can have a try.
from dynamicrafter.
我的主机不能访问huggingface,/laion/CLIP-ViT-H-14-laion2B-s32B-b79K/resolve/main/open_clip_pytorch_model.bin 这个文件已经下载到本地,请问应该放到哪个目录下,谢谢!
https://www.codewithgpu.com/m/dynamicrafter_mo
hub.zip
解压后放入
/root/.cache/huggingface
如果是Windows系统,估计在:
C:\Users\这里是你的用户名.cache\huggingface
from dynamicrafter.
I am not sure about that, which is related to your own configuration. One possible solution is adding
version: "<path to this bin file in your computer>"
under theparams
ofcond_stage_config
andimg_cond_stage_config
in each config yaml:cond_stage_config: target: lvdm.modules.encoders.condition.FrozenOpenCLIPEmbedder params: version: "<path to this bin file in your computer>" freeze: true layer: "penultimate" img_cond_stage_config: target: lvdm.modules.encoders.condition.FrozenOpenCLIPImageEmbedderV2 params: version: "<path to this bin file in your computer>" freeze: true
I am not sure if it works or not and you can have a try.
thank you for reply, but it is not work for me
from dynamicrafter.
我的主机不能访问huggingface,/laion/CLIP-ViT-H-14-laion2B-s32B-b79K/resolve/main/open_clip_pytorch_model.bin 这个文件已经下载到本地,请问应该放到哪个目录下,谢谢!
https://www.codewithgpu.com/m/dynamicrafter_mo
hub.zip 解压后放入 /root/.cache/huggingface
如果是Windows系统,估计在: C:\Users\这里是你的用户名.cache\huggingface
非常感谢,路径已找到 .cache/huggingface/hub/models--laion--CLIP-ViT-H-14-laion2B-s32B-b79K/snapshots/de081ac0a0ca8dc9d1533eed1ae884bb8ae1404b/ 但还是不行
from dynamicrafter.
我的主机不能访问huggingface,/laion/CLIP-ViT-H-14-laion2B-s32B-b79K/resolve/main/open_clip_pytorch_model.bin 这个文件已经下载到本地,请问应该放到哪个目录下,谢谢!
https://www.codewithgpu.com/m/dynamicrafter_mo
hub.zip 解压后放入 /root/.cache/huggingface
如果是Windows系统,估计在: C:\Users\这里是你的用户名.cache\huggingface非常感谢,路径已找到 .cache/huggingface/hub/models--laion--CLIP-ViT-H-14-laion2B-s32B-b79K/snapshots/de081ac0a0ca8dc9d1533eed1ae884bb8ae1404b/ 但还是不行
Maybe you can try my above solution by changing version
path as <your path>/models--laion--CLIP-ViT-H-14-laion2B-s32B-b79K/blobs/<the file with filesize of ~4GB>
from dynamicrafter.
.cache/huggingface/hub/models--laion--CLIP-ViT-H-14-laion2B-s32B-b79K/
cond_stage_config:
version: "/home/testaa/.cache/huggingface/hub/models--laion--CLIP-ViT-H-14-laion2B-s32B-b79K/blobs/open_clip_pytorch_model.bin"
target: lvdm.modules.encoders.condition.FrozenOpenCLIPEmbedder
params:
freeze: true
layer: "penultimate"
img_cond_stage_config:
version: "/home/testaa/.cache/huggingface/hub/models--laion--CLIP-ViT-H-14-laion2B-s32B-b79K/blobs/open_clip_pytorch_model.bin"
target: lvdm.modules.encoders.condition.FrozenOpenCLIPImageEmbedderV2
params:
freeze: true
thank you ,it's my config file,This issue has not been resolved.
from dynamicrafter.
First the version
should be put under params
like what I have mentioned here:
cond_stage_config:
target: lvdm.modules.encoders.condition.FrozenOpenCLIPEmbedder
params:
version: "xxxxx"
freeze: true
layer: "penultimate"
img_cond_stage_config:
target: lvdm.modules.encoders.condition.FrozenOpenCLIPImageEmbedderV2
params:
version: "xxxx"
freeze: true
Second, what files were originally in your folder of blobs
(instead of .bin)?
from dynamicrafter.
感谢,已经好了
from dynamicrafter.
Related Issues (20)
- watermarks on rendered videos HOT 1
- Plan to integrated into diffusers HOT 1
- only 2 seconds ? HOT 1
- When loading the graph, the following node types were not found: DynamiCrafterLoader HOT 1
- 图片不同分辨率的性能 HOT 2
- 关于bf16模型的性能问题 HOT 1
- Batch functionality HOT 3
- OSError: [Errno 101] Network is unreachable HOT 2
- 同样配置的机器,windows下和linux下速度差一倍 HOT 2
- How Dynamicrafter achieve frame interpolation? HOT 4
- help,pls HOT 1
- Finetune HOT 4
- way to "preload" the checkpoint for inference? HOT 2
- any need to transform condition image to [-1,1]?
- 生成帧插值如何控制动作幅度 HOT 2
- 是否可以控制Camera,像stablevideo那样 HOT 1
- Inquiry about the Role of use_dynamic_rescale in Training vs. Inference
- Do you have any plans to release the interpolation training code? HOT 5
- annotations of the constructed dataset HOT 9
- fine tune 256x256 model HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dynamicrafter.