Comments (3)
Hi @ChethanN01,
Thank You for your interest in our work. Please note that you have to add the root directory into the PYTHONPATH
to run the Video-ChatGPT scripts.
Please run the following command from the root directory of the repository.
export PYTHONPATH="./:$PYTHONPATH
Please let me know if it solves the issue. Thank You.
from video-chatgpt.
thanks, please tell me how many hours of video your model can check and analyze
from video-chatgpt.
Hi @ChethanN01 ,
Thanks for your interest in Video-ChatGPT and for bringing up this question.
Currently, the model has been primarily trained on the ActivityNet dataset, which comprises videos with an average duration of around 2 minutes. The model takes 100 uniformly sampled frames from each video during both training and inference.
While we haven't extensively tested the model with significantly longer videos the current sampling method should technically be applicable. However, as the video length increases, the representativeness of the sampled frames could diminish because we're still only sampling 100 frames.
In essence, the model is capable of processing longer videos, but the effectiveness may not be the same as for the shorter videos it was trained on. We encourage you to experiment with longer videos and share your findings.
Thank you.
from video-chatgpt.
Related Issues (20)
- Same output for any system prompt HOT 1
- Adding Modality HOT 1
- Question about the semi-automatic dataset creation process HOT 1
- RuntimeError: Parent directory ./Video-ChatGPT_7B-1.1_Checkpoints/checkpoint-3000 does not exist. HOT 5
- Why is the <video> tag is needed in training json? HOT 1
- How to load the tuned backbone? HOT 1
- Code for Dataset Generation HOT 1
- Train errors: some videos in train_video_ids.txt do not appear in activity_clip-14L_spatio_temporal_356 HOT 2
- What is the formal name of the benchmark? HOT 3
- GPT Judge does not work for the Prompt
- 13B, 70B models HOT 1
- RuntimeError: Internal: src/sentencepiece_processor.cc(1101) [model_proto->ParseFromArray(serialized.data(), serialized.size())] HOT 5
- I encountered an error while using "Run the Demo". HOT 3
- Insufficient VRAM on a single card, how to utilize multiple cards for inference HOT 2
- Question about consistency evaluation HOT 3
- The responses from the offline_demo are garbled HOT 2
- Why TGIF videos missed and can't be processed HOT 3
- How to download the ready LLaVA-Lightening-7B weights HOT 5
- Download videos HOT 1
- How many frames are sampled per video for the training and testing process? HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from video-chatgpt.