- 👋 Hi, I’m Guo Chen
cg1177 / videollm Goto Github PK
View Code? Open in Web Editor NEWVideoLLM: Modeling Video Sequence with Large Language Models
License: Apache License 2.0
VideoLLM: Modeling Video Sequence with Large Language Models
License: Apache License 2.0
I find your paper and methodology very intriguing and would like to use it for my research. Could you please provide a specific timeline for when the source code and pretrained models will be made publicly available?
I have no idea about you training schedule( 2 stage or 1 stage), what text encoder and visual encoder used, and what decoder used, although you have done great ablation study.
Hi,
First of all, thank you for this wonderful contribution, your results are really impressive!
I had a question regarding Table 4 in your paper. For action segmentation, can you please share the train/test split you used for the breakfast dataset? and did you use raw labels for training or you modified the dataset into chat style?
I know you plan to release the dataset soon but if you can answer the above, that would be really helpful!
Thanks
Dear authors,
thank you for your will to open-sourcing your code and models. May I ask how heavy is the training resources needed? How many gpu required for videollm?
Hi, I am really interested in your fantastic work.
I want to follow your work and investigate further.
May I know when you plan to release the code and the pretrian model?
That will inspire all the researchers in the video area.
Thanks
Hi! I just went through your preprint, and here are my two quick reactions, if you don't mind:
(b) “Unssen tokens” are data units that have not yet arrived, and predicting their attributes or when they appear in the future usually belongs to future prediction tasks.
It should be “Unseen tokens”.
VideoLLM, especially the use of linear projector to map video tokens to tokens for the LLM, reminds me of https://github.com/kohjingyu/fromage. However, there is no equivalent of the Image-text retrieval pretraining task: i.e., given a description of the video, train the LLM to retrieve the correct video tokens in the correct order among all the video tokens in the same batch. Can it be a useful pretraining task here?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.