Comments (2)
gasvn
commented on August 25, 2024
Yes, DyLinear block applied to each variables independently. Dylinear is used to change to weight shape to make it match various sequence lengths.
from units.
khchul
commented on August 25, 2024
Thank you for your clarification!
Though I still can't follow the purpose of DyLinear block.
I first thought it was added to force the variable sized sequences to have fixed length, but realized this cannot be done due to the division of Zin (since Z2mid doesn't pass DyLinear operator).
Could you elaborate more of the effect of DyLinear block?
Thank you
from units.
Related Issues (20)
- Typo in README HOT 1
- How to run self supervised pretraining using UniTS on custom data? HOT 1
- The initialization of Category Embedding HOT 1
- Why there is no loss.backward in training process? HOT 1
- IncompatibleKeys Error when load pre-trained model to do the fine-tuning. HOT 4
- Should requirements.txt be updated including more packages? HOT 2
- Using UniTS on Unlabeled Data for Anomaly Detection Task HOT 2
- During the run of the UniTS_pretrain_x128.sh script the loss value encountered nan. HOT 1
- Validation set HOT 2
- Dataset Download HOT 1
- A question about fine-tuning
- Using UniTS for new tasks
- gluonts problem HOT 1
- Hello! Asking about Inference. HOT 2
- When loading the model, _IncompatibleKeys appears. HOT 3
- Most recent commit removed all files? HOT 2
- How is the internal review going? What's the status? HOT 1
- Question about Model Configuration and Checkpoint Availability in Zero-Shot Setting
- RuntimeError: Distributed package doesn't have NCCL built in HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from units.