Comments (2)
@wangruoyu1126 According to my memory, the number of negative samples used in the paper is 2B-1,ref Eq. (1) in that paper.
from simclr.
Thanks. Yes you are right, refer to Eq. (1), 2B-1 is correct.
Though it feels a bit weird that in that paper, just a few lines before Eq. (1), it says 2(N-1) are used as negative samples, and I found some other implementations use 2(N-1) in their code. And personally I feel 2(N-1) is more intuitive.
But anyways, thanks for your code and prompt reply.
from simclr.
Related Issues (20)
- I don't know how part of the code works
- Pretrained model load error HOT 3
- question about learning rate HOT 2
- Data augmentation in linear evaluation HOT 1
- results reported in your repo are finetuning and not linear evalaution HOT 1
- Question about linear finetune HOT 1
- Useless download link! HOT 1
- How can I perform data enhancement for other data sets? HOT 1
- what does total_num*100 mean HOT 1
- 下游任务训练的数据量 HOT 1
- DataParrallel to avoid memory issue HOT 4
- Why no upscale back to original size in augmentations? HOT 1
- Training HOT 1
- Pretrain model HOT 1
- loss function problem HOT 2
- Question about positive similarity in training process
- Batch size doesn't affect HOT 1
- Hello. How long did it take to pretrain your model with an NVIDIA TESLA V100(32G) GPU? HOT 1
- Problem in dictionary keys
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from simclr.