Giter VIP home page Giter VIP logo

contrastivelearninghar's People

Contributors

iantangc avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

contrastivelearninghar's Issues

KL divergency of t-sne in pretraining epochs

Hi,
Thank you so much for sharing the excellent work! I'm now also trying to see the effectiveness of SimCLR on HAR data, and want to discuss it with you.

Since we can output KL divergence of t-sne result to see the network feature space, I try to output the t-sne results at each pretraining epoch (the SimCLR head) using your plot function. However, the feature space doesn't change a lot.

If I understood correctly, the KL divergence is supposed to be smaller after many epochs, because the SimCLR is supposed to learn good features for different activities. However, as the SimCLR loss got smaller, the latent feature didn't get better. Did you have some idea about this problem?

Thank you very much for your help!
Best
Cassie

对比学习预训练模型

作者你好,请问一下你的对比学习模型的初始参数是在哪个数据集上训练的。如 SimCLR中的预训练参数是使用ResNet在ImageNet上训练的。

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.