Giter VIP home page Giter VIP logo

Comments (3)

Coobiw avatar Coobiw commented on August 11, 2024

Hello,thanks for your issue. I will talk about my own opinion in order.

  1. About global or local discriminator
    Actually, this repo has not implement the global discriminator. In my algorithm, the fake input of the discriminator is:
    origin_img*(1-mask)+output_G*mask
    So that, the loss of discriminator just care the mask region. That's why we call it local discriminator. If you want to add an additional global discriminator, you can probably just make the new global discriminator pay attention to the whole input img(not just the mask region, just change the loss, input can be the same).
    As for this, you can read this paper for more details. Globally and Locally Consistent Image Completion

  2. train_label and train
    I'm not sure what you want to mean exactly. But I guss that you want to know the train and BP process. The input image when training is an masked image(processed by RandomErasing in pytorch). After the foward, you will get an output whose shape is same as the input. Then, computing loss on the mask region with the original images.
    To sum up, the masked img is the input and the original img is the "label".

  3. input of predict.py
    This is easy to extend, you can implement it and give me a pull request if it is convenient for you! Sincerely thanks!

  4. Intruction
    I'm really sorry that I have not write fuction doc when I open source this code. But actually, this code is easy to unstand. If possible, you can read Chapter.3.A and the Appendix of our paper and then you will know the whole pipeline of the algorithm.
    The link of our paper is https://opg.optica.org/ao/fulltext.cfm?uri=ao-60-26-8198&id=458598.
    And if you have another problem during this period, you can just give me an issue! I am glad to discuss it with you!

Hope these are helpful for you!

from context-encoder.

Gh1874 avatar Gh1874 commented on August 11, 2024

Hello,thanks for your issue. I will talk about my own opinion in order.

  1. About global or local discriminator
    Actually, this repo has not implement the global discriminator. In my algorithm, the fake input of the discriminator is:
    origin_img*(1-mask)+output_G*mask
    So that, the loss of discriminator just care the mask region. That's why we call it local discriminator. If you want to add an additional global discriminator, you can probably just make the new global discriminator pay attention to the whole input img(not just the mask region, just change the loss, input can be the same).
    As for this, you can read this paper for more details. Globally and Locally Consistent Image Completion
  2. train_label and train
    I'm not sure what you want to mean exactly. But I guss that you want to know the train and BP process. The input image when training is an masked image(processed by RandomErasing in pytorch). After the foward, you will get an output whose shape is same as the input. Then, computing loss on the mask region with the original images.
    To sum up, the masked img is the input and the original img is the "label".
  3. input of predict.py
    This is easy to extend, you can implement it and give me a pull request if it is convenient for you! Sincerely thanks!
  4. Intruction
    I'm really sorry that I have not write fuction doc when I open source this code. But actually, this code is easy to unstand. If possible, you can read Chapter.3.A and the Appendix of our paper and then you will know the whole pipeline of the algorithm.
    The link of our paper is https://opg.optica.org/ao/fulltext.cfm?uri=ao-60-26-8198&id=458598.
    And if you have another problem during this period, you can just give me an issue! I am glad to discuss it with you!

Hope these are helpful for you!

Many thanks for replying so soon :). I'll follow your suggestions and propose another issue if I have any.

I'm still learning about the coding and the algorithm and have not decided which model I should choose. If I decide to modify based on your code, I'll try to modify the predict.py and share it with you anyway.

from context-encoder.

Coobiw avatar Coobiw commented on August 11, 2024

OK,best wishes for you!

from context-encoder.

Related Issues (1)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.