Giter VIP home page Giter VIP logo

camma-public / selfsupsurg Goto Github PK

View Code? Open in Web Editor NEW
28.0 7.0 5.0 43.73 MB

Official repository for "Dissecting Self-Supervised Learning Methods for Surgical Computer Vision"

License: Other

Python 100.00%
self-supervised-learning semi-supervised-learning surgical-data-science surgical-phase-recognition transfer-learning surgical-scene-segmentation deep-learning endoscopic-vision laparascopic-cholecystectomy surgical-computer-vision

selfsupsurg's People

Contributors

srv902 avatar vinkle avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

selfsupsurg's Issues

Difference in metrics between the two arxiv version

Hi, I've noticed there is a difference in the F1 score for phase recognition between the two arxiv versions and wanted to understand the differences. It seems that the linear evaluation protocol haven't changed so how can you explain the differences in tables 3 and 4?

For example for table 3: dino, base, 40 videos -> 71.6 and in the older version the value was 67.0.

Thanks for your great work!

No module named 'downstream_phase_tcn.linear_evaluation'

Greetings. When I try your codes, the part of
# 2) TCN fine-tuning (selfsupsurg)>cfg=hparams/cholec80/finetuning/cholec_to_cholec/series_01/test/phase_tcn/12.5/1/h002.yaml (selfsupsurg)>python main_ft_phase_tcn.py -hp $cfg -t test
There is an error showing that ModuleNotFoundError: No module named 'downstream_phase_tcn.linear_evaluation'
And after checking the trainers.py line18 from downstream_phase_tcn.linear_evaluation import FCN, it seems that there is no such a file (linear_evaluation) in the folder downstream_phase_tcn
Could you please help me to solve this problem?

How to reproduce the results in Table 6

Thanks for the paper and codes, I have some questions about the code. I follow the Readme to run the codes, but it only generates the results in Table 4. What should I do if I want to reproduce the results in Table 6?

Besides

save_dir = './frames/train/' + video_name.strip('.mp4') +'/'

will generate incorrect paths. for example, It changes "video34.mp4" into "video3".

Few errors in the evaluation code of the experiment listed in Table 6

Hi, thanks for your code and paper, I may have found some errors in your evaluation code when agg='video_relaxed'.

First the original matlab script

index = find(prec>100);
prec(index)=100;
index = find(rec>100);
rec(index)=100;

They limit the value of precision and recall.

Besides when you compute the 'tp_and_fp'

tp_and_fp = np.argwhere(preds == iPhase).flatten()
tp_and_fn = np.argwhere(targets == iPhase).flatten()
union = np.union1d(tp_and_fp, tp_and_fn)
# compute tp
tp = np.sum(updatedDiff[tp_and_fp] == 0)

This code will add some 0s into 'tp_and_fp'. For example, if the predictions of frame 5 to frame 8 equals to iPhase, then

tp_and_fp $=[0,5,0,6,0,7,0,8]$

And if updatedDiff[0] $=0$, the value of tp will increase by 4.

Endoscapes dataset

Hi, thanks for sharing.
Have you made your dataset publicly available? Or am I just not finding it?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.