How to zero-shot transfer to PASCAL VOC? The config file does not provide any information about PASCAL VOC about groupvit HOT 6 OPEN

Hi @XiaominLi1997
The config is here https://github.com/NVlabs/GroupViT/blob/main/configs/default.yml#L90

from groupvit.

I also want to know the evaluation part.
Does the cls part only include the ImageNet?
And the seg part includes Pascal VOC, Pascal Context and COCO?
Thank you very much.

config file:
evaluate:
eval_only: false
eval_freq: 1
task:
- cls
- seg
cls:
save_best: true
template: subset
seg:
save_best: true
cfg: segmentation/configs/base/datasets/pascal_voc12.py
template: simple
opts: []

from groupvit.

I also want to know the evaluation part.
Does the cls part only include the ImageNet?
And the seg part includes Pascal VOC, Pascal Context and COCO?
Thank you very much.

config file:
evaluate:
eval_only: false
eval_freq: 1
task:
- cls
- seg
cls:
save_best: true
template: subset
seg:
save_best: true
cfg: segmentation/configs/base/datasets/pascal_voc12.py
template: simple
opts: []

from groupvit.

Hi @XiaominLi1997 The config is here https://github.com/NVlabs/GroupViT/blob/main/configs/default.yml#L90

Thanks. And I have another question, in the reference phase, can GroupViT only group the objects appearring in the training samples? If GroupViT can group objects unseen in the training phase.

Thank you again for your patient reply.

from groupvit.

Hi @XiaominLi1997
Since the training samples are noisy, it may cover a wide range of concepts. Some of them may overlap with our evaluation dataset, e.g. Pascal VOC. But we didn't explicitly evaluate the out of distribution grouping since it's hard to exclude some objects from noisy training set.

from groupvit.

I also want to know the evaluation part. Does the cls part only include the ImageNet? And the seg part includes Pascal VOC, Pascal Context and COCO? Thank you very much.

config file: evaluate: eval_only: false eval_freq: 1 task: - cls - seg cls: save_best: true template: subset seg: save_best: true cfg: segmentation/configs/base/datasets/pascal_voc12.py template: simple opts: []

The cls part is referring to the ImageNet zero-shot classification.
You may change the evaluation dataset following instructions here. By default, we are using Pascal VOC dataset.

from groupvit.