how to compute CMC and rank? about open-reid HOT 13 CLOSED

Suppose you have 3 gallery samples with ID 0,1,1 and 4 query samples with ID 0,0,1,1, then you need to

Compute 3x4 pairwise distance matrix D, where D[i, j] = distance between gallery-i and query-j
Create a query ID list qids = [0,0,1,1]
Create a gallery ID list gids = [0,1,1]
Then you can call reid.evaluation_metrics.cmc(D, qids, gids) to get CMC.

from open-reid.

1.why is ID 0,1,1 ? it mean the second and the third are the same person ?
2.so ID 0,1,1 don't have like cuhk03 ID 0000 0001 0002 0003 .....(many ID) ?

from open-reid.

1. Yeah, it's just an example. The second and the third belong to the same person identity.
2. It's just an example to help you understand.

from open-reid.

cuhk03 is use val to compute CMC right?

from open-reid.

I am not sure what you refer to. All the results here in open reid are reported on the test set.

from open-reid.

hi
１. what are the gallery , query and probe ?

2. if the value of distance matrix is large = the pairwise is not the same person
   the value of distance matrix is small= the pairwise is the same person
   right?

from open-reid.

@Phoebe-star query is the same means as probe,you have a query(probe)image and then you should find the image that have the same id in the gallery. and we have a rank list of the gallery images ,CMC is caculated based on the list

from open-reid.

@Linranran Thank you very much for the explanation!

@Phoebe-star Yes, large distance value implies the pair is probably not the same person, and vice versa.

from open-reid.

@Cysu its my pleasure，haha

from open-reid.

I got it , thanks you ^^

from open-reid.

I have another problem
how to select cuhk03 dataset validation to compute CMC ??

every time , I got a different cmc value

from open-reid.

I have another question in computing CMC and mAP of cuhk03. Open reid gived me the result that rank1 was greater than mAP, but When I read some papers such as “SVDNet for Pedestrian Retrieval”， they showed the results that mAP was greater than rank1. I'm comfused all the time even after I read Evaluation Metrics in docs of open reid. Could anyone help me figure out that or just point me to some helpful website?

from open-reid.

what is your cmc code ?

from open-reid.