Abouth using median value to solve scale ambiguity when evualating about deep-sfm-revisited HOT 4 OPEN

Hey @xhchen10 , did you have any luck finding out the reason? I spotted that too and seems strange

from deep-sfm-revisited.

Nope. :(

from deep-sfm-revisited.

Hi @xhchen10 @LeoPerelli ,

The role of "GT scale \alpha_gt (see Line 536-541 in main.py)" is to ensure that the depth values are properly normalized during the training phase, which helps with the stability of the training process. This is for the stability of training. As mentioned, such an operation can be skipped during inference.

At the same time, "use the ratio between the median values of predicted and GT depth to scale the predicted depth (576-585)" is the common evaluation protocol for depth evaluation. This is due to the well known scale ambiguity problem. We simply adopted the same evaluation pipeline used in previous methods. For example, https://github.com/nianticlabs/monodepth2/blob/b676244e5a1ca55564eb5d16ab521a48f823af31/evaluate_depth.py#L206 in monodepth2.

Please let me know if you have further questions :)

Best,
Jianyuan

from deep-sfm-revisited.

Thanks a lot Jianyuan, now it makes sense! :)

from deep-sfm-revisited.