NuScenes Evaluation about eagermot HOT 3 CLOSED

Hello!

So currently the code only produces one JSON file for one sequence, I believe what was happening was due to the break here, which would exit the loop after processing a single sequence. I was able to remove this break and get the functionality that I needed.

Thanks for the help!

from eagermot.

Oops, I must have left it there after a recent test run.

Thanks for the flag! Fixed it and gave you a shoutout in the commit message :)

from eagermot.

Hi, thanks for checking out our work!

The code outputs sequence-level evaluations for KITTI, but for NuScenes it produces only one final JSON file after processing the whole data split - you can trace the call of this function. The final result's format should be perfect for NuScenes Devkit evaluation. I am not aware of an easy way to do sequence-level evaluations.

When running on NuScenes script does produce .txt files for each sequence, but they are empty. This functionality is a by-product of KITTI-specific code that I wrote, which I did not remove because it was useful to see how far the run has gone without ssh-ing into the session :). I also attempted to use those .txt files to save progress for each sequence by it became too cumbersome.
Perhaps this led you to this confusion, but those files are completely empty, so you can remove them if you'd like.

from eagermot.