OWLv2 Evaluation Code Does Not Work!! about scenic HOT 7 OPEN

Thanks for the reply, I ended up using one of the custom evaluation code shared earlier here in the issues.

from scenic.

@mjlm could you please help? I think this should be easy version fix, using the current requirements.txt doesn't seem to work :(

from scenic.

we have to use jax, and jaxlib version of 0.4.23 for the evaluation code to work, maybe you can hardcode the version in requirements?

Now getting new error in evaluator.py :/

file scenic/scenic/projects/owl_vit/evaluator.py", line 675, in main

    compilation_cache.set_cache_dir('/tmp/jax_compilation_cache')
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'jax.experimental.compilation_cache.compilation_cache' has no attribute 'set_cache_dir'

from scenic.

@mjlm could you please help? I think this should be easy version fix, using the current requirements.txt doesn't seem to work :(

I fixed this issue by changing PRNGKeyArray to PRNGKEY in the initializers.py file.

from scenic.

@rohit901 What evaluation code did you use ? when i tried to run the evaluation code using this command

python -m scenic.projects.owl_vit.evaluator --alsologtostderr=true --platform=gpu --config=clip_b32 --checkpoint_path=gs://scenic-bucket/owl_vit/checkpoints/clip_vit_b32_b0203fc --output_dir=/tmp/evaluator
its creating the tfds lvis dataset and its taking very long time >1 day and gets killed. Could you please let me know how to evaluate on LVIS dataset ?

from scenic.

@Mukil07
i referred this: #762

from scenic.

I solved it by changing PRNGKeyArray to PRNGKEY in the initializers.py file.
#1043
You can see the steps there to know where the file is located and what to change.

from scenic.