Comments (4)
Hi @Bigtuo, thank you for trying our code.
If this is what you get after submitting your results to ApolloScape website, there is a high probability that your code has bugs. Because you did you provide any useful information about how you get this result (Code modification, GPUs, OS, Libraries, etc.), I cannot figure out the reason.
There are so many researchers have tried our code and got duplicated results.
The code we released can get similar results (after submitting results to ApolloScape):
GRIP 1.2524 2.2081 0.7142 1.8024 2.3440 3.9805 1.3732 3.4155
If you are sure that your code does not have any bugs, there are some factors may impact the precision (but not in a large scale):
- The GPUs. Different GPUs have different precision.
- Driver/Library version. The NVIDIA driver, CUDA, CUDNN, Pytorch, Python, even OS can impact the precision.
from grip.
I didn't make any changes,and I use APOLLO's evaluation.py. In addition to your inconsistent results, the official baseline evaluation results are also inconsistent.
The evaluation results of baseline model are as follows:
WSADE: 35.52371758873721
ADEv, ADEp, ADEb: 35.73273751079803 36.26945977251843 33.367651902349614
WSFDE: 18.967547482188102
FDEv, FDEp, FDEb: 24.395048414119227 16.602132518526005 20.269549720996242
How should I solve it
from grip.
@Bigtuo if you did not change the code, and directly run the "evaluation.py", you are expected to get a very bad result.
Because they have already clearly describe that "./test_eval_data/prediction_gt.txt is just for testing the code which is not the real ground truth.", which means using testing on a fake ground truth. Please submit your result to their website to get true error. Thanks.
from grip.
from grip.
Related Issues (20)
- Visualize results
- About the test results HOT 8
- Argoverse数据集的训练与测试问题 HOT 2
- Is grip++using heading? HOT 4
- velocity input HOT 2
- In data_process.py line 15 HOT 2
- input preprocessing model HOT 4
- Integrated with HD map (vector map)
- xin_feeder_baidu.py file HOT 2
- How can I install layers.graph_operation_layer in graph_conv_block.py
- model文件中出现了keyerror
- 论文中Fig.5中,有车道线信息,请问这个车道线信息是从apollo数据集中获取的吗? HOT 1
- GRIP code
- GRIP++ on NGSIM HOT 14
- About dataset HOT 1
- GRIP++ on NGSIM
- the question of Urban Traffic Scene(Sample)
- 有关行进方向
- GRIP++ Without NVIDIA HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from grip.