Types of Issue
Descriptive summary
During Freight Work Zone Management testing, the team discovered large latencies during the process of V2XHub receiving a TrafficControlRequest (TCR) and broadcasting corresponding TrafficControlMessages (TCMs). The test set up for these evaluation runs sometimes included one vehicle transmitting TCRs at 1 Hz, and sometimes included three vehicles simultaneously transmitting TCRs at 1 Hz. CARMA Cloud was setup to provide 9 TCMs for each of these TCRs.
From these test runs, the RSU pcap logs, V2XHub docker logs, and CARMA Cloud tomcat logs were analyzed.
After conducting data analysis on the CARMA Cloud tomcat logs, some instances of a large delay between CARMA Cloud receiving a TCR from V2XHub and sending all corresponding TCMs to V2XHub were found. The average CARMA Cloud processing time (Time between receiving a TCR and sending all of the corresponding TCMs) was ~1.68 seconds for all April 22nd data (with 50% occurring under 1 second), but it was found that occasionally CARMA Cloud received a TCR and took 10-20 seconds to send a corresponding TCM to V2XHub. Some instances of delays over 100 seconds were found as well. It is currently unclear what caused these delays.
V2XHUB version where this issue was discovered
CARMA Cloud version from April 22nd-April 25th, 2022
Expected behavior
The following metric was developed in order to evaluate the performance of the system, and does not indicate pass/fail of the system; however, the round trip times for TCR/TCM processing are expected to be much lower than the actual behavior found during testing:
- Freight Workzone Metric 4: Once CC receives a TCR from the vehicle (via CS), it sends a TCM to CS within 0.1 seconds.
Actual behavior
- Freight Workzone Metric 4: Average of 1-2 seconds, but can occasionally spike to 100+ seconds.
Steps to reproduce the actual behavior
Conduct Freight Work Zone Management evaluation runs (1-vehicle or 3-vehicle versions) per the verification test plan for the use case.
Related work
Related V2XHub Issue: Click Here