Time Cost Difference between Non-GPU Version IPC and Normal GPU Version IPC

What is the Time Cost difference between Non-GPU version IPC and Normal GPU version IPC?

Taking the instance segmentation modules as an example:

We conducted tests on the module using the following hardware specifications:

  • CPU: Intel Core i7-12700F
  • GPU: NVIDIA GeForce GTX 1660 SUPER

Test Method MAX Time (ms) AVG Time(ms) Min Time(ms)
CPU 1165 826.0 767
GPU Default 297 126.6 107
GPU Optimization 93 82.7 81