Calculating the FLOPs of the model about shift-gcn HOT 8 CLOSED

Thanks for your interest.
Firstly, the computation cost of temporal convolution is [(9 × T C1 C1) × N] instead of [(9 × T C C1) × N], which is 6.08G. My apologies for the typo in supplement. Our result is calculated by [(9 × T C1 C1) × N], which is consistent with the ST-GCN model structure.
Secondly, in the NTU RGB+D dataset, there are one or two people in each sample. For samples with only one person, the second person is padded with zeros. The skeleton graphs of these two people are computed respectively. So we need to multiply the computation cost by 2.
Thus the result is (2.0232G + 6.08G) * 2 = 16.2G.

from shift-gcn.

For ST-GCN, the number of parameters in a spatial convolution layer is [ C×C1 + C ], the number of parameters in a temporal convolution layer is [9×C1×C1 + C1], the number of parameters in FC layer is 256×60. The total parameter cost is 3.0M.
For Shift-GCN, the number of parameters in a spatial convolution layer is [C×C1 + C1 + N×C1], the number of parameters in a temporal convolution layer is [C1×C1 + C1 + 2C1], the number of parameters in FC layer is 256×60. The total parameter cost is 0.5M.

from shift-gcn.

Thank you very much for your quick response.
I have also verified for Shift-GCN.

Would also like to know if you have calculated the number of parameters for the model.

from shift-gcn.

Dear @kchengiva,

That was very helpful.

Thanks for your quick response.

from shift-gcn.

Dear @kchengiva,
In the given code I am not able to find where FLOPS are computed? Can you please help.

from shift-gcn.

Thanks for your interest. @preksha12
The code for calculating the computational cost of ST-GCN is as below:

import numpy as np 

channel = [[3,64],[64,64],[64,64],[64,64],[64,128],[128,128],[128,128],[128,256],[256,256],[256,256],]
temporal = [300,300,300,300,150,150,150,75,75,75]

# ST-GCN
Sflops = 0
Tflops = 0
for layer in range(len(channel)):
	Sflops += 3*(channel[layer][0]*channel[layer][1]*25 + channel[layer][1]*25*25)*temporal[layer]
	Tflops += 9*(temporal[layer]*25)*(channel[layer][1]*channel[layer][1])
fc = 256*60

print('ST-GCN')
print('spatial', Sflops*2/1e9)
print('temporal', Tflops*2/1e9)
print('1 stream', (Sflops+Tflops+fc)*2/1e9)
print('2 stream', (Sflops+Tflops+fc)/1e9*2*2)
print('4 stream', (Sflops+Tflops+fc)/1e9*2*4)

from shift-gcn.

Thanks for your interest. @preksha12
The code for calculating the computational cost of ST-GCN is as below:

import numpy as np 

channel = [[3,64],[64,64],[64,64],[64,64],[64,128],[128,128],[128,128],[128,256],[256,256],[256,256],]
temporal = [300,300,300,300,150,150,150,75,75,75]

# ST-GCN
Sflops = 0
Tflops = 0
for layer in range(len(channel)):
	Sflops += 3*(channel[layer][0]*channel[layer][1]*25 + channel[layer][1]*25*25)*temporal[layer]
	Tflops += 9*(temporal[layer]*25)*(channel[layer][1]*channel[layer][1])
fc = 256*60

print('ST-GCN')
print('spatial', Sflops*2/1e9)
print('temporal', Tflops*2/1e9)
print('1 stream', (Sflops+Tflops+fc)*2/1e9)
print('2 stream', (Sflops+Tflops+fc)/1e9*2*2)
print('4 stream', (Sflops+Tflops+fc)/1e9*2*4)

Thank you so much for your reply.

from shift-gcn.

Hello,
I also have doubt regarding how you have formulated these equations for FLOPS. How can we apply FLOPS formula for any other network?

Thanks for your interest. @preksha12
The code for calculating the computational cost of ST-GCN is as below:

import numpy as np 

channel = [[3,64],[64,64],[64,64],[64,64],[64,128],[128,128],[128,128],[128,256],[256,256],[256,256],]
temporal = [300,300,300,300,150,150,150,75,75,75]

# ST-GCN
Sflops = 0
Tflops = 0
for layer in range(len(channel)):
	Sflops += 3*(channel[layer][0]*channel[layer][1]*25 + channel[layer][1]*25*25)*temporal[layer]
	Tflops += 9*(temporal[layer]*25)*(channel[layer][1]*channel[layer][1])
fc = 256*60

print('ST-GCN')
print('spatial', Sflops*2/1e9)
print('temporal', Tflops*2/1e9)
print('1 stream', (Sflops+Tflops+fc)*2/1e9)
print('2 stream', (Sflops+Tflops+fc)/1e9*2*2)
print('4 stream', (Sflops+Tflops+fc)/1e9*2*4)

Thank you so much for your reply.

Hello,
I also have doubt regarding how you have formulated these equations for FLOPS. How can we apply FLOPS formula for any other network?

from shift-gcn.