zaidalyafeai / attentionn Goto Github PK
View Code? Open in Web Editor NEWAll about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
License: MIT License
attentionn's Issues
Can you develop a version for pytorch models?
Great job!
Would you please develop a pytorch version so that I can use it to visualize the attention of NN trained on Pytorch & fast.ai ?
Thanks a lot!
No such layer: conv5_block3_2_relu
tried to run Attention_in_Image_Captioning:
File "E:\Anaconda3\lib\site-packages\tensorflow\python\keras_impl\keras\engine\network.py", line 433, in get_layer
raise ValueError('No such layer: ' + name)
ValueError: No such layer: conv5_block3_2_relu
Exception ignored in: <bound method BaseSession.del of <tensorflow.python.client.session.Session object at 0x000001E921F12668>>
Traceback (most recent call last):
File "E:\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 707, in del
TypeError: 'NoneType' object is not callable
print(image_model.summary())
Layer (type) Output Shape Param # Connected to
input_1 (InputLayer) (None, 224, 224, 3) 0
conv1 (Conv2D) (None, 112, 112, 64) 9472 input_1[0][0]
bn_conv1 (BatchNormalization) (None, 112, 112, 64) 256 conv1[0][0]
activation_1 (Activation) (None, 112, 112, 64) 0 bn_conv1[0][0]
max_pooling2d_1 (MaxPooling2D) (None, 55, 55, 64) 0 activation_1[0][0]
res2a_branch2a (Conv2D) (None, 55, 55, 64) 4160 max_pooling2d_1[0][0]
bn2a_branch2a (BatchNormalizati (None, 55, 55, 64) 256 res2a_branch2a[0][0]
activation_2 (Activation) (None, 55, 55, 64) 0 bn2a_branch2a[0][0]
res2a_branch2b (Conv2D) (None, 55, 55, 64) 36928 activation_2[0][0]
bn2a_branch2b (BatchNormalizati (None, 55, 55, 64) 256 res2a_branch2b[0][0]
activation_3 (Activation) (None, 55, 55, 64) 0 bn2a_branch2b[0][0]
res2a_branch2c (Conv2D) (None, 55, 55, 256) 16640 activation_3[0][0]
res2a_branch1 (Conv2D) (None, 55, 55, 256) 16640 max_pooling2d_1[0][0]
bn2a_branch2c (BatchNormalizati (None, 55, 55, 256) 1024 res2a_branch2c[0][0]
bn2a_branch1 (BatchNormalizatio (None, 55, 55, 256) 1024 res2a_branch1[0][0]
add_1 (Add) (None, 55, 55, 256) 0 bn2a_branch2c[0][0]
bn2a_branch1[0][0]
activation_4 (Activation) (None, 55, 55, 256) 0 add_1[0][0]
res2b_branch2a (Conv2D) (None, 55, 55, 64) 16448 activation_4[0][0]
bn2b_branch2a (BatchNormalizati (None, 55, 55, 64) 256 res2b_branch2a[0][0]
activation_5 (Activation) (None, 55, 55, 64) 0 bn2b_branch2a[0][0]
res2b_branch2b (Conv2D) (None, 55, 55, 64) 36928 activation_5[0][0]
bn2b_branch2b (BatchNormalizati (None, 55, 55, 64) 256 res2b_branch2b[0][0]
activation_6 (Activation) (None, 55, 55, 64) 0 bn2b_branch2b[0][0]
res2b_branch2c (Conv2D) (None, 55, 55, 256) 16640 activation_6[0][0]
bn2b_branch2c (BatchNormalizati (None, 55, 55, 256) 1024 res2b_branch2c[0][0]
add_2 (Add) (None, 55, 55, 256) 0 bn2b_branch2c[0][0]
activation_4[0][0]
activation_7 (Activation) (None, 55, 55, 256) 0 add_2[0][0]
res2c_branch2a (Conv2D) (None, 55, 55, 64) 16448 activation_7[0][0]
bn2c_branch2a (BatchNormalizati (None, 55, 55, 64) 256 res2c_branch2a[0][0]
activation_8 (Activation) (None, 55, 55, 64) 0 bn2c_branch2a[0][0]
res2c_branch2b (Conv2D) (None, 55, 55, 64) 36928 activation_8[0][0]
bn2c_branch2b (BatchNormalizati (None, 55, 55, 64) 256 res2c_branch2b[0][0]
activation_9 (Activation) (None, 55, 55, 64) 0 bn2c_branch2b[0][0]
res2c_branch2c (Conv2D) (None, 55, 55, 256) 16640 activation_9[0][0]
bn2c_branch2c (BatchNormalizati (None, 55, 55, 256) 1024 res2c_branch2c[0][0]
add_3 (Add) (None, 55, 55, 256) 0 bn2c_branch2c[0][0]
activation_7[0][0]
activation_10 (Activation) (None, 55, 55, 256) 0 add_3[0][0]
res3a_branch2a (Conv2D) (None, 28, 28, 128) 32896 activation_10[0][0]
bn3a_branch2a (BatchNormalizati (None, 28, 28, 128) 512 res3a_branch2a[0][0]
activation_11 (Activation) (None, 28, 28, 128) 0 bn3a_branch2a[0][0]
res3a_branch2b (Conv2D) (None, 28, 28, 128) 147584 activation_11[0][0]
bn3a_branch2b (BatchNormalizati (None, 28, 28, 128) 512 res3a_branch2b[0][0]
activation_12 (Activation) (None, 28, 28, 128) 0 bn3a_branch2b[0][0]
res3a_branch2c (Conv2D) (None, 28, 28, 512) 66048 activation_12[0][0]
res3a_branch1 (Conv2D) (None, 28, 28, 512) 131584 activation_10[0][0]
bn3a_branch2c (BatchNormalizati (None, 28, 28, 512) 2048 res3a_branch2c[0][0]
bn3a_branch1 (BatchNormalizatio (None, 28, 28, 512) 2048 res3a_branch1[0][0]
add_4 (Add) (None, 28, 28, 512) 0 bn3a_branch2c[0][0]
bn3a_branch1[0][0]
activation_13 (Activation) (None, 28, 28, 512) 0 add_4[0][0]
res3b_branch2a (Conv2D) (None, 28, 28, 128) 65664 activation_13[0][0]
bn3b_branch2a (BatchNormalizati (None, 28, 28, 128) 512 res3b_branch2a[0][0]
activation_14 (Activation) (None, 28, 28, 128) 0 bn3b_branch2a[0][0]
res3b_branch2b (Conv2D) (None, 28, 28, 128) 147584 activation_14[0][0]
bn3b_branch2b (BatchNormalizati (None, 28, 28, 128) 512 res3b_branch2b[0][0]
activation_15 (Activation) (None, 28, 28, 128) 0 bn3b_branch2b[0][0]
res3b_branch2c (Conv2D) (None, 28, 28, 512) 66048 activation_15[0][0]
bn3b_branch2c (BatchNormalizati (None, 28, 28, 512) 2048 res3b_branch2c[0][0]
add_5 (Add) (None, 28, 28, 512) 0 bn3b_branch2c[0][0]
activation_13[0][0]
activation_16 (Activation) (None, 28, 28, 512) 0 add_5[0][0]
res3c_branch2a (Conv2D) (None, 28, 28, 128) 65664 activation_16[0][0]
bn3c_branch2a (BatchNormalizati (None, 28, 28, 128) 512 res3c_branch2a[0][0]
activation_17 (Activation) (None, 28, 28, 128) 0 bn3c_branch2a[0][0]
res3c_branch2b (Conv2D) (None, 28, 28, 128) 147584 activation_17[0][0]
bn3c_branch2b (BatchNormalizati (None, 28, 28, 128) 512 res3c_branch2b[0][0]
activation_18 (Activation) (None, 28, 28, 128) 0 bn3c_branch2b[0][0]
res3c_branch2c (Conv2D) (None, 28, 28, 512) 66048 activation_18[0][0]
bn3c_branch2c (BatchNormalizati (None, 28, 28, 512) 2048 res3c_branch2c[0][0]
add_6 (Add) (None, 28, 28, 512) 0 bn3c_branch2c[0][0]
activation_16[0][0]
activation_19 (Activation) (None, 28, 28, 512) 0 add_6[0][0]
res3d_branch2a (Conv2D) (None, 28, 28, 128) 65664 activation_19[0][0]
bn3d_branch2a (BatchNormalizati (None, 28, 28, 128) 512 res3d_branch2a[0][0]
activation_20 (Activation) (None, 28, 28, 128) 0 bn3d_branch2a[0][0]
res3d_branch2b (Conv2D) (None, 28, 28, 128) 147584 activation_20[0][0]
bn3d_branch2b (BatchNormalizati (None, 28, 28, 128) 512 res3d_branch2b[0][0]
activation_21 (Activation) (None, 28, 28, 128) 0 bn3d_branch2b[0][0]
res3d_branch2c (Conv2D) (None, 28, 28, 512) 66048 activation_21[0][0]
bn3d_branch2c (BatchNormalizati (None, 28, 28, 512) 2048 res3d_branch2c[0][0]
add_7 (Add) (None, 28, 28, 512) 0 bn3d_branch2c[0][0]
activation_19[0][0]
activation_22 (Activation) (None, 28, 28, 512) 0 add_7[0][0]
res4a_branch2a (Conv2D) (None, 14, 14, 256) 131328 activation_22[0][0]
bn4a_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4a_branch2a[0][0]
activation_23 (Activation) (None, 14, 14, 256) 0 bn4a_branch2a[0][0]
res4a_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_23[0][0]
bn4a_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4a_branch2b[0][0]
activation_24 (Activation) (None, 14, 14, 256) 0 bn4a_branch2b[0][0]
res4a_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_24[0][0]
res4a_branch1 (Conv2D) (None, 14, 14, 1024) 525312 activation_22[0][0]
bn4a_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4a_branch2c[0][0]
bn4a_branch1 (BatchNormalizatio (None, 14, 14, 1024) 4096 res4a_branch1[0][0]
add_8 (Add) (None, 14, 14, 1024) 0 bn4a_branch2c[0][0]
bn4a_branch1[0][0]
activation_25 (Activation) (None, 14, 14, 1024) 0 add_8[0][0]
res4b_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_25[0][0]
bn4b_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4b_branch2a[0][0]
activation_26 (Activation) (None, 14, 14, 256) 0 bn4b_branch2a[0][0]
res4b_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_26[0][0]
bn4b_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4b_branch2b[0][0]
activation_27 (Activation) (None, 14, 14, 256) 0 bn4b_branch2b[0][0]
res4b_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_27[0][0]
bn4b_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4b_branch2c[0][0]
add_9 (Add) (None, 14, 14, 1024) 0 bn4b_branch2c[0][0]
activation_25[0][0]
activation_28 (Activation) (None, 14, 14, 1024) 0 add_9[0][0]
res4c_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_28[0][0]
bn4c_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4c_branch2a[0][0]
activation_29 (Activation) (None, 14, 14, 256) 0 bn4c_branch2a[0][0]
res4c_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_29[0][0]
bn4c_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4c_branch2b[0][0]
activation_30 (Activation) (None, 14, 14, 256) 0 bn4c_branch2b[0][0]
res4c_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_30[0][0]
bn4c_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4c_branch2c[0][0]
add_10 (Add) (None, 14, 14, 1024) 0 bn4c_branch2c[0][0]
activation_28[0][0]
activation_31 (Activation) (None, 14, 14, 1024) 0 add_10[0][0]
res4d_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_31[0][0]
bn4d_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4d_branch2a[0][0]
activation_32 (Activation) (None, 14, 14, 256) 0 bn4d_branch2a[0][0]
res4d_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_32[0][0]
bn4d_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4d_branch2b[0][0]
activation_33 (Activation) (None, 14, 14, 256) 0 bn4d_branch2b[0][0]
res4d_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_33[0][0]
bn4d_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4d_branch2c[0][0]
add_11 (Add) (None, 14, 14, 1024) 0 bn4d_branch2c[0][0]
activation_31[0][0]
activation_34 (Activation) (None, 14, 14, 1024) 0 add_11[0][0]
res4e_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_34[0][0]
bn4e_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4e_branch2a[0][0]
activation_35 (Activation) (None, 14, 14, 256) 0 bn4e_branch2a[0][0]
res4e_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_35[0][0]
bn4e_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4e_branch2b[0][0]
activation_36 (Activation) (None, 14, 14, 256) 0 bn4e_branch2b[0][0]
res4e_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_36[0][0]
bn4e_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4e_branch2c[0][0]
add_12 (Add) (None, 14, 14, 1024) 0 bn4e_branch2c[0][0]
activation_34[0][0]
activation_37 (Activation) (None, 14, 14, 1024) 0 add_12[0][0]
res4f_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_37[0][0]
bn4f_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4f_branch2a[0][0]
activation_38 (Activation) (None, 14, 14, 256) 0 bn4f_branch2a[0][0]
res4f_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_38[0][0]
bn4f_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4f_branch2b[0][0]
activation_39 (Activation) (None, 14, 14, 256) 0 bn4f_branch2b[0][0]
res4f_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_39[0][0]
bn4f_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4f_branch2c[0][0]
add_13 (Add) (None, 14, 14, 1024) 0 bn4f_branch2c[0][0]
activation_37[0][0]
activation_40 (Activation) (None, 14, 14, 1024) 0 add_13[0][0]
res5a_branch2a (Conv2D) (None, 7, 7, 512) 524800 activation_40[0][0]
bn5a_branch2a (BatchNormalizati (None, 7, 7, 512) 2048 res5a_branch2a[0][0]
activation_41 (Activation) (None, 7, 7, 512) 0 bn5a_branch2a[0][0]
res5a_branch2b (Conv2D) (None, 7, 7, 512) 2359808 activation_41[0][0]
bn5a_branch2b (BatchNormalizati (None, 7, 7, 512) 2048 res5a_branch2b[0][0]
activation_42 (Activation) (None, 7, 7, 512) 0 bn5a_branch2b[0][0]
res5a_branch2c (Conv2D) (None, 7, 7, 2048) 1050624 activation_42[0][0]
res5a_branch1 (Conv2D) (None, 7, 7, 2048) 2099200 activation_40[0][0]
bn5a_branch2c (BatchNormalizati (None, 7, 7, 2048) 8192 res5a_branch2c[0][0]
bn5a_branch1 (BatchNormalizatio (None, 7, 7, 2048) 8192 res5a_branch1[0][0]
add_14 (Add) (None, 7, 7, 2048) 0 bn5a_branch2c[0][0]
bn5a_branch1[0][0]
activation_43 (Activation) (None, 7, 7, 2048) 0 add_14[0][0]
res5b_branch2a (Conv2D) (None, 7, 7, 512) 1049088 activation_43[0][0]
bn5b_branch2a (BatchNormalizati (None, 7, 7, 512) 2048 res5b_branch2a[0][0]
activation_44 (Activation) (None, 7, 7, 512) 0 bn5b_branch2a[0][0]
res5b_branch2b (Conv2D) (None, 7, 7, 512) 2359808 activation_44[0][0]
bn5b_branch2b (BatchNormalizati (None, 7, 7, 512) 2048 res5b_branch2b[0][0]
activation_45 (Activation) (None, 7, 7, 512) 0 bn5b_branch2b[0][0]
res5b_branch2c (Conv2D) (None, 7, 7, 2048) 1050624 activation_45[0][0]
bn5b_branch2c (BatchNormalizati (None, 7, 7, 2048) 8192 res5b_branch2c[0][0]
add_15 (Add) (None, 7, 7, 2048) 0 bn5b_branch2c[0][0]
activation_43[0][0]
activation_46 (Activation) (None, 7, 7, 2048) 0 add_15[0][0]
res5c_branch2a (Conv2D) (None, 7, 7, 512) 1049088 activation_46[0][0]
bn5c_branch2a (BatchNormalizati (None, 7, 7, 512) 2048 res5c_branch2a[0][0]
activation_47 (Activation) (None, 7, 7, 512) 0 bn5c_branch2a[0][0]
res5c_branch2b (Conv2D) (None, 7, 7, 512) 2359808 activation_47[0][0]
bn5c_branch2b (BatchNormalizati (None, 7, 7, 512) 2048 res5c_branch2b[0][0]
activation_48 (Activation) (None, 7, 7, 512) 0 bn5c_branch2b[0][0]
res5c_branch2c (Conv2D) (None, 7, 7, 2048) 1050624 activation_48[0][0]
bn5c_branch2c (BatchNormalizati (None, 7, 7, 2048) 8192 res5c_branch2c[0][0]
add_16 (Add) (None, 7, 7, 2048) 0 bn5c_branch2c[0][0]
activation_46[0][0]
activation_49 (Activation) (None, 7, 7, 2048) 0 add_16[0][0]
avg_pool (AveragePooling2D) (None, 1, 1, 2048) 0 activation_49[0][0]
Total params: 23,587,712
Trainable params: 23,534,592
Non-trainable params: 53,120
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.