Tensorflow Implementation of Hard Mish - Memory Efficient and faster equivalent of Mish

Formula - (x/2).min(2, max(0, x+2))

import tensorflow as tf
def hard_mish(x):
    return tf.minimum(2., tf.nn.relu(x + 2.)) * 0.5 * x

Figure 1. Hard Mish Activation Function

• H-Mish