Function Description

Operator Function

An improved version of the Rectified Linear Unit (ReLU) activation function, performs parameterized ReLU operation.

Forward formula:

Backward formula: