Rate This Document
Findability
Accuracy
Completeness
Readability

Function Description

Operator Function

An improved version of the Rectified Linear Unit (ReLU) activation function, performs parameterized ReLU operation.

Formula

The forward formula is as follows:

The backward formula is as follows: