Function Description

Function

Perform layer normalization.

Formula

Where,

• is the optional scaling factor and shift of a channel.
• is the mean and variance.
• ε is a constant used to improve numerical stability.