3.1.22.7. unit_scaling.functional.layer_norm

unit_scaling.functional.layer_norm(input: Tensor, normalized_shape: Sequence[int], weight: Tensor | None = None, bias: Tensor | None = None, eps: float = 1e-05) → Tensor[source]

Applies a unit-scaled Layer Normalization for last certain number of dimensions.

See LayerNorm for details.