3.1.22.15. unit_scaling.functional.rms_norm

unit_scaling.functional.rms_norm(input: Tensor, normalized_shape: Tuple[int, ...], weight: Tensor | None = None, eps: float = 1e-05) → Tensor[source]

Apply unit-scaled RMS Normalization for last certain number of dimensions.

See RMSNorm for details.