3.8.2. unit_scaling.utils.ScalePair

class unit_scaling.utils.ScalePair(forward: float | None = None, backward: float | None = None)[source]

Dataclass containing a pair of scalars, intended to represent the standard deviation of an arbitrary tensor in the forward and backward passes.