3.5. unit_scaling.scale

Operations to enable different scaling factors in the forward and backward passes.

Functions

scale_bwd(input, scale)

Applies a scalar multiplication to a tensor in only the backward pass.

scale_fwd(input, scale)

Applies a scalar multiplication to a tensor in only the forward pass.