3.1.23.3. unit_scaling.optim.lr_scale_func_sgd

unit_scaling.optim.lr_scale_func_sgd(readout_constraint: str | None) Callable[[ParameterData], float][source]

Calculate the LR scaling factor for torch.optim.SGD.