3.1.23.3. unit_scaling.optim.lr_scale_func_sgd
- unit_scaling.optim.lr_scale_func_sgd(readout_constraint: str | None) Callable[[ParameterData], float] [source]
Calculate the LR scaling factor for
torch.optim.SGD
.
Calculate the LR scaling factor for torch.optim.SGD
.