3.1.24. unit_scaling.parameter

Extends torch.nn.Parameter with attributes for u-μP.

Functions

Parameter(data, mup_type[, mup_scaling_depth])	Construct a u-μP parameter object, an annotated torch.nn.Parameter.
has_parameter_data(parameter)	Check that the parameter supports the ParameterData protocol.

Classes

OrderedDict	Dictionary that remembers insertion order
ParameterData(*args, **kwargs)	Extra fields for torch.nn.Parameter, tagging u-μP metadata.
Protocol()	Base class for protocol classes.
Tensor