Struct Parameter
Encapsulates information about network parameters.
struct Parameter
;
This can be used to keep track of per-parameter loss functions (e.g., weight decay), and also projection functions that can be applied using constrained optimisation methods.
Fields
Name | Type | Description |
---|---|---|
loss | Operation | Used for applying loss terms to this parameter (e.g., weight decay) |
projection | Operation delegate(Operation) | A projection operation that can enforce some constraint |
symbol | Operation | An "variable" operation. |