adagrad algorithm

Adagrad

PyTorch documentation

Implements Adagrad algorithm. For further details regarding the algorithm we refer to Adaptive Subgradient Methods for Online Learning and Stochastic Optimization . params ( iterable ) – iterable of p...

Adamax

PyTorch documentation

Implements Adamax algorithm (a variant of Adam based on infinity norm). For further details regarding the algorithm we refer to Adam: A Method for Stochastic Optimization . params ( iterable ) – itera...