Implement Adam from Scratch in PyTorch
Hardauto-graded
Implement the Adam optimizer from scratch on top of torch.optim.Optimizer: exponential moving averages of the gradient and its square, with bias correction.
Solve it
Check your answer
The grader verifies properties of your implementation, so a correct solution written differently from ours still passes.
pip install torchleet
from torchleet import check
check("adam", MyAdam)