Write a Custom Autograd Function (SILU) in PyTorch

Hardauto-graded

Implement SiLU activation with a custom autograd Function, defining both forward and backward passes manually.

Solve it

Open in ColabQuestion notebookSolution

Check your answer

The grader verifies properties of your implementation, so a correct solution written differently from ours still passes.

pip install torchleet

from torchleet import check
check("custom-autograd", LearnedSiLUFunction, LinearRegressionModel)