Diagnose these exploding gradients: loss → NaN after 20 steps, weights become 1e8. Name the mechanism and two fixes.

prerequisite: NN-004

Context fixture

{
  "symptom": "NaN",
  "weights": "1e8",
  "layer": 12
}

Hints · 0/3

Your answer

Opening…