Predict how initialization changes activation scale: weights initialized 10× larger than the recommended range.

prerequisite: NN-001

Context fixture

{
  "initScale": "10×",
  "layer": "linear → tanh"
}

Hints · 0/3

Your answer

Opening…