ATTN-005Communicationtrack →Inspect this attention failure: the model attends to the padding token at the end of every sentence. Explain the mechanism and the harm.
prerequisite: ATTN-003
Context fixture{
"attention": "→ padding",
"harm": "noise pollutes the context"
}
Hints · 0/3