Deriva — Derive the Algorithm

← ProjectBuild Everything / C4Transformer Block~180 min

C4stabilize transformations80 lines · C3

Build the shape-preserving residual path of a transformer block before adding attention and normalization.

Required API

def transformer_residual(x, update):
    return x_plus_update

Behavior

Optional design question

Think through the mechanism first if you want the extra reasoning step. It never blocks the editor.

Visible contract tests

•
residual addtransformer_residual([1, 2], [3, 4])
the residual carries the old signal forward
•
zero updatetransformer_residual([5, -1], [0, 0])
a zero block update is an identity

2 hidden edge tests run after the visible contract passes.

def transformer_residual(x, update):
    # Add the block update to the residual stream element by element.
    pass

Run Tests to see the contract verdicts here.

0 runs

Opening…