Turn a new attention idea into evidence
one move: test a new hypothesis
Open the code pane immediately, then use the Spec tab, optional design question, tests, and artifact when you want them.
Finish each move before carrying the artifact forward.
Research means defining a mechanism, predicting a tradeoff, measuring it, and writing what survived.
Deliverable: Write the mechanism in one sentence.Choose and implement a linear or sparse attention variant with a fair baseline.
Deliverable: Type the smallest runnable implementation.Numerical equivalence, speed, memory, and quality must be compared on fixed fixtures.
Deliverable: Record the expected output and one edge case.Run ablations, falsify the hypothesis where possible, and write the limitations.
Deliverable: Change one variable and explain the result.A reproducible experiment package and a short technical paper.
Deliverable: Save the code, output, and a short failure note.Numerical equivalence, speed, memory, and quality must be compared on fixed fixtures.
Run ablations, falsify the hypothesis where possible, and write the limitations.
A reproducible experiment package and a short technical paper.
Mapped from the supplied Build Everything PDF, source page 73. The five moves are Deriva’s implementation contract for this project.