Project 5 · Data engineering0/5 completeData Pipeline
Cursored batches, transient failures, and dead letters: the learner builds a pipeline that resumes, rebuilds from a manifest, and warns on drift.
requires artifacts from: document-intelligence
- L1Source Adapterdefine the contract · ~12 minstart →
- L2Checkpointed Pipelinepreserve an invariant · ~16 minlocked
- L3Retry + Dead Lettermeasure behavior · ~18 minlocked
- L4Rebuild from Manifestbound a failure · ~20 minlocked
- L5Drift Warningmake an operational decision · ~24 minlocked
Artifacts this project producesL1 · Source Adapteroutputs: data-pipeline:l1-source-adapter:artifact
L2 · Checkpointed Pipelineoutputs: data-pipeline:l2-checkpointed-pipeline:artifact
L3 · Retry + Dead Letteroutputs: data-pipeline:l3-retry-deadletter:artifact
L4 · Rebuild from Manifestoutputs: data-pipeline:l4-rebuild-manifest:artifact
L5 · Drift Warningoutputs: data-pipeline:l5-drift-warning:artifact