Deriva — Derive the Algorithm

← Projectsgrounded-answer / L2Citation Binder~18 min

one move: preserve an invariant

Evaluate retrieval separately from generation with recall@k and reciprocal rank for one query. In the Grounded Answer Service system, implement this level as a deterministic contract before composing it with the next service.

Required API

def retrieval_metrics(relevant, retrieved, k):
    return {'recall_at_k': ..., 'mrr': ...}

Behavior

measure hits only in the top k
deduplicate top results
use the first relevant rank for MRR

Examples — tap to reveal

Constraints

Use only the Python standard library.
Return deterministic values so every run can be compared with the contract.
Do not mutate caller-owned inputs.

Opening…