eval-author (NVIDIA-NeMo)VerificationConfidence: Medium

Proof runs for a FreeCAD CAD agent ate about 226 minutes when only tests changed, because every check change reran the whole proof from scratch.

Impact Analysis

Persona

Hardware Engineer

Team Size Impact

5x Multiplier

Prototype Delay

3 Days

Est. Annual Cost

$30,000

1 user · 1 month240 min
Rest of team960 min
Rest of year13,200 min

monthly_minutes × 12 × team_multiplier ÷ 60 × $75/hr = $30k/yr

$75/hr assumed rate.

Annual team-minutes decomposed from the reported monthly inputs.

Evidence & Sources

1 Sources

NVIDIA-NeMo/eval-author Issue #139: Proofs: regrade stored runs when only tests/ changed

github.com

→

Analyst Notes

From the Grok pain-radar digests, Oct 27-28 2026 (Oct 27 8:41 AM ET through Oct 28 7:41 AM ET digests plus the Haitch editions). Verified live 2026-10-28: issue/PR/thread read; title and state confirmed.