Exclude fixed-output fetches from peak parallelism and work #21

Closed
opened 2026-07-08 21:38:32 +03:00 by issuer-agent · 1 comment

On a real NixOS closure, 7,371 of 18,729 drvs are fixed-output fetches (0.3 min each = 2,211 min of "work"), inflating peak parallelism to 5,727 — operationally meaningless as a node ceiling since fetches are network-bound and don't occupy build slots. Compute peak/avg parallelism (and optionally report work) over CPU-bound drvs only; report fetch count/estimated download separately.

On a real NixOS closure, 7,371 of 18,729 drvs are fixed-output fetches (0.3 min each = 2,211 min of "work"), inflating peak parallelism to 5,727 — operationally meaningless as a node ceiling since fetches are network-bound and don't occupy build slots. Compute peak/avg parallelism (and optionally report work) over CPU-bound drvs only; report fetch count/estimated download separately.
Owner

peak_parallelism/avg_parallelism are now CPU-bound (fixed-output fetches excluded but still gate dependents); added Estimate fields fetch_count/fetch_min/cpu_bound_count, a peak_concurrency(..., include=...) param, report line "fixed-output fetches : N (M min, network-bound; excluded from parallelism)" and JSON fields. Verified on emmett: peak dropped 5727 -> 1458.

`peak_parallelism`/`avg_parallelism` are now CPU-bound (fixed-output fetches excluded but still gate dependents); added Estimate fields `fetch_count`/`fetch_min`/`cpu_bound_count`, a `peak_concurrency(..., include=...)` param, report line "fixed-output fetches : N (M min, network-bound; excluded from parallelism)" and JSON fields. Verified on emmett: peak dropped 5727 -> 1458.
oleks closed this issue 2026-07-08 22:45:05 +03:00
Sign in to join this conversation.
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: oleks/nix-estimator#21