Skip to content

Bump to 0.5.27 + Add experimental Parallel Step#280

Merged
jrapin merged 22 commits into
mainfrom
parallel-step
Jul 1, 2026
Merged

Bump to 0.5.27 + Add experimental Parallel Step#280
jrapin merged 22 commits into
mainfrom
parallel-step

Conversation

@jrapin

@jrapin jrapin commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jun 4, 2026
@jrapin jrapin changed the title [Experimental] Add Parallel Step Bump to 0.5.27 + Add experimental Parallel Step Jun 24, 2026
@jrapin jrapin merged commit 6bc001b into main Jul 1, 2026
7 checks passed
@jrapin jrapin deleted the parallel-step branch July 1, 2026 08:48
bruAristimunha added a commit to bruAristimunha/neuroai that referenced this pull request Jul 1, 2026
Replace the hand-rolled PackedExperiment packing with exca 0.5.27's
Parallel step (facebookresearch/exca#280). Pending experiments are
dispatched as one sweep into ceil(pending/N) array elements, each still
caching under its own TaskInfra identity, so re-running the grid without
packing hits the same caches.

- packing.py: PackedExperiment/pack_experiments_for_submission ->
  submit_packed() + a thin _ExperimentStep wrapper delegating to
  experiment.run(); exca owns chunking, claim coordination and shuffling.
- Drop --local-workers-per-job: variants in one scheduler element run
  serially, so in-job multiprocessing has no equivalent.
- Bump exca to >=0.5.27; fix stale _FakeAggregator test stub.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant