Kmonte/explore dataloader cpp and vectorized#679

Draft

kmontemayor2-sc wants to merge 31 commits into

mainfrom

kmonte/explore-dataloader-cpp-and-vectorized

Commits on Jun 23, 2026

feat(distributed): add GIGL_COLLATE_IMPL flag resolver for collate dispatch
kmontemayor
committed
refactor(distributed): extract ablp label remap into _loop_set_labels + dispatch
kmontemayor
committed
feat(distributed): vectorize ablp label remap with searchsorted
kmontemayor
committed
test(distributed): assert python vs vectorized collate label equivalence
kmontemayor
committed
chore(distributed): satisfy type/format gates for vectorized label remap
kmontemayor
committed

Commits on Jun 24, 2026

test: add collate-equivalence comparison helper (homogeneous)

kmontemayor
and
claude
committed
test: complete collate-equivalence helper (heterogeneous)

kmontemayor
and
claude
committed
test(distributed): add cross-impl batch-capture driver (D3)

kmontemayor
and
claude
committed
fix(test): D3 driver — use COLLATE_IMPLS default, required test names, re-export annotation

kmontemayor
and
claude
committed
test: ABLP homogeneous collate equivalence across GIGL_COLLATE_IMPL

kmontemayor
and
claude
committed
test: ABLP heterogeneous + edge_dir in/out collate equivalence
kmontemayor
committed
Collate core: scaffold gigl_core.collate_core pybind11 extension

kmontemayor
and
claude
committed
Collate core: per-hop count padding helpers + C++ test target

kmontemayor
and
claude
committed
Collate core: homogeneous collate component-tensor builder

kmontemayor
and
claude
committed
Collate core: heterogeneous collate (dict build, edge swap, padding)

kmontemayor
and
claude
committed
Collate core: pybind11 bindings for homogeneous/heterogeneous collate

kmontemayor
and
claude
committed
Collate core: dispatcher flag resolution + PyG assembly shim

kmontemayor
and
claude
committed
Collate core: dispatcher C++-path collate entry functions

kmontemayor
and
claude
committed
Collate core: route both loaders' GLT body through GIGL_COLLATE_IMPL dispatch

kmontemayor
and
claude
committed
Collate core: python-vs-cpp output equivalence tests (CORA/DBLP, edge_dir=in, empty anchor)

kmontemayor
and
claude
committed
feat(distributed): opt-in collate-vs-recv timing accumulator on BaseDistLoader

kmontemayor
and
claude
committed
feat(launcher): forward GIGL_COLLATE_IMPL env into Vertex AI worker spec

kmontemayor
and
claude
committed
fix(distributed): lazy-import collate_core to avoid crash when extension absent
kmontemayor
committed
feat(ablp): add GIGL_ABLP_LABEL_FORMAT selector (dict|edge_list)

kmontemayor
and
claude
committed
feat(ablp): add AnchorLabels dense edge-list container + per-tensor remap

kmontemayor
and
claude
committed
feat(ablp): add edge_list_set_labels kernel, parity-tested vs loop oracle

kmontemayor
and
claude
committed
feat(ablp): route GIGL_ABLP_LABEL_FORMAT=edge_list through _set_labels

kmontemayor
and
claude
committed
feat(ablp): forward GIGL_ABLP_LABEL_FORMAT to sampling workers

kmontemayor
and
claude
committed
fix(orchestration): propagate loader-selection env vars to component pods

kmontemayor
and
claude
committed

Commits on Jun 25, 2026

fix(ablp): place anchor_of_entry on the label tensor's device

kmontemayor
and
claude
committed
docs(distributed): tidy collate/label comments and docstrings

kmontemayor
and
claude
committed