DGL Files

Highlights

• DGL 2.4 documentation can be found here: https://www.dgl.ai/dgl_docs/index.html
• distributed module is not imported in default when import dgl. Users need to import manually: import dgl.distributed.
• DistNodeDataLoader and DistEdgeDataLoader are moved from dgl.dataloading to dgl.distributed. Users are recommended to call dgl.distributed.DistNode/EdgeDataLoader though dgl.dadaloading.DistNode/EdgeDataLoader is still available. Such backward compatibility will be removed in next release.
• GraphBolt examples are now in examples/graphbolt.
• The users are now required to install GraphBolt's CUDA wheels if they have a CUDA enabled torch installation.
• numpy 2.x is now supported.
• torch 2.4 & CUDA 12.4 are now supported by @pyynb in https://github.com/dmlc/dgl/pull/7629
• Importing DGL does not cause an import of GraphBolt anymore. by @Rhett-Ying in https://github.com/dmlc/dgl/pull/7676, https://github.com/dmlc/dgl/pull/7756
• GraphBolt does not depend on the deprecated torchdata package anymore and this release is incompatible with the torchdata package. by @frozenbugs in https://github.com/dmlc/dgl/pull/7638, https://github.com/dmlc/dgl/pull/7609, https://github.com/dmlc/dgl/pull/7667, https://github.com/dmlc/dgl/pull/7688
• [GraphBolt][CUDA] Use better memory allocation algorithm to avoid OOM. by @mfbalin in https://github.com/dmlc/dgl/pull/7618
• [GraphBolt] GPU utilization has been maximized by eliminating all (known) GPU synchronizations: https://github.com/dmlc/dgl/pull/7528, https://github.com/dmlc/dgl/pull/7682, https://github.com/dmlc/dgl/pull/7709, https://github.com/dmlc/dgl/pull/7707, https://github.com/dmlc/dgl/pull/7712, https://github.com/dmlc/dgl/pull/7705, https://github.com/dmlc/dgl/pull/7602, https://github.com/dmlc/dgl/pull/7603, https://github.com/dmlc/dgl/pull/7634, https://github.com/dmlc/dgl/pull/7757 by @mfbalin.
• [GraphBolt][io_uring] gb.DiskBasedFeature is now ready to use for out-of-core training: https://github.com/dmlc/dgl/pull/7506, https://github.com/dmlc/dgl/pull/7713, https://github.com/dmlc/dgl/pull/7562, https://github.com/dmlc/dgl/pull/7515, https://github.com/dmlc/dgl/pull/7530, https://github.com/dmlc/dgl/pull/7518 by @mfbalin.
• [GraphBolt] Users are now recommended to use gb.numpy_save_aligned instead of numpy.save to save their features for out-of-core training. by @mfbalin in https://github.com/dmlc/dgl/pull/7524
• [GraphBolt] gb.CPUCachedFeature was added to speedup out-of-core training: https://github.com/dmlc/dgl/pull/7492, https://github.com/dmlc/dgl/pull/7508, https://github.com/dmlc/dgl/pull/7520, https://github.com/dmlc/dgl/pull/7526, https://github.com/dmlc/dgl/pull/7525, https://github.com/dmlc/dgl/pull/7531, https://github.com/dmlc/dgl/pull/7537, https://github.com/dmlc/dgl/pull/7538, https://github.com/dmlc/dgl/pull/7581, https://github.com/dmlc/dgl/pull/7723, https://github.com/dmlc/dgl/pull/7644, https://github.com/dmlc/dgl/pull/7731 and more by @mfbalin.
• [GraphBolt] Feature fetching pipeline is fully parallelized by enabling all hardware components run concurrently: https://github.com/dmlc/dgl/pull/7546, https://github.com/dmlc/dgl/pull/7547, https://github.com/dmlc/dgl/pull/7548, https://github.com/dmlc/dgl/pull/7550, https://github.com/dmlc/dgl/pull/7549, https://github.com/dmlc/dgl/pull/7553, https://github.com/dmlc/dgl/pull/7551, https://github.com/dmlc/dgl/pull/7552, https://github.com/dmlc/dgl/pull/7554, https://github.com/dmlc/dgl/pull/7555, https://github.com/dmlc/dgl/pull/7559, https://github.com/dmlc/dgl/pull/7540 and more by @mfbalin.
• [GraphBolt][Temporal] Temporal sampling support is extended with more samplers and GPU support: https://github.com/dmlc/dgl/pull/7500, https://github.com/dmlc/dgl/pull/7503, https://github.com/dmlc/dgl/pull/7677, https://github.com/dmlc/dgl/pull/7678 by @mfbalin.
• [GraphBolt][CUDA] Sampling pipeline parallelism optimizations in https://github.com/dmlc/dgl/pull/7714, https://github.com/dmlc/dgl/pull/7665 and example use in https://github.com/dmlc/dgl/pull/7702, https://github.com/dmlc/dgl/pull/7669, https://github.com/dmlc/dgl/pull/7664, https://github.com/dmlc/dgl/pull/7662 by @mfbalin.
• [GraphBolt][PyG] Add to_pyg for layer input conversion. by @mfbalin in https://github.com/dmlc/dgl/pull/7745 and https://github.com/dmlc/dgl/pull/7747.
• [Feature] Fixed sampler with limit on sampled nodes/edges in batch subgraph by @ayushnoori in https://github.com/dmlc/dgl/pull/6668
• [GraphBolt] Refactor and extend FeatureStore. by @mfbalin in https://github.com/dmlc/dgl/pull/7558
• [dev] Several build and setup improvements by @Rhett-Ying in https://github.com/dmlc/dgl/pull/7565, https://github.com/dmlc/dgl/pull/7567, https://github.com/dmlc/dgl/pull/7570, https://github.com/dmlc/dgl/pull/7571, https://github.com/dmlc/dgl/pull/7574, https://github.com/dmlc/dgl/pull/7684
• [GraphBolt][CUDA] gb.indptr_edge_ids. by @mfbalin in https://github.com/dmlc/dgl/pull/7592, https://github.com/dmlc/dgl/pull/7593
• [GraphBolt] Allow using multiple processes for GraphBolt partition conversion by @thvasilo in https://github.com/dmlc/dgl/pull/7497
• [GraphBolt][CUDA] Update CCCL to 2.6.0. by @mfbalin in https://github.com/dmlc/dgl/pull/7636
• [Performance] Change hash table for performance. by @mfbalin in https://github.com/dmlc/dgl/pull/7658, https://github.com/dmlc/dgl/pull/7631
• [GraphBolt][CUDA] Refactor overlap_graph_fetch, simplify gb.DataLoader. by @mfbalin in https://github.com/dmlc/dgl/pull/7681, https://github.com/dmlc/dgl/pull/7732
• [Build] Organize cmake file by @mfbalin in https://github.com/dmlc/dgl/pull/7715
• [GraphBolt] Feature.count(). by @mfbalin in https://github.com/dmlc/dgl/pull/7730

Bug Fixes

• [GraphBolt] Check data alignment before copying the file by @Liu-rj in https://github.com/dmlc/dgl/pull/7641
• [GraphBolt] Several documentation display fixes by @pyynb in https://github.com/dmlc/dgl/pull/7639, https://github.com/dmlc/dgl/pull/7691
• Several miscellaneous warnings and bugs were fixed: https://github.com/dmlc/dgl/pull/7486, https://github.com/dmlc/dgl/pull/7493, https://github.com/dmlc/dgl/pull/7484, https://github.com/dmlc/dgl/pull/7622, https://github.com/dmlc/dgl/pull/7719, https://github.com/dmlc/dgl/pull/7560, https://github.com/dmlc/dgl/pull/7557, https://github.com/dmlc/dgl/pull/7577, https://github.com/dmlc/dgl/pull/7627 by @drivanov and other contributors.
• [GraphBolt] Edge feature fetch fix. by @mfbalin in https://github.com/dmlc/dgl/pull/7589, https://github.com/dmlc/dgl/pull/7594, https://github.com/dmlc/dgl/pull/7595

New Examples

• [GraphBolt] Add DiskBasedFeature example for DGL model by @Liu-rj in https://github.com/dmlc/dgl/pull/7624
• [GraphBolt][PyG] Heterogenous example. by @mfbalin in https://github.com/dmlc/dgl/pull/7722
• [GraphBolt][PyG] Link prediction example. by @mfbalin in https://github.com/dmlc/dgl/pull/7752

New built-in datasets:

• [GraphBolt] igb-hom-[tiny|small|medium] variants of IGB datasets are added. by @BowenYao18 in https://github.com/dmlc/dgl/pull/7717

New Contributors

• @BowenYao18 made their first contribution in https://github.com/dmlc/dgl/pull/7516
• @kec020 made their first contribution in https://github.com/dmlc/dgl/pull/7527
• @Liu-rj made their first contribution in https://github.com/dmlc/dgl/pull/7641
• @CfromBU made their first contribution in https://github.com/dmlc/dgl/pull/7674

Full Changelog: https://github.com/dmlc/dgl/compare/v2.3.0...v2.4.0