Releases: MarcT0K/Fedivertex-Python
Releases · MarcT0K/Fedivertex-Python
Release list
1.1.1
1.1.0
Summary
Replace CroissantML-based data handling with a custom caching and dataset management system.
Changes
- Removed dependency on CroissantML
- Introduced a custom cache layer for dataset download and storage
- Added automatic update detection using dataset metadata (
dateModified) - Implemented
cache_onlymode for offline/reproducible usage - Added streaming downloads with progress (
requests,tqdm) - Ensured atomic writes to avoid corrupted downloads
- Normalized dataset structure (
full/andreduced/directories)
API
init_cache(...)→ initialize dataset metadataload_dataset(...)→ ensure dataset is available and up-to-datecheck_for_update(...)→ inspect cache statusclear_default_cache()→ remove cached data
Design
- Custom
DatasetInforeplaces Croissant abstractions - Cache invalidation based on remote metadata instead of Croissant logic
- Explicit cache states via
CacheStatus
Impact
- Removes external dependency (CroissantML)
- Improves control over caching and updates
- Enables offline usage via
cache_only
Notes
No breaking changes to the public graph loading API.