├── .gitignore ├── .gitmodules ├── Dockerfile ├── LICENSE ├── README.md ├── benchmarks ├── era5_zarr_benchmark.py ├── pyproject.toml └── zstd_benchmark.py ├── conda-lock.yml ├── environment.yml ├── rechunk └── era5_rechunking.ipynb ├── zarr_ML_optimization ├── README.md ├── era5_dataloader.py ├── train_unet.py └── trainer_utils.py └── zarr_dali_example ├── DALI_images.py └── zarr_dali_minimal.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/.gitignore -------------------------------------------------------------------------------- /.gitmodules: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/Dockerfile -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/README.md -------------------------------------------------------------------------------- /benchmarks/era5_zarr_benchmark.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/benchmarks/era5_zarr_benchmark.py -------------------------------------------------------------------------------- /benchmarks/pyproject.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/benchmarks/pyproject.toml -------------------------------------------------------------------------------- /benchmarks/zstd_benchmark.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/benchmarks/zstd_benchmark.py -------------------------------------------------------------------------------- /conda-lock.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/conda-lock.yml -------------------------------------------------------------------------------- /environment.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/environment.yml -------------------------------------------------------------------------------- /rechunk/era5_rechunking.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/rechunk/era5_rechunking.ipynb -------------------------------------------------------------------------------- /zarr_ML_optimization/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/zarr_ML_optimization/README.md -------------------------------------------------------------------------------- /zarr_ML_optimization/era5_dataloader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/zarr_ML_optimization/era5_dataloader.py -------------------------------------------------------------------------------- /zarr_ML_optimization/train_unet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/zarr_ML_optimization/train_unet.py -------------------------------------------------------------------------------- /zarr_ML_optimization/trainer_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/zarr_ML_optimization/trainer_utils.py -------------------------------------------------------------------------------- /zarr_dali_example/DALI_images.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/zarr_dali_example/DALI_images.py -------------------------------------------------------------------------------- /zarr_dali_example/zarr_dali_minimal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pangeo-data/ncar-hackathon-xarray-on-gpus/HEAD/zarr_dali_example/zarr_dali_minimal.py --------------------------------------------------------------------------------