IFCA Seminar: Ethical and Sustainable Computing Methods for Geoscientific Dataset Compression
Start date: 10/04/2024 12:30
End date: 10/04/2024 13:30
«Ethical and Sustainable Computing Methods for Geoscientific Dataset Compression»
By Charlie Zender, researcher in the Department of Earth System Science and Computer Science (University of California, Irvine).
"The Intergovernmental Panel on Climate Change (IPCC) and researchers worldwide use the Coupled Model Intercomparison Project (CMIP) for landmark studies of climate change. CMIP exemplifies geoscientific dataset archive organization and applied informatics. The CMIP metadata and data policies have continuously co-evolved with mature and FAIR technologies (e.g., CF, OpenDAP, ESGF) that are, in turn, often adopted by other Research Data Infrastructures (RDIs). Improved lossy and lossless compression support in the standard netCDF/HDF5 scientific software stack merit consideration for adoption in upcoming MIPs and RDIs like CMIP7. We will describe three point plan for CMIP7 to utilize modern lossy and lossless compression to reduce its storage and power requirements (and associated greenhouse gas emissions). The plan will boost the compression ratio of CMIP-like datasets by a factor of two-to-three relative to CMIP6, preserve all scientifically meaningful data, and retain CF-compliance. We will present the plan, describe it underlying lossy compression technology based on quantization, and discuss why and how to implement the plan in CMIP7 and other MIPs and RDIs."
