Skip to content

Releases: CIROH-UA/NGIAB_data_preprocess

Cli hydrofabric validation fix

14 Jan 19:09
1a1069f
Compare
Choose a tag to compare
  • fixes the cli not validating the correct hydrofabric has been downloaded

forcing generation fix, windows compatibility, uvx map_app fix

10 Jan 04:21
Compare
Choose a tag to compare
  • fixes issues causing commands to not work on windows, mainly relating to filepaths and netcdf files not being closed properly in forcing generation
  • refactors map_app package structure to make it work with uvx (now uvx --from ngiab_data_preprocess@latest map_app)

uvx compatibility

10 Jan 02:46
08c6a28
Compare
Choose a tag to compare

adds cli and map as uvx scripts.
now this tool can be run without installation using
uvx --from ngiab_data_preprocess cli
or
uvx --from ngiab_data_preprocess map

gw_max unit conversion bugfix + forcing processing memory

08 Jan 19:39
d14c50f
Compare
Choose a tag to compare
  • Corrects the unit conversion of ZMax in mm to max_gw_storage in m
  • Limits forcing processing chunk to 20Gb of ram (seems to improve stability processing large datasets)
  • Uses dask auto chunking to forcing output writing which resolves possible out of memory problems

Full Changelog: v3.2.0...v3.2.1

Empirical Model realization, VPU subsetting

03 Dec 02:53
Compare
Choose a tag to compare
  • added --vpu to the cli to allow subsetting by vpu. run python -m ngiab_data_cli --help for more details
  • added --empirical_model or --em to generate forcings, config, and realizations for the machine learning model
  • cfe no longer fetches initial gw_storage from nwm retrospective by default, to re-enable this add --nwm_gw to the cli command
  • fixed a bug where too many files would be opened while downloading the hydrofabric on osx #66

What's Changed

Full Changelog: v3.1.1...v3.2.0

hydrofabric upgrade bugfix

26 Nov 19:03
5dad17b
Compare
Choose a tag to compare
v3.1.2

fix style use in prompt

Better cli display, faster forcing generation, improved new user experience

26 Nov 17:26
5dad17b
Compare
Choose a tag to compare
  • adds version tracking to the hydrofabric
  • improves cli progress bars
  • improves forcing download for smaller areas
  • massively improves hydrofabric download speed
  • works with hydrofabric containing hydrolocations geospatial index
  • fixes #62 by removing rioxarray which depends on gdal

What's Changed

Full Changelog: v3.0.3...v3.1.0

v3.0.3

21 Nov 01:11
407d278
Compare
Choose a tag to compare
  • Updated the map styling to display more information
  • Fixed #59 Opening the console now extends the page if needed so it shouldn't cover the realization output and buttons

What's Changed

Full Changelog: v3.0.2...v3.0.3

Fix for python 3.10 + better configuration for pantarhei

18 Nov 22:02
a8ac5db
Compare
Choose a tag to compare

What's Changed

  • replace /ngen/ngen/data with relative ./ for pantarhei by @JoshCu in #58

Full Changelog: v3.0.1...v3.0.2

cli argument bugfix

14 Nov 19:07
55ceb83
Compare
Choose a tag to compare
v3.0.1

fix non-dev cli