diff --git a/v0.9.2/_examples/delineate_basin.html b/v0.9.2/_examples/delineate_basin.html index 6b992159d..31e02f94f 100644 --- a/v0.9.2/_examples/delineate_basin.html +++ b/v0.9.2/_examples/delineate_basin.html @@ -563,7 +563,7 @@
-2024-01-24 10:08:29,496 - basin_delineation - log - INFO - HydroMT version: 0.9.2
+2024-01-25 10:13:25,552 - basin_delineation - log - INFO - HydroMT version: 0.9.2
-2024-01-24 10:08:29,721 - basin_delineation - data_catalog - INFO - Reading data catalog archive artifact_data v0.0.8
+2024-01-25 10:13:25,582 - basin_delineation - data_catalog - INFO - Reading data catalog archive artifact_data v0.0.8
-2024-01-24 10:08:33,165 - basin_delineation - basin_mask - DEBUG - Getting basin IDs at point locations.
+2024-01-25 10:13:29,187 - basin_delineation - basin_mask - DEBUG - Getting basin IDs at point locations.
-2024-01-24 10:08:33,241 - basin_delineation - basin_mask - INFO - basin bbox: [12.1958, 45.5850, 12.8983, 46.4167]
+2024-01-25 10:13:29,263 - basin_delineation - basin_mask - INFO - basin bbox: [12.1958, 45.5850, 12.8983, 46.4167]
-2024-01-24 10:08:38,274 - basin_delineation - basin_mask - INFO - subbasin bbox: [12.2350, 45.7950, 12.8783, 46.4167]
+2024-01-25 10:13:32,722 - basin_delineation - basin_mask - INFO - subbasin bbox: [12.2350, 45.7950, 12.8783, 46.4167]
-2024-01-24 10:08:39,686 - basin_delineation - basin_mask - DEBUG - Getting IDs of intersecting basins.
+2024-01-25 10:13:33,982 - basin_delineation - basin_mask - DEBUG - Getting IDs of intersecting basins.
-2024-01-24 10:08:39,951 - basin_delineation - basin_mask - INFO - subbasin bbox: [12.1958, 45.7192, 12.8783, 46.4167]
+2024-01-25 10:13:34,248 - basin_delineation - basin_mask - INFO - subbasin bbox: [12.1958, 45.7192, 12.8783, 46.4167]
-2024-01-24 10:08:42,619 - basin_delineation - basin_mask - INFO - interbasin bbox: [12.5000, 45.7200, 12.7000, 46.0000]
+2024-01-25 10:13:36,841 - basin_delineation - basin_mask - INFO - interbasin bbox: [12.5000, 45.7200, 12.7000, 46.0000]
array(['1992-01-01T00:00:00.000000000', '1992-01-02T00:00:00.000000000', + units: m3/s
array(['1992-01-01T00:00:00.000000000', '1992-01-02T00:00:00.000000000', '1992-01-03T00:00:00.000000000', ..., '2021-12-29T00:00:00.000000000', '2021-12-30T00:00:00.000000000', '2021-12-31T00:00:00.000000000'], - dtype='datetime64[ns]')
array([1, 2], dtype=int32)
array([1.0000251, 1.0000251])
array(['shape', 'loc', 'scale'], dtype='<U5')
array(['gev', 'gev'], dtype='<U3')
array([ 2, 5, 25, 100, 500])
array([[nan, nan], + dtype='datetime64[ns]')
array([1, 2], dtype=int32)
array([1.0000251, 1.0000251])
array(['shape', 'loc', 'scale'], dtype='<U5')
array(['gev', 'gev'], dtype='<U3')
array([ 2, 5, 25, 100, 500])
array([[nan, nan], [nan, nan], [nan, nan], ..., [nan, nan], [nan, nan], - [nan, nan]], dtype=float32)
array([[-1.43938489e-01, 1.18602378e+03, 6.36962648e+02], - [-1.60420677e-01, 3.23741304e+02, 1.75376325e+02]])
array([[1425.7708608 , 2252.42822131, 3773.46811579, 5341.06675145, + [nan, nan]], dtype=float32)
array([[-1.43938489e-01, 1.18602378e+03, 6.36962648e+02], + [-1.60420677e-01, 3.23741304e+02, 1.75376325e+02]])
array([[1425.7708608 , 2252.42822131, 3773.46811579, 5341.06675145, 7584.13163529], [ 389.95295666, 621.14850879, 1056.73614513, 1517.1858774 , - 2192.70584887]])
PandasIndex(DatetimeIndex(['1992-01-01', '1992-01-02', '1992-01-03', '1992-01-04', + 2192.70584887]])
PandasIndex(DatetimeIndex(['1992-01-01', '1992-01-02', '1992-01-03', '1992-01-04', '1992-01-05', '1992-01-06', '1992-01-07', '1992-01-08', '1992-01-09', '1992-01-10', ... '2021-12-22', '2021-12-23', '2021-12-24', '2021-12-25', '2021-12-26', '2021-12-27', '2021-12-28', '2021-12-29', '2021-12-30', '2021-12-31'], - dtype='datetime64[ns]', name='time', length=10958, freq=None))
PandasIndex(Index([1, 2], dtype='int32', name='stations'))
PandasIndex(Index(['shape', 'loc', 'scale'], dtype='object', name='dparams'))
PandasIndex(Index([2, 5, 25, 100, 500], dtype='int64', name='rps'))
PandasIndex(Index([1, 2], dtype='int32', name='stations'))
PandasIndex(Index(['shape', 'loc', 'scale'], dtype='object', name='dparams'))
PandasIndex(Index([2, 5, 25, 100, 500], dtype='int64', name='rps'))
-2024-01-24 10:08:54,198 - export data - log - INFO - HydroMT version: 0.9.2
+2024-01-25 10:13:48,246 - export data - log - INFO - HydroMT version: 0.9.2
-2024-01-24 10:08:54,246 - export data - data_catalog - INFO - Reading data catalog archive artifact_data v0.0.8
+2024-01-25 10:13:48,273 - export data - data_catalog - INFO - Reading data catalog archive artifact_data v0.0.8
-2024-01-24 10:08:54,247 - export data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2024-01-25 10:13:48,274 - export data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
The artifact_data
catalog is one of the pre-defined available DataCatalog of HydroMT. You can find an overview of pre-defined data catalogs in the online user guide. You can also get an overview of the pre-defined catalogs with their version number from HydroMT.
-2024-01-24 10:08:54,310 - export data - rasterdataset - INFO - Reading era5 netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/era5.nc
+2024-01-25 10:13:48,335 - export data - rasterdataset - INFO - Reading era5 netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/era5.nc
-2024-01-24 10:08:54,359 - export data - rasterdataset - DEBUG - Shifting time labels with 86400 sec.
+2024-01-25 10:13:48,379 - export data - rasterdataset - DEBUG - Shifting time labels with 86400 sec.
-2024-01-24 10:08:54,361 - export data - rasterdataset - DEBUG - Slicing time dim ('2010-02-02', '2010-02-15')
+2024-01-25 10:13:48,381 - export data - rasterdataset - DEBUG - Slicing time dim ('2010-02-02', '2010-02-15')
-2024-01-24 10:08:54,363 - export data - rasterdataset - DEBUG - Convert units for 7 variables.
+2024-01-25 10:13:48,383 - export data - rasterdataset - DEBUG - Convert units for 7 variables.
-2024-01-24 10:08:54,470 - export data - data_catalog - DEBUG - Exporting merit_hydro.
+2024-01-25 10:13:48,485 - export data - data_catalog - DEBUG - Exporting merit_hydro.
-2024-01-24 10:08:54,472 - export data - rasterdataset - INFO - Reading merit_hydro raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
+2024-01-25 10:13:48,488 - export data - rasterdataset - INFO - Reading merit_hydro raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
-2024-01-24 10:08:54,507 - export data - rasterdataset - DEBUG - Clip to [12.000, 46.000, 13.000, 46.500] (epsg:4326))
+2024-01-25 10:13:48,522 - export data - rasterdataset - DEBUG - Clip to [12.000, 46.000, 13.000, 46.500] (epsg:4326))
-2024-01-24 10:08:54,509 - export data - rasterdataset - WARNING - Dataset does [12.000000000000016, 46.0, 13.0, 46.5] does not fully cover bbox [12.000, 46.000, 13.000, 46.500]
+2024-01-25 10:13:48,524 - export data - rasterdataset - WARNING - Dataset does [12.000000000000016, 46.0, 13.0, 46.5] does not fully cover bbox [12.000, 46.000, 13.000, 46.500]
-2024-01-24 10:08:54,693 - export data - data_catalog - DEBUG - Exporting era5.
+2024-01-25 10:13:48,701 - export data - data_catalog - DEBUG - Exporting era5.
-2024-01-24 10:08:54,693 - export data - rasterdataset - INFO - Reading era5 netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/era5.nc
+2024-01-25 10:13:48,702 - export data - rasterdataset - INFO - Reading era5 netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/era5.nc
-2024-01-24 10:08:54,706 - export data - rasterdataset - DEBUG - Shifting time labels with 86400 sec.
+2024-01-25 10:13:48,715 - export data - rasterdataset - DEBUG - Shifting time labels with 86400 sec.
-2024-01-24 10:08:54,708 - export data - rasterdataset - DEBUG - Slicing time dim ('2010-02-10', '2010-02-15')
+2024-01-25 10:13:48,716 - export data - rasterdataset - DEBUG - Slicing time dim ('2010-02-10', '2010-02-15')
-2024-01-24 10:08:54,715 - export data - rasterdataset - DEBUG - Clip to [12.000, 46.000, 13.000, 46.500] (epsg:4326))
+2024-01-25 10:13:48,724 - export data - rasterdataset - DEBUG - Clip to [12.000, 46.000, 13.000, 46.500] (epsg:4326))
-2024-01-24 10:08:54,718 - export data - rasterdataset - WARNING - Dataset does [12.125, 45.875, 13.125, 46.375] does not fully cover bbox [12.000, 46.000, 13.000, 46.500]
+2024-01-25 10:13:48,727 - export data - rasterdataset - WARNING - Dataset does [12.125, 45.875, 13.125, 46.375] does not fully cover bbox [12.000, 46.000, 13.000, 46.500]
-2024-01-24 10:08:54,720 - export data - rasterdataset - DEBUG - Convert units for 1 variables.
+2024-01-25 10:13:48,728 - export data - rasterdataset - DEBUG - Convert units for 1 variables.
-2024-01-24 10:08:54,732 - export data - data_catalog - DEBUG - Exporting vito.
+2024-01-25 10:13:48,740 - export data - data_catalog - DEBUG - Exporting vito.
-2024-01-24 10:08:54,733 - export data - rasterdataset - INFO - Reading vito raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/vito.tif
+2024-01-25 10:13:48,741 - export data - rasterdataset - INFO - Reading vito raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/vito.tif
-2024-01-24 10:08:54,746 - export data - rasterdataset - DEBUG - Clip to [12.000, 46.000, 13.000, 46.500] (epsg:4326))
+2024-01-25 10:13:48,754 - export data - rasterdataset - DEBUG - Clip to [12.000, 46.000, 13.000, 46.500] (epsg:4326))
-2024-01-24 10:08:54,748 - export data - rasterdataset - WARNING - Dataset does [12.000496031745401, 45.99950396825409, 13.000496031745406, 46.49950396825409] does not fully cover bbox [12.000, 46.000, 13.000, 46.500]
+2024-01-25 10:13:48,755 - export data - rasterdataset - WARNING - Dataset does [12.000496031745401, 45.99950396825409, 13.000496031745406, 46.49950396825409] does not fully cover bbox [12.000, 46.000, 13.000, 46.500]
-2024-01-24 10:08:54,784 - export data - rasterdataset - INFO - Reading merit_hydro raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
+2024-01-25 10:13:48,793 - export data - rasterdataset - INFO - Reading merit_hydro raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
-2024-01-24 10:08:54,799 - export data - rasterdataset - DEBUG - Clip to [11.600, 45.200, 13.000, 46.800] (epsg:4326))
+2024-01-25 10:13:48,807 - export data - rasterdataset - DEBUG - Clip to [11.600, 45.200, 13.000, 46.800] (epsg:4326))
-2024-01-24 10:08:54,800 - export data - rasterdataset - WARNING - Dataset does [11.600000000000023, 45.199999999999996, 13.0, 46.8] does not fully cover bbox [11.600, 45.200, 13.000, 46.800]
+2024-01-25 10:13:48,808 - export data - rasterdataset - WARNING - Dataset does [11.600000000000023, 45.199999999999996, 13.0, 46.8] does not fully cover bbox [11.600, 45.200, 13.000, 46.800]
-2024-01-24 10:09:02,758 - prepare data catalog - log - INFO - HydroMT version: 0.9.2
+2024-01-25 10:13:56,784 - prepare data catalog - log - INFO - HydroMT version: 0.9.2
The steps to use your own data within HydroMT are in brief:
@@ -609,16 +609,16 @@
-merit_hydro_1k
-rgi.gpkg
-osm_landareas.gpkg
-gdp_world.gpkg
-grwl_tindex.gpkg
-grdc.csv
+data_catalog.yml
+gadm_level1.gpkg
+era5.nc
+hydro_reservoirs.gpkg
+chelsa.tif
+ghs_pop_2015_54009.tif
+ghs_pop_2015.tif
dtu10mdt_egm96.tif
-worldclim.nc
-gswo.tif
-gcn250
+era5_orography.nc
+koppen_geiger.tif
-<matplotlib.collections.QuadMesh at 0x7fb4cc9aff50>
+<matplotlib.collections.QuadMesh at 0x7f39a4f41450>
-2024-01-24 10:09:06,114 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/vito.yml
+2024-01-25 10:13:59,908 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/vito.yml
-2024-01-24 10:09:06,116 - prepare data catalog - rasterdataset - INFO - Reading vito raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/vito.tif
+2024-01-25 10:13:59,911 - prepare data catalog - rasterdataset - INFO - Reading vito raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/vito.tif
/home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro
- - elevtn.tif
+ - strord.tif
- hnd.tif
- - upgrid.tif
- - rivwth.tif
+ - lndslp.tif
- basins.tif
+ - rivwth.tif
+ - upgrid.tif
+ - elevtn.tif
- flwdir.tif
- - lndslp.tif
- uparea.tif
- - strord.tif
We have here 9 files. When reading tif files, the name of the file is used as the variable name. HydroMT uses data conventions to ensure that certain variables should have the same name and units to be used in automatically in the workflows. For example elevation data should be called elevtn with unit in [m asl]. Check the data conventions and see if you need to rename
or change units with unit_add
and
@@ -1260,7 +1260,7 @@
-2024-01-24 10:09:06,164 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro.yml
+2024-01-25 10:13:59,958 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro.yml
dict_keys(['vito', 'merit_hydro'])
-2024-01-24 10:09:06,167 - prepare data catalog - rasterdataset - INFO - Reading merit_hydro raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro/*.tif
+2024-01-25 10:13:59,961 - prepare data catalog - rasterdataset - INFO - Reading merit_hydro raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro/*.tif
Let’s see how this works:
@@ -2221,7 +2221,7 @@
-2024-01-24 10:09:06,291 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro.yml
+2024-01-25 10:14:00,085 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro.yml
dict_keys(['vito', 'merit_hydro'])
-2024-01-24 10:09:06,294 - prepare data catalog - rasterdataset - INFO - Reading merit_hydro raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro/{variable}.tif
+2024-01-25 10:14:00,087 - prepare data catalog - rasterdataset - INFO - Reading merit_hydro raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro/{variable}.tif
-2024-01-24 10:09:06,979 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/era5.yml
+2024-01-25 10:14:00,759 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/era5.yml
dict_keys(['vito', 'merit_hydro', 'era5'])
-2024-01-24 10:09:06,982 - prepare data catalog - rasterdataset - INFO - Reading era5 netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.6/era5.nc
+2024-01-25 10:14:00,762 - prepare data catalog - rasterdataset - INFO - Reading era5 netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.6/era5.nc
-2024-01-24 10:09:06,994 - prepare data catalog - rasterdataset - DEBUG - Shifting time labels with 86400 sec.
+2024-01-25 10:14:00,775 - prepare data catalog - rasterdataset - DEBUG - Shifting time labels with 86400 sec.
-2024-01-24 10:09:06,996 - prepare data catalog - rasterdataset - DEBUG - Convert units for 7 variables.
+2024-01-25 10:14:00,776 - prepare data catalog - rasterdataset - DEBUG - Convert units for 7 variables.
[16]:
@@ -4020,7 +4020,7 @@ GeoDataFrame from a vector file
-2024-01-24 10:09:08,048 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/rivers.yml
+2024-01-25 10:14:01,828 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/rivers.yml
dict_keys(['vito', 'merit_hydro', 'era5', 'rivers_lin'])
-2024-01-24 10:09:08,050 - prepare data catalog - geodataframe - INFO - Reading rivers_lin vector data from /home/runner/.hydromt_data/artifact_data/v0.0.6/rivers_lin2019_v1.gpkg
+2024-01-25 10:14:01,829 - prepare data catalog - geodataframe - INFO - Reading rivers_lin vector data from /home/runner/.hydromt_data/artifact_data/v0.0.6/rivers_lin2019_v1.gpkg
-2024-01-24 10:09:08,125 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/gtsm.yml
+2024-01-25 10:14:01,896 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/gtsm.yml
-discharge.nc
-vito_reclass.csv
-geodataset_catalog.yml
-mesh_model
stations.csv
-stations_data.csv
tabular_data_catalog.yml
-example_csv_data.csv
+mesh_model
vito_reclass.yml
+stations_data.csv
+vito_reclass.csv
+discharge.nc
+example_csv_data.csv
+geodataset_catalog.yml
For this driver to work, the format of the timeseries table is quite strict (see docs). Let’s inspect the two files using pandas in python:
@@ -5192,7 +5192,7 @@
-2024-01-24 10:09:08,202 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/waterlevel.yml
+2024-01-25 10:14:01,973 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/waterlevel.yml
-2024-01-24 10:09:12,746 - read geodataset data - log - INFO - HydroMT version: 0.9.2
+2024-01-25 10:14:06,426 - read geodataset data - log - INFO - HydroMT version: 0.9.2
-2024-01-24 10:09:12,793 - read geodataset data - data_catalog - INFO - Reading data catalog archive artifact_data v0.0.8
+2024-01-25 10:14:06,454 - read geodataset data - data_catalog - INFO - Reading data catalog archive artifact_data v0.0.8
-2024-01-24 10:09:12,794 - read geodataset data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2024-01-25 10:14:06,454 - read geodataset data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml