Skip to content

Commit

Permalink
Document how to reingest deltares (#316)
Browse files Browse the repository at this point in the history
  • Loading branch information
ghidalgo3 authored Dec 5, 2024
1 parent b06aa36 commit b108932
Show file tree
Hide file tree
Showing 2 changed files with 19 additions and 3 deletions.
18 changes: 17 additions & 1 deletion datasets/deltaresfloods/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,19 @@
# deltaresfloods PC Tasks

PCTasks code for ingesting deltaresfloods data into the Planetary Computer.
PCTasks code for ingesting deltaresfloods data into the Planetary Computer.
These STAC items JSONs are stored as blobs in the `deltaresfloodssa` storage account under the `floods-stac` container.
You can mount them locally and make modifications before re-ingesting them into the STAC database.

## Item Updates
After fixing items in the `deltaresfloodssa/floods-stac` container, you may run to reingest them:

```bash
pctasks dataset process-items xarray-access-fix \
-a since "2024-11-17T00:00:00Z" \
--dataset datasets/deltaresfloods/dataset.yaml \
--is-update-workflow --upsert --submit
```

Set since to a date strictly before you modified the STAC items in storage.
For example, if you modified items on December 4, set the since to be any date before December 4.
`since` must be a full ISO8061 datetime.
4 changes: 2 additions & 2 deletions datasets/deltaresfloods/dataset.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
id: deltaresfloods
image: pccomponentstest.azurecr.io/pctasks-basic:2022.6.16.2
image: pccomponents.azurecr.io/pctasks-task-base:latest
target_environment: staging

collections:
Expand All @@ -16,4 +16,4 @@ collections:
extensions:
- ".json"
chunk_storage:
uri: blob://deltaresfloodssa/floods-etl-data/chunks
uri: blob://deltaresfloodssa/floods-etl-data/chunks

0 comments on commit b108932

Please sign in to comment.