Skip to content

Commit

Permalink
Merge pull request #104 from HDFGroup/master
Browse files Browse the repository at this point in the history
Updating to master
  • Loading branch information
loricooperhdf authored Dec 28, 2023
2 parents 23e4cf1 + b23328d commit 6b9a146
Show file tree
Hide file tree
Showing 3 changed files with 18 additions and 18 deletions.
2 changes: 1 addition & 1 deletion .github/funding.yml
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
# These are supported funding model platforms

custom: "https://hdfgroup.org/about-us/donate-to-the-hdf-group/"
custom: "https://www.hdfgroup.org/donate"
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ Here is the current policy regarding VFD identifier assignment: Valid VFD identi

Please contact the maintainer of a VFD for help implementing the plugin.

## List of VFDs Registered with The HDF Groupv
## List of VFDs Registered with The HDF Group

| Driver | Driver Identifier| Search Name* | Short Description | URL | Contacts|
| --- | --- | --- | --- | --- | --- |
Expand Down
32 changes: 16 additions & 16 deletions documentation/hdf5-docs/registered_vol_connectors.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,26 +15,26 @@ Here is the current policy regarding VOL connector identifier assignment: Valid
Please contact the maintainer of a VOL connector for help implementing the plugin.

## List of VOL Connectors Registered with The HDF Group
| Connector | Connector Identifier | Search Name* | Short Description | URL | Contacts
| --- | --- | --- | --- | --- | ---|
| Asynchronous I/O | 512 | async | Provides support for asynchronous operations to HDF5 | [https://github.com/hpc-io/vol-async](https://github.com/hpc-io/vol-async) | Suren Byna (sbyna at lbl dot gov) |
| Cache | 513 | cache | Provides support for multi-level, multi-location data caching to dataset I/O operations | [https://github.com/hpc-io/vol-cache](https://github.com/hpc-io/vol-cache) | Suren Byna (sbyna at lbl dot gov) |
| Log-based | 514 | LOG | The log-based VOL plugin stores HDF5 datasets in a log-based storage layout.<br>In this layout, data of multiple write requests made by an MPI process are appended one after another in the file. Such I/O strategy can avoid the expensive inter-process communication and I/O serialization due to file lock contentions when storing data in the canonical order. Through the log-based VOL, existing HDF5 programs can achieve a better parallel write performance with minimal changes to their codes. | [https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md](https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md) | Kai Yuan Hou <br> (khl7265 at ece dot northwestern dot edu) |
| DAOS | 4004 | daos | Designed to utilize the DAOS object storage system by use of the DAOS API <br> https://doi.org/10.1109/TPDS.2021.3097884 | [https://github.com/HDFGroup/vol-daos](https://github.com/HDFGroup/vol-daos) <br> [HDF5 DAOS VOL Connector Design](https://github.com/HDFGroup/vol-daos/blob/master/docs/design_doc.pdf) <br> [HDF5 DAOS VOL Connector User's Guide](https://github.com/HDFGroup/vol-daos/blob/master/docs/users_guide.pdf) | help at hdfgroup dot org |
| native| 0 | native | | | help at hdfgroup dot org |

| pass-through| 517 | pass_through_ext | Provides a simple example of a pass-through VOL connector | [https://github.com/hpc-io/vol-external-passthrough](https://github.com/hpc-io/vol-external-passthrough) | Suren Byna (sbyna at lbl dot gov) |
| dset-split | 518 | dset-split | Creates separate sub files for each dataset created and mounts these sub-files as external links in the main file. It enables versioning of HDF5 files at a dataset boundary. | [https://github.com/hpc-io/vol-dset-split](https://github.com/hpc-io/vol-dset-split) | Annmary Justine (annmary dot roy at hpe dot com) |
| PDC-VOL | 519 | PDC-VOL | It is a terminal VOL that reads and writes HDF5 objects to the PDC system | [https://github.com/hpc-io/pdc](https://github.com/hpc-io/pdc) [https://github.com/hpc-io/vol-pdc](https://github.com/hpc-io/vol-pdc) | Houjun Tang (htang4 at lbl dot gov) |
| REST | 520 | REST | Designed to utilize web-based storage systems by use of the HDF5 REST APIs | [https://github.com/HDFGroup/vol-rest](https://github.com/HDFGroup/vol-rest) | Matthew Larson (mlarson at hdfgroup dot org) |
| LowFive | 521 | LowFive | A new data transport layer based on the HDF5 data model, for in situ workflows. Executables using LowFive can communicate in situ (using in-memory data and MPI message passing), reading and writing traditional HDF5 files to physical storage, and combining the two modes. | [https://github.com/diatomic/LowFive](https://github.com/diatomic/LowFive) | Tom Peterka (tpeterka at mcs dot anl dot gov) <br> Dmitriy Morozov (dmorozov at lbl dot gov) |

| Connector | Connector Identifier | Search Name* | Short Description | URL | Contacts |
| --- | --- | --- | --- | --- | --- |
| Asynchronous I/O | 512 | async | Provides support for asynchronous operations to HDF5 | [https://github.com/hpc-io/vol-async](https://github.com/hpc-io/vol-async) | Suren Byna (sbyna at lbl dot gov) |
| Cache | 513 | cache | Provides support for multi-level, multi-location data caching to dataset I/O operations | [https://github.com/hpc-io/vol-cache](https://github.com/hpc-io/vol-cache) | Suren Byna (sbyna at lbl dot gov) |
| Log-based | 514 | LOG | The log-based VOL plugin stores HDF5 datasets in a log-based storage layout.<br>In this layout, data of multiple write requests made by an MPI process are appended one after another in the file. Such I/O strategy can avoid the expensive inter-process communication and I/O serialization due to file lock contentions when storing data in the canonical order. Through the log-based VOL, existing HDF5 programs can achieve a better parallel write performance with minimal changes to their codes. | [https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md](https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md) | Kai Yuan Hou <br> (khl7265 at ece dot northwestern dot edu) |
| DAOS | 4004 | daos | Designed to utilize the DAOS object storage system by use of the DAOS API <br> https://doi.org/10.1109/TPDS.2021.3097884 | [https://github.com/HDFGroup/vol-daos](https://github.com/HDFGroup/vol-daos) <br> [HDF5 DAOS VOL Connector Design](https://github.com/HDFGroup/vol-daos/blob/master/docs/design_doc.pdf) <br> [HDF5 DAOS VOL Connector User's Guide](https://github.com/HDFGroup/vol-daos/blob/master/docs/users_guide.pdf) | help at hdfgroup dot org |
| native| 0 | native | | | help at hdfgroup dot org |
| pass-through| 517 | pass_through_ext | Provides a simple example of a pass-through VOL connector | [https://github.com/hpc-io/vol-external-passthrough](https://github.com/hpc-io/vol-external-passthrough) | Suren Byna (sbyna at lbl dot gov) |
| dset-split | 518 | dset-split | Creates separate sub files for each dataset created and mounts these sub-files as external links in the main file. It enables versioning of HDF5 files at a dataset boundary. | [https://github.com/hpc-io/vol-dset-split](https://github.com/hpc-io/vol-dset-split) | Annmary Justine (annmary dot roy at hpe dot com) |
| PDC-VOL | 519 | PDC-VOL | It is a terminal VOL that reads and writes HDF5 objects to the PDC system | [https://github.com/hpc-io/pdc](https://github.com/hpc-io/pdc) [https://github.com/hpc-io/vol-pdc](https://github.com/hpc-io/vol-pdc) | Houjun Tang (htang4 at lbl dot gov) |
| REST | 520 | REST | Designed to utilize web-based storage systems by use of the HDF5 REST APIs | [https://github.com/HDFGroup/vol-rest](https://github.com/HDFGroup/vol-rest) | Matthew Larson (mlarson at hdfgroup dot org) |
| LowFive | 521 | LowFive | A new data transport layer based on the HDF5 data model, for in situ workflows. Executables using LowFive can communicate in situ (using in-memory data and MPI message passing), reading and writing traditional HDF5 files to physical storage, and combining the two modes. | [https://github.com/diatomic/LowFive](https://github.com/diatomic/LowFive) | Tom Peterka (tpeterka at mcs dot anl dot gov) <br> Dmitriy Morozov (dmorozov at lbl dot gov) |

*The Search Name provides a mechanism for searching for a VOL.

## List of Prototype VOL Connectors

| Connector | Connector Identifier | Search Name* | Short Description| URL | Contacts |
| --- | --- | --- | --- | --- | --- |
| rados | unassigned | rados | Prototype VOL connector to access data in RADOS | [https://github.com/HDFGroup/vol-rados](https://github.com/HDFGroup/vol-rados) | help at hdfgroup dot org |
| Connector | Connector Identifier | Search Name* | Short Description| URL | Contacts |
| --- | --- | --- | --- | --- | --- |
| rados | unassigned | rados | Prototype VOL connector to access data in RADOS | [https://github.com/HDFGroup/vol-rados](https://github.com/HDFGroup/vol-rados) | help at hdfgroup dot org |

*The Search Name provides a mechanism for searching for a VOL.

0 comments on commit 6b9a146

Please sign in to comment.