You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, when writing data to S3, tensorstore includes the data's SHA256 hash in the x-amz-content-sha256 header. From the docs, it looks like S3 returns this hash during downloads, but tensorstore doesn't currently verify it against the downloaded data. It would be helpful if there was an option to verify it, to build confidence there is no corruption when reading tensors from S3.
The text was updated successfully, but these errors were encountered:
Currently, when writing data to S3, tensorstore includes the data's SHA256 hash in the
x-amz-content-sha256
header. From the docs, it looks like S3 returns this hash during downloads, but tensorstore doesn't currently verify it against the downloaded data. It would be helpful if there was an option to verify it, to build confidence there is no corruption when reading tensors from S3.The text was updated successfully, but these errors were encountered: