Skip to content

Releases: IBM/GEDS

1.0.5

17 May 13:57
Compare
Choose a tag to compare

What's Changed

  • Github CI: Only save caches if there is no cache hit. by @pspoerri in #106
  • CI: Improve tooling and upgrade Debian 11 to 12. by @pspoerri in #107
  • IO Benchmark: Make the benchmark more consistent. by @pspoerri in #108
  • Implement filetransfer on top of boost::asio. by @pspoerri in #109
  • CI/Build: Create a debug build for boost. by @pspoerri in #111
  • Java: Allow overwriting a file during create (and bump the Java API version) by @pspoerri in #112
  • S3: Download files in 1GiB chunks to reduce memory pressure. by @pspoerri in #110

Full Changelog: v1.0.4...v1.0.5

Github CI Test Release

19 Apr 12:32
Compare
Choose a tag to compare

What's Changed

Full Changelog: v1.0.2...v1.0.4

Improve file relocation and Python interop performance.

17 Apr 18:06
Compare
Choose a tag to compare

What's Changed

  • GEDS: Explicitly call fsync before uploading to ObjectStore, or when sharing an FD. by @pspoerri in #99
  • GEDS: Improve file relocation and spilling. by @pspoerri in #100
  • Python Wrapper: Release GIL when accessing GEDS API. by @pspoerri in #98
  • Python: Improve integration with smart_open by @pspoerri in #97

Full Changelog: v1.0.1...v1.0.2

Fix file listing after update.

10 Apr 06:49
Compare
Choose a tag to compare

What's Changed

Full Changelog: v1.0...v1.0.1

Base functionality

12 Dec 13:53
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.8.4...v1.0

Maintenance release: Bump the GEDS Java API Version to 1.2

06 Jul 14:21
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.8.3...v0.8.4

v0.8.3

12 Jun 09:53
Compare
Choose a tag to compare

What's Changed

  • Object relocation and TcpTransport fixes, additional counters to measure local storage. by @pspoerri in #64
  • GEDS: Enable creation/opening of files by passing the object name. by @pspoerri in #65
  • Metadata Server: ObjectStoreHandler fix insertion into object store. by @pspoerri in #66
  • GEDSFile: Expose the mmap pointer to the application. by @pspoerri in #67
  • Fix shutdown in GEDS, add storage counters and make ConcurrentMap::size() const. by @pspoerri in #70
  • GEDS: Make state atomic and fix log statement, integrate a UUID. Export iso8601 time as std::string. by @pspoerri in #71
  • IO Benchmark: Improve performance by reusing the GEDS instance. by @pspoerri in #73
  • GEDS Java: EOF workaround for empty results. by @pspoerri in #74
  • GEDS: Fix race condition with active storage relocation and S3 caching. by @pspoerri in #75
  • GEDS: Improve IO Benchmark by @pspoerri in #77
  • GEDS: Fix object relocation. by @pspoerri in #76
  • Implement the Metadata Server in GO. by @pspoerri in #79
  • Build on RHEL Ubi8. by @pspoerri in #78
  • Integrate CMAKE_BUILD_PARALLEL_LEVEL into Docker files. by @pspoerri in #80
  • Bump golang.org/x/net from 0.5.0 to 0.7.0 in /src/metadataservice_go by @dependabot in #82
  • GEDS: Fix object relocation error. by @pspoerri in #83
  • Port fixes from experiments. by @pspoerri in #85

New Contributors

Full Changelog: v0.8.2...v0.8.3

Integrate Metadata, Object Relocation and move S3 listing to the Metadata Server

19 Apr 07:43
Compare
Choose a tag to compare

What's Changed

  • Implement object relocation. by @pspoerri in #42
  • Integrate Metadata + Query S3 objects from the Metadata Server. by @pspoerri in #54
  • GEDSFileHandle: Integrate mutex for I/O operations and cleanup interface. by @pspoerri in #61
  • GEDS: Mark filehandles with an FD as local. by @pspoerri in #62
  • Fix Python integration. by @pspoerri in #63

Full Changelog: v0.8.1...v0.8.2

Configure GEDS in a config object, fix off-by-one in S3 and report errors in TcpTranport.

17 Apr 09:12
Compare
Choose a tag to compare

What's Changed

  • Use a config object to configure GEDS by @pspoerri in #22
  • Java: Configure GEDS using string types and bump Java API version by @pspoerri in #40
  • GEDSConfig: Log if configuration is not available. by @pspoerri in #41
  • Fix docker builds by @pspoerri in #43
  • GEDS: Fix object store registration. by @pspoerri in #44
  • GEDS: Always delete local file on close. by @pspoerri in #45
  • Fix GEDS Config and add optional length to S3 stream. by @pspoerri in #46
  • Java: Support ByteBuffer with both on Heap and off Heap memory. by @pspoerri in #48
  • GEDSFile: Obtain raw pointer from ByteBuffer. by @pspoerri in #49
  • Cache Metadata Server responses. by @pspoerri in #27
  • GEDS Cache: Cache object on lookup. by @pspoerri in #51
  • CLA: Fix address in GEDS_CLA_Corporate. by @pspoerri in #53
  • TcpTransport: Only open local files by @pspoerri in #52
  • GEDS: Implement reopen on read failures. by @pspoerri in #55
  • TcpTransport: Set ctx->state to Idle once an error is received and fix handling of crashed endpoints. by @pspoerri in #56
  • Grafana: Add a basic version of the GEDS dashboard for Spark. by @pspoerri in #57
  • Minor fixes by @pspoerri in #58
  • Add operator= to StatisticsGauge, integrate LocalStorageSize and LocalMemorySize. by @pspoerri in #59
  • Fix Off-by-One in S3, return error code on TcpTransport and add fsync to LocalFile. by @pspoerri in #60

Full Changelog: v0.8...v0.8.1

Bump the GEDS Java API Version to 1.1

29 Mar 13:06
Compare
Choose a tag to compare
Pre-release
  • Bump the Java API to 1.1
  • Configure GEDS using a config struct.