Skip to content

Latest commit

 

History

History
113 lines (84 loc) · 5.33 KB

CHANGELOG.md

File metadata and controls

113 lines (84 loc) · 5.33 KB

Change log

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning. See MAINTAINERS.md for instructions to keep up to date.

v0.2.0

BREAKING CHANGES

Substreams protocol change

  • Bumps substreams from v1.0.x to v1.1.1 -> RPC protocol changed from sf.substreams.v1.Stream/Blocks to sf.substreams.rpc.v2.Stream/Blocks. See release notes from github.com/streamingfast/substreams for details.

Added

  • Added support for "requester pays" buckets on Google Storage in url, ex: gs://my-bucket/path?project=my-project-id

Changed

  • Config value substreams-stores-save-interval and substreams-output-cache-save-interval have been merged together as a single value to avoid potential bugs that would arise when the value is different for those two. The new configuration value is called substreams-cache-save-interval.

    • To migrate, remove usage of substreams-stores-save-interval: <number> and substreams-output-cache-save-interval: <number> if defined in your config file and replace with substreams-cache-save- interval: <number>, if you had two different value before, pick the biggest of the two as the new value to put. We are currently setting to 1000 for Ethereum Mainnet.

  • Updated to Substreams v0.2.0, please refer to release page for further info about Substreams changes.

  • Updated --substreams-output-cache-save-interval default value to 1000.

Added

  • Added tools bt blocks --bt-project=<bigtable_project> --bt-instance=<bigtable_instance> <start-block-num> <stop-block-num> command to scan bigtable rows

    • Added --firehose-enabled flag to output FIRE log

  • Added reader-bt application to sync directly from bigtable

    • Added --reader-bt-readiness-max-latency flag
    • Added --reader-bt-data-dir flag
    • Added --reader-bt-debug-firehose-logs flag
    • Added --reader-bt-log-to-zap flag
    • Added --reader-bt-shutdown-delay flag
    • Added --reader-bt-working-dir flag
    • Added --reader-bt-blocks-chan-capacity flag
    • Added --reader-bt-one-block-suffix flag
    • Added --reader-bt-startup-delay flag
    • Added --reader-bt-grpc-listen-addr flag

Removed

  • Removed dgraphql application and all associated flags
  • Removed tools reproc replaced with tools bt blocks

Project Rename

Flags and environment variables rename

  • All config via environment variables that started with SFSOL_ now starts with FIRESOL_

  • Changed config-file default from ./sf.yaml to "", preventing failure without this flag.

  • Renamed common-blocks-store-url to common-merged-blocks-store-url

  • Renamed common-oneblock-store-url to common-one-block-store-url

  • Renamed common-blockstream-addr to common-live-blocks-addr

  • Renamed common-protocol-first-streamable-block to common-first-streamable-block

  • Added common-forked-blocks-store-url

  • Renamed the mindreader application to reader

    • Renamed mindreaderPlugin to readerPlugin

  • Renamed all the mindreader-node-* flags to reader-node-*

    • Renamed mindreader-node-start-block-num to reader-node-start-block-num
    • Renamed mindreader-node-stop-block-num to reader-node-stop-block-num
    • Renamed mindreader-node-blocks-chan-capacity to reader-node-blocks-chan-capacity
    • Renamed mindreader-node-wait-upload-complete-on-shutdown to reader-node-wait-upload-complete-on-shutdown
    • Renamed mindreader-node-oneblock-suffix to reader-node-one-block-suffix
    • Renamed mindreader-node-deepmind-batch-files-path to reader-node-firehose-batch-files-path
    • Renamed mindreader-node-purge-account-data to reader-node-purge-account-data
    • Added reader-node-arguments
    • Removed reader-node-merge-and-store-directly
    • Removed reader-node-block-data-working-dir
    • Removed reader-node-extra-arguments
    • Removed reader-node-merge-threshold-block-age

  • Renamed all instances of deepmind to firehose

    • Renamed path-to-deepmind-batch-files to path-to-firehose-batch-files
    • Renamed mindreader-node-deepmind-batch-files-path to reader-node-firehose-batch-files-path

  • Renamed debug-deepmind to debug-firehose-logs

    • Renamed mindreader-node-debug-deep-mind to reader-node-debug-firehose-logs

  • Renamed dmlog to firelog

    • Flag <path_to_dmlog.dmlog> changed to <path_to_firelog.firelog>

  • Renamed DMLOG prefix to FIRE

  • Added/Removed merger-* flags

    • Removed merger-writers-leeway
    • Removed merger-one-block-deletion-threads
    • Removed merger-max-one-block-operations-batch-size
    • Added merger-time-between-store-pruning
    • Added merger-prune-forked-blocks-after
    • Added merger-stop-block

  • Added/Removed firehose-* flags

    • Removed firehose-blocks-store-urls
    • Removed firehose-real-time-tolerance
    • Removed firehose-blocks-store-urls
    • Removed firehose-real-time-tolerance

  • Removed relayer-* flags

    • Removed relayer-source-request-burst
    • Removed relayer-merger-addr
    • Removed relayer-buffer-size
    • Removed relayer-min-start-offset