Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v1.0.0 firecore binary, new block format (based on anypb) #19

Merged
merged 67 commits into from
Dec 8, 2023
Merged
Changes from 1 commit
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
546709a
wip
billettc Nov 15, 2023
4bdf188
wip
billettc Nov 15, 2023
17d6e82
WIP waiting for bstream little refactor ;-)
billettc Nov 15, 2023
6faf4ef
added firehose
billettc Nov 16, 2023
0f3c601
bye bye bstream.Block!
billettc Nov 16, 2023
189450e
fix print and download tools
billettc Nov 16, 2023
9b48bf1
all test pass!
billettc Nov 17, 2023
7a5d1dc
all test pass!
billettc Nov 20, 2023
c47d937
bump bstream with new pbbstream.Block
billettc Nov 20, 2023
3f8b86d
Added rpc poller
jubeless Nov 21, 2023
1f22525
rename rpcpoller pckg to blkpoller
jubeless Nov 21, 2023
e146a25
rename blkpoller to blockpoller
jubeless Nov 21, 2023
2dda977
poller BlockFireFunc is now for internal use and tests
billettc Nov 21, 2023
297b1ef
clean up poller and bstream
jubeless Nov 22, 2023
c92a777
Added cursor, state test
jubeless Nov 22, 2023
991d08a
clean up formatting
jubeless Nov 22, 2023
b80045e
clean up code and fix bug
jubeless Nov 22, 2023
53446f5
fix block handler interface
jubeless Nov 22, 2023
bfd6e22
fix state test
jubeless Nov 22, 2023
e2de095
fix block handler
jubeless Nov 22, 2023
f7debde
Move block printing logic to the Block interface
billettc Nov 23, 2023
3f07b24
bump bstream
billettc Nov 23, 2023
5bd6074
clean up naming
jubeless Nov 23, 2023
644e8a8
Refactor variable names in blockpoller
billettc Nov 23, 2023
80ea795
Add error handling and logging in saveState function
billettc Nov 23, 2023
c9396c2
Refactor print statement in blockpoller
billettc Nov 23, 2023
81e1e91
Remove protobuf usage in consolereader
billettc Nov 23, 2023
19ad29a
fix test
billettc Nov 23, 2023
679c342
github workflows
billettc Nov 23, 2023
b53f673
github workflows switch branch
billettc Nov 23, 2023
f3ec523
github workflows add login
billettc Nov 23, 2023
c9041e5
github workflows fix image name
billettc Nov 23, 2023
2e3f5e2
github workflows fix permission
billettc Nov 23, 2023
e9da1f7
added grpc_health_probe to images
billettc Nov 24, 2023
b2cf970
Move the responsibility of waiting between block fetch to the block f…
billettc Nov 27, 2023
31d5902
Update block printing functions to support chain context
billettc Nov 27, 2023
bc92305
fix logger naming
jubeless Nov 27, 2023
f5e9f30
Implement dynamic protobuf parsing in block printing
billettc Nov 28, 2023
7aa2064
added the ability to ignore the cursor on the block poller
jubeless Nov 30, 2023
1d6f3c3
rename block poller option
jubeless Nov 30, 2023
2e7b9f9
fix substreams block-type
jubeless Nov 30, 2023
57af3fd
Clean up print block
jubeless Dec 4, 2023
818d341
Cleaned up print block
jubeless Dec 5, 2023
5a004d9
bump bstream
jubeless Dec 5, 2023
50415ed
fix firehose server on old and new blocks
sduchesneau Dec 5, 2023
b22a574
clean up printing
jubeless Dec 5, 2023
b639760
remove streamfactory 'decodeblock' option
sduchesneau Dec 5, 2023
f58cd08
refactor of tools and apps package
billettc Dec 5, 2023
efd96c3
wip refactor of tools and apps package
billettc Dec 5, 2023
e851074
finish refactor of tools and apps package
billettc Dec 5, 2023
bf490db
Added proto registry support
jubeless Dec 5, 2023
126fe12
Clean up marshaller added hex support
jubeless Dec 5, 2023
e177b36
clean up func
jubeless Dec 5, 2023
1535160
cleaned up encoder
jubeless Dec 5, 2023
bd5ad8f
move common flags to main
billettc Dec 5, 2023
5a810db
merge firehose commits after Nov9
sduchesneau Dec 6, 2023
6f6433e
bump substreams, bstream to latest
sduchesneau Dec 6, 2023
d2c719a
fix index builder
sduchesneau Dec 6, 2023
2d21be8
bump bstreams to prevent heavy blocks printed in logs
sduchesneau Dec 6, 2023
0ae01d4
add firehose-bitcoin in well known proto types
jubeless Dec 6, 2023
b5b7a44
bump substreams: remove the need to specify block type
sduchesneau Dec 6, 2023
6665daf
bump substreams: fix blockType getter on tier1
sduchesneau Dec 6, 2023
b6771e0
fix merger to convert legacy blocks
sduchesneau Dec 7, 2023
f094747
fix tests
billettc Dec 7, 2023
6db5324
remove CoreBinaryEnabled from chain definition, now only part of the …
sduchesneau Dec 8, 2023
574234d
bump libraries one last time, bump changelog for v1.0.0
sduchesneau Dec 8, 2023
dce4f95
Merge branch 'develop' into block_any
sduchesneau Dec 8, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 6 additions & 6 deletions go.mod
Original file line number Diff line number Diff line change
@@ -16,7 +16,7 @@ require (
github.com/spf13/cobra v1.7.0
github.com/spf13/pflag v1.0.5
github.com/spf13/viper v1.15.0
github.com/streamingfast/bstream v0.0.2-0.20231205185208-7e21cc7e64bc
github.com/streamingfast/bstream v0.0.2-0.20231205214347-a411792eb5ab
github.com/streamingfast/cli v0.0.4-0.20230825151644-8cc84512cd80
github.com/streamingfast/dauth v0.0.0-20231120142446-843f4e045cc2
github.com/streamingfast/dbin v0.9.1-0.20231117225723-59790c798e2c
@@ -30,7 +30,7 @@ require (
github.com/streamingfast/logging v0.0.0-20230608130331-f22c91403091
github.com/streamingfast/pbgo v0.0.6-0.20231120172814-537d034aad5e
github.com/streamingfast/snapshotter v0.0.0-20230316190750-5bcadfde44d0
github.com/streamingfast/substreams v1.1.21-0.20231122013157-938ec26b0ef6
github.com/streamingfast/substreams v1.1.23-0.20231206180647-a75a8a462609
github.com/stretchr/testify v1.8.4
github.com/test-go/testify v1.1.4
go.uber.org/multierr v1.10.0
@@ -195,13 +195,13 @@ require (
go.opentelemetry.io/proto/otlp v1.0.0 // indirect
go.uber.org/atomic v1.10.0
go.uber.org/automaxprocs v1.5.1 // indirect
golang.org/x/crypto v0.13.0 // indirect
golang.org/x/crypto v0.14.0 // indirect
golang.org/x/mod v0.12.0 // indirect
golang.org/x/net v0.15.0 // indirect
golang.org/x/net v0.17.0 // indirect
golang.org/x/oauth2 v0.10.0
golang.org/x/sync v0.3.0 // indirect
golang.org/x/sys v0.12.0 // indirect
golang.org/x/term v0.12.0 // indirect
golang.org/x/sys v0.13.0 // indirect
golang.org/x/term v0.13.0 // indirect
golang.org/x/text v0.13.0 // indirect
golang.org/x/time v0.1.0 // indirect
golang.org/x/xerrors v0.0.0-20220907171357-04be3eba64a2 // indirect
28 changes: 12 additions & 16 deletions go.sum
Original file line number Diff line number Diff line change
@@ -578,12 +578,10 @@ github.com/spf13/pflag v1.0.5/go.mod h1:McXfInJRrz4CZXVZOBLb0bTZqETkiAhM9Iw0y3An
github.com/spf13/viper v1.15.0 h1:js3yy885G8xwJa6iOISGFwd+qlUo5AvyXb7CiihdtiU=
github.com/spf13/viper v1.15.0/go.mod h1:fFcTBJxvhhzSJiZy8n+PeW6t8l+KeT/uTARa0jHOQLA=
github.com/stoewer/go-strcase v1.2.0/go.mod h1:IBiWB2sKIp3wVVQ3Y035++gc+knqhUQag1KpM8ahLw8=
github.com/streamingfast/bstream v0.0.2-0.20231205185208-7e21cc7e64bc h1:ioohiLa+d59fqToa2OhbUx418YMrqt2bLT+m+fmjOG8=
github.com/streamingfast/bstream v0.0.2-0.20231205185208-7e21cc7e64bc/go.mod h1:08GVb+DXyz6jVNIsbf+2zlaC81UeEGu5o1h49KrSR3Y=
github.com/streamingfast/bstream v0.0.2-0.20231205214347-a411792eb5ab h1:CTVn1JAzOvON/d1ZohrV2RicBIVxXMApDQhURguqWXg=
github.com/streamingfast/bstream v0.0.2-0.20231205214347-a411792eb5ab/go.mod h1:08GVb+DXyz6jVNIsbf+2zlaC81UeEGu5o1h49KrSR3Y=
github.com/streamingfast/cli v0.0.4-0.20230825151644-8cc84512cd80 h1:UxJUTcEVkdZy8N77E3exz0iNlgQuxl4m220GPvzdZ2s=
github.com/streamingfast/cli v0.0.4-0.20230825151644-8cc84512cd80/go.mod h1:QxjVH73Lkqk+mP8bndvhMuQDUINfkgsYhdCH/5TJFKI=
github.com/streamingfast/dauth v0.0.0-20230929180355-921f9c9be330 h1:49JYZkn8ALGe+LhcACZyX3L9B8tIxRZ3F3l+OxmNMhY=
github.com/streamingfast/dauth v0.0.0-20230929180355-921f9c9be330/go.mod h1:zfq+mtesfbaZnNeh1BF+vo+zEFP1sat4pm3lvt40nRw=
github.com/streamingfast/dauth v0.0.0-20231120142446-843f4e045cc2 h1:g4mG6ZCy3/XtcsZXfOHrQOsjVGoX9uTc/QlemaPV4EE=
github.com/streamingfast/dauth v0.0.0-20231120142446-843f4e045cc2/go.mod h1:zfq+mtesfbaZnNeh1BF+vo+zEFP1sat4pm3lvt40nRw=
github.com/streamingfast/dbin v0.9.1-0.20231117225723-59790c798e2c h1:6WjE2yInE+5jnI7cmCcxOiGZiEs2FQm9Zsg2a9Ivp0Q=
@@ -594,8 +592,6 @@ github.com/streamingfast/dgrpc v0.0.0-20230929132851-893fc52687fa h1:L/Ipge5pkZt
github.com/streamingfast/dgrpc v0.0.0-20230929132851-893fc52687fa/go.mod h1:AcY2kk28XswihgU6z37288a3ZF4gGGO7nNwlTI/vET4=
github.com/streamingfast/dlauncher v0.0.0-20230607184145-76399faad89e h1:Nh/gLDv8rOMIidb/gpO4rZOYVe09k+tof/trezkpku4=
github.com/streamingfast/dlauncher v0.0.0-20230607184145-76399faad89e/go.mod h1:xErlHEDd5+4NlR+Mg3ZtW7BTTLB0yZBxZAjHPrkk8X4=
github.com/streamingfast/dmetering v0.0.0-20230731155453-e1df53e362aa h1:bM6iy5X7Gtw1oh1bMxFmtroouKZu4K4BHXaFvR96jNw=
github.com/streamingfast/dmetering v0.0.0-20230731155453-e1df53e362aa/go.mod h1:3XggUfQMyciaue133qhbIkFqJQqNzozGpa/gI3sdwac=
github.com/streamingfast/dmetering v0.0.0-20231120142327-a3405f0eed83 h1:IbIUT85146duL9EKwMiiW0HH1djpm8plmJOo+YZbO5U=
github.com/streamingfast/dmetering v0.0.0-20231120142327-a3405f0eed83/go.mod h1:3XggUfQMyciaue133qhbIkFqJQqNzozGpa/gI3sdwac=
github.com/streamingfast/dmetrics v0.0.0-20230919161904-206fa8ebd545 h1:SUl04bZKGAv207lp7/6CHOJIRpjUKunwItrno3K463Y=
@@ -625,8 +621,8 @@ github.com/streamingfast/shutter v1.5.0 h1:NpzDYzj0HVpSiDJVO/FFSL6QIK/YKOxY0gJAt
github.com/streamingfast/shutter v1.5.0/go.mod h1:B/T6efqdeMGbGwjzPS1ToXzYZI4kDzI5/u4I+7qbjY8=
github.com/streamingfast/snapshotter v0.0.0-20230316190750-5bcadfde44d0 h1:Y15G1Z4fpEdm2b+/70owI7TLuXadlqBtGM7rk4Hxrzk=
github.com/streamingfast/snapshotter v0.0.0-20230316190750-5bcadfde44d0/go.mod h1:/Rnz2TJvaShjUct0scZ9kKV2Jr9/+KBAoWy4UMYxgv4=
github.com/streamingfast/substreams v1.1.21-0.20231122013157-938ec26b0ef6 h1:eNA736ywGv/XXCotwx4LkfRDmOrHUyPbAqCKI+RzYI4=
github.com/streamingfast/substreams v1.1.21-0.20231122013157-938ec26b0ef6/go.mod h1:JHCOsJtgXUM2KWNxsvi5/hjrLy4KpClaMRriBR3ybnI=
github.com/streamingfast/substreams v1.1.23-0.20231206180647-a75a8a462609 h1:Fqkzbca2JPg4kKVfrSyPJk0hGGbkJcxSsxgWKwh75KA=
github.com/streamingfast/substreams v1.1.23-0.20231206180647-a75a8a462609/go.mod h1:fCC3pGTYMi0N4VhJjdJPQydefJpY+tsY9BzWxDi152k=
github.com/stretchr/objx v0.1.0/go.mod h1:HFkY916IF+rwdDfMAkV7OtwuqBVzrE8GR6GFx+wExME=
github.com/stretchr/objx v0.1.1/go.mod h1:HFkY916IF+rwdDfMAkV7OtwuqBVzrE8GR6GFx+wExME=
github.com/stretchr/objx v0.4.0/go.mod h1:YvHI0jy2hoMjB+UWwv71VJQ9isScKT/TqJzVSSt89Yw=
@@ -731,8 +727,8 @@ golang.org/x/crypto v0.0.0-20210921155107-089bfa567519/go.mod h1:GvvjBRRGRdwPK5y
golang.org/x/crypto v0.0.0-20211108221036-ceb1ce70b4fa/go.mod h1:GvvjBRRGRdwPK5ydBHafDWAxML/pGHZbMvKqRZ5+Abc=
golang.org/x/crypto v0.0.0-20220214200702-86341886e292/go.mod h1:IxCIyHEi3zRg3s0A5j5BB6A9Jmi73HwBIUl50j+osU4=
golang.org/x/crypto v0.0.0-20220314234659-1baeb1ce4c0b/go.mod h1:IxCIyHEi3zRg3s0A5j5BB6A9Jmi73HwBIUl50j+osU4=
golang.org/x/crypto v0.13.0 h1:mvySKfSWJ+UKUii46M40LOvyWfN0s2U+46/jDd0e6Ck=
golang.org/x/crypto v0.13.0/go.mod h1:y6Z2r+Rw4iayiXXAIxJIDAJ1zMW4yaTpebo8fPOliYc=
golang.org/x/crypto v0.14.0 h1:wBqGXzWJW6m1XrIKlAH0Hs1JJ7+9KBwnIO8v66Q9cHc=
golang.org/x/crypto v0.14.0/go.mod h1:MVFd36DqK4CsrnJYDkBA3VC4m2GkXAM0PvzMCn4JQf4=
golang.org/x/exp v0.0.0-20190121172915-509febef88a4/go.mod h1:CJ0aWSM057203Lf6IL+f9T1iT9GByDxfZKAQTCR3kQA=
golang.org/x/exp v0.0.0-20190306152737-a1d7652674e8/go.mod h1:CJ0aWSM057203Lf6IL+f9T1iT9GByDxfZKAQTCR3kQA=
golang.org/x/exp v0.0.0-20190510132918-efd6b22b2522/go.mod h1:ZjyILWgesfNpC6sMxTJOJm9Kp84zZh5NQWvqDGG3Qr8=
@@ -816,8 +812,8 @@ golang.org/x/net v0.0.0-20210503060351-7fd8e65b6420/go.mod h1:9nx3DQGgdP8bBQD5qx
golang.org/x/net v0.0.0-20211112202133-69e39bad7dc2/go.mod h1:9nx3DQGgdP8bBQD5qxJ1jj9UTztislL4KSBs9R2vV5Y=
golang.org/x/net v0.0.0-20220722155237-a158d28d115b/go.mod h1:XRhObCWvk6IyKnWLug+ECip1KBveYUHfp+8e9klMJ9c=
golang.org/x/net v0.1.0/go.mod h1:Cx3nUiGt4eDBEyega/BKRp+/AlGL8hYe7U9odMt2Cco=
golang.org/x/net v0.15.0 h1:ugBLEUaxABaB5AJqW9enI0ACdci2RUd4eP51NTBvuJ8=
golang.org/x/net v0.15.0/go.mod h1:idbUs1IY1+zTqbi8yxTbhexhEEk5ur9LInksu6HrEpk=
golang.org/x/net v0.17.0 h1:pVaXccu2ozPjCXewfr1S7xza/zcXTity9cCdXQYSjIM=
golang.org/x/net v0.17.0/go.mod h1:NxSsAGuq816PNPmqtQdLE42eU2Fs7NoRIZrHJAlaCOE=
golang.org/x/oauth2 v0.0.0-20180821212333-d2e6202438be/go.mod h1:N/0e6XlmueqKjAGxoOufVs8QHGRruUQn6yWY3a++T0U=
golang.org/x/oauth2 v0.0.0-20190226205417-e64efc72b421/go.mod h1:gOpvHmFTYa4IltrdGE7lF6nIHvwfUNPOp7c8zoXwtLw=
golang.org/x/oauth2 v0.0.0-20190604053449-0f29369cfe45/go.mod h1:gOpvHmFTYa4IltrdGE7lF6nIHvwfUNPOp7c8zoXwtLw=
@@ -915,13 +911,13 @@ golang.org/x/sys v0.0.0-20220704084225-05e143d24a9e/go.mod h1:oPkhp1MJrh7nUepCBc
golang.org/x/sys v0.0.0-20220722155257-8c9f86f7a55f/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/sys v0.0.0-20220908164124-27713097b956/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/sys v0.1.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/sys v0.12.0 h1:CM0HF96J0hcLAwsHPJZjfdNzs0gftsLfgKt57wWHJ0o=
golang.org/x/sys v0.12.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/sys v0.13.0 h1:Af8nKPmuFypiUBjVoU9V20FiaFXOcuZI21p0ycVYYGE=
golang.org/x/sys v0.13.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/term v0.0.0-20201126162022-7de9c90e9dd1/go.mod h1:bj7SfCRtBDWHUb9snDiAeCFNEtKQo2Wmx5Cou7ajbmo=
golang.org/x/term v0.0.0-20210927222741-03fcf44c2211/go.mod h1:jbD1KX2456YbFQfuXm/mYQcufACuNUgVhRMnK/tPxf8=
golang.org/x/term v0.1.0/go.mod h1:jbD1KX2456YbFQfuXm/mYQcufACuNUgVhRMnK/tPxf8=
golang.org/x/term v0.12.0 h1:/ZfYdc3zq+q02Rv9vGqTeSItdzZTSNDmfTi0mBAuidU=
golang.org/x/term v0.12.0/go.mod h1:owVbMEjm3cBLCHdkQu9b1opXd4ETQWc3BhuQGKgXgvU=
golang.org/x/term v0.13.0 h1:bb+I9cTfFazGW51MZqBVmZy7+JEJMouUHTUSKVQLBek=
golang.org/x/term v0.13.0/go.mod h1:LTmsnFJwVN6bCy1rVCoS+qHT1HhALEFxKncY3WNNh4U=
golang.org/x/text v0.0.0-20170915032832-14c0d48ead0c/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
golang.org/x/text v0.3.0/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
golang.org/x/text v0.3.1-0.20180807135948-17ff2d5776d2/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=