Idea: Substreams burst streamer

[abourget]

Imagine a new Substreams “burst streamer proxy” sink or something:

• That merely connects to a Substreams and stream its data.
• It would cache the last X blocks worth of module output in memory
• Exposes a Connect Web/gRPC endpoint, just like the Generic KV, but typed with the module’s output
• Would provide a burst of recent data (up to X blocks), and stream outputs in realtime.
• Be a new deployable unit, and exposed to end-users. Configured through sink_config
• The Guild said it could be integrated into graph-client with not enormous efforts as a streaming source.
• Would provide a direct streaming use of Substreams, and push forward some new use cases (real-time time series)