ci: add Batch Sync workflow skeleton - #12
Open
darkobas2 wants to merge 1 commit into
Open
Conversation
Adds a manually-triggered Batch Sync workflow exposing every batch-export flag as a typed input: start/end block, max requests per second, block range limit, output path, compression and verbosity. The job runs on the self-hosted bee runners, whose egress addresses are inside the RPC provider's allowlist, so no credential is needed there. If it is ever moved to a hosted runner the endpoint requires HTTP Basic auth, so the Compose endpoint step builds an authenticated URL when a user and password are available and falls back to the bare URL when they are not. The composed value is masked and passed through the environment rather than echoed, and the endpoint itself comes from a secret so no infrastructure hostname is committed here. The final sync step is deliberately a failing TODO: the export half is runnable, but the publish destination has not been decided yet.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds a
Batch Syncworkflow skeleton, manually triggered viaworkflow_dispatch.Every
batch-exportflag is exposed as a typed input, defaulted to the CLI's own defaults:start_block31306381--startend_block0(latest)--endmax_request15--max-requestblock_range_limit5--block-range-limitoutputexport.ndjson--outputcompressfalse--compressverbosityinfo--verbosityNotes on a few choices:
make binary, notmake build.make buildrunsgo build ./...and produces no artifact;make binaryis the target that emitsdist/batch-export.Compose endpointstep adds HTTP Basic credentials only when both a user and a password are present, and falls back to the bare URL otherwise. The composed value is masked and passed viaGITHUB_ENVrather than echoed.block_range_limitis documented as "keep low" — largeeth_getLogsranges can exhaust memory on the node serving them.Syncstep is a deliberate failing TODO. The export half is runnable; the publish destination hasn't been decided, and a silent no-op would be worse than an obvious stop.The schedule trigger is present but commented out until the sync destination is wired up.