Skip to content

buildkite/Make: Add short delay after reloading Docker, restart bazel.#13748

Merged
copybara-service[bot] merged 1 commit into
masterfrom
test/cl949770216
Jul 18, 2026
Merged

buildkite/Make: Add short delay after reloading Docker, restart bazel.#13748
copybara-service[bot] merged 1 commit into
masterfrom
test/cl949770216

Conversation

@copybara-service

@copybara-service copybara-service Bot commented Jul 17, 2026

Copy link
Copy Markdown

buildkite/Make: Add short delay after reloading Docker, restart bazel.

The Docker reload command (especially when it's just SIGHUP) can race with
future CI instructions that use the bazel container, causing races.

Example CI logs:

--- CONFIGURE buildkite_runtime → [...]

2026/07/17 21:29:36 Clobber is set. Overwriting runtime buildkite_runtime not found: adding

2026/07/17 21:29:36 Successfully updated config.

--- DOCKER RELOAD

+ sudo systemctl reload docker

+ docker info --format '{{range $k,$v:=.Runtimes}}{{println $k}}{{end}}'

+ grep -qF buildkite_runtime

--- TEST --test_env=RUNTIME=buildkite_runtime [...] //test/[...]

Error: No such container: gvisor-bazel-1f42b90b-x86_64

Makefile:282: recipe for target 'nodejs22.2.0-runtime-tests' failed

make: *** [nodejs22.2.0-runtime-tests] Error 1

Not a great fix, but hopefully this fixes it.

@copybara-service copybara-service Bot added the exported Issue was exported automatically label Jul 17, 2026
@copybara-service
copybara-service Bot force-pushed the test/cl949770216 branch 5 times, most recently from 0f57bd5 to c1f4560 Compare July 18, 2026 00:34
@copybara-service copybara-service Bot changed the title buildkite/Make: Add short delay after reloading Docker. buildkite/Make: Add short delay after reloading Docker, restart bazel. Jul 18, 2026
The Docker reload command (especially when it's just SIGHUP) can race with
future CI instructions that use the bazel container, causing races.

Example CI logs:

```
--- CONFIGURE buildkite_runtime → [...]

2026/07/17 21:29:36 Clobber is set. Overwriting runtime buildkite_runtime not found: adding

2026/07/17 21:29:36 Successfully updated config.

--- DOCKER RELOAD

+ sudo systemctl reload docker

+ docker info --format '{{range $k,$v:=.Runtimes}}{{println $k}}{{end}}'

+ grep -qF buildkite_runtime

--- TEST --test_env=RUNTIME=buildkite_runtime [...] //test/[...]

Error: No such container: gvisor-bazel-1f42b90b-x86_64

Makefile:282: recipe for target 'nodejs22.2.0-runtime-tests' failed

make: *** [nodejs22.2.0-runtime-tests] Error 1
```

Not a great fix, but hopefully this fixes it.

PiperOrigin-RevId: 949850411
@copybara-service
copybara-service Bot merged commit ed5539d into master Jul 18, 2026
1 check was pending
@copybara-service
copybara-service Bot deleted the test/cl949770216 branch July 18, 2026 01:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

exported Issue was exported automatically

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant