Skip to content

[DNM] test tempest#3829

Draft
Valkyrie00 wants to merge 5 commits intoopenstack-k8s-operators:mainfrom
Valkyrie00:feat/parallel-tempest-hook
Draft

[DNM] test tempest#3829
Valkyrie00 wants to merge 5 commits intoopenstack-k8s-operators:mainfrom
Valkyrie00:feat/parallel-tempest-hook

Conversation

@Valkyrie00
Copy link
Copy Markdown
Contributor

WIP

@openshift-ci
Copy link
Copy Markdown
Contributor

openshift-ci bot commented Apr 4, 2026

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@Valkyrie00 Valkyrie00 changed the title [DNM] Add parallel_tempest hook for multi-CR parallel execution [DNM] test tempest Apr 4, 2026
@softwarefactory-project-zuul
Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/b9c4995c6eb84cd6adec2560c34fb413

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 20m 10s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 22m 08s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 32m 59s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 07m 03s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 34s
cifmw-pod-pre-commit FAILURE in 8m 23s

The Jinja2 join("\n") inside a YAML block scalar produces a literal
two-character \n instead of an actual newline. This caused
discover-tempest-config to fail with "An odd number of override
options was found" because the last scenario override and the
controller IP override were concatenated on a single line.

Use a YAML double-quoted variable (_nl: "\n") where the YAML parser
correctly interprets the escape sequence as a real newline character.

Made-with: Cursor
@softwarefactory-project-zuul
Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3dd2faac9b2944a89bd0df9724ed8488

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 20m 51s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 24m 39s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 39m 54s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 06m 46s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 41s
cifmw-pod-pre-commit FAILURE in 7m 57s

When kubernetes.core.k8s_info returns an error (API timeout, transient
connectivity loss), the result dict lacks the .resources key, causing
the until condition and summary vars to fail with 'dict object has no
attribute resources'. Add defensive checks so the retry loop continues
on transient errors instead of aborting.

Made-with: Cursor
@softwarefactory-project-zuul
Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/b2ec697be00b46cdb7cd05fed6329b38

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 12m 39s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 26m 01s
cifmw-crc-podified-edpm-baremetal RETRY_LIMIT in 33m 00s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 59m 35s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 29s
cifmw-pod-pre-commit FAILURE in 8m 05s

When all 4 Tempest CRs include the same extraImages with a fixed ID,
only the first pod to reach image creation succeeds. The rest get a
409 Conflict, leaving IMAGE_ID empty and causing a 600s timeout loop.

Only include extraImages in the first CR (index 0). The other pods
skip image creation and find the image already active in Glance by
the time their tests start.

Made-with: Cursor
@softwarefactory-project-zuul
Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/d75bf645521d4874a5526fd490622416

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 07m 01s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 26m 18s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 42m 47s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 53m 19s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 13s
cifmw-pod-pre-commit FAILURE in 8m 10s

When all 4 pods run discover-tempest-config --create simultaneously,
they race on creating shared Nova flavors (m1.micro, m1.nano) causing
409 Conflict and exit 123 before any tests run.

Fix: only the first CR gets tempestconfRun.create=true. The remaining
3 CRs get create=false (discover-only, no resource creation). The
first CR is applied 120s before the rest, ensuring images and flavors
exist in Glance/Nova when the other pods discover the cloud.

Made-with: Cursor
@openshift-ci
Copy link
Copy Markdown
Contributor

openshift-ci bot commented Apr 8, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign evallesp for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@softwarefactory-project-zuul
Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/b96895c09b294a01a3d1ff59bb1a961d

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 19m 08s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 24m 41s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 30m 09s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 06m 39s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 30s
cifmw-pod-pre-commit FAILURE in 8m 31s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant