Skip to content

ci: do not retry e2e + always verbose for debugging purposes#3467

Draft
sadym-chromium wants to merge 5 commits intomainfrom
sadym/remove-e2e-retry
Draft

ci: do not retry e2e + always verbose for debugging purposes#3467
sadym-chromium wants to merge 5 commits intomainfrom
sadym/remove-e2e-retry

Conversation

@sadym-chromium
Copy link
Copy Markdown
Collaborator

@sadym-chromium sadym-chromium commented Jun 4, 2025

Run 1. Headless Mac ChromeDriver

  • 1/4 12/40 cd-macos-latest-new-headless tests/input/test_input.py::test_input_performActionsEmitsDblClicks. Looks like some infra issue. Log.
  • 3/4 3/40 cd-macos-latest-new-headless test_browsingContext_create_background[False-tab]
    AssertionError: New context should have focus.
  • 3/4 16/40 cd-macos-latest-new-headless test_browsingContext_create_background[False-tab]
    AssertionError: New context should have focus.
  • 3/4 17/40 cd-macos-latest-new-headless test_browsingContext_create_background[False-tab]
    AssertionError: New context should have focus.

Run 2. Headless Mac ChromeDriver

  • 0/4 11/40 cd-macos-latest-new-headless test_browsingContext_beforeUnloadPromptOpened_capabilityRespected[capabilities8-nested] Looks like some infra issue. Log.
  • 1/4 32/40 cd-macos-latest-new-headless test_input_keyDown_closes_browsing_context. connection has been closed. Log.
  • 2/4 3/40 cd-macos-latest-new-headless test_cdp_subscribe_to_all_cdp_events. Looks like some infra issue.
    Log.

Run 3. Headless Mac ChromeDriver

  • cd-macos-latest-new-headless-1-5 test_navigate_checkEvents Looks like some infra issue. Log.

Run Headful Mac ChromeDriver

Run old headless Mac ChromeDriver

Run old and new headless ubuntu ChromeDriver

Run old and new headless ubuntu ChromeDriver

@sadym-chromium sadym-chromium added the DO NOT MERGE Don't merge the marked PR label Jun 4, 2025
@sadym-chromium sadym-chromium force-pushed the sadym/remove-e2e-retry branch 14 times, most recently from 2ecbf18 to e954609 Compare June 5, 2025 13:29
Comment thread tests/test_helpers.py Fixed
Comment thread tests/test_helpers.py Fixed
Comment thread tests/test_helpers.py Fixed
@sadym-chromium sadym-chromium force-pushed the sadym/remove-e2e-retry branch from e954609 to 9762037 Compare June 5, 2025 13:56
Comment thread tests/test_helpers.py Fixed
Comment thread tests/test_helpers.py Fixed
Comment thread tests/test_helpers.py Fixed
Comment thread tests/test_helpers.py Fixed
@sadym-chromium sadym-chromium force-pushed the sadym/remove-e2e-retry branch 5 times, most recently from 485d845 to 7203612 Compare June 6, 2025 14:45
@sadym-chromium sadym-chromium force-pushed the sadym/remove-e2e-retry branch from 9cb4dbb to 6ca3bef Compare June 16, 2025 08:59
@sadym-chromium sadym-chromium force-pushed the sadym/remove-e2e-retry branch from 6ca3bef to 6880cb8 Compare June 18, 2025 12:33
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark

Details
Benchmark suite Current: 5f60777 Previous: 8ed35c7 Ratio
ubuntu-latest-new-headless-node:test_performance_screenshot 164.2667293548584 ms 160.52732467651367 ms 1.02
macos-latest-headful-node:test_performance_screenshot 3172.9332447052 ms 3433.286762237549 ms 0.92
macos-latest-headful-cd:test_performance_screenshot 3242.77720451355 ms 3173.1160163879395 ms 1.02
ubuntu-latest-old-headless-node:test_performance_screenshot 268.52288246154785 ms 269.0617084503174 ms 1.00
macos-latest-old-headless-cd:test_performance_screenshot 284.00378227233887 ms 270.17621994018555 ms 1.05
macos-latest-new-headless-node:test_performance_screenshot 2821.295404434204 ms 3646.190404891968 ms 0.77
macos-latest-old-headless-node:test_performance_screenshot 354.00962829589844 ms 229.7408103942871 ms 1.54
ubuntu-latest-new-headless-cd:test_performance_screenshot 181.3762664794922 ms 170.88866233825684 ms 1.06
ubuntu-latest-old-headless-cd:test_performance_screenshot 267.8524971008301 ms 271.416711807251 ms 0.99
ubuntu-latest-headful-node:test_performance_screenshot 158.3906650543213 ms

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DO NOT MERGE Don't merge the marked PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants