Arm backend: Fix flaky INT comparisons

[bdemirb]

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/18103

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 57 New Failures, 1 Pending, 7 Unrelated Failures

As of commit 51adf07 with merge base 7824373 ():

NEW FAILURES - The following jobs have failed:

• Build Presets / apple (pybind) / build (gh)
  The process '/opt/homebrew/bin/git' failed with exit code 128
• Build Presets / linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
• Build Presets / windows (pybind) / build (gh)
• Build Presets / windows (windows) / build (gh)
• Build Presets / zephyr (zephyr) / build (gh)
• Lint / link-check / lint-urls (gh)
  Process completed with exit code 1.
• pull / android / run-emulator (gh)
  The process '/usr/local/lib/android/sdk/platform-tools/adb' failed with exit code 224
• pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  An action could not be found at the URI 'https://api.github.com/repos/pmeier/pytest-results-action/tarball/a2c1430e2bddadbad9f49a6f9b879f062c6b19b1' (DCD0:2153A0:24A3D:2978C:69B17C4D)
• pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]Response status code does not indicate success: 504 (Gateway Timeout).
• pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  ##[error]Response status code does not indicate success: 504 (Gateway Timeout).
• pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / test-moshi-linux / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
  ##[error]Response status code does not indicate success: 504 (Gateway Timeout).
• pull / test-setup-linux-gcc / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / unittest / macos / macos-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_linear_model
• pull / unittest / windows / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• pull / unittest-arm-backend-with-no-deps (test_pytest_models_tosa) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• pull / unittest-editable / windows / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• Test CUDA Builds / check-all-cuda-builds (gh)
  Process completed with exit code 1.
• Test CUDA Builds / test-executorch-cuda-build-13.0 / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• Test CUDA Builds / test-models-cuda (linear) / linux-job (gh)
  An action could not be found at the URI 'https://api.github.com/repos/pmeier/pytest-results-action/tarball/a2c1430e2bddadbad9f49a6f9b879f062c6b19b1' (DD1A:2214D6:251F6:2A0E9:69B17C68)
• Test CUDA Builds / test-models-cuda (sdpa) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• Test CUDA Builds / unittest-cuda / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-arm-backend-ethos-u (test_pytest_models_ethos_u85) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-arm-backend-ethos-u (test_pytest_ops_ethos_u85) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-arm-backend-vkml (test_pytest_ops_vkml) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-arm-backend-zephyr (ethos-u55) / linux-job (gh)
  An action could not be found at the URI 'https://api.github.com/repos/pmeier/pytest-results-action/tarball/a2c1430e2bddadbad9f49a6f9b879f062c6b19b1' (C63A:D473A:275C6:2C565:69B17C75)
• trunk / test-arm-backend-zephyr (ethos-u85) / linux-job (gh)
  An action could not be found at the URI 'https://api.github.com/repos/pmeier/pytest-results-action/tarball/a2c1430e2bddadbad9f49a6f9b879f062c6b19b1' (C6AE:2153A0:2577D:2A712:69B17C74)
• trunk / test-llama-runner-linux (bf16, custom, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-mcu-cortex-m-backend / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-models-linux-aarch64 (add, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh)
  An action could not be found at the URI 'https://api.github.com/repos/pmeier/pytest-results-action/tarball/a2c1430e2bddadbad9f49a6f9b879f062c6b19b1' (A664:156649:25ECC:2AD6C:69B17C68)
• trunk / test-models-linux-aarch64 (llama3_2_vision_encoder, portable, linux.arm64.2xlarge) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-models-linux-aarch64 (phi_4_mini, portable, linux.arm64.m7g.4xlarge) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-models-linux-aarch64 (resnet18, portable, linux.arm64.2xlarge) / linux-job (gh)
  An action could not be found at the URI 'https://api.github.com/repos/pmeier/pytest-results-action/tarball/a2c1430e2bddadbad9f49a6f9b879f062c6b19b1' (A5B0:14D981:29C27:2EB2E:69B17C6C)
• trunk / test-models-linux-aarch64 (softmax, portable, linux.arm64.2xlarge) / linux-job (gh)
  An action could not be found at the URI 'https://api.github.com/repos/pmeier/pytest-results-action/tarball/a2c1430e2bddadbad9f49a6f9b879f062c6b19b1' (A0A4:197DD1:24AC3:29A35:69B17C73)
• trunk / test-models-linux-aarch64 (vit, portable, linux.arm64.2xlarge) / linux-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-models-linux-aarch64 (vit, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh)
  ##[error]Response status code does not indicate success: 504 (Gateway Timeout).
• trunk / test-models-macos-coreml (emformer_join) / macos-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-models-macos-coreml (resnet50) / macos-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-models-macos-cpu (llama3_2_vision_encoder, portable) / macos-job (gh)
  ##[error]Response status code does not indicate success: 503 (Service Unavailable).
• trunk / test-models-windows (emformer_transcribe, portable) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (emformer_transcribe, xnnpack-q8) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (mobilebert, portable) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (mobilebert, xnnpack-q8) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (mv3, portable) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (mv3, xnnpack-q8) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (resnet50, portable) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (resnet50, xnnpack-q8) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (vit, portable) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / test-models-windows (vit, xnnpack-q8) / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• trunk / unittest-release / windows / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1
• Windows MSVC Build / build-windows-msvc / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 1

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-models-linux (add, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-models-linux (linear, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-phi-3-mini-runner-linux / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[bdemirb]

@pytorchbot label ciflow/trunk

[bdemirb]

@pytorchbot label "partner: arm"

[bdemirb]

@pytorchbot label "release notes: arm"

[usamahz]

Looks many tests are failing?

[bdemirb]

Looks many tests are failing?

None of the are related to the PR. I think the CI seems to be a bit messy. I believe tomorrow it will look cleaner.