Skip to content

WIP - Support cross-compile darwin builds to aarch64 [ci-full] #7137

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
moztcampbell wants to merge 4 commits into
base: main
Choose a base branch
from

debugging ci

e223b5f
Select commit
Loading
Failed to load commit list.
Open

WIP - Support cross-compile darwin builds to aarch64 [ci-full] #7137

debugging ci
e223b5f
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task (pull-request) succeeded Jan 6, 2026 in 22s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-01-06T01:10:13.773Z
Resolved: 2026-01-06T01:10:35.367Z
Task Execution Time: 21 seconds, 594 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/actions.json
- public/chain-of-trust.json
- public/chain-of-trust.json.sig
- public/docker-contexts/linux2004.tar.gz
- public/docker-contexts/linux.tar.gz
- public/fetch-content
- public/full-task-graph.json
- public/label-to-taskid.json
- public/logs/certified.log
- public/logs/live_backing.log
- public/logs/live.log
- public/optimizations.log
- public/parameters.yml
- public/runnable-jobs.json
- public/run-task
- public/target-tasks.json
- public/task-graph.json

[taskcluster 2026-01-06T01:10:13.991Z] Worker Type (app-services-1/decision) settings:
[taskcluster 2026-01-06T01:10:13.991Z]   {
[taskcluster 2026-01-06T01:10:13.991Z]     "config": {
[taskcluster 2026-01-06T01:10:13.991Z]       "deploymentId": ""
[taskcluster 2026-01-06T01:10:13.991Z]     },
[taskcluster 2026-01-06T01:10:13.991Z]     "generic-worker": {
[taskcluster 2026-01-06T01:10:13.991Z]       "config": {
[taskcluster 2026-01-06T01:10:13.991Z]         "headlessTasks": true
[taskcluster 2026-01-06T01:10:13.991Z]       },
[taskcluster 2026-01-06T01:10:13.991Z]       "engine": "multiuser",
[taskcluster 2026-01-06T01:10:13.991Z]       "go-arch": "amd64",
[taskcluster 2026-01-06T01:10:13.991Z]       "go-os": "linux",
[taskcluster 2026-01-06T01:10:13.991Z]       "go-version": "go1.25.4",
[taskcluster 2026-01-06T01:10:13.991Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v93.1.2",
[taskcluster 2026-01-06T01:10:13.991Z]       "revision": "e954a7555fe32f7de69247759908749d1d670889",
[taskcluster 2026-01-06T01:10:13.991Z]       "source": "https://github.com/taskcluster/taskcluster/commits/e954a7555fe32f7de69247759908749d1d670889",
[taskcluster 2026-01-06T01:10:13.991Z]       "version": "93.1.2"
[taskcluster 2026-01-06T01:10:13.991Z]     },
[taskcluster 2026-01-06T01:10:13.991Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2025-11-14",
[taskcluster 2026-01-06T01:10:13.991Z]     "instance-id": "4598063270013821266",
[taskcluster 2026-01-06T01:10:13.991Z]     "instance-type": "projects/887720501152/machineTypes/n2-standard-2",
[taskcluster 2026-01-06T01:10:13.991Z]     "local-ipv4": "10.142.0.2",
[taskcluster 2026-01-06T01:10:13.991Z]     "project-id": "fxci-production-level1-workers",
[taskcluster 2026-01-06T01:10:13.991Z]     "public-hostname": "app-services-1-decision-fvk4qhxergmwxvsn2putcg.c.fxci-production-level1-workers.internal",
[taskcluster 2026-01-06T01:10:13.991Z]     "public-ipv4": "34.73.186.51",
[taskcluster 2026-01-06T01:10:13.991Z]     "region": "us-east1",
[taskcluster 2026-01-06T01:10:13.991Z]     "zone": "us-east1-c"
[taskcluster 2026-01-06T01:10:13.991Z]   }
[taskcluster 2026-01-06T01:10:13.991Z] Task ID: JVq8eYbyQ6iW1KD4YOkuDQ
[taskcluster 2026-01-06T01:10:13.991Z] === Task Starting ===
[taskcluster 2026-01-06T01:10:16.168Z] [mounts] No existing writable directory cache 'app-services-level-1-checkouts-v1' - creating /home/generic-worker/caches/L3_JZvjrT_qsb82xV64Bpg
[taskcluster 2026-01-06T01:10:16.169Z] [mounts] Creating directory /home/task_176766157902091/cache0
[taskcluster 2026-01-06T01:10:16.180Z] [mounts] Updating ownership of files inside directory '/home/task_176766157902091/cache0' from root to task_176766157902091
[taskcluster 2026-01-06T01:10:16.182Z] [mounts] Successfully mounted writable directory cache '/home/task_176766157902091/cache0'
[taskcluster 2026-01-06T01:10:16.183Z] [d2g] Loading docker image
[taskcluster 2026-01-06T01:10:22.609Z] [d2g] Loaded docker image "docker.io/mozillareleases/taskgraph:decision-v11.2.4@sha256:eb53b1ca6b86b1344d61f55aab77b130048c0ae007eef181ec82eec327e91e07"
[taskcluster 2026-01-06T01:10:22.626Z] Executing command 0: docker run -t --name taskcontainer_FLQ4ChS3RuWFG0ZacJKWag --memory-swap -1 --pids-limit -1 '--add-host=localhost.localdomain:127.0.0.1' -v /home/task_176766157902091/cache0:/builds/worker/checkouts --add-host=taskcluster:host-gateway --env-file 'env.list' 'mozillareleases/taskgraph:decision-v11.2.4@sha256:eb53b1ca6b86b1344d61f55aab77b130048c0ae007eef181ec82eec327e91e07' /usr/local/bin/run-task --appservices-checkout=/builds/worker/checkouts/vcs --task-cwd=/builds/worker/checkouts/vcs -- bash -cx 'ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='\''0'\'' --pushdate='\''0'\'' --project='\''application-services'\'' --message="" --owner='\''moztcampbell@users.noreply.github.com'\'' --level='\''1'\'' --base-repository="$APPSERVICES_BASE_REPOSITORY" --head-repository="$APPSERVICES_HEAD_REPOSITORY" --head-ref="$APPSERVICES_HEAD_REF" --head-rev="$APPSERVICES_HEAD_REV" --repository-type="$APPSERVICES_REPOSITORY_TYPE" --tasks-for='\''github-pull-request'\'' 
[taskcluster 2026-01-06T01:10:22.626Z] '
[setup 2026-01-06T01:10:24.334Z] run-task started in /
[setup 2026-01-06T01:10:24.334Z] Invoked by command: --appservices-checkout=/builds/worker/checkouts/vcs --task-cwd=/builds/worker/checkouts/vcs -- bash -cx ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='application-services' --message="" --owner='moztcampbell@users.noreply.github.com' --level='1' --base-repository="$APPSERVICES_BASE_REPOSITORY" --head-repository="$APPSERVICES_HEAD_REPOSITORY" --head-ref="$APPSERVICES_HEAD_REF" --head-rev="$APPSERVICES_HEAD_REV" --repository-type="$APPSERVICES_REPOSITORY_TYPE" --tasks-for='github-pull-request' 

[setup 2026-01-06T01:10:24.334Z] Python version: 3.11.2
[cache 2026-01-06T01:10:24.335Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[setup 2026-01-06T01:10:24.336Z] running as worker:worker
[vcs 2026-01-06T01:10:24.336Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2026-01-06T01:10:24.337Z] executing ['git', 'clone', 'https://github.com/mozilla/application-services', '/builds/worker/checkouts/vcs']
[vcs 2026-01-06T01:10:24.339Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2026-01-06T01:10:30.467Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/moztcampbell/application-services', 'aarch64_darwin_cross']
[vcs 2026-01-06T01:10:30.678Z] From https://github.com/moztcampbell/application-services
[vcs 2026-01-06T01:10:30.678Z]  * branch                aarch64_darwin_cross -> FETCH_HEAD
[vcs 2026-01-06T01:10:30.680Z] executing ['git', 'checkout', '-f', '-B', 'aarch64_darwin_cross', 'e223b5f358ec65896d95d7cd95937d685761691b']
[vcs 2026-01-06T01:10:30.878Z] Switched to a new branch 'aarch64_darwin_cross'
[vcs 2026-01-06T01:10:30.878Z] executing ['git', 'submodule', 'init']
[vcs 2026-01-06T01:10:30.899Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2026-01-06T01:10:30.919Z] cleaning git checkout...
[vcs 2026-01-06T01:10:30.919Z] executing ['git', 'clean', '-nxdff']
[vcs 2026-01-06T01:10:30.927Z] removing []
[vcs 2026-01-06T01:10:30.927Z] successfully cleaned git checkout!
[vcs 2026-01-06T01:10:30.929Z] TinderboxPrint:<a href='https://github.com/moztcampbell/application-services/commit/e223b5f358ec65896d95d7cd95937d685761691b' title='Built from application-services commit e223b5f358ec65896d95d7cd95937d685761691b'>e223b5f358ec65896d95d7cd95937d685761691b</a>
[setup 2026-01-06T01:10:30.929Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[pip-install 2026-01-06T01:10:30.944Z] executing ['uv', 'pip', 'install', '--python', '/usr/bin/python3', '--target', '/builds/worker/.local/lib/python3.11/site-packages', '--require-hashes', '-r', '/builds/worker/checkouts/vcs/taskcluster/requirements.txt']
[pip-install 2026-01-06T01:10:31.165Z] Resolved 33 packages in 172ms
[pip-install 2026-01-06T01:10:31.348Z] Prepared 33 packages in 180ms
[pip-install 2026-01-06T01:10:31.374Z] Installed 33 packages in 25ms
[pip-install 2026-01-06T01:10:31.374Z]  + appdirs==1.4.4
[pip-install 2026-01-06T01:10:31.374Z]  + arrow==1.3.0
[pip-install 2026-01-06T01:10:31.374Z]  + binaryornot==0.4.4
[pip-install 2026-01-06T01:10:31.374Z]  + certifi==2024.8.30
[pip-install 2026-01-06T01:10:31.374Z]  + chardet==5.2.0
[pip-install 2026-01-06T01:10:31.374Z]  + charset-normalizer==3.3.2
[pip-install 2026-01-06T01:10:31.374Z]  + click==8.1.7
[pip-install 2026-01-06T01:10:31.374Z]  + cookiecutter==2.6.0
[pip-install 2026-01-06T01:10:31.374Z]  + giturlparse==0.12.0
[pip-install 2026-01-06T01:10:31.375Z]  + idna==3.8
[pip-install 2026-01-06T01:10:31.375Z]  + jinja2==3.1.4
[pip-install 2026-01-06T01:10:31.375Z]  + json-e==4.7.1
[pip-install 2026-01-06T01:10:31.375Z]  + markdown-it-py==3.0.0
[pip-install 2026-01-06T01:10:31.375Z]  + markupsafe==2.1.5
[pip-install 2026-01-06T01:10:31.375Z]  + mdurl==0.1.2
[pip-install 2026-01-06T01:10:31.375Z]  + mozilla-repo-urls==0.1.1
[pip-install 2026-01-06T01:10:31.375Z]  + mozilla-taskgraph==3.0.1
[pip-install 2026-01-06T01:10:31.375Z]  + pygments==2.18.0
[pip-install 2026-01-06T01:10:31.375Z]  + python-dateutil==2.9.0.post0
[pip-install 2026-01-06T01:10:31.376Z]  + python-slugify==8.0.4
[pip-install 2026-01-06T01:10:31.376Z]  + pyyaml==6.0.2
[pip-install 2026-01-06T01:10:31.376Z]  + redo==3.0.0
[pip-install 2026-01-06T01:10:31.376Z]  + requests==2.32.3
[pip-install 2026-01-06T01:10:31.376Z]  + rich==13.8.0
[pip-install 2026-01-06T01:10:31.376Z]  + six==1.16.0
[pip-install 2026-01-06T01:10:31.376Z]  + slugid==2.0.0
[pip-install 2026-01-06T01:10:31.376Z]  + taskcluster-taskgraph==11.2.4
[pip-install 2026-01-06T01:10:31.376Z]  + taskcluster-urls==13.0.1
[pip-install 2026-01-06T01:10:31.376Z]  + text-unidecode==1.3
[pip-install 2026-01-06T01:10:31.376Z]  + types-python-dateutil==2.9.0.20240821
[pip-install 2026-01-06T01:10:31.376Z]  + typing-extensions==4.12.2
[pip-install 2026-01-06T01:10:31.376Z]  + urllib3==2.2.2
[pip-install 2026-01-06T01:10:31.376Z]  + voluptuous==0.14.2
[task 2026-01-06T01:10:31.380Z] executing ['bash', '-cx', 'ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id=\'0\' --pushdate=\'0\' --project=\'application-services\' --message="" --owner=\'moztcampbell@users.noreply.github.com\' --level=\'1\' --base-repository="$APPSERVICES_BASE_REPOSITORY" --head-repository="$APPSERVICES_HEAD_REPOSITORY" --head-ref="$APPSERVICES_HEAD_REF" --head-rev="$APPSERVICES_HEAD_REV" --repository-type="$APPSERVICES_REPOSITORY_TYPE" --tasks-for=\'github-pull-request\' \n']
[task 2026-01-06T01:10:31.382Z] + ln -s /builds/worker/artifacts artifacts
[task 2026-01-06T01:10:31.383Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=application-services --message= --owner=moztcampbell@users.noreply.github.com --level=1 --base-repository=https://github.com/mozilla/application-services --head-repository=https://github.com/moztcampbell/application-services --head-ref=aarch64_darwin_cross --head-rev=e223b5f358ec65896d95d7cd95937d685761691b --repository-type=git --tasks-for=github-pull-request
[task 2026-01-06T01:10:31.830Z] 2026-01-06 01:10:31,830 - INFO - Loading graph configuration.
[task 2026-01-06T01:10:31.868Z] 2026-01-06 01:10:31,868 - INFO - base_ref has been reset from "" to "origin/main".
[task 2026-01-06T01:10:31.868Z] 2026-01-06 01:10:31,868 - INFO - base_rev is not set.
[task 2026-01-06T01:10:31.868Z] 2026-01-06 01:10:31,868 - INFO - Using base_ref "origin/main" to determine latest common revision...
[task 2026-01-06T01:10:31.870Z] 2026-01-06 01:10:31,870 - INFO - base_rev has been reset from "" to "f46182e4a8ae04b1b8ac9d3a2675580e215a3283".
[task 2026-01-06T01:10:31.874Z] 2026-01-06 01:10:31,873 - WARNING - using default project parameters; add application-services to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.11/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2026-01-06T01:10:31.874Z] 2026-01-06 01:10:31,874 - INFO - Using Parameters(id=5bf53a450507) (from defaults)
[task 2026-01-06T01:10:31.875Z] 2026-01-06 01:10:31,874 - INFO - writing artifact file `parameters.yml`
[task 2026-01-06T01:10:31.882Z] 2026-01-06 01:10:31,882 - INFO - writing artifact file `actions.json`
[task 2026-01-06T01:10:31.883Z] 2026-01-06 01:10:31,883 - INFO - Loading kinds
[task 2026-01-06T01:10:31.888Z] 2026-01-06 01:10:31,887 - INFO - Generating full task set
[task 2026-01-06T01:10:31.891Z] 2026-01-06 01:10:31,891 - INFO - Writing docker-contexts/linux.tar.gz for docker image linux
[task 2026-01-06T01:10:31.908Z] 2026-01-06 01:10:31,908 - INFO - Writing docker-contexts/linux2004.tar.gz for docker image linux2004
[task 2026-01-06T01:10:31.924Z] 2026-01-06 01:10:31,924 - INFO - Generated 2 tasks for kind docker-image
[task 2026-01-06T01:10:31.936Z] 2026-01-06 01:10:31,936 - INFO - Generated 1 tasks for kind fetch
[task 2026-01-06T01:10:31.939Z] 2026-01-06 01:10:31,939 - INFO - Generated 2 tasks for kind lint
[task 2026-01-06T01:10:31.978Z] 2026-01-06 01:10:31,978 - INFO - Generated 6 tasks for kind toolchain
[task 2026-01-06T01:10:31.980Z] 2026-01-06 01:10:31,980 - INFO - Generated 1 tasks for kind android-build
[task 2026-01-06T01:10:32.001Z] 2026-01-06 01:10:32,001 - INFO - Generated 23 tasks for kind module-build
[task 2026-01-06T01:10:32.004Z] 2026-01-06 01:10:32,004 - INFO - Generated 1 tasks for kind swift
[task 2026-01-06T01:10:32.007Z] 2026-01-06 01:10:32,007 - INFO - Generated 2 tasks for kind branch-build
[task 2026-01-06T01:10:32.013Z] 2026-01-06 01:10:32,013 - INFO - Generated 23 tasks for kind signing
[task 2026-01-06T01:10:32.018Z] 2026-01-06 01:10:32,017 - INFO - Generated 6 tasks for kind server-megazord-build
[task 2026-01-06T01:10:32.023Z] 2026-01-06 01:10:32,023 - INFO - Generated 11 tasks for kind nimbus-build
[task 2026-01-06T01:10:32.026Z] 2026-01-06 01:10:32,026 - INFO - Generated 1 tasks for kind build-summary
[task 2026-01-06T01:10:32.028Z] 2026-01-06 01:10:32,028 - INFO - Generated 2 tasks for kind nimbus-binaries-assemble
[task 2026-01-06T01:10:32.030Z] 2026-01-06 01:10:32,030 - INFO - Generated 1 tasks for kind release-publish
[task 2026-01-06T01:10:32.032Z] 2026-01-06 01:10:32,032 - INFO - Generated 2 tasks for kind server-megazord-assemble
[task 2026-01-06T01:10:32.034Z] 2026-01-06 01:10:32,034 - INFO - Generated 1 tasks for kind upload-symbols
[task 2026-01-06T01:10:32.053Z] 2026-01-06 01:10:32,053 - INFO - Generated 29 tasks for kind beetmover
[task 2026-01-06T01:10:32.055Z] 2026-01-06 01:10:32,055 - INFO - Generated 1 tasks for kind mark-as-shipped
[task 2026-01-06T01:10:32.055Z] 2026-01-06 01:10:32,055 - INFO - Generating full task graph
[task 2026-01-06T01:10:32.056Z] 2026-01-06 01:10:32,056 - INFO - Full task graph contains 115 tasks and 320 dependencies
[task 2026-01-06T01:10:32.060Z] 2026-01-06 01:10:32,059 - INFO - writing artifact file `full-task-graph.json`
[task 2026-01-06T01:10:32.078Z] 2026-01-06 01:10:32,078 - INFO - writing artifact file `runnable-jobs.json`
[task 2026-01-06T01:10:32.079Z] 2026-01-06 01:10:32,079 - INFO - Generating target task set
[task 2026-01-06T01:10:32.079Z] 2026-01-06 01:10:32,079 - INFO - Filter filter_target_tasks pruned 100 tasks (15 remain)
[task 2026-01-06T01:10:32.079Z] 2026-01-06 01:10:32,079 - INFO - Filter filter_branch_build_tasks pruned 2 tasks (13 remain)
[task 2026-01-06T01:10:32.079Z] 2026-01-06 01:10:32,079 - INFO - writing artifact file `target-tasks.json`
[task 2026-01-06T01:10:32.080Z] 2026-01-06 01:10:32,079 - INFO - Generating target task graph
[task 2026-01-06T01:10:32.080Z] 2026-01-06 01:10:32,079 - INFO - Adding 0 tasks with `always_target` attribute
[task 2026-01-06T01:10:32.080Z] 2026-01-06 01:10:32,079 - INFO - Generating optimized task graph
[task 2026-01-06T01:10:32.080Z] 2026-01-06 01:10:32,080 - INFO - No tasks removed during optimization
[task 2026-01-06T01:10:32.493Z] 2026-01-06 01:10:32,493 - INFO - Replaced 5 tasks by index-search (index-search) during optimization.
[task 2026-01-06T01:10:32.494Z] 2026-01-06 01:10:32,494 - INFO - writing artifact file `task-graph.json`
[task 2026-01-06T01:10:32.496Z] 2026-01-06 01:10:32,496 - INFO - writing artifact file `label-to-taskid.json`
[task 2026-01-06T01:10:32.498Z] 2026-01-06 01:10:32,498 - INFO - Creating task with taskId MdgcqduXQsqyaMRfLSOgEg for toolchain-android
[task 2026-01-06T01:10:32.499Z] 2026-01-06 01:10:32,499 - INFO - Creating task with taskId I9ggqR1yRoeCZcX1ximqvA for Build summary task
[task 2026-01-06T01:10:32.501Z] 2026-01-06 01:10:32,501 - INFO - Creating task with taskId G65eeKCyQnmKb2fPRhJvzA for lint-ktlint
[task 2026-01-06T01:10:32.501Z] 2026-01-06 01:10:32,501 - INFO - Creating task with taskId FsG-4xAkS_2GBV5bGbcf6g for lint-detekt
[task 2026-01-06T01:10:32.503Z] 2026-01-06 01:10:32,503 - INFO - Creating task with taskId cdiZcpqPR2eGeUyxwczGLQ for toolchain-desktop-macos
[task 2026-01-06T01:10:32.505Z] 2026-01-06 01:10:32,505 - INFO - Creating task with taskId Bmje7GqjTxW8ui85cnEsqw for toolchain-libs-ios
[task 2026-01-06T01:10:32.507Z] 2026-01-06 01:10:32,507 - INFO - Creating task with taskId KZEe7kpzQ_eICHJFZRkgog for toolchain-desktop-linux
[task 2026-01-06T01:10:32.848Z] 2026-01-06 01:10:32,848 - INFO - Creating task with taskId YhnjL--9SYSOHUNES1ezDQ for android-build-pr
[taskcluster 2026-01-06T01:10:33.286Z]                        Exit Code: 0
[taskcluster 2026-01-06T01:10:33.286Z]                        User Time: 15.902ms
[taskcluster 2026-01-06T01:10:33.286Z]                      Kernel Time: 12.233ms
[taskcluster 2026-01-06T01:10:33.286Z]                        Wall Time: 10.65936415s
[taskcluster 2026-01-06T01:10:33.286Z]  Average Available System Memory: 7.11 GiB
[taskcluster 2026-01-06T01:10:33.286Z]       Average System Memory Used: 655.66 MiB
[taskcluster 2026-01-06T01:10:33.286Z]          Peak System Memory Used: 667.70 MiB
[taskcluster 2026-01-06T01:10:33.286Z]              Total System Memory: 7.75 GiB
[taskcluster 2026-01-06T01:10:33.286Z]                           Result: SUCCEEDED
[taskcluster 2026-01-06T01:10:33.286Z] === Task Finished ===
[taskcluster 2026-01-06T01:10:33.286Z] Task Duration: 10.660221779s
[taskcluster 2026-01-06T01:10:34.833Z] [mounts] Preserving cache: Moving "/home/task_176766157902091/cache0" to "/home/generic-worker/caches/L3_JZvjrT_qsb82xV64Bpg"
View more details on firefoxci-taskcluster