Crawlee CLI Broken for macOS13

[ForumeFoundation]

Background

The release of Playwright 1.58.0 has broken the CLI for macOS 13.

You can review the breaking changes on their release notes, here:
https://github.com/microsoft/playwright/releases/tag/v1.58.0

Steps to Reproduce

1. Follow the instructions here
   https://crawlee.dev/python/docs/introduction/setting-up#using-crawlee-cli-directly

Expected Outcome

A New Crawlee Project is created.

Actual Outcome

Creation of the Project fails with the following error:

Failed to install browsers Error: ERROR: Playwright does not support webkit on mac13 Traceback (most recent call last): ⠇ Bootstrapping... File "/var/folders/2j/8wzk93sd24q5361wfk_trcnw0000gn/T/tmp_69dlrv_.py", line 22, in <module> subprocess.check_call([str(path / 'playwright'), 'install']) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/Cellar/python@3.13/3.13.5/Frameworks/Python.framework/Versions/3.13/lib/python3.13/subprocess.py", line 419, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['.venv/bin/playwright', 'install']' returned non-zero exit status 1. Stopping generation because post_gen_project hook script didn't exit successfully Project creation failed. Check the error message above.

[ForumeFoundation]

Note

We cannot create and then install a Crawlee Python project because the requirements.txt file that y'all create only has the following line:

crawlee[playwright,httpx]

So, we cannot adjust the dependency versions to fix this.

I was able to bypass this failure by using a previous projects requirements.txt file and manually locking to the appropriate playwright version; but, I was only able to accomplish this out of pure luck.

I will add this previous requirements.txt file to this note.

requirements.txt

[Pijukatel]

Hello, I am not really sure we shoud even fix this, that Mac version was deprecated last year. It is too specific and the user fix is very simple:

• In CLI Should the project be installed now? (Y/n) Select n
• Add playwright<=1.57.0 constraint to requirements.txt or pyproject.toml and install the environment.

We can indeed detect such edgecase in the template, but do not think it is worth it:

• If template playwright-webkit or playwright
• and running on Mac and Mac major version <=13
  ...

Older Playwright versions also has some limiting Mac version...
Some examples from Pw repo:
https://github.com/microsoft/playwright/releases/tag/v1.45.0
v1.45 is the last release to receive WebKit update for macOS 12 Monterey. Please update macOS to keep using the latest WebKit.

https://github.com/microsoft/playwright/releases/tag/v1.25.0
This is the last release with macOS 10.15 support (deprecated as of 1.21).

and so on....