-
Notifications
You must be signed in to change notification settings - Fork 1
Migrate Python CLI template to uv #21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Why these changes are being introduced: This is the first pass in migrating to uv from pipenv. How this addresses that need: * Removes Pipfile and Pipfile.lock * Updates pyproject.toml to be a valid uv project * All dependencies handled via 'uv add' and exist in pyproject.toml * Makefile and pre-commits updated to use uv syntax * Github actions *temporarily* hardcoded in local workflows, with a TODO to move these to a shared workflow when things settle down * Bumps python to 3.13 Side effects of this change: * Many! Hard pivot from Pipenv installation and running of the application. At this time, the largest side effect is the loss of 'pipenv run <appname>'. A future commit will apply a new strategy, but that is not present now. A workaround is 'uv run my_app/cli.py`. Relevant ticket(s): * https://mitlibraries.atlassian.net/browse/IN-1425
Why these changes are being introduced: As we continue to slowly build out this uv driven version of the CLI template, finding little things to update along the way. How this addresses that need: * Updated Dockerfile to use uv in image build * Add convenience docker methods in Makefile, unassociated with AWS ECR (helpful for local testing) * Update dependencies Side effects of this change: * None Relevant ticket(s): * None
95fceb3 to
8331067
Compare
Pull Request Test Coverage Report for Build 21072504558Details
💛 - Coveralls |
ehanson8
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looking good but a few questions and comments
|
|
||
| COPY Pipfile* / | ||
| RUN pipenv install | ||
| # Install package into system python, includes "marimo-launcher" script |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This docstring probably shouldn't have the marimo-launcher reference
| # Docker | ||
| #################################### | ||
| docker-build: # Build local image for testing | ||
| docker build -t python-cli-template:latest . |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is there a reason this is python-cli-template rather than my-app? It would simplify the find/replace if they were the same
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Seconded! Sort of...
While we're on this block, I might propose fully removing this # Docker section. I just recently removed it from the timdex-embeddings project.
It was helpful for a bit, whilst experimenting with uv deployments, but I don't think we need it. Until InfraEng adds the makd dist-dev style commands to a project, I think it's reasonable we could figure out how to build and test docker containers. The maintenance of this section feels like it outweighs the benefits.
| # https://mitlibraries.atlassian.net/wiki/spaces/IN/pages/3432415247/Python+Project+Linters#Template-for-pyproject.toml | ||
|
|
||
| [project] | ||
| name = "python-cli-template" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Again, could this be my-app?
| [project] | ||
| name = "python-cli-template" | ||
| version = "2.0.0" | ||
| requires-python = ">=3.12" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think we want ~=3.12.0 rather than >=3.12 to avoid inadvertently upgrading to 3.13, ~=3.12.0 keeps it in 3.12 but gets the newest patch version
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Smart. Agreed.
I could find links, but it's Google-able: uv takes the position of upgrading where possible but not downgrading. It's a little surprising at first, but it seems pretty well established. For libraries within the project, I think that's okay. But python versions we do control pretty closely.
I'm not 100% sure that behavior is applied at this python version level, but I feel like I've almost encountered it myself, and would believe it.
Nice catch @ehanson8!
I would propose that we keep the Looking at this commit @jonavellecuerdo, I'd propose re-adding it as a commit. |
ghukill
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall, looking great. Did request a couple of small changes, mostly things pointed out by @ehanson8.
I'd also like to propose an update to the README about running the CLI.
Under the section ## Development I'd propose updating this:
- To run the app: `uv run my-app --help` (Note the hyphen `-` vs underscore `_` that matches the `project.scripts` in `pyproject.toml`)
To the following, which shows two options:
- To run the app:
- `my-app`
- utilizes `uv` built entrypoint (see `project.scripts` in `pyproject.toml`)
- does not support loading a `.env` file
- `uv run --env-file .env my-app`
- more verbose, but supports loading with a `.env` file
Thoughts?
| # Docker | ||
| #################################### | ||
| docker-build: # Build local image for testing | ||
| docker build -t python-cli-template:latest . |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Seconded! Sort of...
While we're on this block, I might propose fully removing this # Docker section. I just recently removed it from the timdex-embeddings project.
It was helpful for a bit, whilst experimenting with uv deployments, but I don't think we need it. Until InfraEng adds the makd dist-dev style commands to a project, I think it's reasonable we could figure out how to build and test docker containers. The maintenance of this section feels like it outweighs the benefits.
| [project] | ||
| name = "python-cli-template" | ||
| version = "2.0.0" | ||
| requires-python = ">=3.12" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Smart. Agreed.
I could find links, but it's Google-able: uv takes the position of upgrading where possible but not downgrading. It's a little surprising at first, but it seems pretty well established. For libraries within the project, I think that's okay. But python versions we do control pretty closely.
I'm not 100% sure that behavior is applied at this python version level, but I feel like I've almost encountered it myself, and would believe it.
Nice catch @ehanson8!
| ## App Setup (delete this section and above after initial application setup) | ||
|
|
||
| 1. Rename "my_app" to the desired app name across the repo. (May be helpful to do a project-wide find-and-replace). | ||
| 1. Rename "my_app" and "python-cli-template" to the desired app name across the repo. (May be helpful to do a project-wide find-and-replace). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If taking Eric's suggestions to defaultg to my_app, then probably want to update this.
Purpose and background context
Migrate Python CLI template to uv
How can a reviewer manually see the effects of these changes?
The
uv-based GitHub CI workflow has been tested in MITLibraries/timdex-embeddings#33Includes new or updated dependencies?
YES
Changes expectations for external applications?
NO
What are the relevant tickets?
Code review