Skip to content

Add icechunk to tif conversion endpoint and S3 upload support#323

Open
suvanbanerjee wants to merge 22 commits into
mainfrom
feat/satellite-ui-processor
Open

Add icechunk to tif conversion endpoint and S3 upload support#323
suvanbanerjee wants to merge 22 commits into
mainfrom
feat/satellite-ui-processor

Conversation

@suvanbanerjee

@suvanbanerjee suvanbanerjee commented Jun 5, 2026

Copy link
Copy Markdown
Member

Pull Request

Description

This PR adds the endpoint and logic to fetch files from Icechunk, convert them into TIFF format for UI display, and store the generated files in S3.

Chages needed in env

HISTORIC_SAT_S3_BUCKET=historical-cloud-data-geotiff
ICECHUNK_S3_BUCKET=nowcasting-sat-development
ICECHUNK_S3_PREFIX=odegree_v1/data/odegree_uk3000m.icechunk
AWS_DEFAULT_REGION=eu-west-1 <- this should be set by default on ec2 but on local we have to set it
ROUTERS=satellite

Checklist:

  • My code follows OCF's coding style guidelines
  • I have performed a self-review of my own code
  • I have made corresponding changes to the documentation
  • I have added tests that prove my fix is effective or that my feature works
  • I have checked my code and corrected any misspellings

@suvanbanerjee suvanbanerjee requested a review from braddf June 5, 2026 07:36

@braddf braddf left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good, some small comments to address once #321 is finalised

Comment thread src/quartz_api/internal/service/satellite/_ingest.py Outdated
Comment thread src/quartz_api/internal/service/satellite/router.py
Comment thread src/quartz_api/internal/service/satellite/router.py
Comment thread src/quartz_api/internal/service/satellite/_ingest.py Outdated
Comment thread src/quartz_api/internal/service/satellite/_ingest.py
Comment thread src/quartz_api/internal/service/satellite/_ingest.py Outdated
Comment thread src/quartz_api/internal/service/satellite/_ingest.py
@suvanbanerjee suvanbanerjee requested a review from braddf June 15, 2026 05:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants