feat(workflows): Onboarding STACKIT Workflows#1528
Open
c-thiel wants to merge 1 commit into
Open
Conversation
Adds Terraform support for STACKIT Workflows (Apache Airflow 3 as a
service):
resources: stackit_workflows_instance, stackit_workflows_dag_bundle
data sources: stackit_workflows_instance, stackit_workflows_instances,
stackit_workflows_dag_bundle, stackit_workflows_dag_bundles,
stackit_workflows_provider_options
All seven surfaces are gated behind the `workflows` experiment flag.
Notes for reviewers:
* The workflows Go SDK is not yet on a published tag; this PR uses a
replace-directive in `go.mod` pointing at the bot-generated branch.
This is per the dev-tools team's request to enable an early review
pass. The replace will be dropped once the SDK release lands.
* `dag_bundle` list/get endpoints currently return 403 in prod for
service-account-authenticated callers. The server-side fix is merged
upstream and awaiting deploy; acceptance tests against those endpoints
will only pass once that ships.
* A separate cluster-side issue (helm chart unconditionally provisions
an ExternalSecret for the git-bundle credentials) means Airflow 3
instances cannot reach `active` unless a dag_bundle is configured at
Create time. This is owned by the API team. Subsequent provider PR
will inline dag_bundles onto the instance Create payload to work
around it cleanly.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds Terraform support for STACKIT Workflows (Apache Airflow 3 as a service):
All seven surfaces are gated behind the
workflowsexperiment flag.Notes for reviewers:
go.modpointing at the bot-generated branch. This is per the dev-tools team's request to enable an early review pass. The replace will be dropped once the SDK release lands.dag_bundlelist/get endpoints currently return 403 in prod for service-account-authenticated callers. The server-side fix is merged upstream and awaiting deploy; acceptance tests against those endpoints will only pass once that ships./dag-bundlesresource. Two follow-up items are still in flight and are not provider bugs:/dag-bundleslist/get endpoints currently return 403 forservice-account callers in production. The fix is merged upstream
and awaiting deploy; acceptance tests against those endpoints will
pass once it ships.
ExternalSecret for the DAG-bundle git credentials, which means an
Airflow 3 instance created without a bundle can't reach
active.The team is working on this; in the meantime a follow-up provider
PR will inline the bundles back onto the instance Create payload
(which the API already supports) to side-step it.
Description
relates to #1234
Checklist
make fmtexamples/directory)make generate-docs(will be checked by CI)make test(will be checked by CI)make lint(will be checked by CI)