Skip to content

feat(inference-operator): Update inference helm chart to v2.1.1 with latest CRDs#416

Open
shantanutrip wants to merge 1 commit intoaws:mainfrom
shantanutrip:inference-helm-may-5
Open

feat(inference-operator): Update inference helm chart to v2.1.1 with latest CRDs#416
shantanutrip wants to merge 1 commit intoaws:mainfrom
shantanutrip:inference-helm-may-5

Conversation

@shantanutrip
Copy link
Copy Markdown
Contributor

What's changing and why?

Update the inference operator helm chart to v2.1.1 from the latest AWSCrescendoInferenceOperator dist.

Changes:

  • CRDs: Updated all 3 CRDs (inferenceendpointconfigs, jumpstartmodels, sagemakerendpointregistrations) with latest schema additions
  • Chart.yaml: Version bump 2.1.02.1.1
  • values.yaml: Added init container config (image.initContainer.repository/tag) and enableCustomServiceAccounts: false
  • config/manager/manager.yaml:
    • Init container image changed from hardcoded public.ecr.aws/bitnami/kubectl:1.30 to templated value
    • Added env vars: AWS_REGION, ENABLE_CUSTOM_SERVICE_ACCOUNTS, OPERATOR_SERVICE_ACCOUNT_NAME, OPERATOR_NAMESPACE
    • HYPERPOD_CLUSTER_ARN made optional with default ""

Before/After UX

Before:

  • Inference operator chart at v2.1.0 with older CRD schemas
  • Init container using hardcoded public bitnami kubectl image

After:

  • Inference operator chart at v2.1.1 with latest CRD schemas
  • Init container using configurable private image via values.yaml
  • Support for custom service accounts via enableCustomServiceAccounts flag

How was this change tested?

  • Validated all CRD YAML files are syntactically correct (parsed with Python yaml.safe_load)
  • Verified no remaining pdSpec/DPD references in published CRDs
  • Diff verified against source AWSCrescendoInferenceOperator dist

Are unit tests added?

N/A — Helm chart config/CRD update only, no application code changes.

Are integration tests added?

N/A — CRD schema and chart config changes. Integration tests along with HP CLI will handle this.

Reviewer Guidelines

‼️ Merge Requirements: PRs with failing integration tests cannot be merged without justification.

One of the following must be true:

  • Changes are documentation-only format?
  • [] All automated PR checks pass

…latest CRDs

Update inference operator chart from AWSCrescendoInferenceOperator dist.
Includes new CRD schemas, init container support, custom service
accounts flag, and templated manager configuration. Excludes pdSpec
(disaggregated prefill/decode) as it is not yet GA.
@shantanutrip shantanutrip requested a review from a team as a code owner May 5, 2026 20:35
stage: "prod"
tlsCertificateS3Bucket:
enableWebhooks: true
enableCustomServiceAccounts: false
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we only allowlisting a subset of customer to enable this?

Comment on lines +209 to +212
- name: OPERATOR_SERVICE_ACCOUNT_NAME
value: {{ .Values.namePrefix }}-controller-manager
- name: OPERATOR_NAMESPACE
value: {{ .Values.shortPrefix }}-system
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am wondering why these are added in this release? Are these hardcoded before?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants