- HyperPod Dev Spaces template for data scientists to create, manage, and access interactive ML development environments with configurable resource allocation and namespace isolation
- Support for KVCaching, intelligent routing, tiered storage, MIG
- Support for fractional gpu
- Support KVCache and Intelligent Routing support in template version 1.1
- User can modify jinja template to add parameters supported by CRD through init experience, for further CLI customization
- MIG support for model deployment on SageMaker Hyperpod Inference
- Describe cluster command
- User can use hyp describe cluster to learn more info about hp clusters
- Jinja template handling logic for inference and training
- User can modify jinja template to add parameters supported by CRD through init experience of inference and training, for further CLI customization
- Cluster creation template versioning
- User can choose cloudformation template version through cluster creation expeirence
- KVCache and intelligent routing for HyperPod Inference
- InferenceEndpointConfig CRD supported is updated to v1
- KVCache and Intelligent Routing support is added in template version 1.1
- Init Experience
- Init, Validate, and Create JumpStart endpoint, Custom endpoint, and PyTorch Training Job with local configuration
- Cluster management
- Bug fixes for cluster creation
- Fix for production canary failures caused by bad training job template.
- New version for Health Monitoring Agent (1.0.790.0_1.0.266.0) with minor improvements and bug fixes.
- Cluster management
- Bug Fixes with cluster creation
- Enable cluster template to be installed with hyperpod CLI .
- Cluster management
- Creation of cluster stack
- Describing and listing a cluster stack
- Updating a cluster
- Init Experience
- Init, Validate, Create with local configurations
- Task Governance feature for training jobs.
- Update volume flag to support hostPath and PVC
- Add an option to disable the deployment of KubeFlow TrainingOperator
- Enable telemetry for CLI
- Training Job - Create, List , Get
- Inference Jumpstart - Create , List, Get, Invoke
- Inference Custom - Create , List, Get, Invoke
- Observability changes
- feature: The HyperPod CLI now support (Hyperpod recipes). The HyperPod recipes enable customers to get started training and fine-tuning popular publicly-available foundation models like Llama 3.1 405B in minutes. Learn more (here).
- feature: Add support for SageMaker HyperPod CLI