Release candidate: v1.48.0 - #3858

Merged

harshthakkar01 merged 278 commits into

mainfrom

release-candidate

Apr 1, 2025

harshthakkar01 commented Mar 28, 2025 •

edited

Loading

Contributor

Highlights

The GKE nodepool module of Toolkit has been updated to support multiple nodepools. (PR#3826)
Automatic Prolog/Epilog Slurm GPU Health Checks
Kueue v0.11.1 manifest support

What's Changed

Key New Features 🎉

Add a4-high-vm blueprint by @samskillman in Add a4-high-vm blueprint #3751
Cloud DNS config addition to GKE Cluster module by @SwarnaBharathiMantena in Cloud DNS config addition to GKE Cluster module #3752
Update Slurm image reference to new family (6-9) by @abbas1902 in Update Slurm image reference to new family (6-9) #3740
Adding Automatic Prolog/Epilog Slurm GPU Health Checks by @RachaelSTamakloe in Adding Automatic Prolog/Epilog Slurm GPU Health Checks #3781
Created GPU Operator Manifest by @ighosh98 in Created GPU Operator Manifest #3814
add kueue v0.11.1 manifest by @ighosh98 in add kueue v0.11.1 manifest #3833
Support resource manager tags on instance template and attached disks by @annuay-google in Support resource manager tags on instance template and attached disks #3829
introduce feature to enable k8s beta apis by @ighosh98 in introduce feature to enable k8s beta apis #3840
Add support for Kueue 0.11.1 by @mwysokin in Add support for Kueue 0.11.1 #3830
Integrate gpu operator in kubectl by @ighosh98 in Integrate gpu operator in kubectl #3838

Module Improvements 🔨

add support for enablePrivateNode at nodepool level by @chengcongdu in add support for enablePrivateNode at nodepool level #3794
Add nodeset name as a label to all nodeset instance templates by @annuay-google in Add nodeset name as a label to all nodeset instance templates #3787
Fix network names backward compatibility for A3 Mega and A3 High by @sharabiani in Fix network names backward compatibility for A3 Mega and A3 High #3811
Support multiple nodepools creation in gke nodepool module by @SwarnaBharathiMantena in Support multiple nodepools creation in gke nodepool module #3826
Enable higher performance self-managed NFS server configurations by @ndebuhr in Enable higher performance self-managed NFS server configurations #3807
add support for resource quota in gpu-operator namespace by @ighosh98 in add support for resource quota in gpu-operator namespace #3855

Improvements 🛠

A4 GKE integration test by @annuay-google in A4 GKE integration test #3718
A3U Slurm: enable nvidia-persistenced daemon by @tpdownes in A3U Slurm: enable nvidia-persistenced daemon #3698
Remove experimental tag from GKE blueprints in readme by @parulbajaj01 in Remove experimental tag from GKE blueprints in readme #3724
NCCL integration tests by @annuay-google in NCCL integration tests #3697
Add NeMo and HPL Slurm GCS System Benchmarks with Ramble by @samskillman in Add NeMo and HPL Slurm GCS System Benchmarks with Ramble #3726
GCS update to GKE A4 High blueprint by @SwarnaBharathiMantena in GCS update to GKE A4 High blueprint #3749
Update Kueue documentation by @ighosh98 in Update Kueue documentation #3786
Add comment descriptions for a3U vars by @parulbajaj01 in Add comment descriptions for a3U vars #3783
Improve job template naming by @ighosh98 in Improve job template naming #3816
Update GPU Operator manifest definition by @ighosh98 in Update GPU Operator manifest definition #3820
Unify gke a3 ultra blueprints by @ighosh98 in Unify gke a3 ultra blueprints #3835
Advanced network configuration support on notebook instance community module by @caetano-colin in Advanced network configuration support on notebook instance community module #3671
updating defaults for slurm chs prolog by @RachaelSTamakloe in updating defaults for slurm chs prolog #3843
Add disk size vars in deployment file for a3U by @parulbajaj01 in Add disk size vars in deployment file for a3U #3812
Update A3U slurm threads configuration by @ighosh98 in Update A3U slurm threads configuration #3853

Deprecations 💤

Reduce number of startup scripts. by @mr0re1 in Reduce number of startup scripts. #3770
Add omnia deprecation warning and update A3U and A4 blueprints threads configurations by @ighosh98 in Add omnia deprecation warning and update A3U and A4 blueprints threads configurations #3837

Version Updates ⏫

Bump NCCL/gIB version to 1.0.5 by @sheepx86 in Bump NCCL/gIB version to 1.0.5 #3832

Bug fixes 🐞

Fix issue 3748 (Error with stateful_ips iteration in MIG) by @rbekhtaoui in Fix issue 3748 (Error with stateful_ips iteration in MIG) #3765
Update urls to point to toolkit main by @ighosh98 in Update urls to point to toolkit main #3793
Rollback name injection change in job template by @ighosh98 in Rollback name injection change in job template #3821
Add Rocky 9 compatibility for NFS by @samskillman in Add Rocky 9 compatibility for NFS #3813
fix gke a3-ultra blueprint by @ighosh98 in fix gke a3-ultra blueprint #3845
Force retry use of gce service account by @samskillman in Force retry use of gce service account #3854

New Contributors

@yuryu made their first contribution in Remove yuryu from CODEOWNERS #3728
@DavidToneian-Google made their first contribution in Rename obsolete mentions of "resource" to "module" #3766
@rbekhtaoui made their first contribution in Fix issue 3748 (Error with stateful_ips iteration in MIG) #3765
@Shuang-cnt made their first contribution in update HPC reservation name #3799
@sheepx86 made their first contribution in Bump NCCL/gIB version to 1.0.5 #3832
@caetano-colin made their first contribution in Advanced network configuration support on notebook instance community module #3671
@ndebuhr made their first contribution in Enable higher performance self-managed NFS server configurations #3807
@mwysokin made their first contribution in Add support for Kueue 0.11.1 #3830

Full Changelog: v1.47.0...v1.48.0

What’s changed gets added automatically by GitHub.

RachaelSTamakloe and others added 30 commits

February 26, 2025 20:59


          Merge pull request #3733 from RachaelSTamakloe/merge_back

7e08f61

Merge Main back to Develop


          updating tpg from 6.20.0 to 6.23.0

9782a9e


          Merge pull request #3734 from RachaelSTamakloe/update_tpg_version

71c8ee7

Update TPG from v6.20.0 to v6.23.0


          Merge branch 'develop' into advanced-network-config

0226ff3


          Update community/modules/compute/notebook/README.md

205d9e8

Co-authored-by: Andrew Peabody <andrewpeabody@google.com>


          Update community/modules/compute/notebook/main.tf

4648a9f

Co-authored-by: Andrew Peabody <andrewpeabody@google.com>


          Bump cryptography from 44.0.0 to 44.0.1 in /community/front-end/ofe

92b4c94

Bumps [cryptography](https://github.com/pyca/cryptography) from 44.0.0 to 44.0.1.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](pyca/cryptography@44.0.0...44.0.1)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>


          Enable using network_attachment on controller machine

f810c7c


          Merge pull request #3727 from mr0re1/psc_ctr2

a5e90c4

Enable using network_attachment on controller machine


          Merge branch 'develop' into develop

8609a0f


          Remove experimental tags from gke blueprints

7dd2a7b


          Merge branch 'develop' into readme_changes

2766c39


          Merge pull request #3724 from parulbajaj01/readme_changes

a74f77f

Remove experimental tag from GKE blueprints in readme


          Move from auth/munge to auth/slurm