Skip to main content
Rightsizing · Medium severity

Over-Provisioned SageMaker HyperPod Cluster

The cluster reserves its accelerator capacity for the whole time it exists, so instances beyond what training uses hold the most expensive hardware in the account idle.

Free to start. No card. The playground just needs your work email.

AWSprovider
Mediumseverity
Savingswhere it shows up
Manualfix, steps written out

AWS

Found, explained, handed over.

Findings with a dollar figure attached, idle, oversized, orphaned, unscheduled and undiscounted spend.

01

Detect

ZopNight checks this automatically across AWS, with read-only access to the account.

02

Explain

Every finding says exactly what to change: Rightsize the HyperPod cluster. Where the saving can be proven it is priced; where it cannot, the finding says so.

03

Fix

The finding opens with the fix already written out, step by step, so it is one ticket, not an investigation.

Applies to
SageMaker Clusters on AWS
The fix, by hand
  1. Review node_cpu_utilization / node_memory_utilization per instance group in CloudWatch.
  2. Identify the least-utilised instance group and reduce its node count (UpdateCluster instance-group InstanceCount).
  3. HyperPod scales instance groups individually. Pick the group whose nodes are idle, not necessarily the most expensive one.
  4. Confirm training throughput and queue wait stay healthy on the smaller fleet.

These are the steps the finding carries in the product.

Category
Rightsizing. Resources sized for headroom they never use. A smaller size runs the same workload for less.
Where it appears
The Savings tab of Recommendations, with every affected resource listed.
Rule ID
RC-1626
Full reference

Over-Provisioned SageMaker HyperPod Cluster

Related checks

See the oversized resources in your account.

Connect a read-only role and the first pass runs on your own estate. This check, and the rest of the catalogue, with it.

Prefer to talk it through first? Book 20 minutes with the team.

  • $30M+annualised cloud spend under management
  • 550K+resources tracked since launch
  • 20-60%off the bill in the first month
  • SOC 2Type II report, plus ISO 27001

Figures published on zop.dev.

Multi-cloud automation· Production-ready in 30 min· SOC 2 · ISO 27001· 20–60% off the bill, first month· 4 platforms · 1 console· Multi-cloud automation· Production-ready in 30 min· SOC 2 · ISO 27001· 20–60% off the bill, first month· 4 platforms · 1 console·