SageMaker Training Job, Enable Managed Spot Training
Managed spot training checkpoints and resumes around interruptions, so a training job pays substantially less for the same work at the cost of elapsed time.
Free to start. No card. The playground just needs your work email.
AWS
Found, explained, handed over.
Findings with a dollar figure attached, idle, oversized, orphaned, unscheduled and undiscounted spend.
Detect
ZopNight checks this automatically across AWS, with read-only access to the account.
Explain
Every finding says exactly what to change: Enable managed spot training on the SageMaker training job. Where the saving can be proven it is priced; where it cannot, the finding says so.
Fix
The finding opens with the fix already written out, step by step, so it is one ticket, not an investigation.
- Applies to
- SageMaker Training Job on AWS
- The fix, by hand
- Set EnableManagedSpotTraining=true in the training job / estimator configuration.
- Set MaxWaitTimeInSeconds at least MaxRuntimeInSeconds to allow time for spot capacity.
- Configure a checkpoint S3 location (CheckpointConfig) so interrupted runs resume instead of restarting.
- Re-run the job; SageMaker reports the realized spot savings in the training job summary.
These are the steps the finding carries in the product.
- Category
- Commitment discounts. Reserved Instance, Savings Plan and Committed Use opportunities, where steady usage justifies a commitment.
- Where it appears
- The Savings tab of Recommendations, with every affected resource listed.
- Rule ID
RC-1621- Full reference
Related checks
See the discount opportunities in your account.
Connect a read-only role and the first pass runs on your own estate. This check, and the rest of the catalogue, with it.
Prefer to talk it through first? Book 20 minutes with the team.
- $30M+annualised cloud spend under management
- 550K+resources tracked since launch
- 20-60%off the bill in the first month
- SOC 2Type II report, plus ISO 27001
Figures published on zop.dev.