Audience
Companies in search of a solution to get scalable access to high-performance compute instances for their machine learning training and inference workloads
About Amazon EC2 Capacity Blocks for ML
Amazon EC2 Capacity Blocks for ML enable you to reserve accelerated compute instances in Amazon EC2 UltraClusters for your machine learning workloads. This service supports Amazon EC2 P5en, P5e, P5, and P4d instances, powered by NVIDIA H200, H100, and A100 Tensor Core GPUs, respectively, as well as Trn2 and Trn1 instances powered by AWS Trainium. You can reserve these instances for up to six months in cluster sizes ranging from one to 64 instances (512 GPUs or 1,024 Trainium chips), providing flexibility for various ML workloads. Reservations can be made up to eight weeks in advance. By colocating in Amazon EC2 UltraClusters, Capacity Blocks offer low-latency, high-throughput network connectivity, facilitating efficient distributed training. This setup ensures predictable access to high-performance computing resources, allowing you to plan ML development confidently, run experiments, build prototypes, and accommodate future surges in demand for ML applications.
Other Popular Alternatives & Related Software
AWS Fargate
AWS Fargate is a serverless compute engine for containers that works with both Amazon Elastic Container Service (ECS) and Amazon Elastic Kubernetes Service (EKS). Fargate makes it easy for you to focus on building your applications. Fargate removes the need to provision and manage servers, lets you specify and pay for resources per application, and improves security through application isolation by design. Fargate allocates the right amount of compute, eliminating the need to choose instances and scale cluster capacity. You only pay for the resources required to run your containers, so there is no over-provisioning and paying for additional servers. Fargate runs each task or pod in its own kernel providing the tasks and pods their own isolated compute environment. This enables your application to have workload isolation and improved security by design.
Learn more about AWS Fargate
AWS EC2 Trn3 Instances
Amazon EC2 Trn3 UltraServers are AWS’s newest accelerated computing instances, powered by the in-house Trainium3 AI chips and engineered specifically for high-performance deep-learning training and inference workloads. These UltraServers are offered in two configurations, a “Gen1” with 64 Trainium3 chips and a “Gen2” with up to 144 Trainium3 chips per UltraServer. The Gen2 configuration delivers up to 362 petaFLOPS of dense MXFP8 compute, 20 TB of HBM memory, and a staggering 706 TB/s of aggregate memory bandwidth, making it one of the highest-throughput AI compute platforms available. Interconnects between chips are handled by a new “NeuronSwitch-v1” fabric to support all-to-all communication patterns, which are especially important for large models, mixture-of-experts architectures, or large-scale distributed training.
Learn more about AWS EC2 Trn3 Instances
Amazon EC2 Trn2 Instances
Amazon EC2 Trn2 instances, powered by AWS Trainium2 chips, are purpose-built for high-performance deep learning training of generative AI models, including large language models and diffusion models. They offer up to 50% cost-to-train savings over comparable Amazon EC2 instances. Trn2 instances support up to 16 Trainium2 accelerators, providing up to 3 petaflops of FP16/BF16 compute power and 512 GB of high-bandwidth memory. To facilitate efficient data and model parallelism, Trn2 instances feature NeuronLink, a high-speed, nonblocking interconnect, and support up to 1600 Gbps of second-generation Elastic Fabric Adapter (EFAv2) network bandwidth. They are deployed in EC2 UltraClusters, enabling scaling up to 30,000 Trainium2 chips interconnected with a nonblocking petabit-scale network, delivering 6 exaflops of compute performance. The AWS Neuron SDK integrates natively with popular machine learning frameworks like PyTorch and TensorFlow.
Learn more about Amazon EC2 Trn2 Instances
CoreWeave
CoreWeave is a cloud infrastructure provider specializing in GPU-based compute solutions tailored for AI workloads. The platform offers scalable, high-performance GPU clusters that optimize the training and inference of AI models, making it ideal for industries like machine learning, visual effects (VFX), and high-performance computing (HPC). CoreWeave provides flexible storage, networking, and managed services to support AI-driven businesses, with a focus on reliability, cost efficiency, and enterprise-grade security. The platform is used by AI labs, research organizations, and businesses to accelerate their AI innovations.
Learn more about CoreWeave
Integrations
Company Information
Amazon
Founded: 1994
United States
aws.amazon.com/ec2/capacityblocks/
Videos and Screen Captures
Other Useful Business Software
Ship Agents Faster
Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
Product Details
Platforms Supported
Cloud
Training
Documentation
Webinars
In Person
Videos
Support
Phone Support
24/7 Live Support
Online
Amazon EC2 Capacity Blocks for ML Frequently Asked Questions
Q: What kinds of users and organization types does Amazon EC2 Capacity Blocks for ML work with?
Amazon EC2 Capacity Blocks for ML works with these users and organization types: Mid Size Business, Small Business, Enterprise, Freelance, Nonprofit, Government, and Startup.
Q: What languages does Amazon EC2 Capacity Blocks for ML support in their product?
Amazon EC2 Capacity Blocks for ML supports these languages: English.
Q: What kind of support options does Amazon EC2 Capacity Blocks for ML offer?
Amazon EC2 Capacity Blocks for ML offers support via phone support, 24/7 live support, and online.
Q: What other applications or services does Amazon EC2 Capacity Blocks for ML integrate with?
Amazon EC2 Capacity Blocks for ML integrates with: Amazon EC2 G5 Instances, Amazon EC2 Inf1 Instances, Amazon EC2 P4 Instances, Amazon EC2 P5 Instances, Amazon EC2 Trn1 Instances, Amazon EC2 Trn2 Instances, Amazon EC2 UltraClusters, Amazon EC2, Amazon Elastic Container Service (Amazon ECS), Amazon EKS, Amazon SageMaker, AWS Neuron, AWS Nitro System, AWS Trainium, Amazon Web Services (AWS), Greenovative, PyTorch, and TensorFlow.
Q: What type of training does Amazon EC2 Capacity Blocks for ML provide?
Amazon EC2 Capacity Blocks for ML provides training in the form of documentation, webinars, in person, and videos.
