Audience
Companies in search of a solution to train their large-scale deep learning and generative AI models
About Amazon EC2 Trn2 Instances
Amazon EC2 Trn2 instances, powered by AWS Trainium2 chips, are purpose-built for high-performance deep learning training of generative AI models, including large language models and diffusion models. They offer up to 50% cost-to-train savings over comparable Amazon EC2 instances. Trn2 instances support up to 16 Trainium2 accelerators, providing up to 3 petaflops of FP16/BF16 compute power and 512 GB of high-bandwidth memory. To facilitate efficient data and model parallelism, Trn2 instances feature NeuronLink, a high-speed, nonblocking interconnect, and support up to 1600 Gbps of second-generation Elastic Fabric Adapter (EFAv2) network bandwidth. They are deployed in EC2 UltraClusters, enabling scaling up to 30,000 Trainium2 chips interconnected with a nonblocking petabit-scale network, delivering 6 exaflops of compute performance. The AWS Neuron SDK integrates natively with popular machine learning frameworks like PyTorch and TensorFlow.
Other Popular Alternatives & Related Software
Amazon EC2 Trn1 Instances
Amazon Elastic Compute Cloud (EC2) Trn1 instances, powered by AWS Trainium chips, are purpose-built for high-performance deep learning training of generative AI models, including large language models and latent diffusion models. Trn1 instances offer up to 50% cost-to-train savings over other comparable Amazon EC2 instances. You can use Trn1 instances to train 100B+ parameter DL and generative AI models across a broad set of applications, such as text summarization, code generation, question answering, image and video generation, recommendation, and fraud detection. The AWS Neuron SDK helps developers train models on AWS Trainium (and deploy models on the AWS Inferentia chips). It integrates natively with frameworks such as PyTorch and TensorFlow so that you can continue using your existing code and workflows to train models on Trn1 instances.
Learn more about Amazon EC2 Trn1 Instances
AWS EC2 Trn3 Instances
Amazon EC2 Trn3 UltraServers are AWS’s newest accelerated computing instances, powered by the in-house Trainium3 AI chips and engineered specifically for high-performance deep-learning training and inference workloads. These UltraServers are offered in two configurations, a “Gen1” with 64 Trainium3 chips and a “Gen2” with up to 144 Trainium3 chips per UltraServer. The Gen2 configuration delivers up to 362 petaFLOPS of dense MXFP8 compute, 20 TB of HBM memory, and a staggering 706 TB/s of aggregate memory bandwidth, making it one of the highest-throughput AI compute platforms available. Interconnects between chips are handled by a new “NeuronSwitch-v1” fabric to support all-to-all communication patterns, which are especially important for large models, mixture-of-experts architectures, or large-scale distributed training.
Learn more about AWS EC2 Trn3 Instances
AWS Neuron
It supports high-performance training on AWS Trainium-based Amazon Elastic Compute Cloud (Amazon EC2) Trn1 instances. For model deployment, it supports high-performance and low-latency inference on AWS Inferentia-based Amazon EC2 Inf1 instances and AWS Inferentia2-based Amazon EC2 Inf2 instances. With Neuron, you can use popular frameworks, such as TensorFlow and PyTorch, and optimally train and deploy machine learning (ML) models on Amazon EC2 Trn1, Inf1, and Inf2 instances with minimal code changes and without tie-in to vendor-specific solutions. AWS Neuron SDK, which supports Inferentia and Trainium accelerators, is natively integrated with PyTorch and TensorFlow. This integration ensures that you can continue using your existing workflows in these popular frameworks and get started with only a few lines of code changes. For distributed model training, the Neuron SDK supports libraries, such as Megatron-LM and PyTorch Fully Sharded Data Parallel (FSDP).
Learn more about AWS Neuron
Amazon SageMaker
Amazon SageMaker is an advanced machine learning service that provides an integrated environment for building, training, and deploying machine learning (ML) models. It combines tools for model development, data processing, and AI capabilities in a unified studio, enabling users to collaborate and work faster. SageMaker supports various data sources, such as Amazon S3 data lakes and Amazon Redshift data warehouses, while ensuring enterprise security and governance through its built-in features. The service also offers tools for generative AI applications, making it easier for users to customize and scale AI use cases. SageMaker’s architecture simplifies the AI lifecycle, from data discovery to model deployment, providing a seamless experience for developers.
Learn more about Amazon SageMaker
Integrations
Company Information
Amazon
Founded: 1994
United States
aws.amazon.com/ec2/instance-types/trn2/
Videos and Screen Captures
Other Useful Business Software
Ship Agents Faster
Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
Product Details
Platforms Supported
Cloud
Training
Documentation
Webinars
In Person
Videos
Support
Phone Support
24/7 Live Support
Online
Amazon EC2 Trn2 Instances Frequently Asked Questions
Q: What kinds of users and organization types does Amazon EC2 Trn2 Instances work with?
Amazon EC2 Trn2 Instances works with these users and organization types: Mid Size Business, Small Business, Enterprise, Freelance, Nonprofit, Government, and Startup.
Q: What languages does Amazon EC2 Trn2 Instances support in their product?
Amazon EC2 Trn2 Instances supports these languages: English.
Q: What kind of support options does Amazon EC2 Trn2 Instances offer?
Amazon EC2 Trn2 Instances offers support via phone support, 24/7 live support, and online.
Q: What other applications or services does Amazon EC2 Trn2 Instances integrate with?
Amazon EC2 Trn2 Instances integrates with: Amazon EC2 G5 Instances, Amazon EC2 Inf1 Instances, Amazon EC2 P4 Instances, Amazon EC2 P5 Instances, Amazon EC2 Trn1 Instances, Amazon EC2 UltraClusters, Amazon EC2, Amazon Elastic Container Service (Amazon ECS), Amazon EKS, Amazon SageMaker, AWS Batch, AWS Deep Learning AMIs, AWS Neuron, AWS Nitro System, AWS Trainium, Amazon Web Services (AWS), Datadog, Domino Enterprise AI Platform, Amazon EC2 Capacity Blocks for ML, Hugging Face, PyTorch, Ray, and TensorFlow.
Q: What type of training does Amazon EC2 Trn2 Instances provide?
Amazon EC2 Trn2 Instances provides training in the form of documentation, webinars, in person, and videos.
