AWS Graviton
AWS Graviton is a 64-bit ARM-based CPU designed by AWS, an Amazon subsidiary. The first version was launched at AWS's customer event, re:Invent 2018. The second generation, AWS Graviton2, was launched in December 2019. AWS states that Graviton2 delivers up to 40% improved price/performance over the same generation M5, C5, and R5 instances[1] and an average of 72% reduction in power consumption.[2]
Graviton
The first Graviton CPU has 16 Cortex A72 cores, with ARMv8-A ISA including Neon, crc, crypto. The vCPUs are physical cores in a single NUMA domain, running at 2.3 GHz. It also includes hardware acceleration for floating-point math, SIMD, plus AES, SHA-1, SHA-256, GCM, and CRC-32 algorithms.[3]
Graviton2
The Graviton2 CPU has 64 Neoverse-N1 cores, with ARMv8.2-A ISA including 2x128 bit Neon, LSE, fp16, rcpc, dotprod, crypto. The vCPUs are physical cores in a single NUMA domain, running at 2.5 GHz.[5]
EC2 products that include Graviton2: M6g, M6gd, C6g, C6gd, C6gn, R6g, R6gd, T4g, X2gd, G5g, Im4gn, Is4gen. One or more of these instances are available in 28 AWS regions.
Graviton3
The Graviton3 CPU has 64 Neoverse-V1 cores, with ARMv8.4-A ISA including 4x128 bit Neon, LSE, 2x256 bit SVE, rng, bf16, int8, crypto. Organized in a single NUMA domain, all vCPUs are physical cores running at 2.6 GHz.[5]
EC2 products that include Graviton3: C7g, C7gn, HPC7g.
Graviton3 provides up to 25% better compute performance, up to 2x higher floating-point performance, up to 2x faster cryptographic workload performance, up to 3x better performance for ML workloads including support for bfloat16, and 50% more memory bandwidth compared to AWS Graviton2 processors. Graviton3-based instances use up to 60% less energy for the same performance than comparable EC2 instances. [6]
Graviton3E is a higher power version of Graviton3. [7]
Reason behind creating
David Brown, VP of EC2 at AWS in 2020 said, that some customers were not using their EC2 instances at full capacity. After listening to customers such as SmugMug and Flickr, AWS added to their X86-64 family of processors an Arm based option for their servers for several reasons: [8]
- Offer more choice in terms of selection of EC2 instances for customers
- Target Arm-based applications
- Provide high availability and security, while reducing virtualization costs
- Offer decent server performance with lower prices for customers
Graviton1 reached these goals. Graviton2 now offers better performance compared to X86: 35% faster running Redis,[9] 30% faster running Apache Cassandra,[10] and up to 117% higher throughput for MongoDB.[11] In addition to higher performance, Graviton offers 70% lower power consumption [12] and 20% lower price.[13]
See also
- Developed by Annapurna Labs, part of the AWS organization.
- Timeline of Amazon Web Services for launch dates.
References
- "Announcing New Amazon EC2 M6g, C6g, and R6g Instances Powered by Next-Generation Arm-based AWS Graviton2 Processors". Amazon Web Services. 2019-12-03. Retrieved 2019-12-03.
- "NTT DOCOMO and NEC Reduce Power Consumption for 5G SA Core by an Average of 72% using AWS Graviton2, followed by a Successful Onboarding of 5G SA Core on Hybrid Cloud". Amazon Web Services. 2022-09-29. Retrieved 2022-10-11.
- "Amazon's homegrown 2.3GHz 64-bit Graviton processor was very nearly an AMD Arm CPU". theregister. 2018-11-27.
- "Amazon EC2 A1 Instances". Amazon Web Services. 2018-11-26. Retrieved 2022-10-11.
- "Building for Graviton2 and Graviton3". Amazon Web Services. 2022-09-22. Retrieved 2022-10-10.
- "Amazon 2021 Letter to Shareholders". AboutAmazon. 2022-04-14. Retrieved 2022-11-16.
- "New Amazon EC2 Instance Types In the Works". AWS News Blog. 2022-11-28. Retrieved 2022-11-29.
- "What Is AWS Graviton? Here's When To Use It". cloudzero. 2021-05-28.
- "Gain up to 35% performance benefits for deploying Redis on AWS Graviton2". arm. 2021-07-20.
- "Increase performance by up to 30% by deploying Apache Cassandra on AWS Graviton2". arm. 2021-08-18.
- "MongoDB performance on Arm Neoverse based AWS Graviton2 processors". arm. 2021-06-09.
- "NTT DOCOMO and NEC Reduce Power Consumption for 5G SA Core by an Average of 72% using AWS Graviton2, followed by a Successful Onboarding of 5G SA Core on Hybrid Cloud". nec. 2022-11-29.
- "20% lower cost and up to 40% higher performance for M6g, C6g, and R6g instances over M5, C5, and R5 instances respectively". amazon. 2022-03-03.
External links
- Official website
- AWS: AWS Graviton Technical Guide
- Dev.to: Large System Extensions for AWS Graviton Processors
- Arm: Gain up to 35% performance benefits for deploying Redis on AWS Graviton2
- Arm: Gain up to 30% Cost-Performance benefits for Apache Kafka on AWS Graviton2 Processors
- AWS: AWS Lambda Functions Powered by AWS Graviton2 Processor – Run Your Functions on Arm and Get Up to 34% Better Price Performance
- AWS: Announcing AWS Graviton2 Support for AWS Fargate – Get up to 40% Better Price-Performance for Your Serverless Containers