EC2 Instance Type – inf2.24xlarge
The inf2.24xlarge instance is part of the inf2 series, featuring 96 vCPUs and 50 Gigabit of RAM, with Machine Learning Asic Instances. It is available at a rate of $6.4906/hour.
inf2 Family :
Amazon EC2 Inf2 instances are designed specifically for deep learning inference, offering exceptional performance at the lowest cost on Amazon EC2 for generative AI models, such as large language models and vision transformers. Powered by AWS Inferentia2, these instances provide 3 times the compute performance, 4 times the accelerator memory, up to 4 times the throughput, and up to 10 times lower latency compared to Inf1 instances.
Features
Equipped with up to 12 AWS Inferentia2 chips
Compatible with AWS Neuron SDK
Features dual AMD EPYC processors (AMD EPYC 7R13)
Provides up to 384 GB of shared accelerator memory, with 32 GB HBM per accelerator
Supports up to 100 Gbps of networking bandwidth
Credits: AWS Resources, Updated At: 2024-08-23
Use Cases
Understanding natural language through advanced text analysis, document processing, and conversational agents. Includes translation, generating images and videos, recognizing speech, personalizing content, detecting fraud, and more.
inf2 Instance Type Family
| Instances | vCPUs | Memory (GiB) |
|---|---|---|
| inf2.xlarge | 4 | 16 GiB |
| inf2.8xlarge | 32 | 128 GiB |
| inf2.24xlarge | 96 | 384 GiB |
| inf2.48xlarge | 192 | 768 GiB |
EC2 Instance - inf2.24xlarge Specification
| General | |
|---|---|
| Type | inf2.24xlarge |
| Region | N. Virginia |
| Family Group | Inf2 |
| Family Category | Machine Learning Asic Instances |
| Instance Generation | Current |
| Term Type | On-demand |
| Pricing (USD/hr) | $ 6.4906 |
| Compute | |
|---|---|
| vCPU | 96 |
| Memory | 384 GiB |
| Storage | EBS only |
| Processor Architecture | 64-bit |
| Operating System | Linux |
| EBS Optimized | NA |
| Tenancy | Shared |
| Clock Speed | 2.95 GHz |
| GPU | NA |
| ECU | 0.0000 |
| Virtualization | HVM |
| Networking | |
|---|---|
| Network Performance | 50 Gigabit |
| ENA Support | True |
EC2 Instance - inf2.24xlarge Pricing
| Region | Price / Unit | Monthly Pricing |
|---|---|---|
| Oregon | $6.4906 | $4738.16 |
| Ohio | $6.4906 | $4738.16 |
| Stockholm | $7.1397 | $5211.98 |
| Ireland | $8.1133 | $5922.70 |
| Mumbai | $8.4378 | $6159.61 |
| Sydney | $8.4378 | $6159.61 |
| Paris | $9.0869 | $6633.43 |
| Singapore | $9.0869 | $6633.43 |
| Tokyo | $9.7360 | $7107.24 |
| London | $9.7360 | $7107.24 |
| Frankfurt | $9.7360 | $7107.24 |
| Sao Paulo | $11.0341 | $8054.88 |