EC2 Instance Type – inf2.48xlarge
The inf2.48xlarge instance is part of the inf2 series, featuring 192 vCPUs and 100 Gigabit of RAM, with Machine Learning Asic Instances. It is available at a rate of $12.9813/hour.
inf2 Family :
Amazon EC2 Inf2 instances are designed specifically for deep learning inference, offering exceptional performance at the lowest cost on Amazon EC2 for generative AI models, such as large language models and vision transformers. Powered by AWS Inferentia2, these instances provide 3 times the compute performance, 4 times the accelerator memory, up to 4 times the throughput, and up to 10 times lower latency compared to Inf1 instances.
Features
Equipped with up to 12 AWS Inferentia2 chips
Compatible with AWS Neuron SDK
Features dual AMD EPYC processors (AMD EPYC 7R13)
Provides up to 384 GB of shared accelerator memory, with 32 GB HBM per accelerator
Supports up to 100 Gbps of networking bandwidth
Credits: AWS Resources, Updated At: 2024-08-23
Use Cases
Understanding natural language through advanced text analysis, document processing, and conversational agents. Includes translation, generating images and videos, recognizing speech, personalizing content, detecting fraud, and more.
inf2 Instance Type Family
| Instances | vCPUs | Memory (GiB) |
|---|---|---|
| inf2.xlarge | 4 | 16 GiB |
| inf2.8xlarge | 32 | 128 GiB |
| inf2.24xlarge | 96 | 384 GiB |
| inf2.48xlarge | 192 | 768 GiB |
EC2 Instance - inf2.48xlarge Specification
| General | |
|---|---|
| Type | inf2.48xlarge |
| Region | N. Virginia |
| Family Group | Inf2 |
| Family Category | Machine Learning Asic Instances |
| Instance Generation | Current |
| Term Type | On-demand |
| Pricing (USD/hr) | $ 12.9813 |
| Compute | |
|---|---|
| vCPU | 192 |
| Memory | 768 GiB |
| Storage | EBS only |
| Processor Architecture | 64-bit |
| Operating System | Linux |
| EBS Optimized | NA |
| Tenancy | Shared |
| Clock Speed | 2.95 GHz |
| GPU | NA |
| ECU | 0.0000 |
| Virtualization | HVM |
| Networking | |
|---|---|
| Network Performance | 100 Gigabit |
| ENA Support | True |
EC2 Instance - inf2.48xlarge Pricing
| Region | Price / Unit | Monthly Pricing |
|---|---|---|
| Ohio | $12.9813 | $9476.33 |
| Oregon | $12.9813 | $9476.33 |
| Stockholm | $14.2794 | $10423.95 |
| Ireland | $16.2266 | $11845.40 |
| Sydney | $16.8757 | $12319.22 |
| Mumbai | $16.8757 | $12319.22 |
| Paris | $18.1738 | $13266.85 |
| Singapore | $18.1738 | $13266.85 |
| Frankfurt | $19.4719 | $14214.49 |
| London | $19.4719 | $14214.49 |
| Tokyo | $19.4719 | $14214.49 |
| Sao Paulo | $22.0681 | $16109.75 |