Ultra-Bandwidth Solutions Memory Comparison
Ultra-Bandwidth Solutions | GDDR6 | GDDR6X | HBM2E |
---|---|---|---|
Memory Comparison | AI Inference Accelerator | AI Inference Accelerator | AI Training Accelerator |
Application Type (Example) |
Titan RTX RX5700 XT |
GeForce® RTX™ 3090 GeForce® RTX™ 3080 |
Expected |
# of Placements | 12 | 12 | 4-6 |
Gb/s/pin | 14-16 |
19-21 | 3.2-3.6 |
GB/s/placement | 56-64 | 76-84 | 410-461 |
GB/s/system | 672-768 | 912-1008 | 1638-2765 |
Configuration (Example) |
384 IO (12pcs x 32 IO package) |
384 IO (12pcs x 32 IO package) |
4096 IO 6144 IO |
Frame Buffer of Typical System | 12GB | 12GB | 32-96GB |
Average Device Power (pJ/bit) | 7.5 | 7.25 | 6.0 |
Typical IO Channel |
PCB (P2P SM) |
PCB (P2P SM) |
Si Interposer (2.5D integration) |