Tebibyte per second to Terabit per second

AMD's MI300X stacks 8 HBM3 memory modules and multiple compute chiplets on a single package using advanced 2.5D packaging with silicon interposers. The short physical distance between compute and memory dies — millimeters instead of centimeters — dramatically reduces signal latency and power per bit. This allows a 5.3 TB/s aggregate bandwidth that would be physically impossible with traditional socketed memory. The trend toward chiplet packaging is how the industry keeps scaling bandwidth despite hitting limits in single-die manufacturing.

Significantly. When provisioning an AI training cluster with hundreds of GPUs, a 10% bandwidth miscalculation cascades through the entire system design — buffer sizes, interconnect capacity, cooling, and power. Getting the units wrong could mean the difference between a training run finishing in 30 days vs 33 days.

Training large language models (100B+ parameters), molecular dynamics simulations, weather modeling, and fluid dynamics at scale. These workloads move enormous matrices through memory billions of times. The TiB/s memory bandwidth of modern GPUs is what makes training models like GPT-4 possible in months rather than decades.

Memory bandwidth dwarfs network bandwidth. Each H100 GPU has 3.35 TiB/s of internal memory bandwidth but connects to the network at only 0.05 TiB/s (400 Gbps InfiniBand). This 60:1 ratio is why AI chip designers obsess over keeping computations local to each GPU and minimising network communication.

Not in the same way. Quantum computers process information through qubits that exist in superposition, so they do not shuttle classical data around at TiB/s. However, the classical control systems that manage quantum processors and process measurement results do need high bandwidth — current quantum-classical interfaces operate at modest Gbps rates.

Global internet traffic peaks at roughly 1,000–1,500 Tbps (1–1.5 Pbps) as of 2026. This is growing at about 25% per year, driven by video streaming, cloud computing, and AI training data transfers. A single viral live event can spike regional traffic by tens of Tbps.

Internet traffic automatically reroutes through other cables and paths via BGP routing protocols, usually within seconds. Speed may degrade in the affected region but rarely drops entirely. Cable cuts happen more often than people think — about 100 per year globally, mostly from ship anchors and fishing trawlers.

Dense wavelength-division multiplexing (DWDM) sends dozens of different light colors (wavelengths) through a single fiber simultaneously, each carrying its own data stream. A modern cable contains multiple fiber pairs, each carrying 100+ wavelengths, with each wavelength modulated at 400 Gbps or more.

Netflix's library is estimated at around 30–40 petabytes. At 1 Tbps, downloading the entire catalog would take roughly 70–90 hours. At 100 Tbps (a realistic submarine cable capacity), you could theoretically grab all of Netflix in under an hour.

Researchers at Japan's NICT achieved 22.9 Pbps (22,900 Tbps) through a single multicore fiber in 2024. That is enough to transfer the entire Library of Congress in a fraction of a second. These lab records typically reach commercial deployment 5–10 years later.