Block to Petabyte

Modern hard drives (2011+) and SSDs use 4,096-byte (4 KiB) physical sectors — known as "Advanced Format" or AF. Legacy drives used 512-byte sectors. Filesystems (NTFS, ext4, APFS) typically use 4 KiB logical block sizes to match physical sectors, which avoids the performance penalty of misaligned writes. Enterprise SSDs may use larger block sizes (16 KiB or more) for better parallelism.

Cloud block storage services (AWS EBS, Azure Managed Disks, GCP Persistent Disk) use I/O block sizes typically of 4 KiB or 16 KiB. Performance is measured in IOPS (I/O operations per second) and throughput (MB/s) — both depend on block size. A throughput-optimized workload (sequential video) benefits from large blocks; an IOPS-optimized workload (database random reads) uses small blocks.

Filesystems allocate disk space in whole blocks. On a system with 4 KiB blocks, every file — no matter how small — occupies at least 4,096 bytes. A directory of 10,000 small configuration files (each 100 bytes of content) uses 40 MB of disk space (10,000 × 4,096 bytes) rather than 1 MB (10,000 × 100 bytes). This is called "block slack" or "internal fragmentation".

Disk blocks (filesystem blocks) are typically 512 bytes to 4 KiB. Database blocks (database pages) are the unit of I/O for a database engine — typically 8 KiB (PostgreSQL, SQL Server), 16 KiB (MySQL InnoDB), or 32 KiB (Oracle, configurable). Database blocks usually align to multiples of disk blocks for efficiency. Reading one database page may involve reading 2–8 disk blocks.

RAID stripe size (or chunk size) is the amount of data written to each drive before moving to the next drive in the array — typically 64 KiB to 512 KiB. It should be set to match your workload: sequential large-file workloads benefit from larger stripe sizes; random small-block workloads benefit from stripe sizes closer to the filesystem block size. Mismatched stripe and block sizes cause write amplification and reduce RAID performance.

1 petabyte (PB) = 1,000 terabytes (TB) in the SI decimal system. In the binary IEC system, 1 pebibyte (PiB) = 1,024 tebibytes (TiB) = 1,125,899,906,842,624 bytes. The distinction matters for enterprise storage procurement: a petabyte of raw disk capacity appears as about 909 TiB in an OS reporting binary units.

Petabyte-scale storage is common at: social media platforms (Facebook/Meta stores over 100 PB of photos alone), streaming services (Netflix's content library is estimated at 100+ PB), government agencies (US NSA, CERN particle physics data), genomic research institutions, and large financial exchanges storing tick-level trading data. Major cloud providers (AWS, Azure, GCP) collectively store zettabytes.

In 2024, cloud storage costs roughly $20–25 per TB per month (S3 standard tier), making 1 PB approximately $20,000–$25,000/month. Raw enterprise disk hardware for 1 PB runs about $20,000–$50,000 upfront (at $20–50 per TB for high-density drives), plus ongoing power, cooling, and management overhead. Tape-based archival storage is considerably cheaper at $2–5 per TB.

YouTube users upload approximately 500 hours of video per minute, or 720,000 hours per day. At an average compressed size of 1–2 GB per hour of HD video, that equates to roughly 720–1,440 TB (0.7–1.4 PB) of new video data per day — before YouTube re-encodes into multiple formats and quality levels, which multiplies storage requirements several-fold.

The SI prefix hierarchy above petabyte: exabyte (EB, 10¹⁸ bytes), zettabyte (ZB, 10²¹ bytes), yottabyte (YB, 10²⁴ bytes), ronnabyte (RB, 10²⁷ bytes), and quettabyte (QB, 10³⁰ bytes) — the last two added by the BIPM in 2022. Current global data storage is estimated in the hundreds of exabytes; no single organisation approaches yottabyte scale.