What is database sharding? What are the challenges of horizontal partitioning?

Answer preview

Sharding (horizontal partitioning across machines) splits one logical dataset into disjoint subsets, each owned by a separate database instance, so writes, storage, and working set scale beyond a single node. It is the last resort after read replicas, caching, and vertical scalin…