System Design · Hard · ProDesign a web crawler (Googlebot-scale).System DesignProduct DesignSearch & Ads