Tiny Web Directory Forum

General Category => Water Cooler => Topic started by: Brad on December 02, 2019, 06:20:01 AM

Title: Googlebot is Fast
Post by: Brad on December 02, 2019, 06:20:01 AM
Googlebot is easily the most aggressive spider out there.  Yesterday I updated the navigation menu on Indieseek.xyz to include a link to the forum and within 2 minutes Googlebot was hammering the forums.  It boggles the mind.