Googlebot is the common name for Google’s web crawler. Both a desktop crawler that simulates a user on a desktop and a mobile crawler that simulates a user on a mobile device is called Googlebot. To increase performance, Googlebot was built to run simultaneously on thousands of machines.
