Crawler (Spider)

Crawler (Spider) is a bot which repeatedly browses websites. They are used by search engines in order to grow and refresh their indexes.