Neocities.org
Added a few more ScrubTheWeb related links to my article. Still have a few more to go; might need to organize them a bit.
Crossed 13,407 views! Thank you!
1 like
websitering
7 years ago
Actually I crossed 13,400 views; 13,407 is the view count. Thanks again! (And forgive me for the mistake.)
websitering
7 years ago
Added a few links to ScrubTheWeb article. Some at the end, others in the article itself.
I mis-id'd scrubtheweb's user agent. It was called Scrubby, not roverbot. Corrected and included a link to an archived version of the site where I found the robot listed.
It looks like ScrubTheWeb's Facebook page was taken down. Their Twitter page is still up.