[NTLK] Requiring registration to download?

Marisa Giancarla fstltna at me.com
Tue Apr 11 17:52:54 EDT 2017

Exactly. I had the downloads folder set as no visit in the robots.txt… What is odd is that I see the same IPs on all my sites. :/

> On Apr 11, 2017, at 2:27 PM, Dan <dan at dbdigitalweb.com> wrote:
> Can't be the way back machine then.  I was going to ask about your
> robots.txt but that answered it.  Also it wouldn't be every day.
> Changes perhaps, every few days or weeks.  But not every day.
> -Dan
> On 4/11/2017 2:51 PM, Marisa Giancarla wrote:
>> If it was way back machine why would they download the same files over and ove again, and ignore robots.txt?
>> ----
> ----------------------------------------------------------------------
> http://newtontalk.net/
> http://twitter.com/newtontalk

More information about the NewtonTalk mailing list