[NTLK] Requiring registration to download?
Marisa Giancarla
fstltna at me.com
Tue Apr 11 17:52:54 EDT 2017
Exactly. I had the downloads folder set as no visit in the robots.txt… What is odd is that I see the same IPs on all my sites. :/
Marisa
> On Apr 11, 2017, at 2:27 PM, Dan <dan at dbdigitalweb.com> wrote:
>
> Can't be the way back machine then. I was going to ask about your
> robots.txt but that answered it. Also it wouldn't be every day.
> Changes perhaps, every few days or weeks. But not every day.
>
> -Dan
>
> On 4/11/2017 2:51 PM, Marisa Giancarla wrote:
>> If it was way back machine why would they download the same files over and ove again, and ignore robots.txt?
>>
>> ----
>
>
> ----------------------------------------------------------------------
>
> http://newtontalk.net/
> http://twitter.com/newtontalk
More information about the NewtonTalk
mailing list