The Cellar - View Single Post

Undertoad · 01-08-2018, 09:51 AM

I can't see why they are useful so I've politely told them to go away via the file "/robots.txt". Let's see what happens in 15 minutes' time.

user-agent: AhrefsBot
disallow: /

01-08-2018, 09:51 AM	#2356
Undertoad Radical Centrist Join Date: Jan 2001 Location: Cottage of Prussia Posts: 31,423	I can't see why they are useful so I've politely told them to go away via the file "/robots.txt". Let's see what happens in 15 minutes' time. user-agent: AhrefsBot disallow: /