Web Design Forums

Limbo · 24-11-2005, 05:17

Webmasterworld has added a robot.txt file that disallows all user agents - thereby stoppping all Search Engines visting the site. This huge step by the operator and has already sent a ripple across the SEO community. Brett, the site owner states his reason is becasue of rogue bots visiting many million times a day... this is an odd decision - you can ban rogue bots in many ways.

Link: http://www.webmasterworld.com/forum9/9593.htm

This action has thrown up a much bigger question:

Do we actually need Search Engines as a promotion tool?

- or is Word of mouth/advertising good enough (assuming the product is quality)

A paying member in another thread mused that it might be a SE gaming technique to ensure that the site receives so many quality backlinks that he cultures a PR10 site (or second highest after google) that he could sell to the highest bidder.

That's a far fetched theory but the consequesces of this action could actually effect Google stock. Really.

Oli - ever considered this? I doubt it

but as an it's experiment defintely worth monitoring.

paulanthony · 24-11-2005, 12:17

Is that site on a pay for me only basis?

Limbo · 24-11-2005, 12:28

Quote:

Originally Posted by webmasterworld

Either we require login from users from your ISP because of abuse, or the thread is marked members only. Please login and then back up to view.

Didn't realise that that had happened - sorry. seems the thread is off limits to non members - but it's not a pay site.

paulanthony · 24-11-2005, 15:34

wheres the register page....a link would be nice...

smallbeer · 24-11-2005, 15:36

it's on the login box.

http://www.webmasterworld.com/register.cgi

oli · 24-11-2005, 15:47

They're a strange lot there, maybe he should spend more time redesigning the site than worrying about 'rogue bots'.

Limbo · 25-11-2005, 04:18

I dont think they give a flying fek about looks - The SEO crowd only care about speed, ROI and Content.

24-11-2005, 05:17	#1 (permalink)
Limbo On yer bike... Join Date: Feb 2005 Posts: 4,951	Large webmaster forum bans all search engines Webmasterworld has added a robot.txt file that disallows all user agents - thereby stoppping all Search Engines visting the site. This huge step by the operator and has already sent a ripple across the SEO community. Brett, the site owner states his reason is becasue of rogue bots visiting many million times a day... this is an odd decision - you can ban rogue bots in many ways. Link: http://www.webmasterworld.com/forum9/9593.htm This action has thrown up a much bigger question: Do we actually need Search Engines as a promotion tool? - or is Word of mouth/advertising good enough (assuming the product is quality) A paying member in another thread mused that it might be a SE gaming technique to ensure that the site receives so many quality backlinks that he cultures a PR10 site (or second highest after google) that he could sell to the highest bidder. That's a far fetched theory but the consequesces of this action could actually effect Google stock. Really. Oli - ever considered this? I doubt it but as an it's experiment defintely worth monitoring. Last edited by Limbo : 24-11-2005 at 12:18.

24-11-2005, 12:17	#2 (permalink)
paulanthony mingin dawg baitch Join Date: Apr 2004 Location: Belfast Posts: 1,028	Is that site on a pay for me only basis? __________________ Web design Ireland

24-11-2005, 15:34	#4 (permalink)
paulanthony mingin dawg baitch Join Date: Apr 2004 Location: Belfast Posts: 1,028	wheres the register page....a link would be nice... __________________ Web design Ireland

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

24-11-2005, 15:36	#5 (permalink)
smallbeer I Ain't Losing Any Sleep™ Join Date: Apr 2003 Posts: 5,236	it's on the login box. http://www.webmasterworld.com/register.cgi

24-11-2005, 15:47	#6 (permalink)
oli Free Ring Ding™ Join Date: Feb 2003 Location: Manchester Posts: 9,502	They're a strange lot there, maybe he should spend more time redesigning the site than worrying about 'rogue bots'.

25-11-2005, 04:18	#7 (permalink)
Limbo On yer bike... Join Date: Feb 2005 Posts: 4,951	I dont think they give a flying fek about looks - The SEO crowd only care about speed, ROI and Content.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)