Hi all,
How can I prevent Google from showing the log-in page for WebYep? It is showing:
http://www.xxxxx.co.uk/webyep-system/program/help/english/access-denied.php
And ideally I would like to stop it. I can’t add a meta tag to the page in question, because I actually want that page indexing, but not the WebYep elements.
Thanks in advance.
Jonathan
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options
Jonathan,
Here is a link to a Google’s webmaster forum -
http://www.google.com/support/forum/p/Webmasters/thread?tid=4790fe490de7a55e
Basically advises that it is near impossible and that the only possible solutions - no guarantees - is either use external JS or Frames.
Good luck,
Bryan
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options
What about a robots.txt file that says stay out of the entire webyep-
system folder? Have a google for the correct syntax. Then get on the
Google Webmaster Tools page and request that folder be removed from
the index. It won’t be immediate, but it should help.
Walter
On Jun 15, 2011, at 6:16 AM, Jonathan Riddle wrote:
Hi all,
How can I prevent Google from showing the log-in page for WebYep? It
is showing:http://www.xxxxx.co.uk/webyep-system/program/help/english/access-denied.php
And ideally I would like to stop it. I can’t add a meta tag to the
page in question, because I actually want that page indexing, but
not the WebYep elements.Thanks in advance.
Jonathan
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options
Thanks both. I did look at the robot.txt route, but it seemed to only nail it down to the actual page and set as a meta tag which would have prevented the entire page from being indexed. Will look further into it.
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options
No, you can create a plain text file named robots.txt which you place
in the site root on your server (next to the index.html). This file
can contain a whole host of different directives, and white-hat
spiders like Google and its upstanding kin are sworn to follow these
directives. You can restrict a spider from a folder, a specific file,
all files in all folders that contain a particular string of text in
their filename, pretty much the sky’s the limit. Have a quick read at http://robotstxt.org
for more information.
Walter
On Jun 15, 2011, at 9:21 AM, Jonathan Riddle wrote:
Thanks both. I did look at the robot.txt route, but it seemed to
only nail it down to the actual page and set as a meta tag which
would have prevented the entire page from being indexed. Will look
further into it.
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options
Right, the robots.txt method works as well as the META tags of “robots” with a value of “noindex,nofollow,noarchive”.
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options
OK.
One thing I have learnt not to do is to amend the config file in WebYep to mention the actual website/client name, because that is what the page gets called, and that is what Google is finding.
I have put a 301 redirect into an .htaccess file steering people who may clink the WebYep link to the home page, which should help in clearing it from Google searches sooner rather than later, too.
Also, in a robot.txt file I believe this will work:
User-agent: *
Disallow: /webyep-system/
Which I think will block any access to Google to the entire WebYep folder, but still allow indexing of the actual page which is shown live on the website.
Thanks for your help.
Jonathan
freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options