HTML markup and robots.txt

HI
Just suppose I want to put in a robots.txt file or similar file I assume I would put it in as HTML markup - but how do I decide where - before/after html? head? body? Is there any guidance or ruling or best practise on this.

And in the case specifically of robots.txt rather than inserting html would it be better to creat a meta tag (name: robots value: noindex nofollow) on the page in question?

Regards

Richard


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Hi Richard,
When it comes to robots exclusion commands you can do this one of two
ways.

The first is to add the meta tags to your pages using the Page/Meta
Tags dialog.
Open up the Page/Meta Tags dialog, make are you are on the User tab,
click the New button and enter;
Name: robots
Value: noindex, nofollow
You can find a list of values here;
http://www.seoconsultants.com/meta-tags/robots/

The second method is to create a plain text file (called robots.txt)
and upload this to the root (top level) of your web site. The file
should contain the same commands as before but is a slightly different
format;
http://www.seoconsultants.com/robots-text-file/
Use the Upload Stuff or Upload Extra Resources actions to upload the
file with your site.
FreewayActions.com | Upload Stuff - Upload Stuff
http://www.actionsforge.com/actions/view/45-upload-extra-resources -
Upload Extra Resources

Regards,
Tim.

On 4 Nov 2009, at 15:25, Richard Lowther wrote:

HI
Just suppose I want to put in a robots.txt file or similar file I
assume I would put it in as HTML markup - but how do I decide where

  • before/after html? head? body? Is there any guidance or ruling or
    best practise on this.

And in the case specifically of robots.txt rather than inserting
html would it be better to creat a meta tag (name: robots value:
noindex nofollow) on the page in question?

FreewayActions.com - Freeware and shareware actions for Freeway
Express & Pro.

Protect your mailto links from being harvested by spambots with Anti
Spam.
Only available at FreewayActions.com

http://www.freewayactions.com


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Thanks Tim, that is nice and clear. Is one method better than another or does it make little difference?

On another topic -did you ever find time to move forward with your search site action which drew a lot of chatter in August/September?

Hope you are enjoying life in Oxford.

Best wishes

Richard


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Hi Richard,
Both methods do the same thing although I tend to favor the robots.txt
file just because I can update the whole site without having to alter
individual pages with Freeway.
The Simple Site Search action is well underway although I hit a couple
of issues with the actions API that may need fixing in the
application. Expect wonderful things in the near future. :slight_smile:
Oxford is great. The commute from London and back is less so. :expressionless:
All the best,
Tim.

On 4 Nov 2009, at 18:07, Richard Lowther wrote:

Thanks Tim, that is nice and clear. Is one method better than
another or does it make little difference?

On another topic -did you ever find time to move forward with your
search site action which drew a lot of chatter in August/September?

Hope you are enjoying life in Oxford.

FreewayActions.com - Freeware and shareware actions for Freeway
Express & Pro.

Protect your mailto links from being harvested by spambots with Anti
Spam.
Only available at FreewayActions.com

http://www.freewayactions.com


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options