[Pro] Google and crawling

REFRESH THIS PAGE EVERY 60 SECONDS

This sounds like rather an iffy idea. Seriously, please tell me 'cause I seem to have missed something here: what exactly is supposed to be achieved with this?

k


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

well it seemed to work - not the javascript thing though I have stuck this in one page to see what happens - but removing the catch from Google then resubmitting the page has worked I can now search on a new bit of text from my site I just added and it finds it on my site - not perfect but sure beats waiting a month.
Thanks guys

J


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

k

Once Google has registered the site for the first time with the Javascript included,
any pages that have the Refresh script will show Users the latest info.
Just have to wait for google to come around again before this happens.
It does not help to make Google come around any quicker, but your pages will Refresh
with the latest info (every 60 seconds) when any User views the site.

Adrian

On 15 Mar 2010, at 20:09, Keith Martin wrote:

REFRESH THIS PAGE EVERY 60 SECONDS

This sounds like rather an iffy idea. Seriously, please tell me 'cause I seem to have missed something here: what exactly is supposed to be achieved with this?

k


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Any pages that have the Refresh script will show Users the latest info. Just have to wait for google to come around again before this happens.

Thanks but thats not the problem, Its Google showing out of date info in the search results because it caches my page about once a month. Unless it considers your site ‘important’ enough it wont update that often. Kinda kills it for me, as I was under the impression of instant publishing which I’ve found out it, doesn’t really work like that. I’m not asking for millions of readers, or millions of links just would just be great if Google would keep up with page changes - thats all.

Anyway back to the 9-5

Thanks for the inputs


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Justin,
If Google Caches your Refresh page just once, every User after that will get pages refreshed with the latest info?
Adrian

On 16 Mar 2010, at 10:02, Justin Easthall wrote:

Any pages that have the Refresh script will show Users the latest info. Just have to wait for google to come around again before this happens.

Thanks but thats not the problem, Its Google showing out of date info in the search results because it caches my page about once a month. Unless it considers your site ‘important’ enough it wont update that often. Kinda kills it for me, as I was under the impression of instant publishing which I’ve found out it, doesn’t really work like that. I’m not asking for millions of readers, or millions of links just would just be great if Google would keep up with page changes - thats all.

Anyway back to the 9-5

Thanks for the inputs


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Sorry trying to understand whether you are referring to my actual page on my site, or the search results in Google?

Do you mean - in the Google search results it shows the latest page snippet I updated right now? If I was to do a search on whatever and whatever my page will appear in the search results with the latest sentence i just amended in the snippet? The one I just did a min ago?

The page itself when visited is always up to date its the Google end Im stuck on? Showing up to date info


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

But if the page contains a script to Refresh every minute, even an old page that Google has cached will refresh itself every minute.
Adrian

On 16 Mar 2010, at 10:29, Justin Easthall wrote:

Sorry trying to understand whether you are referring to my actual page on my site, or the search results in Google?

Do you mean - in the Google search results it shows the latest page snippet I updated right now? If I was to do a search on whatever and whatever my page will appear in the search results with the latest sentence i just amended in the snippet? The one I just did a min ago?

The page itself when visited is always up to date its the Google end Im stuck on? Showing up to date info


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

I think I know what you mean - so if it refreshes in the cache every minute then it will source back to my page every minute to update the cache? It wont just refresh itself sitting in the cache?

Cool!!


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Exactly. Try inserting the short Javascript code in a page that Goggle currently has an old version of.
Upload your page. Search with Google and check if the page refreshes with the latest info.
Adrian

On 16 Mar 2010, at 10:41, Justin Easthall wrote:

I think I know what you mean - so if it refreshes in the cache every minute then it will source back to my page every minute to update the cache? It wont just refresh itself sitting in the cache?

Cool!!


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Justin,
You’ll obviously need to wait until Google comes around again before you can test this!
Adrian

On 16 Mar 2010, at 10:43, Adrian Williams wrote:

Exactly. Try inserting the short Javascript code in a page that Goggle currently has an old version of.
Upload your page. Search with Google and check if the page refreshes with the latest info.
Adrian

On 16 Mar 2010, at 10:41, Justin Easthall wrote:

I think I know what you mean - so if it refreshes in the cache every minute then it will source back to my page every minute to update the cache? It wont just refresh itself sitting in the cache?

Cool!!


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

This trick is dangerously close to what CNN used to do on their home
page to boost ad views. (I have no illusions that they were concerned
with people seeing the “latest” news.) Anything like this that flushes
the page while you’re in the middle of reading should be taken with a
salt lick-sized grain of salt. It’s incredibly user-hostile. If you’re
going to do this, look some more for a script that sets a flag for
itself so the page will only refresh ONCE. Google will ignore
JavaScript, and I’m not sure if a cached page includes the script. The
ones I have seen have been shorn of their stylesheets, for example.

Walter

On Mar 16, 2010, at 7:55 AM, Adrian Williams wrote:

Justin,
You’ll obviously need to wait until Google comes around again before
you can test this!
Adrian

On 16 Mar 2010, at 10:43, Adrian Williams wrote:

Exactly. Try inserting the short Javascript code in a page that
Goggle currently has an old version of.
Upload your page. Search with Google and check if the page
refreshes with the latest info.
Adrian

On 16 Mar 2010, at 10:41, Justin Easthall wrote:

I think I know what you mean - so if it refreshes in the cache
every minute then it will source back to my page every minute to
update the cache? It wont just refresh itself sitting in the cache?

Cool!!


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Walter, I agree, but I was just trying to get Justin to think differently about his issue.
Updating once is obviously what it requires. This could be done by simply making the setTimeout very long.
All the Javascript is in the Body of the page so should be cached by Google.
Adrian

On 16 Mar 2010, at 12:41, Walter Lee Davis wrote:

This trick is dangerously close to what CNN used to do on their home page to boost ad views. (I have no illusions that they were concerned with people seeing the “latest” news.) Anything like this that flushes the page while you’re in the middle of reading should be taken with a salt lick-sized grain of salt. It’s incredibly user-hostile. If you’re going to do this, look some more for a script that sets a flag for itself so the page will only refresh ONCE. Google will ignore JavaScript, and I’m not sure if a cached page includes the script. The ones I have seen have been shorn of their stylesheets, for example.

Walter

On Mar 16, 2010, at 7:55 AM, Adrian Williams wrote:

Justin,
You’ll obviously need to wait until Google comes around again before you can test this!
Adrian

On 16 Mar 2010, at 10:43, Adrian Williams wrote:

Exactly. Try inserting the short Javascript code in a page that Goggle currently has an old version of.
Upload your page. Search with Google and check if the page refreshes with the latest info.
Adrian

On 16 Mar 2010, at 10:41, Justin Easthall wrote:

I think I know what you mean - so if it refreshes in the cache every minute then it will source back to my page every minute to update the cache? It wont just refresh itself sitting in the cache?

Cool!!


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Thanks people - to get it to refresh twice a day i would need to… sorry not a coder

J


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Justin,

Change this…
setTimeout(“refresh_location()”, 100060); // 1000 ms * 60 = 60 seconds
To this…
setTimeout(“refresh_location()”, 1000
3600); // = 1 hour
Or this…
setTimeout(“refresh_location()”, 1000*21600); // = 6 hours

Adrian

On 16 Mar 2010, at 14:18, Justin Easthall wrote:

Thanks people - to get it to refresh twice a day i would need to… sorry not a coder

J


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Thanks really appreciated

J


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

But that would only mean anything if your visitors leave the page open
in their browsers all day. What you might want to do is simply add a
cache-blocking element to your URL, like this:

<script type="text/javascript">
//check if the page already has a querystring
var d = new Date();
if(!!window.location.search){
	var u = window.location.href;
	if((parseInt(u.split('?')[1]) + (1000 * 21600)) < d.getTime()){
		window.location.href = u.split('?')[0] + '?' + d.getTime();
	}
}else{
	window.location.href = window.location.href + '?' + d.getTime();
}
</script>

What this does is check to see if the page URL already has a
querystring that looks like this:

yourpage.html?1268753907163

…(where that number is the number of milliseconds since January 1,
1970). If it does, then it further checks if that number is inside
your 6 hour window. If it is, then the script ends at that point.
(There’s very little point setting a timeout to 6 hours in JavaScript
since the script cancels the moment the visitor blurs away from the
page.)

If there isn’t such a querystring, then the page reloads and adds the
querystring.

If the visitor bookmarks the page, or just goes back in her history,
then the querystring will be out of date and the page will refresh.
And Google will crawl and cache the page without any querystring,
since it doesn’t execute any JavaScript on the pages it visits (so the
“first run” behavior will never occur). So any human entering the site
from a Google link will magically refresh to the latest version the
moment the page opens.

If your page already uses a querystring for something else (a form
using the GET protocol?), then you should avoid this technique or
modify it to work along with your existing querystring scheme.

Walter

On Mar 16, 2010, at 10:31 AM, Adrian Williams wrote:

Justin,

Change this…
setTimeout(“refresh_location()”, 100060); // 1000 ms * 60 = 60
seconds
To this…
setTimeout(“refresh_location()”, 1000
3600); // = 1 hour
Or this…
setTimeout(“refresh_location()”, 1000*21600); // = 6 hours

Adrian

On 16 Mar 2010, at 14:18, Justin Easthall wrote:

Thanks people - to get it to refresh twice a day i would need
to… sorry not a coder

J


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Thanks Walter. My original prob - was just to get Google to show my latest page amendments in search results, without have to wait a month for the page to be re-cached? The page people see when they visit the site is all good and not a problem - but it is a problem if the page they thought they was viewing was from the month old snippet… Does this make sense? I’m not trying for millions of hits or a big readership - all I want is the cached page to be the same as my actual page - I thought Adrian had sorted this…


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Adrian’s latest code won’t do anything unless the visitor opens the
page and leaves it open for 6 hours. The very first suggestion would
actively make your visitors go nuts, by reloading periodically. If
they had been scrolled down the page and were suddenly and forcibly
reloaded back to the top of the page, that would be enough reason to
leave, methinks.

Walter

On Mar 16, 2010, at 12:17 PM, Justin Easthall wrote:

Thanks Walter. My original prob - was just to get Google to show my
latest page amendments in search results, without have to wait a
month for the page to be re-cached? The page people see when they
visit the site is all good and not a problem - but it is a problem
if the page they thought they was viewing was from the month old
snippet… Does this make sense? I’m not trying for millions of hits
or a big readership - all I want is the cached page to be the same
as my actual page - I thought Adrian had sorted this…


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

If the Home page had content enough just to fit into a screen without scrolling,
the refreshing that forces the page to top would not drive users nuts.
A shorter time, perhaps 15 seconds is enough time?
Admittedly the Home page as it currently stands is too long for this to happen elegantly.

Adrian

On 16 Mar 2010, at 18:00, Walter Lee Davis wrote:

Adrian’s latest code won’t do anything unless the visitor opens the page and leaves it open for 6 hours. The very first suggestion would actively make your visitors go nuts, by reloading periodically. If they had been scrolled down the page and were suddenly and forcibly reloaded back to the top of the page, that would be enough reason to leave, methinks.

Walter

On Mar 16, 2010, at 12:17 PM, Justin Easthall wrote:

Thanks Walter. My original prob - was just to get Google to show my latest page amendments in search results, without have to wait a month for the page to be re-cached? The page people see when they visit the site is all good and not a problem - but it is a problem if the page they thought they was viewing was from the month old snippet… Does this make sense? I’m not trying for millions of hits or a big readership - all I want is the cached page to be the same as my actual page - I thought Adrian had sorted this…


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options

Well, if you made your refresh happen once at the very beginning, and
then never again, you would guarantee the latest content without
flashing people back to the top.

<script type="text/javascript">
if(!window.location.search || document.window.search.indexOf('latest')  
== -1){
	var d = new Date();
	window.location.href = window.location.href + '?latest=' + d.getTime();
}
</script>

or something like that. That will run once only, and then you’ve
reloaded the page with a querystring, which will bust any cache in
between you and the original source.

Walter

On Mar 16, 2010, at 2:20 PM, Adrian Williams wrote:

If the Home page had content enough just to fit into a screen
without scrolling,
the refreshing that forces the page to top would not drive users nuts.
A shorter time, perhaps 15 seconds is enough time?
Admittedly the Home page as it currently stands is too long for this
to happen elegantly.

Adrian

On 16 Mar 2010, at 18:00, Walter Lee Davis wrote:

Adrian’s latest code won’t do anything unless the visitor opens the
page and leaves it open for 6 hours. The very first suggestion
would actively make your visitors go nuts, by reloading
periodically. If they had been scrolled down the page and were
suddenly and forcibly reloaded back to the top of the page, that
would be enough reason to leave, methinks.

Walter

On Mar 16, 2010, at 12:17 PM, Justin Easthall wrote:

Thanks Walter. My original prob - was just to get Google to show
my latest page amendments in search results, without have to wait
a month for the page to be re-cached? The page people see when
they visit the site is all good and not a problem - but it is a
problem if the page they thought they was viewing was from the
month old snippet… Does this make sense? I’m not trying for
millions of hits or a big readership - all I want is the cached
page to be the same as my actual page - I thought Adrian had
sorted this…


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options


freewaytalk mailing list
email@hidden
Update your subscriptions at:
http://freewaytalk.net/person/options