NickStallman.net

PropertyNow and Google Crawl Stats

by on Oct.08, 2010, under google, internet, realsauce, website

PropertyNow Real Estate has just recently opened its doors to agents and its done so in a big way. A very large number of agents have already signed up and more are coming.

So much so, Google has taken a interest. Googlebot has been frantically crawling the past couple of days, and the Crawl Rate settings have changed as well. Usually you cant ask Googlebot to go any faster than 0.5 requests/s  but it is now letting me select up to 1.25 requests/sec or 0.8 seconds between requests! I’ve never seen that behaviour before.

We’ll have to see if that is reflected by a improvement in the search results. Fingers crossed.


Leave a Reply

Looking for something?

Use the form below to search the site:

Still not finding what you're looking for? Drop a comment on a post or contact us so we can take care of it!

Blogroll

A few highly recommended websites...