Saved Bookmarks
| 1. |
Solve : Does SE robot visit show in server log?? |
|
Answer» Does Search Engine Robot Visits also show in SERVER LOG? Does Search Engine Robot Visits also show in SERVER LOG?Yes, unless you filter them out.Hi, [size=14]There is something I want to pointout here[/size] One can find a site through SES, also the SE robot will visit the site AUTOMATICALLY after a predetermined interval. Does for both these type of visits, only the SE robot's visit is shown in server log (i.e. no way to track those who are finding the site through SEs ?) Question: In what way to filter out The robot visit?Here is a typical web browser - web server transaction. Browser: Hey, I want such and such a page. This is my IP address: x.x.x.x Server: Hello, x.x.x.x, here is your web page. Here is a typical index spider - web server transaction. Spider: I'm gonna start with your index page, and ravish you from there. This is my IP address: x.x.x.x Server: Hello, x.x.x.x, here is your web page. Sometimes the browser will say, Hey, I want such and such a page. I heard about it from Y. This is my IP address: x.x.x.x The "I heard about it from Y" bit is the HTTP Referer (sic) header. There's a really GOOD, intelligible article >here< about HTTP requests. It will definitely help you to understand what's going on betwee a browser/spider and the web server. For a more technical description of the HTTP header system, read >read here<. As for filtering out spider hits - well that DEPENDS on how those visits are LOGGED and how you view/analyse the logs. |
|