Search Engines in Data Results

Joe Rebele
Joe Rebele
Offline
0
Germi,

Thanks for all your support and prompt replies! I've been using this component the last two days and it's is a really good start on statistics. The problem I have with it right now is the event transactions that are recorded for search engines. The data is the most important thing for me right now and having all the search engine events in the data renders it impossible to use since it is skewing it so bad. I just can't afford the time to monitor IP Addresses and enter each one into the System Plugin. I think if you could get this product to the point where it "blocks" all search engine access, it would be incredible to use.

If you know a way to block the search engines without affecting my rankings, I'd be more than will to try it. Thanks again for all your help!

Regards,
Joe
Responses (6)
  • Accepted Answer

    Wednesday, August 10 2011, 07:04 AM - #Permalink
    0
    hello Joe,

    I understand your point, totally.
    Actually, our first version did NOT have the IP block feature, but then I saw that a lot of data from google, facebook and such was recorded. I saw 4 or 5 IPs mainly, so I added the "block IP" feature.

    I'm thinking that maybe the search engines send some kind of variable that says "hey, I'm a search engine robot" so I can use this to block.

    I'll have to investigate a little bit. let me a couple days to see if I can get this issue solved, ok? :)

    Germi
    The reply is currently minimized Show
  • Accepted Answer

    Wednesday, August 10 2011, 07:37 AM - #Permalink
    0
    well well well... :)

    I just upgraded the core plugin to include a search engine block.

    it is based on the USER AGENT the robot uses.

    the new version is 1.2.0. please download and install, and let me know!
    The reply is currently minimized Show
  • Accepted Answer

    Joe Rebele
    Joe Rebele
    Offline
    Wednesday, August 10 2011, 12:26 PM - #Permalink
    0
    Germi,

    This is AWESOME! THANKS for your prompt work on this feature! I think all will benefit from this feature. I've installed and will look tomorrow when I do some analytics.

    Is there any way to determine the search engine names that can be put into this feature in "System - Content Statistics"? I've seen a lot of hits from IP's in Japan and China. If there is not, I'll filter the IP addresses.

    Thanks again for the fantastic support!
    Joe
    The reply is currently minimized Show
  • Accepted Answer

    Wednesday, August 10 2011, 12:32 PM - #Permalink
    0
    there are several sites over there that tell you the principal user agents for robots, such as http://www.jafsoft.com/searchengines/webbots.html

    you only need to type an identifier (such as "googlebot" for the Googlebot)

    let me know!
    The reply is currently minimized Show
  • Accepted Answer

    Joe Rebele
    Joe Rebele
    Offline
    Wednesday, August 10 2011, 12:35 PM - #Permalink
    0
    Germi,

    I was actually on that site when you replied to my message! Entering the bots now. I'll provide you with feedback tomorrow!

    THANKS!
    Joe
    The reply is currently minimized Show
  • Accepted Answer

    Wednesday, August 10 2011, 12:36 PM - #Permalink
    0
    awesome.
    let me know how it works, if there's some bug or something to be improved!
    I'll await your comments!
    The reply is currently minimized Show
Your Reply