RSS Feeds: Reducing AdSense Impressions from Robots
(Update: On second thought, never mind. AVG has seen the error of their ways and the other code simply keeps logs from showing the Live Search referrer data. I'm blocking the log data a different way now. Another update will be in a later post with a similar title.)
I've spent the last umpteen hours scouring the Internet for this information. There are two robot sources using JavaScript robots and causing extra AdSense impressions. They had to be terminated.
Here are the .htaccess rules that can stop them both:
# block spurious referrals from microsoft LVSP, LIVSOP or QBHP
RewriteCond %{REMOTE_ADDR} ^65\.55\.(109|110|165|232) [OR]
RewriteCond %{REMOTE_ADDR} ^131\.107\.0\.9[56]
RewriteCond %{HTTP_REFERER} FORM=(LVSP|LIVSOP|QBHP)$ [NC]
RewriteRule .* – [F]# here we assume certain MSIE 6.0 agents are from linkscanner
# redirect these requests back to avg in the hope they'll see their silliness
RewriteCond %{HTTP_USER_AGENT} ".*MSIE 6.0; Windows NT 5.1; SV1.$" [OR]
RewriteCond %{HTTP_USER_AGENT} ".*MSIE 6.0; Windows NT 5.1;1813.$"
RewriteCond %{HTTP_REFERER} ^$
RewriteCond %{HTTP:Accept-Encoding} ^$
RewriteRule ^.* http://www.avg.com/?LinkScannerSucks [R=307,L]
Sources: Using AVG linkscanner against itself and Stupid search.live.com and form=QBHP
Similar Posts:
how did you find this? just curious cuz i have also spent hours after hours just to find this script.. thanks for the info..
I searched… for more than a day.
Funny thing about .htaccess… I was looking for that file for awhile on an old site of mine, and in my search, I accidentally crashed the whole site and had to upload a backup. And robots are quite pesky in relation to AdSense, especially the classic Terminator ones, always searching the Internet mindlessly.
Damn those AdSense Terminators! :shock:
I have heard that heavy Stumbles can get you dropped from Adsense due to the drop in the CTR. Is this the reason for reducing the impressions from robots or is it to get more accurate stats?
Well, not dropped, but smart-priced into nothingness. That's the reason I only let search visitors see the ads.
Cool, I never really made much from Adsense. I guess it's because I never really studied it much. It pays to be in the know.
My latest blog post: The Magic Russian Website Submitter