Kayne Posted November 20, 2018 Report Share Posted November 20, 2018 What gives? every tim I click a link to a partner site from here on Android i get rhe following page. What am I doing wrong, and how do I fix it? "Bots are not allowed to access this URL. Please follow the directives in our robots.txt file. Sorry you encountered an error. Details about this error have been written to our logs and will be reviewed to make sure it doesn't happen to other users." Quote Link to comment Share on other sites More sharing options...
Hairybttmcub43 Posted November 21, 2018 Report Share Posted November 21, 2018 Same issue Quote Link to comment Share on other sites More sharing options...
pupHawaii Posted November 22, 2018 Report Share Posted November 22, 2018 It's not just Android. I'm on a PC - I am using Chrome - and got the same response. I opened Firefox and copied the link over .. same response. My guess is that it's the link - it's not you or your browser .. Quote Link to comment Share on other sites More sharing options...
HairyBarebacker Posted November 22, 2018 Report Share Posted November 22, 2018 I get that same message too every time I click a partner link Quote Link to comment Share on other sites More sharing options...
Guest Tallpike13 Posted December 1, 2018 Report Share Posted December 1, 2018 Same issue Quote Link to comment Share on other sites More sharing options...
TattPig Posted December 2, 2018 Report Share Posted December 2, 2018 I'm getting the exact same error. Windows 10 with Opera browser. Quote Link to comment Share on other sites More sharing options...
DarkroomTaker Posted December 4, 2018 Report Share Posted December 4, 2018 Bots are not allowed to access this URL. Please follow the directives in our robots.txt file. Me too. Quote Link to comment Share on other sites More sharing options...
Monster5-8gPA Posted December 4, 2018 Report Share Posted December 4, 2018 Same here with an iPhone! Quote Link to comment Share on other sites More sharing options...
Administrators rawTOP Posted December 13, 2018 Administrators Report Share Posted December 13, 2018 On 11/20/2018 at 6:27 AM, Kayne said: What gives? every tim I click a link to a partner site from here on Android i get rhe following page. What am I doing wrong, and how do I fix it? "Bots are not allowed to access this URL. Please follow the directives in our robots.txt file. Sorry you encountered an error. Details about this error have been written to our logs and will be reviewed to make sure it doesn't happen to other users." On 12/3/2018 at 8:49 PM, DarkroomTaker said: Bots are not allowed to access this URL. Please follow the directives in our robots.txt file. Me too. Late last month I installed reCAPTCHA v3 on the new sites I'm developing. All the links go through a script on the new sites, which is why you're encountering the problem with links. Then about a week later I installed it here, but it has a different function here. Let me back up and explain… reCAPTCHA v3 never actually shows you a CAPTCHA. The idea is that it monitors your activity on the site to see if you're doing things that seem suspicious. It's looking for patterns of behavior that a bot would make that a human wouldn't make. It then combines that with what Google knows about your IP (reCAPTCHA is a Google service), and probably some other details, and then gives me a score back whenever I ask for it. So installing it here lets Google see your pattern of behavior and should help them figure out you're human. According to reCAPTCHA, about 40% of the traffic on my sites is bot traffic. Clearly some of the traffic they label as bot is human, which is why you're complaining. The issue is that bots were throwing off my stats, and another webmaster I know actually had some of his sponsors close his accounts because the bots were using his outbound links to find sites to test stolen credit cards. I need to think about what to do. One option is to give you a reCAPTCHA v2 challenge (the "I'm not a bot" things you're probably familiar with). It will be a few days before I get around to doing something. I possibly won't get to it until after the holidays. And just for reference… Men.com is also using reCAPTCHA v3 for logins, though they do revert to v2 when it says you're a bot. Guess I'll need to do the same, unless I think up something else. Quote Link to comment Share on other sites More sharing options...
Administrators rawTOP Posted January 2, 2019 Administrators Report Share Posted January 2, 2019 I'm just wondering if any of you are still having this problem? Looking at my daily stats, the % of bots dropped from being regularly around 40% to ~10% about 10 days or 2 weeks ago. I suspect it took Google that long to figure out what "normal" looked like for my sites. Now that it know what normal humans do, it's finding less suspicious activity, which, if true, means fewer of you would be blocked when trying to go to sponsor sites. I should also mention that I checked the code and my code was only blocking people who were rated as the most suspicious. Google's rating scale goes from 0 to 1 with 0.1 meaning "almost certainly a bot". Those were the only folks I was blocking. Given that no one else has posted in the thread I'm assuming the problem solved itself. If that's not the case, please let me know. Quote Link to comment Share on other sites More sharing options...
Monster5-8gPA Posted January 2, 2019 Report Share Posted January 2, 2019 rawTOP thanks for checking back! I’ve had no further issues 1 Quote Link to comment Share on other sites More sharing options...
Kayne Posted January 3, 2019 Author Report Share Posted January 3, 2019 4 hours ago, rawTOP said: please let me know... Sir, I am happy to report I am a le to explore links. 1 Quote Link to comment Share on other sites More sharing options...
(2)(Small).thumb.jpg.979e777ced12009c673211ce62234474.jpg)
Recommended Posts