Kayne Posted November 20, 2018 Report Posted November 20, 2018 What gives? every tim I click a link to a partner site from here on Android i get rhe following page. What am I doing wrong, and how do I fix it? "Bots are not allowed to access this URL. Please follow the directives in our robots.txt file. Sorry you encountered an error. Details about this error have been written to our logs and will be reviewed to make sure it doesn't happen to other users." Quote
pupHawaii Posted November 22, 2018 Report Posted November 22, 2018 It's not just Android. I'm on a PC - I am using Chrome - and got the same response. I opened Firefox and copied the link over .. same response. My guess is that it's the link - it's not you or your browser .. Quote
Guest Posted November 22, 2018 Report Posted November 22, 2018 I get that same message too every time I click a partner link Quote
TattPig Posted December 2, 2018 Report Posted December 2, 2018 I'm getting the exact same error. Windows 10 with Opera browser. Quote
DarkroomTaker Posted December 4, 2018 Report Posted December 4, 2018 Bots are not allowed to access this URL. Please follow the directives in our robots.txt file. Me too. Quote
Administrators rawTOP Posted December 13, 2018 Administrators Report Posted December 13, 2018 On 11/20/2018 at 6:27 AM, Kayne said: What gives? every tim I click a link to a partner site from here on Android i get rhe following page. What am I doing wrong, and how do I fix it? "Bots are not allowed to access this URL. Please follow the directives in our robots.txt file. Sorry you encountered an error. Details about this error have been written to our logs and will be reviewed to make sure it doesn't happen to other users." On 12/3/2018 at 8:49 PM, DarkroomTaker said: Bots are not allowed to access this URL. Please follow the directives in our robots.txt file. Me too. Late last month I installed reCAPTCHA v3 on the new sites I'm developing. All the links go through a script on the new sites, which is why you're encountering the problem with links. Then about a week later I installed it here, but it has a different function here. Let me back up and explain… reCAPTCHA v3 never actually shows you a CAPTCHA. The idea is that it monitors your activity on the site to see if you're doing things that seem suspicious. It's looking for patterns of behavior that a bot would make that a human wouldn't make. It then combines that with what Google knows about your IP (reCAPTCHA is a Google service), and probably some other details, and then gives me a score back whenever I ask for it. So installing it here lets Google see your pattern of behavior and should help them figure out you're human. According to reCAPTCHA, about 40% of the traffic on my sites is bot traffic. Clearly some of the traffic they label as bot is human, which is why you're complaining. The issue is that bots were throwing off my stats, and another webmaster I know actually had some of his sponsors close his accounts because the bots were using his outbound links to find sites to test stolen credit cards. I need to think about what to do. One option is to give you a reCAPTCHA v2 challenge (the "I'm not a bot" things you're probably familiar with). It will be a few days before I get around to doing something. I possibly won't get to it until after the holidays. And just for reference… Men.com is also using reCAPTCHA v3 for logins, though they do revert to v2 when it says you're a bot. Guess I'll need to do the same, unless I think up something else. Quote
Administrators rawTOP Posted January 2, 2019 Administrators Report Posted January 2, 2019 I'm just wondering if any of you are still having this problem? Looking at my daily stats, the % of bots dropped from being regularly around 40% to ~10% about 10 days or 2 weeks ago. I suspect it took Google that long to figure out what "normal" looked like for my sites. Now that it know what normal humans do, it's finding less suspicious activity, which, if true, means fewer of you would be blocked when trying to go to sponsor sites. I should also mention that I checked the code and my code was only blocking people who were rated as the most suspicious. Google's rating scale goes from 0 to 1 with 0.1 meaning "almost certainly a bot". Those were the only folks I was blocking. Given that no one else has posted in the thread I'm assuming the problem solved itself. If that's not the case, please let me know. Quote
Monster5-8gPA Posted January 2, 2019 Report Posted January 2, 2019 rawTOP thanks for checking back! I’ve had no further issues 1 Quote
Kayne Posted January 3, 2019 Author Report Posted January 3, 2019 4 hours ago, rawTOP said: please let me know... Sir, I am happy to report I am a le to explore links. 1 Quote
(2)(Small).thumb.jpg.979e777ced12009c673211ce62234474.jpg)
Recommended Posts