Home (All Topics) → Technology → Software ↓
By Marios Alexandrou on October 4, 2016.
Check out these related articles:
I've installed your robots.txt plugin, however it's not affecting the robots.txt file - however wordpress is installed in a sub-folder ( ../web/ )
is there a fix for this?
There's no easy fix. The problem is that when a file is requested outside of the WP folder (robots.txt is always requested from the root), the WP engine doesn't "know" about the request and so it can't intercept it and return the virtual robots.txt file. You could get this to work with the right settings in the .htaccess file, but I don't have the exact entries handy.
Note that the issue with sub-folders refers to your site being in a sub-folder off of the domain e.g. domain.com/your-wp-site-under-this-folder/. A sub-folder on the server "behind-the-scenes" is perfectly fine.
I have a problem, I installed your plugin and since I can't rewrite my robots.txt. I remove your plugin and same problem. I add a physical robot.txt in my root and always same problem. I can't edit my robot.txt, that's a big problem.
If you've deactivated and deleted the plugin, then it can no longer be impacting your site in any way.
Sorry, it won't let me reply to your comment.
Yes I have, I still get the 404 error. My site isn't live, could that be the issue? I have a plug-in for my sitemaps but that seems to be working?
You should still be able to view your robots.txt file even if the site isn't live.
Unfortunately I'm not sure what the problem is. These things are hard to diagnose without errors.
If you'd be willing to let me log into your site, I'd could "look around". If you're game, email me the info: firstname.lastname@example.org. Don't post it here!
I've installed this on my Wordpress but whenever I click preview I get a '404 Not Found' error. What am I doing wrong?
Is your WordPress installation in a sub-folder like /blog/ or something similar?
I don't think so, it's in the public_html folder?
Have you tried accessing the robots.txt by typing in your site's URL followed by /robots.txt?
Sorry, I don't understand the "FAQ: Will it conflict with any existing robots.txt file?
If a physical robots.txt file exists on your site, WordPress won't process any request for one, so there will be no conflict."
I have a physical robots.txt file (blocking google my business) that is different from the one created by your plugin. Will your plugin OVERRIDE the physical robots.txt file?
A physical file will override the plugin.
Your email address will not be published. Required fields are marked *
Replies to my comments
Notify me of followup comments via e-mail.
Current ye@r *
Leave this field empty