This is a weird one. Mac OS 10.11.5. FMS 184.108.40.206. Two machine installation.
My web site disappeared from Google search results.
After a day of work, found the following at the end of the Apache installation in FMS https.conf:
# Globally disallow robots from crawling the sever
Header Set X-Robots-Tag "noindex, noarchive, nosnippet"
This seems to be setting the headers of all of the hosted web pages to not permit indexing by search engine robots. I commented out the header line and rebooted in the hope that the system would stop saying that search engines can't index my pages.
It does not appear to have stopped every header in my site coming out with the following in header tests :
|X-Robots-Tag||noindex, noarchive, nosnippet|
Does anyone have any other ideas for getting this behavior to stop?
I do not have this setting on in any of the actual pages. I do not use an htaccess file.