Difference between revisions of "Robots exclusion standard (robots.txt)"
Jump to navigation
Jump to search
| Line 3: | Line 3: | ||
[[Elastic App Search web crawler]] | [[Elastic App Search web crawler]] | ||
Failed to fetch robots.txt: [[SSL certificate chain is invalid]] [unable to find valid certification path to requested target]. Make sure your SSL certificate chain is correct. For self-signed certificates or certificates signed with unknown certificate authorities, you can add your signing certificate to Enterprise Search Crawler configuration. Alternatively, you can [[disable SSL certificate validation]] (non-production environments only). | Failed to fetch robots.txt: [[SSL certificate chain is invalid]] [unable to find valid certification path to requested target]. Make sure your SSL certificate chain is correct. For self-signed certificates or certificates signed with unknown certificate authorities, you can add your signing certificate to Enterprise Search Crawler configuration. Alternatively, you can [[disable SSL certificate validation]] (non-production environments only). | ||
| + | |||
| + | |||
| + | |||
| + | [[User-agent:]] | ||
| + | |||
== Related == | == Related == | ||
Revision as of 19:02, 13 November 2022
Elastic App Search web crawler
Failed to fetch robots.txt: SSL certificate chain is invalid [unable to find valid certification path to requested target]. Make sure your SSL certificate chain is correct. For self-signed certificates or certificates signed with unknown certificate authorities, you can add your signing certificate to Enterprise Search Crawler configuration. Alternatively, you can disable SSL certificate validation (non-production environments only).
User-agent:
Related
Advertising:
