X-Robots-Tag HTTP Header - Bring2mind

Site
Web

Bring2mind Forums

Forums
Search Forum
Advanced SearchTopicsPosts

Forums > Document Exchange > Storage and Security

X-Robots-Tag HTTP Header

Last Post 05/01/2014 1:53 PM by Peter Donker. 1 Replies.

Sort:

	Prev Next
You are not authorized to post a reply.

Author

Messages

Support Rogue Wave

New Member
Posts:11

04/15/2014 10:12 PM
Is it possible to restrict which documents in DMX that bots are allowed to index? We have several files we need to keep "public" to avoid requiring authentication, but we don't want bots to be able to index. There are numerous articles about how to restrict bots in various ways but the most recommend seems to be setting the X-Robots-Tag in the HTTP header. There are a few ways to set this (web.config), but as the PDFs are being served by DMX, I assume these methods won't work as I believe DMX writes its own headers. Response Header: HTTP/1.1 200 OK ... X-Robots-Tag: noindex https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag?hl=de

Peter Donker

Veteran Member
Posts:4536

05/01/2014 1:53 PM
No, that is not possible. It is also not a very common use case to have files "public" that you don't want "found". Peter

You are not authorized to post a reply.

Forums > Document Exchange > Storage and Security

About Bring2mind

Bring2mind is the company of Peter Donker, a DotNetNuke enthusiast who has been involved with the platform from the very beginning. At the same time as the market for modules emerged, he realized there was no good document management solution for the platform yet and he set about creating this. In part he based the module on his experience with other document management systems he used while working as a researcher. His module, Document Exchange, was an instant success and has since become the premier document management solution for DotNetNuke. In 2004 he created Bring2mind as a vehicle for the module and is one of the few successful businesses solely based on a DotNetNuke product.

Contact Info

Please note we are located in Europe. Business hours are weekdays between 9 AM and 6 PM local time (Central European Time) which corresponds to 3 AM and noon EST.