Hi Peter,

I currently use the "Disk File Storage Provider" with MS Indexing Service running on a separate SQL Server. (We've discussed this before.)

You have had Amazon S3 and SQL Storage Providers available for some time and I would like to understand how Searching works with these providers.

I know from other posts and your Search help document that the Lucene Search provider must be used for these storage providers.

The main reason I do not use Lucene is that it is unable to perform a content index of documents in a Medium Trust environment. (i.e., it is unable to use the iFilters, Adobe or Microsoft, to index the contents of a document in Medium Trust web server environment.)

So, when using S3 or SQL storage, what type of indexing, and therefore searching, is possible when using Lucene?

You can assume a Full Trust environment for your answer, but if you know the behavior in Medium Trust, that would be great.

Thanks Peter.

Rob

Hi Rob,

Indeed. You'll need to use Lucene with the other storage providers which requires full trust as far as I'm aware. Indexing Service only works on disk stored files (with original extension).

Best,

Peter

Hi Peter,

Sorry I was not more clear in my question. When using S3 or SQL storage providers, is Lucene able to index the **contents** of the files as it does when using the "Disk File Storage Provider"?

(bye the way, I am not receiving post notifications, like when you replied yesterday)

Rob

Sorry, yes it is. The file is briefly retained on disk and indexed. Then it is moved to the store. Note that if you reindex all documents are downloaded from the store and reindexed. Just so you know as S3 charges you for this of course.

Peter

Thanks Peter. Based on your response, sounds like S3 and SQL Storage are handled the same in this regard?

Are files downloaded one at a time and re-indexed, or in batches? Just wondering how to account for local disk requirements for a mass re-index operation.

Also, email notifications are **not** working from the forum. Is this intentional?

Rob

Hi Rob,

Sorry about the email notifications. I'll look into it shortly. I recently upgraded my ActiveForums and there are a few "issues" I had to contend with.

The files are downloaded one at a time and *should* be immediately deleted. Disclaimer: sometimes Windows can be a b*tch in locking files and a delete doesn't happen. It's wrapped in a try-catch so it doesn't blow up the module. But be aware that sometimes a temp file can hang around until the next cleanup round.

Peter