dreed

Indexing Help on a Large File

Discussion created by dreed on Nov 19, 2012
Latest reply on Nov 20, 2012 by dreed

Hello,

 

I have a file with about 1.2 million records and about 800 GB of external container data. I've been going through the process of using the Scribe plugin to read text contents of the supported file types (pdf, office docs, etc) into a text field in this table for searching. There will be about 250,000 records in the table that will contain data in this text field and currently my script has processed ~80,0000 of them. I stopped the processing of the script to check on some errors the plugin reported (older, unsupported office doc types), and while I was doing this I decided to turn on indexing for this field, since it will be necessary for searching the text contents.

 

How long do you think it might take to build this index, considering that some of these fields may contain pages of text? many of the fields are empty or contain only a few lines of text, but since I turned on the index and commited the change from Manage Database, Filemaker (12v3) has been unresponsive, just giving the indeterminate progress bar. It's been >12 hours at this point.

Outcomes