I have just imported a file containing 7 million records. Each field in the table has quotes around the data. Can anyone tell me an easy way to remove the quotes?
1. how long did it take to import?
2. what format did you use to import?
3. might it be faster to import correctly (without the quotes)?
4. are you sure it's double quotes? or might it be curly double quotes?
Find/Replace (see attachment)
of course, you need to pay attention to quote marks that ARE meant to be there
... and put the computer in the fridge while running that.
... also remember that you have to be on a layout containing ALL your fields, formatted as edit box.
I'd use BBEdit find and replace on the source file, before the import, as Bev says.
"Adding to Bev's questions:
5. How many fields are we talking about?
6. Do any of the fields have quotes in the contents (or is it possible that there is)?
Another trick you could use is a calculation, i.e. using in a "replace field contents" (cmd+equals). You'd have to do this for every field, but the calculation would be the same:
If ( ( Left ( Self ; 1 ) = "\"" ) and ( Right ( Self ; 1 ) = "\"" ) ;
Middle ( Self ; 2 ; Length ( Self - 2 ) ) ;
If Beverly's is right in her question 4 and they are curly brackets, you could duplicate the If part of the equation so it comes out as (translated into English): If ( ( Starts and ends with double brackets ) OR ( Starts and ends with curly brackets ) ; then Write it out without the first and last characters ; else leave it as is )
Though I agree with the others that the best way is to remove the curly brackets in the source (and/or reimport but watch the format selected in the import dialog).
Note that you can move through the records in the Import Records dialog to preview how they will look, using the < and > arrows below the field selection area.
Agreed. Get the import format fixed outside of FM.
BBEdit I believe supports search/replace regular expressions.
(I would probably do this in Java using RegEx. Java can search a 500,000 line text file - on disk - in less than once second with only a single line of code.)
You'll need a professional editor like that to handle a huge file.
BBedit can do a search and replace on 100 files in seconds. It IS a professional editor. Since 1992.
Agreed. BBEdit is definitely a professional editor. I did not mean to imply otherwise, but just didn't know it's entire feature set.
I might try TextWrangler, the free editor first, however, unless there's some file limitation (I didn't see any in the manual).
The TextWrangler manual states: ".... TextWrangler offers powerful regular expression–based (“grep”)
search and replace, multi-file search, sophisticated text transformations, intelligent text
coloring, and other features not usually found (or missed) in word processors."
Unless I'm doing Java development (most of the time) where I use a professional IDE with features no text editor has (or is expected to have), TW has always been plenty for my "basic" editor needs.
For creating/testing regular expressions, my tool of choice is RegExRx. Very inexpensive and excellent. Good tech support too.
Bare Bones Software | TextWrangler
(For diffing files and folders, I'd use Beyond Compare from Scooter Software (now on Mac!), not a text editor, but that's just me.)
Scooter Software: Home of Beyond Compare
I agree with TextWrangler being a very good alternative - after all it's a fruit coming from the same tree.
If it were for me, I'd still using WriteNow....
Notepad++ ? (wasn't sure what platform you're on..) For Windows anyway, this is my 'pre-processor' for any files before importing them into FM.
Can't say enough about Beyond Compare. Used it on Windows for years and begged them to come out with a Mac version... finally they did and I'm using it daily on both Mac and Windows.
Me too. Used Beyond Compare on Windows doing .NET development and other dev stuff. Although modern IDEs have file sync built in, there's nothing quite like a dedicated tool.
Scooter Software really listened to their customers.
After getting Beyond Compare, I deleted the other Mac file comparison software I bought.
P.S. Using FileMaker, I just hope someday they actually have basic script search. Built-in FMP refactoring apparently is too much to hope for....
Retrieving data ...