I need to access historical trading price data. Scale is 1500 securities per day x 365 days = 547,500 records per year x 4 years history = about 2 million records. Its a very skinny file be long one.
I need to use the data in calculations so it cannot reside externally, so I need a download of trade history data from 2014 to now, then add yesterday's trade history for 1500 securities after close of business each day.
How to best architecture from FileMaker?
Can we call an API to pull the data directly into FileMaker instead of the API calling it to a PostgreSQL table then calling into FileMaker?