I need to access historical trading price data. Scale is 1500 securities per day x 365 days = 547,500 records per year x 4 years history = about 2 million records. Its a very skinny file be long one.
I need to use the data in calculations so it cannot reside externally, so I need a download of trade history data from 2014 to now, then add yesterday's trade history for 1500 securities after close of business each day.
How to best architecture from FileMaker?
Can we call an API to pull the data directly into FileMaker instead of the API calling it to a PostgreSQL table then calling into FileMaker?
FileMaker can integrate directly with the API.
The main script step you will use is "Insert From URL" and its new (as of version 16) cURL capabilities.
You will also need to learn the JSON functions to parse the responses.
Try searching for "FileMaker cURL Tutorial" or "FileMaker APIs Tutorial" or similar to get started. Don't get confused by the "Data API", which is something different (where the FileMaker Server is the host of the API).