Log in to create and rate content, and to follow, bookmark, and share content with other members. Not a member? Join Now!

FileMaker Pro to SFTP Server

Discussion created by daniel_the_manual on Jun 27, 2017
Latest reply on Nov 28, 2018 by fmpdude

Like • Show 0 Likes0
Comment • 37

Hello Community of FileMaker users,

I'm having a bit of an issue, I need to get my FileMaker Pro 16 system to automatically transfer some files to one SFTP Server, which then transfers said files to another SFTP Server. I tried looking for some information regarding what I just stated but no Forum or Technical support person is able to help me. Now I'm asking the online community if they have any suggestions, scrips, steps and maybe a link to a trusted site detailing what I need to do to make what I'm asking possible.

Best Regards,

DTM

Outcomes

37 Replies

Jens Teich Jun 27, 2017 2:16 PM
Do you need that for Mac / Win or both?
Where are the files you want to move: in FileMaker container fields?
Like • Show 0 Likes0
Actions
bigtom @ Jens Teich on Jun 27, 2017 2:19 PM
You can you Insert from URL script to do this, but depends on there the files are to start with. Also not intuitive that when you want to send a file out you use a script to insert something into FileMaker.
Like • Show 0 Likes0
Actions
daniel_the_manual @ Jens Teich on Jun 27, 2017 2:21 PM
I need it for Windows, the files/data are within FileMaker Pro.
Like • Show 0 Likes0
Actions
bigtom Jun 27, 2017 2:24 PM
FM16 can do this with Insert from URL and cURL options. Files must be in a container and must be sent one at a time To the destination.

If you need need bulk transfers look at a plugin. Base Elements and MBS and other can do this.
Like • Show 0 Likes0
Actions
monkeybreadsoftware Jun 27, 2017 2:26 PM
You can try the MBS FileMaker Plugin for SFTP via the CURL functions.
Our plugin comes with a couple of examples for uploading files via SFTP/FTP.

e.g. on this page is an example for FTP:
Monkeybread Software - MBS FileMaker Plugin: CURL.OpenInputFile

You can simply try it with a sftp:// URL and it should work.
We support authentication via password or private key file.
Like • Show 2 Likes2
Actions
daniel_the_manual @ bigtom on Jun 27, 2017 2:30 PM
Ok I'll see if it works or helps, but i'm hopping for something more automatic and does not require an individual to constantly send files out one at a time. Thank you anyways
Like • Show 0 Likes0
Actions
Jens Teich @ daniel_the_manual on Jun 27, 2017 2:30 PM
For WIN I recommend to install WinSCP, which has automation features see Scripting and Task Automation :: WinSCP.

In your FileMaker script you first export files from database to file system using 'export field contents', then you call WinSCP with 'Send Event'.
Like • Show 0 Likes0
Actions
bigtom @ daniel_the_manual on Jun 27, 2017 2:31 PM
You can script a routine that runs automatically but each file needs to be send individually.
Like • Show 0 Likes0
Actions
monkeybreadsoftware @ daniel_the_manual on Jun 27, 2017 2:34 PM
With a scheduled script you could have a script check every few Minutes if there is something to upload and simply run a script to upload a file.

So first figure out which file needs to go where.
For SFTP server, you need the URL, a folder to target and of course credentials.
Like • Show 0 Likes0
Actions
daniel_the_manual Jun 28, 2017 9:30 AM
Hello Guys and Gals,

It seems that plug-ins and third party programs are Forbidden, I need the transfer of data to the SFTP to work without the help of another program. Any suggestions (script wise).
Like • Show 0 Likes0
Actions
philmodjunk Jun 28, 2017 9:34 AM
You already have suggestions here that do not use plug-ins nor third party programs.

Use a script with Insert From URL.

This step can only do one file at a time, but your script can use the same step repeatedly to upload all of your files.
Like • Show 0 Likes0
Actions
daniel_the_manual @ philmodjunk on Jun 28, 2017 9:39 AM
Ok Thank you for the information I'll try it out immediately
Like • Show 0 Likes0
Actions
bigtom @ daniel_the_manual on Jun 28, 2017 1:39 PM
I have not tried but with PSOS you might be able to get multiple transfers going in parallel or simply process batches regularly with a schedule.
Like • Show 0 Likes0
Actions
daniel_the_manual @ philmodjunk on Jun 29, 2017 11:23 AM
What I'm looking for is a script that allows you to transfer data from FileMaker Pro to the SFTP server.

What you recommended or better to say re-blogged me is a script that transferring data from the SFTP server to the FileMaker Pro system. <- that is not what I'm looking for.
Like • Show 0 Likes0
Actions
fmpdude Jun 29, 2017 12:01 PM
Another option.

If you can SQL-SELECT the fields, you could write a small JDBC (Java) program that, using FMP's Free JDBC driver, would connect to FMP and get your data. From there, you could write SFTP connection logic. Best yet, there are free, established (did I say free?) libraries from Apache that have SFTP logic built in. Here's a posting from a few years back. I'm sure there have been updates since then.

Java SFTP Apache commons file download, upload and delete example

If you need to extract actual files, say in container fields, that's also supported by FMP's JDBC driver. I've done that, too, with FMP <--> MySQL Sync logic I wrote a couple years back.

Once you wrote the code, you could schedule it in Windows or Mac to run automatically on any schedule you like.

The one caveat is that FMI has crippled the JDBC driver so if you're using FMP and not FMS, that JDBC code will only run on the same machine as your database. I've worked around that ridiculous restriction too, but that's more work.

This type of JDBC code is flexible, FREE, and fast.

Let me know if you have any questions.
Like • Show 0 Likes0
Actions
bigtom @ daniel_the_manual on Jun 29, 2017 12:17 PM
daniel_the_manual wrote:

What I'm looking for is a script that allows you to transfer data from FileMaker Pro to the SFTP server.

What you recommended or better to say re-blogged me is a script that transferring data from the SFTP server to the FileMaker Pro system. <- that is not what I'm looking for.
Not sure exactly what you are referencing, but like I said not an intuitive script step choice.

Insert from URL in this case is not inserting a file into FM. It is inserting the response from the ftp server after transferring the data. There is an explanation of how this works in the following link, but the short answer is "--user user:pass -T $file".

New CuRL Function and FTP

Reference Links

FileMaker Pro 16 Help

FileMaker Pro 16 Help
Like • Show 0 Likes0
Actions
philmodjunk @ daniel_the_manual on Jun 29, 2017 3:55 PM
When you use Insert From URL for an FTP upload, the step inserts the response back from the FTP site. Thus, this is not a download into FMP--though the step can do that as well, but an upload to the FTP site.
Like • Show 0 Likes0
Actions
darkchoc May 8, 2018 2:17 PM
In response to OP...Unfortunately, Insert from URL does not support the SFTP protocol. It does support FTP and FTPS.
2 people found this helpful
Like • Show 0 Likes0
Actions
ThierryGuemboura May 8, 2018 2:27 PM
What about a free program like FileZilla server. I just wrote a document https://community.filemaker.com/docs/DOC-9041 that you ,might find interesting. Combine with Using FileZilla for FTP/SFTP - Media Temple you should be able to do the trick for free.
Like • Show 0 Likes0
Actions
fmpdude @ darkchoc on May 8, 2018 3:28 PM
Sure, but if you do an INSERT FROM URL to a micro-service, that micro-service can do anything you want and transfer any data back to FileMaker you want. Text data, binary data, whatever.

Don't let FileMaker get in your way.

Plus with the service approach, you're free to use that SFTP logic for any other HTTP-enabled application.

Sent from (https://protonmail.com), Swiss-based encrypted email.

‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
Like • Show 0 Likes0
Actions
bigtom @ fmpdude on May 8, 2018 5:13 PM
It is a mystery why FM does not support SFTP.
Like • Show 0 Likes0
Actions
monkeybreadsoftware @ bigtom on May 8, 2018 11:54 PM
It's a consequence.
CURL in FileMaker uses native SSL, but SFTP needs LibSSH and so you can't enable SFTP when using native SSL.
MBS FileMaker Plugin brings it's own SSL, so we can include LibSSH and offer much more SSL configuration options.
3 people found this helpful
Like • Show 1 Like1
Actions
skywillmott @ darkchoc on May 9, 2018 2:41 AM
Unfortunately the OP has said that plugins and 3rd party software is forbidden, but in any case I have had success with using BaseElements plugin to upload with SFTP... works nice. And if the BaseElements plugin is installed on FileMaker Server, then can be used with Perform Script on Server which is cool - good for FileMaker Go and WebDirect as well as FMPro without plugins, and it's 'free to use' :-)

The BaseElements function is 'BE_FTP_Upload' - BE_FTP_Upload – BaseElements Plugin Help Centre

One thing to watch out for that I noticed when comparing using this for SFTP compared to regular old FTP was that the path on the server was different... For FTP in a situation I was testing on, the path was just:
ftp://serverAddress/public_html/myDestinationFolder/myFile
whereas with SFTP it needed the full path of:
sftp://serverAddress/home/myuseraccount/public_html/myDestinationFolder/myFile
On Mac, I use the good old dog 'Fetch' for drag and drop FTP/SFTP and it has a 'Path' button you can click when you are viewing the contents of your destination folder to show you the path you are at.

Would love to see native SFTP support with 'Insert from URL' script step and Christian Schmitz's info on why it is not is good to know :-)
Like • Show 2 Likes2
Actions
fmpdude @ bigtom on May 9, 2018 4:14 AM
Don't let FileMaker get in your way!

There are workarounds. Great free third party libraries for Java/micro-services, plug-in support for FileMaker, etc.

But if the OP paints himself into a corner with "no third party software" and "no plug-ins", that's his call.

My clients want and expect ... functionality.

Below is an example I did using FMP as a test for regular FTP (note SFTP is a minor change to what I've already done). I used a micro-service for the FTP implementation since other HTTP-enabled programs in normal heterogeneous program environments want/need to use (S)FTP functionality, not just FMP. This FMP sample took about 15 minutes to complete.

(In the sample below, the binary output from a container field streams to the micro-service with no local disk file created or needed.)

I posted a video of this FTP sample working, here: https://community.filemaker.com/videos/3063?commentID=33627#comment-33627

Good luck.
1 person found this helpful
Like • Show 1 Like1
Actions
darkchoc @ fmpdude on May 9, 2018 6:03 AM
I suspect that all of our clients desire functionality, but often times they also have corporate IT policies that prohibit installing plug-ins or any third-party software. In these cases, it is helpful to know what FileMaker does and does not support.
1 person found this helpful
Like • Show 0 Likes0
Actions
monkeybreadsoftware @ darkchoc on May 9, 2018 6:07 AM
A couple of really big cooperations have no problem with plugins.
Maybe it's time to make a list.

And for some clients, they simply install plugin with installing FileMaker in one step (copy plugin file into right folder after running fm installation via script).
2 people found this helpful
Like • Show 0 Likes0
Actions
fmpdude @ darkchoc on May 9, 2018 6:17 AM
I hardly consider "Java" third party software in the sense you seem to be implying. Java is the #1 programming language, and has been, for over a decade. Java is also open source.

Every Fortune 500 company I've worked with uses Java heavily.

(I've never worked with a Fortune 500 company who uses FileMaker, however.)

YMMV
Like • Show 0 Likes0
Actions
ThierryGuemboura @ fmpdude on May 9, 2018 6:29 AM
Some Fortune 500 companies do use FileMaker though, Lockheed Martin, Pratt & Whitney, etc...
Like • Show 0 Likes0
Actions
monkeybreadsoftware May 9, 2018 6:33 AM
And if you get a newsletter from FileMaker, you can check what they used to send it with...
They use a couple of plugins internally for their own solutions.
Like • Show 0 Likes0
Actions
darkchoc @ monkeybreadsoftware on May 9, 2018 6:42 AM
I realize that some have a vested interest in promoting plug-ins. I am not making a case for or against using plug-ins. I am simply pointing out that as developers we don't always have that option, even when working with our Fortune 500 clients.
1 person found this helpful
Like • Show 0 Likes0
Actions
fmpdude @ darkchoc on May 9, 2018 8:57 AM
Though I'm a huge MBS fan, and Christian will do everything reasonable to support you, you should also understand that the Java and micro-service route is free, you control the code, any HTTP enabled app can use it, that service code can run from anywhere, for virtually any number of users, etc.

If you don't know how to write code, and don't have time or desire to learn, the MBS route is terrific as Christian has already done all the work for you.

Since FileMaker itself is a "third-party" application in the same way Java is, you might want to check your IT department as Java is about as vanilla as you can get.

(I would have finished this SFTP project in less than 30 minutes ==> Happy Client. Moving on to other requirements...)
Like • Show 0 Likes0
Actions
ThierryGuemboura May 9, 2018 12:50 PM
I understand you have order not to develop with plugins but time is money and for $149, your problem could be solved with MBS plugin. I am not married nor in cahoots with monkeybreadsoftware Christian but I have to admit that MBS plugin is efficient
Like • Show 0 Likes0
Actions
ksproul May 10, 2018 6:25 AM
Hello

I use FTPEEK from 360works. I love the product.

360works.com

Keith
Like • Show 0 Likes0
Actions
aknudsen @ daniel_the_manual on May 10, 2018 7:29 AM
The no 3rd party or plugin sounds more like politics than risk. Any other development tool would use a 3rd party or a plugin for that function. In VB they're called controls, in Python they're called modules. Same same

I use the MBS plugin to push and pull from some 20 SQL servers nation wide, on a schedule, with new SQL servers being stood up on a regular basis. Imagine if I had to manage ODBC connections for all of these. For importing from these SQL servers I use the MBS Hash and Quicklist functions to filter and direct data into separate tables. My biggest hash table has 105 k values and the MBS have no problem parsing this stuff.

My use cases are probably very different from most of you, but the MBS has been invaluable. I wouldn't have been possible in native FM.

My point here is that any other tool either use a plugin, module or control. If this is a risk/security issue then I would use the arguments that every tool is using 3rd party code one way or another.

I work in a very large enterprise with a lot of red tape and regulations.

Christian has been great in supporting his product. The license is perpetual so if you decide not to upgrade you'll still have a working plugin.
1 person found this helpful
Like • Show 2 Likes2
Actions
fmpdude @ aknudsen on May 10, 2018 8:46 AM
Or, writing a small micro-service where you control all the code using the #1 programming language and standard framework seems like a no-brainier to me.
Like • Show 0 Likes0
Actions
michibell Nov 28, 2018 12:35 AM
Hi,
and again, the MBS Plugin solved my problem in minutes. My question was answered within two hours from Mr. Schmitz via email and it works perfect. For me and my company it's worth every cent.

Regards
Michael
Like • Show 1 Like1
Actions
fmpdude @ michibell on Nov 28, 2018 3:23 AM
I agree, MBS is a nice utility.

Yet, with about the same number of lines of code on the service side (not that "lines of code number" is really that important a metric), possibly fewer, and depending on your programming background, you can do the same thing, for free that can be used not only by FMP but by any other HTTP-enabled application. No user limit. No license terms, ...

Below is a working example I did in about 15 minutes from scratch:
(only one line of code needed in FMP)
Like • Show 0 Likes0
Actions

Incoming Links

Re: Best way to use FileMaker as a backend for a website

FileMaker Pro to SFTP Server

Outcomes

Related Content

Recommended Content

Incoming Links