12 Replies Latest reply on Apr 2, 2014 11:26 AM by philmodjunk

    Import Records (http and httppost) limitation

    5104117733

      Summary

      Import Records (http and httppost) limitation

      Product

      FileMaker Pro

      Version

      13

      Operating system version

      MacOs Mavericks

      Description of the issue

      Using the script step "Import Records" using httppost does not execute (returns error 717).
      it works fine when the posted data is short enough, but it breaks when you try to post longer data.

      Steps to reproduce the problem

      • create a script
      • add "import record" script step
      • set options:
         • specify datasource: xml data
         • specify xml datasource: Calculation:
      "httppost://anyurl.com/api?d=WyAJCXsic3luY19pZCI6ICJCN0RBMzJFOS01MkQyLTREOTItQUFCNS0zMjJBQTMxMjM5NjAiLCAiaWQiOiAiNDk2OCIsICJ0aW1lc3RhbXAiOiAiNC4xMi4yMDEzIDk6NTM6MzYgVWhyIiwgImRhdGUiOiAiMjIuMTEuMjAxMyIsICJ0aW1lX3N0YXJ0IjogIiIsICJ0aW1lX3N0b3AiOiAiIiwgInRpbWVfZHVyYXRpb24iOiAiLjYiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAiVGVzdCBOb3RpejwvYnI+IiwgInN5bmNoc3RhdGUiOiAicHJvZyIgfSAsIAkJeyJzeW5jX2lkIjogIjBFRjk2MDU0LUExQjktNEE1My1CODJBLTNBNzk1NjkwMTVEMiIsICJpZCI6ICI0OTY5IiwgInRpbWVzdGFtcCI6ICI2LjEyLjIwMTMgMDowMDowMyBVaHIiLCAiZGF0ZSI6ICIyMi4xMS4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIyIiwgImZrX3VzZXJfaWQiOiAiIiwgImZrX3Byb2plY3RfaWQiOiAiIiwgImZrX2FkZHJlc3NfaWQiOiAiIiwgImZrX2FydGljbGVfaWQiOiAiIiwgIm5vdGVzIjogImludGVybiBCdWVybyBOb3RpeiIsICJzeW5jaHN0YXRlIjogInByb2ciIH0gLCAJCXsic3luY19pZCI6ICI2QkZEMTA2Qy00OTkzLTQ4RDEtODhDNy00QjhBRjU5NkE4NzUiLCAiaWQiOiAiNDk3MCIsICJ0aW1lc3RhbXAiOiAiMjIuMTEuMjAxMyAxNjo0NjozNiBVaHIiLCAiZGF0ZSI6ICIyMi4xMS4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIuNzUiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAiRXJidm9yYmV6dWcsIE5vdGl6IiwgInN5bmNoc3RhdGUiOiAicHJvZyIgfSAsIAkJeyJzeW5jX2lkIjogIjQ1QkMzNzI2LTM0MkEtNEYxNy04RDhELUQ5OEU3NjQzRkI2QyIsICJpZCI6ICI1MDM1IiwgInRpbWVzdGFtcCI6ICI2LjEyLjIwMTMgMTE6MTU6MjggVWhyIiwgImRhdGUiOiAiNi4xMi4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAiYWEiLCAic3luY2hzdGF0ZSI6ICJwcm9nIiB9ICwgCQl7InN5bmNfaWQiOiAiQjk4RjUzNDktQzM5My00OTU2LTg2OUQtMDBGMjNDOTgzRkQ0IiwgImlkIjogIjUwMzYiLCAidGltZXN0YW1wIjogIjYuMTIuMjAxMyAxMToxNTozMCBVaHIiLCAiZGF0ZSI6ICI2LjEyLjIwMTMiLCAidGltZV9zdGFydCI6ICIiLCAidGltZV9zdG9wIjogIiIsICJ0aW1lX2R1cmF0aW9uIjogIiIsICJma191c2VyX2lkIjogIiIsICJma19wcm9qZWN0X2lkIjogIiIsICJma19hZGRyZXNzX2lkIjogIiIsICJma19hcnRpY2xlX2lkIjogIiIsICJub3RlcyI6ICJ2dnZ2IiwgInN5bmNoc3RhdGUiOiAicHJvZyIgfSAsIAkJeyJzeW5jX2lkIjogIjIyQ0E3NkY1LUU5NTUtNDVDQy05MTU0LTQ3QTcxMDRDNTNGMSIsICJpZCI6ICI1MDM3IiwgInRpbWVzdGFtcCI6ICI2LjEyLjIwMTMgMTE6NDg6NDAgVWhyIiwgImRhdGUiOiAiNi4xMi4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAic3NzIiwgInN5bmNoc3RhdGUiOiAicHJvZyIgfSAsIAkJeyJzeW5jX2lkIjogIjIwQ0QzQTQ5LTRCOTItNEM3QS05NzAxLTk5Mzc5RkU3NjM2QSIsICJpZCI6ICI1MDM4IiwgInRpbWVzdGFtcCI6ICI2LjEyLjIwMTMgMTE6NDg6NDIgVWhyIiwgImRhdGUiOiAiNi4xMi4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAiZGRkIiwgInN5bmNoc3RhdGUiOiAicHJvZyIgfSAsIAkJeyJzeW5jX2lkIjogIjg3OUI2MDgzLTk3QUUtNDg4NS1CNzBGLURERkE4Nzc4NjZDNiIsICJpZCI6ICI1MDM5IiwgInRpbWVzdGFtcCI6ICI2LjEyLjIwMTMgMTE6NDg6NDQgVWhyIiwgImRhdGUiOiAiNi4xMi4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAiY2NjYyIsICJzeW5jaHN0YXRlIjogInByb2ciIH0gXQ=="

      ( whereas the data sent is a base64 encoded json object! )

      • run script

      Expected result

      The "import records" request should post the parameter "d" to "http://anyurl.com/api" and import the received xml into a specified table.

      Actual result

      • Nothing is sent to the server (debugged the incoming traffic there as well)
      • No records get imported

      Exact text of any error message(s) that appear

      The script step returns the error 717

      Workaround

      THERE IS NO WORKAROUND!!

      please fix this.
      (POST request lengths are not limited, as the data is sent within the header)
      (GET requests are nowadays limited around 2500 characters, but it depends on the server)

        • 1. Re: Import Records (http and httppost) limitation
          TSGal

               Bruno Bachmann:

               Thank you for your post.

               I have forwarded your entire post to our Development and Testing departments for review.  When I receive any feedback, I will let you know.

               TSGal
               FileMaker, Inc.

          • 2. Re: Import Records (http and httppost) limitation
            TSGal

                 Bruno Bachmann:

                 Since error 717 says there is not enough XML/XSL information to proceed with the import or export, one of our Technical Support technicians suggested creating a field to accept the XML and then use the script step "Insert from URL" to see what information (if any) is accepted.

                 TSGal
                 FileMaker, Inc.

            • 3. Re: Import Records (http and httppost) limitation
              5104117733

                   Thanks for your answer. As I use the script step "Insert from URL" the provided xml from the website gets inserted correctly into the field. In fact, the script above works well with less data attached ( e.g. as I only send a smaller base64 encoded json object through the post request ).

                   you can reproduce the error as described below: (working urls for now)

                     
              •           A database containing the fields 

                   _sync_error_code (type number)

                   and

                   _sync_error_msg (type text)

                     
              •           Create a script with the script step "Import Records", Specify Datasource: XML-Data, XML-Datasource (Calculation): "httppost://api.flexbuero.ch/labor/FileMakerXmlTest/xml.php", use XSL style sheet (Calculation): "http://api.flexbuero.ch/labor/FileMakerXmlTest/xslt.php"

                   This works properly and imports 5 records into the database.

                    

                   as I attach a parameter and send it through a post request the error 717 occurs:

                   Specify XML-Data source (Calculation):

                   "httppost://api.flexbuero.ch/labor/FileMakerXmlTest/xml.php?d=WyAJCXsic3luY19pZCI6ICJCN0RBMzJFOS01MkQyLTREOTItQUFCNS0zMjJBQTMxMjM5NjAiLCAiaWQiOiAiNDk2OCIsICJ0aW1lc3RhbXAiOiAiNC4xMi4yMDEzIDk6NTM6MzYgVWhyIiwgImRhdGUiOiAiMjIuMTEuMjAxMyIsICJ0aW1lX3N0YXJ0IjogIiIsICJ0aW1lX3N0b3AiOiAiIiwgInRpbWVfZHVyYXRpb24iOiAiLjYiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAiVGVzdCBOb3RpejwvYnI-IiwgInN5bmNoc3RhdGUiOiAicHJvZyIgfSAsIAkJeyJzeW5jX2lkIjogIjBFRjk2MDU0LUExQjktNEE1My1CODJBLTNBNzk1NjkwMTVEMiIsICJpZCI6ICI0OTY5IiwgInRpbWVzdGFtcCI6ICI2LjEyLjIwMTMgMDowMDowMyBVaHIiLCAiZGF0ZSI6ICIyMi4xMS4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIyIiwgImZrX3VzZXJfaWQiOiAiIiwgImZrX3Byb2plY3RfaWQiOiAiIiwgImZrX2FkZHJlc3NfaWQiOiAiIiwgImZrX2FydGljbGVfaWQiOiAiIiwgIm5vdGVzIjogImludGVybiBCdWVybyBOb3RpeiIsICJzeW5jaHN0YXRlIjogInByb2ciIH0gLCAJCXsic3luY19pZCI6ICI2QkZEMTA2Qy00OTkzLTQ4RDEtODhDNy00QjhBRjU5NkE4NzUiLCAiaWQiOiAiNDk3MCIsICJ0aW1lc3RhbXAiOiAiMjIuMTEuMjAxMyAxNjo0NjozNiBVaHIiLCAiZGF0ZSI6ICIyMi4xMS4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIuNzUiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAiRXJidm9yYmV6dWcsIE5vdGl6IiwgInN5bmNoc3RhdGUiOiAicHJvZyIgfSAsIAkJeyJzeW5jX2lkIjogIjQ1QkMzNzI2LTM0MkEtNEYxNy04RDhELUQ5OEU3NjQzRkI2QyIsICJpZCI6ICI1MDM1IiwgInRpbWVzdGFtcCI6ICI2LjEyLjIwMTMgMTE6MTU6MjggVWhyIiwgImRhdGUiOiAiNi4xMi4yMDEzIiwgInRpbWVfc3RhcnQiOiAiIiwgInRpbWVfc3RvcCI6ICIiLCAidGltZV9kdXJhdGlvbiI6ICIiLCAiZmtfdXNlcl9pZCI6ICIiLCAiZmtfcHJvamVjdF9pZCI6ICIiLCAiZmtfYWRkcmVzc19pZCI6ICIiLCAiZmtfYXJ0aWNsZV9pZCI6ICIiLCAibm90ZXMiOiAiYWEiLCAic3luY2hzdGF0ZSI6ICJwcm9nIiB9ICwgCQl7InN5bmNfaWQiOiAiQjk4RjUzNDktQzM5My00OTU2LTg2OUQtMDBGMjNDOTgzRkQ0IiwgImlkIjogIjUwMzYiLCAidGltZXN0YW1wIjogIjYuMTIuMjAxMyAxMToxNTozMCBVaHIiLCAiZGF0ZSI6ICI2LjEyLjIwMTMiLCAidGltZV9zdGFydCI6ICIiLCAidGltZV9zdG9wIjogIiIsICJ0aW1lX2R1cmF0aW9uIjogIiIsICJma191c2VyX2lkIjogIiIsICJma19wcm9qZWN0X2lkIjogIiIsICJma19hZGRyZXNzX2lkIjogIiIsICJma19hcnRpY2xlX2lkIjogIiIsICJub3RlcyI6ICJ2dnZ2IiwgInN5bmNoc3RhdGUiOiAicHJvZyIgfSBd&a=eyAJCSJhcGlfa2V5IiA6ICIxMjM0IiwgCQkic2hhcmVkX3NlY3JldCIgOiAiMjIiLCAJCSJjbGllbnRfaWQiIDogIjEiIH0g&a="

                    

                   While writing this post I noticed the following:

                   As i try to enter the Url in the HTTP request field (not in the calculation field) a display pops up which says: "The length of the selected text cannot exceed 2048 character(s).". Obviously this is a limitation due to the get request in urls which is not required for post requests. post requests can contain larger data.

                   Hope this helps you to reproduce the error.

                   I'm looking forward to hearing from you soon.

                   Regards Roman Lickel, Bachmann Support GmbH

              • 4. Re: Import Records (http and httppost) limitation
                TSGal

                     Bruno Bachmann:

                     Thank you for the information.  The information has been appended to the original report.  It does  appear the 2048 character limit is also imposed.  I'll keep you updated when I receive feedback.

                     TSGal
                     FileMaker, Inc.

                • 5. Re: Import Records (http and httppost) limitation
                  TSGal

                       Bruno Bachmann:

                       Until I receive feedback from Development/Testing, one of our Technical Support agents devised a workaround.  In essence, use Insert from URL into a field, export the field contents to an XML file, and then import records using the XML file.

                       A database file has been created with your example above, and I have sent it to our Technical Support contact.  You should receive an reply from him soon.  If you don't receive he file within the next hour, please let me know, and I'll make sure the file is sent to you immediately.

                       TSGal
                       FileMaker, Inc.

                  • 6. Re: Import Records (http and httppost) limitation
                    philmodjunk

                         TSGal, I'm having trouble deciding whether to write this one up as a bug in the Known Bugs List or not. Your thoughts?

                    • 7. Re: Import Records (http and httppost) limitation
                      TSGal

                           PhilModJunk:

                           At this point, I haven't heard from Development/Testing whether this is a product issue or a product limitation.  If this is a product limitation, it will need to be documented (future documentation, Knowledge Base Article, etc.).

                           TSGal
                           FileMaker, Inc.

                      • 8. Re: Import Records (http and httppost) limitation
                        philmodjunk

                             And I sometimes put "limitations" in the Known Bugs List as well. Not to disagree with how it's categorized, but so that others that might encounter the issue will find it if they search the DB for information...

                        • 9. Re: Import Records (http and httppost) limitation
                          TSGal

                               Bruno Bachmann (et al):

                               Testing has confirmed it is a FileMaker issue, and the information has been forwarded to Development for additional review.

                               TSGal
                               FileMaker, Inc.

                          • 10. Re: Import Records (http and httppost) limitation
                            philmodjunk
                            An entry in the Known Bugs List has been linked to this Issue Report. Any Comments/Questions/Suggested Corrections should be posted here or in a new thread. Please do not post such comments to the Known Bugs List thread.
                            • 11. Re: Import Records (http and httppost) limitation
                              TSGal

                                   All:

                                   This has been fixed in FileMaker Pro 13.0v2.  You can download the update through Knowledge Base Article #13313:

                              http://help.filemaker.com/app/answers/detail/a_id/13313/

                                   TSGal
                                   FileMaker, Inc.

                              • 12. Re: Import Records (http and httppost) limitation
                                philmodjunk

                                     Known Bugs List has been updated. An updated DB should be ready for download by Friday.