In the past few days, i have observed these two things that cause FileMaker Advanced to go into a non-responding mode requiring a Force-Quit...
1. Execute the Upload to Server command when a database is open, and respond affirmatively to the prompt that says the file will be closed before it will be updated. The file closes, and the Upload to Server dialog box never appears. After a Force-Quit, the file can be uploaded without a problem the way it was in previous versions of FileMaker Advanced.
(Assume you meant to say "before it will be uploaded.")
I saw problem #1 once or twice a while ago, have not seen it in last couple of months. In all my recent experience, I select "upload to server", file closes, I pick the server and authenticate and file gets uploaded.
Alas, I have no idea what I did (if anything) that caused problem to go away. Using same versions of macOS (10.12.2) that you are using, but am using FileMaker Advanced 184.108.40.206, which 'Check for Updates' reports is the latest version. Beta problem perhaps?