I cannot reproduce this in WIndows 7 with FileMaker 13.03 advanced. When I open a file in Kiosk mode and click a button set up with "Exit Application". it quits FileMaker Pro.
There is a script triggered from the last window close that executed after the button script, I added Exit Application as the last step in this script and now it works. Thank you for the double check.