Thank you for your post.
The main issue with Small Business Server 2008 is to not run Sharepoint services on the same computer, so be sure to remove Sharepoint from the server.. In addition, make sure the directory where the files are located have full read/write privileges. Otherwise, FileMaker Pro will not run.
Out of curiosity, does sharepoint need to be removed if you don't publish the database to the web?