3 Replies Latest reply on Sep 4, 2013 10:35 AM by philmodjunk

    FMS 11 crashes intermittently (after DebugSymbols crash)

    GregerSundin

      Summary

      FMS 11 crashes intermittently (after DebugSymbols crash)

      Product

      FileMaker Server

      Version

      FileMaker Server 11 (11.0.5.510)

      Operating system version

      Mac OSX server Lion 10.7.5

      Description of the issue

      The last few months, the fmserver deamon has started to crash intermittently, sometimes three times per day, sometimes after ten days. What I have noticed from the system logs is that every time, the crash is directly preceded (within seconds) by "ReportCrash: DebugSymbols was unable to start a spotlight query: spotlight is not responding or disabled". This DebugSymbols-crash does never occur alone without the crashed fmserverd.

      The crashed threads in the crash report for fmserverd varies from each occasion (sometimes it states "Dispatch queue: com.apple.root.default-priority" by the crashed thread as in the example below), but the crash leaves no record in the fmserver-log.
      I have excluded most of the the hd from Spotlight (the user dirs and Library dir, etc.) and deactivated TimeMachine to no avail. I have also ran Apple Hardware Test on the machine and MemTest, none of which show any hardware problems (I suspected a faulty memory module, but that doesn't seem to be the case).

      I am starting to run out of options. Since this is a production server, I have had limited possibilities to run extended tests during office hours. Does anyone have experience in this error and can provide some assistance?

      Steps to reproduce the problem

      I cannot reproduce.

      Expected result

      N/A

      Actual result

      N/A

      Exact text of any error message(s) that appear

      ---------------
      // System.log #example
      ---------------
      2013-09-02 10:29:56,232 ReportCrash: DebugSymbols was unable to start a spotlight query: spotlight is not responding or disabled.
      2013-09-02 10:30:02,847 ReportCrash: Saved crash report for fmserverd[222] version ??? (???) to /Library/Logs/DiagnosticReports/fmserverd_2013-09-02-103002_localhost.crash


      ----------------
      // CrashReporter #example
      ----------------

      Process:         fmserverd [222]
      Path:            /Library/FileMaker Server/*/fmserverd
      Identifier:      fmserverd
      Version:         ??? (???)
      Code Type:       X86 (Native)
      Parent Process:  launchd [1]

      Date/Time:       2013-09-02 10:29:55.379 +0200
      OS Version:      Mac OS X Server 10.7.5 (11G63)
      Report Version:  9

      Crashed Thread:  62  Dispatch queue: com.apple.root.default-priority

      Exception Type:  EXC_BAD_ACCESS (SIGBUS)
      Exception Codes: KERN_PROTECTION_FAILURE at 0x0000000000000000

      VM Regions Near 0:
      --> __PAGEZERO             0000000000000000-0000000000001000 [    4K] ---/--- SM=NUL  /Library/FileMaker Server/*
          __TEXT                 0000000000001000-000000000001b000 [  104K] r-x/rwx SM=COW  /Library/FileMaker Server/*

      Application Specific Information:
      objc[222]: garbage collection is OFF

      Thread 0:: Dispatch queue: com.apple.main-thread
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   fmserverd                          0x0000f9e8 ServerApp::OnRun() + 48
      6   com.filemaker.FMS.framework        0x001f2865 FMS::AppBase::StartService() + 85
      7   fmserverd                          0x0000dbfe main + 324
      8   fmserverd                          0x00002a6e start + 54

      Thread 1:: Dispatch queue: com.apple.libdispatch-manager
      0   libsystem_kernel.dylib             0x935e990a kevent + 10
      1   libdispatch.dylib                  0x94453e04 _dispatch_mgr_invoke + 969
      2   libdispatch.dylib                  0x94452853 _dispatch_mgr_thread + 53

      Thread 2:
      0   libsystem_kernel.dylib             0x935e8bb2 __semwait_signal + 10
      1   libsystem_c.dylib                  0x9ace17b9 nanosleep$UNIX2003 + 187
      2   com.filemaker.support.framework     0x0167072c Draco::Thread::Sleep(unsigned long) + 172
      3   com.filemaker.support.framework     0x01670b2c Draco::TimerCheckThread::Main() + 252
      4   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 3:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.support.framework     0x01600b56 Draco::DebugThread::Main() + 70
      6   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      7   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      8   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      9   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 4:
      0   libsystem_kernel.dylib             0x935e9d4e __read + 10
      1   com.filemaker.FMS.framework        0x001d46fc SignalThread::Main() + 124
      2   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      3   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      4   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      5   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 5:
      0   libsystem_kernel.dylib             0x935e6c22 mach_msg_trap + 10
      1   libsystem_kernel.dylib             0x935e61f6 mach_msg + 70
      2   com.apple.CoreFoundation           0x9a7469da __CFRunLoopServiceMachPort + 170
      3   com.apple.CoreFoundation           0x9a74fb04 __CFRunLoopRun + 1428
      4   com.apple.CoreFoundation           0x9a74f1dc CFRunLoopRunSpecific + 332
      5   com.apple.CoreFoundation           0x9a75ff01 CFRunLoopRun + 129
      6   com.filemaker.support.framework     0x0166c142 Draco::RunLoopThread::Main() + 162
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 6:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.omniorb4.framework     0x011baf80 omni_condition::wait() + 38
      4   com.filemaker.omniorb4.framework     0x010e3e41 omni::ORBAsyncInvoker::perform(unsigned long, unsigned long) + 145
      5   com.filemaker.omniorb4.framework     0x010e3292 omniOrbORB::run() + 172
      6   com.filemaker.FMS.framework        0x001f0ca0 FMS::RunORBThread::Main() + 48
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 7:
      0   libsystem_kernel.dylib             0x935e8b42 __select + 10
      1   com.filemaker.omniorb4.framework     0x011c2962 omni::SocketCollection::Select() + 544
      2   com.filemaker.omniorb4.framework     0x011ccc82 omni::tcpEndpoint::AcceptAndMonitor(void (*)(void*, omni::giopConnection*), void*) + 136
      3   com.filemaker.omniorb4.framework     0x011313ff omni::giopRendezvouser::execute() + 159
      4   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      5   com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      6   com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      7   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      8   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 8:
      0   libsystem_kernel.dylib             0x935e8b42 __select + 10
      1   com.filemaker.omniorb4.framework     0x011c2962 omni::SocketCollection::Select() + 544
      2   com.filemaker.omniorb4.framework     0x011ccc82 omni::tcpEndpoint::AcceptAndMonitor(void (*)(void*, omni::giopConnection*), void*) + 136
      3   com.filemaker.omniorb4.framework     0x011313ff omni::giopRendezvouser::execute() + 159
      4   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      5   com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      6   com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      7   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      8   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 9:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   fmserverd                          0x000083ee FMS::ComponentMgrThread::Main() + 56
      6   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      7   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      8   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      9   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 10:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.FMS.framework        0x0025c24e FMS::LifeLineThread::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 11:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.PrefsMgr.framework     0x0035128e PreferencesMgr::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 12:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace13e0 pthread_cond_timedwait$UNIX2003 + 70
      3   com.filemaker.omniorb4.framework     0x011baff5 omni_condition::timedwait(unsigned long, unsigned long) + 63
      4   com.filemaker.omniorb4.framework     0x01137d43 omni::Scavenger::execute() + 179
      5   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      6   com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      7   com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      8   com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 13:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.EventLogWriter.framework     0x00140c6e PlainTextLog::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 14:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 15:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.StatsLogWriter.framework     0x00396f3e StatsLog::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 16:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.AuthMgr.framework     0x0187c80e AuthMgr::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 17:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.DirServiceMgr.framework     0x000806ee DirServiceMgr::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 18:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.AdminMgr.framework     0x0004bc0e AdminMgr::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 19:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.EngineMgr.framework     0x000ab1de EngineMgr::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 20:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 21:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.FMS.framework        0x0022b401 FMS::ComponentBaseThread::Main() + 161
      6   com.filemaker.SchedulesMgr.framework     0x0037b32e SchedulesMgr::Main() + 334
      7   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      8   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      9   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      10  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 22:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.EngineMgr.framework     0x000dbaa7 EngineMgr::DatabaseThread::Main() + 103
      6   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      7   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      8   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      9   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 23:
      0   libsystem_kernel.dylib             0x935e990a kevent + 10
      1   com.filemaker.AdminMgr.framework     0x00052705 DirectoryMonitorThread::Main() + 117
      2   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      3   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      4   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      5   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 24:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.EngineMgr.framework     0x00090c93 StatsMgr::Main() + 163
      6   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      7   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      8   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      9   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 25:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.dbengine.framework     0x003ac230 Draco::HBEngine::HBEngineThread::Main() + 128
      6   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      7   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      8   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      9   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 26:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.dbengine.framework     0x004af0d7 Draco::DBEngineThread::Main() + 135
      6   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      7   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      8   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      9   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 27:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166fe75 Draco::MsgQ::GetMsg() + 69
      5   com.filemaker.dbengine.framework     0x0051b9e8 Draco::DBLockContinueThread::Main() + 648
      6   com.filemaker.support.framework     0x0166ce4e Draco::Thread::RunThread() + 46
      7   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      8   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      9   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 28:: com.apple.CFSocket.private
      0   libsystem_kernel.dylib             0x935e8b42 __select + 10
      1   com.apple.CoreFoundation           0x9a79de15 __CFSocketManager + 1557
      2   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      3   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 29:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 30:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.omniorb4.framework     0x011baf80 omni_condition::wait() + 38
      4   com.filemaker.omniorb4.framework     0x0113b1da omni::giopStream::sleepOnRdLockAlways() + 68
      5   com.filemaker.omniorb4.framework     0x0112f4e9 omni::giopImpl12::inputReplyBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 127
      6   com.filemaker.omniorb4.framework     0x011300cb omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 49
      7   com.filemaker.omniorb4.framework     0x011227f0 omni::GIOP_C::ReceiveReply() + 104
      8   com.filemaker.omniorb4.framework     0x011bcec1 omniRemoteIdentity::dispatch(omniCallDescriptor&) + 299
      9   com.filemaker.omniorb4.framework     0x0119f9cd omniObjRef::_invoke(omniCallDescriptor&, bool) + 291
      10  com.filemaker.dbengine.framework     0x003f9a98 _objref_RPO::Notify(unsigned long, OctetSeq const&, OctetSeq_out) + 184
      11  com.filemaker.dbengine.framework     0x00406d7c Draco::RCConnection::Send(unsigned long, unsigned char*&, unsigned long&, bool) + 524
      12  com.filemaker.dbengine.framework     0x00407d56 Draco::RCNetworkStack::SendingThread::Main() + 86
      13  com.filemaker.support.framework     0x0166f448 Draco::RepThread::RunThread() + 56
      14  com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      15  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      16  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 31:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 32:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 33:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 34:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 35:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 36:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 37:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 38:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 39:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 40:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 41:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 42:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace13e0 pthread_cond_timedwait$UNIX2003 + 70
      3   com.filemaker.omniorb4.framework     0x011baff5 omni_condition::timedwait(unsigned long, unsigned long) + 63
      4   com.filemaker.omniorb4.framework     0x01142fa0 omniAsyncWorker::real_run() + 454
      5   com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      6   com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      7   com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      8   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      9   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 43:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 44:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 45:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 46:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 47:
      0   libsystem_kernel.dylib             0x935e883e __psynch_cvwait + 10
      1   libsystem_c.dylib                  0x9ad30e21 _pthread_cond_wait + 827
      2   libsystem_c.dylib                  0x9ace142c pthread_cond_wait$UNIX2003 + 71
      3   com.filemaker.support.framework     0x0166f25f Draco::Semaphore::P(Draco::Thread*) + 159
      4   com.filemaker.support.framework     0x0166f46a Draco::RepThread::RunThread() + 90
      5   com.filemaker.support.framework     0x0166e118 Draco::Thread::ThreadUnixProc(void*) + 72
      6   libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      7   libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 48:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 49:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 50:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 51:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 52:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 53:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 54:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 55:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 56:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 57:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 58:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 59:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 60:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 61:
      0   libsystem_kernel.dylib             0x935e8a9a __recvfrom + 10
      1   libsystem_c.dylib                  0x9ace14a2 recv$UNIX2003 + 54
      2   com.filemaker.omniorb4.framework     0x011cc509 omni::tcpConnection::Recv(void*, unsigned long, unsigned long, unsigned long) + 357
      3   com.filemaker.omniorb4.framework     0x0113b76a omni::giopStream::inputMessage() + 336
      4   com.filemaker.omniorb4.framework     0x0112fff5 omni::giopImpl12::inputNewServerMessage(omni::giopStream*) + 71
      5   com.filemaker.omniorb4.framework     0x01130148 omni::giopImpl12::inputMessageBegin(omni::giopStream*, void (*)(omni::giopStream*)) + 174
      6   com.filemaker.omniorb4.framework     0x01123dc6 omni::GIOP_S::dispatcher() + 96
      7   com.filemaker.omniorb4.framework     0x0113d9f2 omni::giopWorker::real_execute() + 1406
      8   com.filemaker.omniorb4.framework     0x0113daaa omni::giopWorker::execute() + 50
      9   com.filemaker.omniorb4.framework     0x01142f28 omniAsyncWorker::real_run() + 334
      10  com.filemaker.dbengine.framework     0x003fc3a6 threadCreateInterceptor(omni::omniInterceptors::createThread_T::info_T&) + 22
      11  com.filemaker.omniorb4.framework     0x01143134 omniAsyncWorker::run(void*) + 50
      12  com.filemaker.omniorb4.framework     0x011bbd0e omni_thread_wrapper + 160
      13  libsystem_c.dylib                  0x9ad2ced9 _pthread_start + 335
      14  libsystem_c.dylib                  0x9ad306de thread_start + 34

      Thread 62 Crashed:: Dispatch queue: com.apple.root.default-priority
      0   libobjc.A.dylib                    0x920bd098 (anonymous namespace)::AutoreleasePoolPage::AutoreleasePoolPage((anonymous namespace)::AutoreleasePoolPage*) + 22
      1   libobjc.A.dylib                    0x920bd027 objc_autoreleasePoolPush + 86
      2   com.apple.CoreFoundation           0x9a746b45 _CFAutoreleasePoolPush + 21
      3   libdispatch.dylib                  0x94452f97 _dispatch_worker_thread2 + 98
      4   libsystem_c.dylib                  0x9ad2eb24 _pthread_wqthread + 346
      5   libsystem_c.dylib                  0x9ad306fe start_wqthread + 30

      Thread 62 crashed with X86 Thread State (32-bit):
        eax: 0x920bd090  ebx: 0xb1050000  ecx: 0x00000000  edx: 0x00000000
        edi: 0x00000000  esi: 0x00000000  ebp: 0xb104ff38  esp: 0xb104ff00
         ss: 0x00000023  efl: 0x00010286  eip: 0x920bd098   cs: 0x0000001b
         ds: 0x00000023   es: 0x00000023   fs: 0x00000023   gs: 0x0000000f
        cr2: 0x00000000
      Logical CPU: 0

      Binary Images:
          0x1000 -    0x1afff +fmserverd (??? - ???) <0173523A-CC25-E3C4-BF29-51AA0873BDB3> /Library/FileMaker Server/*/fmserverd
         0x35000 -    0x62ffb +com.filemaker.AdminMgr.framework (AdminMgr version 11.0v4 - 11.0.4) /Library/FileMaker Server/*/AdminMgr.framework/Versions/A/AdminMgr
         0x7c000 -    0x84fe3 +com.filemaker.DirServiceMgr.framework (DirServiceMgr version 11.0v1 - 11.0.1) <701ACF67-88B9-F54D-511E-7248FEB9B627> /Library/FileMaker Server/*/DirServiceMgr.framework/Versions/A/DirServiceMgr
         0x8f000 -    0xfaff3 +com.filemaker.EngineMgr.framework (EngineMgr version 11.0v5 - 11.0.5) <9B3E6D27-B0B2-42B0-474B-938EC0BC99AA> /Library/FileMaker Server/*/EngineMgr.framework/Versions/A/EngineMgr
        0x13d000 -   0x146feb +com.filemaker.EventLogWriter.framework (EventLogWriter version 11.0v1 - 11.0.1) /Library/FileMaker Server/*/EventLogWriter.framework/Versions/A/EventLogWriter
        0x151000 -   0x18dffc +com.filemaker.FAL.framework (FAL version 11.0v1 - 11.0.1) <4BB5754F-09FE-0089-FAE5-09D7B4DBBD84> /Library/FileMaker Server/*/FAL.framework/Versions/A/FAL
        0x1bc000 -   0x2bdffb +com.filemaker.FMS.framework (FMS version 11.0v5 - 11.0.5) <5791AD2A-AA75-3667-CBA8-D5F2D5B20D92> /Library/FileMaker Server/*/FMS.framework/Versions/A/FMS
        0x348000 -   0x359ffb +com.filemaker.PrefsMgr.framework (PrefsMgr version 11.0v1 - 11.0.1) <884A30AF-7FC4-CF34-333A-6EF222F08DF8> /Library/FileMaker Server/*/PrefsMgr.framework/Versions/A/PrefsMgr
        0x366000 -   0x384feb +com.filemaker.SchedulesMgr.framework (SchedulesMgr version 11.0v1 - 11.0.1) <8B079AB8-E7DF-9C95-CB1B-D94E0844A059> /Library/FileMaker Server/*/SchedulesMgr.framework/Versions/A/SchedulesMgr
        0x395000 -   0x39aff3 +com.filemaker.StatsLogWriter.framework (StatsLogWriter version 11.0v1 - 11.0.1) <6114ED80-5E1A-D618-39F8-3D249B2861BF> /Library/FileMaker Server/*/StatsLogWriter.framework/Versions/A/StatsLogWriter
        0x3a3000 -   0xa0afe6 +com.filemaker.dbengine.framework (FileMaker DBEngine version 11.0.5 - 11.0.5) <36E1160D-5783-4212-0F37-C5FE51478122> /Library/FileMaker Server/*/DBEngine.framework/Versions/A/DBEngine
        0xcc9000 -   0xf49fef +com.filemaker.fmengine.framework (FileMaker FMEngine version 11.0.5 - 11.0.5) /Library/FileMaker Server/*/FMEngine.framework/Versions/A/FMEngine
      0x10c3000 -  0x126bfff +com.filemaker.omniorb4.framework (OmniORB4 version 4.1.3 - 4.1.3) /Library/FileMaker Server/*/OmniORB4.framework/Versions/A/OmniORB4
      0x1443000 -  0x157ffe3 +com.filemaker.openssl.framework (OpenSSL version 0.9.8i - 0.9.8i) /Library/FileMaker Server/*/OpenSSL.framework/Versions/A/OpenSSL
      0x15e7000 -  0x174eff9 +com.filemaker.support.framework (FileMaker Support version 11.0.5 - 11.0.5) <71666BDF-AEBB-0690-9838-2AE820F8D7BE> /Library/FileMaker Server/*/Support.framework/Versions/A/Support
      0x17e2000 -  0x1853ff7 +libetpan.13.dylib (15.2.0 - compatibility 15.0.0) <0B8A1B39-2883-CF87-9629-B2220E5FA991> /Library/FileMaker Server/*/libetpan.13.dylib
      0x1878000 -  0x1883ffb +com.filemaker.AuthMgr.framework (AuthMgr version 11.0v4 - 11.0.4) /Library/FileMaker Server/*/AuthMgr.framework/Versions/A/AuthMgr
      0x188e000 -  0x18c7ffb  libiodbc.2.dylib (4.18.0 - compatibility 4.0.0) <51AD48FC-F152-30D0-AB04-5197A5244B53> /usr/lib/libiodbc.2.dylib
      0x18d4000 -  0x1b66ffc +libxerces-c-3.0.dylib (??? - ???) <4852B70F-946F-0C8F-66D7-C7A02CFAD83F> /Library/FileMaker Server/*/libxerces-c-3.0.dylib
      0x1deb000 -  0x1decff1  com.apple.textencoding.unicode (2.4 - 2.4) <4E55D4B9-4E67-3FC9-9407-3E99D1D50F15> /System/Library/TextEncodings/Unicode Encodings.bundle/Contents/MacOS/Unicode Encodings
      0x1fe2000 -  0x1ff4fff  libTraditionalChineseConverter.dylib (54.0.0 - compatibility 1.0.0) /System/Library/CoreServices/Encodings/libTraditionalChineseConverter.dylib
      0x57eb000 -  0x57f7ffd  libiodbcinst.2.dylib (4.18.0 - compatibility 4.0.0) <9BFE1CB4-D199-38E1-A1F2-BDA207D671A0> /usr/lib/libiodbcinst.2.dylib
      0x8780000 -  0x87a3ffc  libssl.0.9.7.dylib (0.9.7 - compatibility 0.9.7) /usr/lib/libssl.0.9.7.dylib
      0xc100000 -  0xc2fcfeb +atopnsrc.so (??? - ???) <203BEEBC-9850-EAE1-DB0A-15DB9120535B> /Library/ODBC/Actual Open Source Databases.bundle/Contents/MacOS/atopnsrc.so
      0xc37f000 -  0xc42cff7  libcrypto.0.9.7.dylib (0.9.7 - compatibility 0.9.7) <7B6DB792-C9E5-3772-8734-8D0052757B8C> /usr/lib/libcrypto.0.9.7.dylib
      0x38000000 - 0x382d2ffc +libxalan-c.111.0.dylib (1.11.0 - compatibility 1.0.0) <7B6AD02C-4991-77E5-5CD8-EB30B03FC1BD> /Library/FileMaker Server/*/libxalan-c.111.0.dylib
      0x40000000 - 0x40005feb +libxalanMsg.111.0.dylib (1.11.0 - compatibility 1.0.0) <9B0B9959-2F6B-D43C-E2C8-F1CA73FDB9A4> /Library/FileMaker Server/*/libxalanMsg.111.0.dylib
      0x8fe75000 - 0x8fea7aa7  dyld (195.6 - ???) <60FD3471-A1D7-342E-99A7-3EDECDAEC6EC> /usr/lib/dyld
      0x90005000 - 0x9000fff0  com.apple.DirectoryService.Framework (10.7 - 146) /System/Library/Frameworks/DirectoryService.framework/Versions/A/DirectoryService
      0x90119000 - 0x90159ff7  libauto.dylib (??? - ???) <984C81BE-FA1C-3228-8F7E-2965E7E5EB85> /usr/lib/libauto.dylib
      0x9015a000 - 0x905cfff7  FaceCoreLight (1.4.7 - compatibility 1.0.0) <3E2BF587-5168-3FC5-9D8D-183A9C7C1DED> /System/Library/PrivateFrameworks/FaceCoreLight.framework/Versions/A/FaceCoreLight
      0x905d0000 - 0x905ddfff  libGL.dylib (??? - ???) /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGL.dylib
      0x90ed5000 - 0x90f2efff  com.apple.HIServices (1.21 - ???) <91EC636D-AC27-3332-BA1C-FD7301917429> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/HIServices.framework/Versions/A/HIServices
      0x90f37000 - 0x91046ff7  com.apple.DesktopServices (1.6.5 - 1.6.5) /System/Library/PrivateFrameworks/DesktopServicesPriv.framework/Versions/A/DesktopServicesPriv
      0x91047000 - 0x9107bff8  libssl.0.9.8.dylib (44.0.0 - compatibility 0.9.8) <567E922C-E64F-321B-9A47-6B18BF481625> /usr/lib/libssl.0.9.8.dylib
      0x91086000 - 0x91086fff  com.apple.Accelerate (1.7 - Accelerate 1.7) <4192CE7A-BCE0-3D3C-AAF7-6F1B3C607386> /System/Library/Frameworks/Accelerate.framework/Versions/A/Accelerate
      0x910a9000 - 0x910adffa  libcache.dylib (47.0.0 - compatibility 1.0.0) <56256537-6538-3522-BCB6-2C79DA6AC8CD> /usr/lib/system/libcache.dylib
      0x910b5000 - 0x910b5fff  com.apple.Accelerate.vecLib (3.7 - vecLib 3.7) <22997C20-BEB7-301D-86C5-5BFB3B06D212> /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/vecLib
      0x91264000 - 0x91b8f72b  com.apple.CoreGraphics (1.600.0 - ???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/CoreGraphics.framework/Versions/A/CoreGraphics
      0x91b90000 - 0x91ba5ff7  com.apple.ImageCapture (7.1.0 - 7.1.0) /System/Library/Frameworks/Carbon.framewor

      Configuration information

      Mac mini server (macmini5,3), Intel Core i7 2Ghz, 8MB RAM.

      Apple Hardware Test (extended test, looped 4 times) shows no errors.
      MemTest (via Rember) shows no errors.

      The system has an ODBC setup via the ODBC manager in OSX system settings.

      FMP 9, FMP 11 and FMPA 11 are installed on the machine.

      Workaround

      None so far...

        • 1. Re: FMS 11 crashes intermittently (after DebugSymbols crash)
          philmodjunk

               Figuring out why FileMaker is crashing can require some sleuthing to rule out possible issues.

               Basic diagnostic tests to perform when you get frequent crashes or “hangs”:

               Does the crash only occur with a specific file?
               Test by creating a small sample file and see if opening it and working with it also generates a crash. If it crashes too, the problem likely lies with the computer or it's installation of FileMaker. If it does not crash, it becomes more likely that there is a problem with the file.

               To check for possible problems on a specific computer, you may want to run a utility to check out the hard drive and also to check out the user accounts on that computer for possible problems.

               What is reported when you recover the file?
               The file could be damaged. Not only can file damage cause crashes, but the crashes (or forced quits after a "hang") can damage your file. You may need to test a recovered copy to see if it works without crashing.

               Things to keep in mind about Recover:

                 
          1.           Recover does not detect all problems
          2.      
          3.           Recover doesn't always fix all problems correctly
          4.      
          5.           Best Practice is to never put a recovered copy back into regular use or development. Instead, replace the damaged file with an undamaged back up copy if this is at all possible. You may have to save a clone of the back up copy and import all data from your recovered copy to get a working copy with the most up to date information possible.


               Does it always crash when you are doing the same thing with your file?
               That may point to a specific layout, script, operation that interacts with your Operating system or other applications...
                

          • 2. Re: FMS 11 crashes intermittently (after DebugSymbols crash)
            GregerSundin

                 Thank you for reply, PhilModJunk. Just to clarify, the FM server Admin Console never crashes, the database server just stops (which is fact is the fmserver deamon crashing). When I click "Start database server" it starts again, and after verifying the files it all comes back to normal. I never have to recover the files.

                 The problem with testing here is that it can work perfectly well for two weeks until it goes down. To test thoroughly by adding one functionality after another to a blank file would take immense time. It is a quite complex fm-system but it has been working for years. It was installed on this server 2011, but was originally written 2006. Recent added functionality includes batch printing invoices as pdfs via a serverscript, but the running of that script doesn't coincide with the crashes, neither does the ODBC-syncing to our online-MySQL-db.

                 I had another guess that the problem could be the result of some memory leak in FMS 11 (from SQL-requests or printing perhaps, as seen elsewhere on this forum), because of a buildup of RAM for the fmserverd-process over time. However, since I experienced severel crashes in one day, that is probably not the issue.

                 I can't really find a filemaker event that corresponds to the crashes of fmserverd. That is why I'm wondering if there is some process outside of fmserverd that creates a conflict (such as spotlight indexing etc.).

                 (The harddrive is a Promise Pegasus R4 (RAID 5) which reports no errors on utility testing.)

                 Thank you for your effort. /Greger

                  

            • 3. Re: FMS 11 crashes intermittently (after DebugSymbols crash)
              philmodjunk
                   

                        I never have to recover the files.

                   I'd run a recover on them just to increase the odds that they are truly intact. Damage to a file doesn't always result in immediately obvious problems with your file. Unfortunately, the damage may not manifest for sometime and then reverting to an undamaged copy and updating it with data and any recent design changes is a major challenge.

                   And it is still possible that a damaged file is crashing the server...