5 Replies Latest reply on Jun 21, 2012 10:59 AM by Dekade

    Calc returns VERY strange numbers

    Dekade

      Title

      Calc returns VERY strange numbers

      Post

      FMProADV 10.0v3 on Windows 7 Professional 64 bit

      I have messed around for hours on the following calculation problem. Either something is wrong with my software/hardware or I am simply not seeing what I am doing wrong.

      Here is the calculation:

      Field: 'Trial First 40 Overtime'.  Case ( Trial First 40 Worked > "40"; Trial First 40 Worked - "40"; "" )

      Here is the problem:

      Everything works fine except for 'Trial First 40 Worked' digits 5 thru 9.  5 returns "-35", 6 returns "-34", 7 returns "-33", 8 returns "-32", and 9 returns "-31".

      'Trial First 40 Worked' digits 1 thru 4 and 'Trial First 40 Worked' digits 10 thru 40 return appropriate results.

      What the heck is going wrong that I don't see?

      Need some help here. Please advise.

      Thanks, Dekade