Your assumptions are correct when comparing strings. You may get different results when comparing mixed data types, like a String with a Date. Filemaker is pretty good at inferring which type data type you want, but sometimes it goofs up.
It's strange that this isn't documented anywhere. But what you say about the data types makes sense. Thank you, Christopher!