Try making the window wider.
See that button labeled "Aa"?
It controls whether the text formatting tool bar is visible/invisible.
That shows or hides the entire bar. It doesn't reveal the alignment buttons.
Turns out making the window wider worked. It never occurred to me that a narrower window could be hiding something in the middle of the bar. What a DUH moment.